Finding most similar arrays of integers in elasticsearch -

-

rewrite:

I have images in my project. Each image in the range [1, 10] There are 5 tags I used to upload these tags using elastic shirr:

I have these documents loaded in elastic search in the index with "my_project" type "img": 

  curl -XPUT 'http: // localhost: 9 0000 / my_project / img / 1' -d '{"tag": [1,4,6,7,9]}'   
 Other example documents that I upload {"Tag": [2,3,5,6]} {"tag": [1, 2,3, 8]}   
 In my application, vectors are very high, but with a certain number of fixed elements. And I have 20 M of these documents.  
 Now I have to find similar documents for the given vector. Vectors are more common when they have more general tags, so for example I want to find the most similar document for integer vector  [1,2,3,7] . The last example of the best match should be document  {"tags": [1,2,3,8]} , because they share 3 common values ​​in their tags,  [1, 2,3] , more common values ​​than any other vector.  
 So my problems are if I upload the document with the curl command above, then I get this mapping: <"<"> my_project ": {" mappings ": {" img ": {" Properties ": {" tags ": {" type ":" string "}}}}}}   
 But I think the correct mapping should use an integer instead of strings. How can I correct mapping for this type of data?  
 Now I want to search for documents with above parity algorithms. How do I get 100 similar documents of the type given above with the given symmetry algorithm? If I convert these vectors from the spaces to spaces with different numbers, then with the statement I want for this search Boolean query will be able to use, but I think the use of arrays of integer should be faster than you can tell me, how do I elasticsearch For I could build a search query?  
 
 My solution so far  
 Now Convert integer array I string the basic solution. So I save the document as:  
  curl -XPUT 'http: // localhost: 9200 / my_project / img / 1' -d '{"tags": "1 4 6 7 9 "} '  
 and then basically search for the string " 1 2 3 ". Although it works in some way, I think it will be more precise and faster to save the integer as an array of integers, not strings. Is it possible to work with the arrays of integers as integers in the elasticsearch? Perhaps my approach with string is best and integer arrays can not be clearly used in the elasticsearch.   
 
 
 I will take a look at this discussion on the elastic merchant mailing list from last year last year. Another ESU user was trying to do exactly what you are trying to do, sort array elements according to match and likeness. In their case, their array members were "one", "two", "three" etc. But this is very similar:  
  
 There is nothing going on in the discussion as a problem You need to exit the box Your approach will stop you from using the array members (either the string or the integer, either both will be fine), but there will probably be some differences in what you want to achieve. . The reason for this is that the default similarity scoring system (and also Lucin / Solar) in the ElasticShark can be quite close to TF / IDF:  
 TF / IDF can be very close and depending on the case of usage you can get similar results , But will not be guaranteed to do so, a tag that appears very often (we say that "1" twice the frequency "2") will change the weight of each word so that the type of search you are looking for, Same question Do not get it.  
 If you need your exact scoring / similarity algorithm I believe you will need a custom score. As you've discovered a custom scoring script, it will not be as good as this script is going to run for each document, so starting it is not very fast and there will be decay in reaction time in linear fashion.  
 Personally, I probably use some similarity modules that provide aliensischurch, such as BM 25:

Comments

Post a Comment

Popular posts from this blog

ios - Adding an SKSpriteNode to SKScene from a child SKSpriteNode -

-
I have a SKScene where I am adding an SKSpriteNode I have subclassed the SKSpriteNode class to create this node. In the subclass I am defining some SKActions on Sprite. What do I want to do when the end of this phantom ends the SKAction sequence, then I add a new Prayer node to this scene. How is this possible. The following code is mine: The code for the sequence is that I'm running on the Scansprinitode subclass (TEMissileNode): - SKAction * moveDown = [SKAction moveToY: Self.position.y - 20 Duration: 0.2]; SKAction * animation = [SKAction animateWithTextures: textures timePerFrame: time / 7]; SKAction * moveMissileProjectile = [SKAction Moving: Pointoffscreen Term: Time]; SKAction * group = [SKAction group: @ [animation, movement projectile]]; SKAction * Sequence = [SKAction Sequence: @ [Hilldown, Group, [SKAction removalFromParent]]]; [Self run action: sequence]; From the main scene, I call those actions that execute these tasks TEMissileNode * missile = [tmissil...
Read more

Matlab transpose a table vector -

-
An embarrassing simple question seems to be, but how can I move a Matlab table vector? aTableT = aTable '; I tried a standard syntax for the simple interaction of a line vector to a line vector aTable : ATableT = reshape (aTable, 1, Height (aTable)); and aTableT = rot90 (aTable); According to the head, the last time table should work for table, see. However, I get this error code: Error type in using table / permit (line 396) Undefined function 'permute' for the input arguments. Error in rot 90 (line 29) b = magnitude (b, [2 1 3: ndims (a)]); NB: fliplr is not useful either pretty sure I have covered clear angles - any ideas? Thanks! Try changing your table into an array, move it, then back to a table In other words, try doing this: aTableArray = table2array (aTable); ATableT = array 2table (aTableArray. '); I have also read the document for rot90 , and it says that rot90 is definitely working for tables Do, and I find you...
Read more

c# - Textbox not clickable but editable -

-
I have a small form with 10 text boxes, I have set them in the correct tab order. I want them on my tab service I was wondering if there is a way to set the text box so that they can be selected for editing until they are tabbed. That is ... I do not want the end user to edit the text box to click on them, I just want to make them editable through tabu. this should do the trick public partial category poor text box: Text Box {Safe Override Zero WndProc (Ref: Message Message) {if (m.msg == (Int) WM.LBUTTONDOWN) {Return; // mount down events} base.WndProc (ref m); }} Window message enum can be found. How to do this without anherizing: text box : class EatMouseDown: netwindows {safe override zero WndProc (ref message message) {if (m.msg == (int) WM.LBUTTONDOWN) {return; } Base.WandProc (Ref M); }} Safe Override Zero Onload (EventEurge E) {base.OnLoad (e); How to do this without any part: left a clean part, whatever is important, this can be a buggy but it works R...
Read more