Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: integrate inverted index into lance index APIs #2577

Merged
merged 32 commits into from
Jul 23, 2024
Merged

feat: integrate inverted index into lance index APIs #2577

merged 32 commits into from
Jul 23, 2024

Commits on Jul 15, 2024

  1. feat: integrate inverted index into lance index APIs 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    67a175c View commit details
    Browse the repository at this point in the history

  2. fix 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    0583292 View commit details
    Browse the repository at this point in the history

  3. add doc and example 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    ef52e1c View commit details
    Browse the repository at this point in the history

  4. fmt 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    836c740 View commit details
    Browse the repository at this point in the history

  5. python bindings 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    698c005 View commit details
    Browse the repository at this point in the history

  6. add test 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    fe0c2d7 View commit details
    Browse the repository at this point in the history

  7. fix ut 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    f1938e2 View commit details
    Browse the repository at this point in the history

  8. fix ut 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    790181b View commit details
    Browse the repository at this point in the history

  9. fix ut 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    b190caf View commit details
    Browse the repository at this point in the history

  10. remove unused code 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    bd10bbc View commit details
    Browse the repository at this point in the history

  11. fit type hint 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    499cf5c View commit details
    Browse the repository at this point in the history

  12. impl remap 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    19a8ca4 View commit details
    Browse the repository at this point in the history

  13. add doc 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    2513052 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. perf: push down limit to inverted index 

    - with this we don't need to sort all the matched docs
- also optimizes the BM25 calculation

Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    b3fdc40 View commit details
    Browse the repository at this point in the history

  2. fmt 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    f7c7577 View commit details
    Browse the repository at this point in the history

  3. fix expression 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    5c8c4b6 View commit details
    Browse the repository at this point in the history

  4. optimize 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    a5809e2 View commit details
    Browse the repository at this point in the history

  5. fmt 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    be4fd53 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. fix 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    7126c9b View commit details
    Browse the repository at this point in the history

  2. simplify 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    9b2dbbe View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. support string 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    5632911 View commit details
    Browse the repository at this point in the history

  2. fix string 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    6f7205b View commit details
    Browse the repository at this point in the history

  3. fix example 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    7d80ea9 View commit details
    Browse the repository at this point in the history

  4. add FtsExec plan node 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    365638f View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' of https://github.com/lancedb/lance into fts-exec

    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    ed17ee2 View commit details
    Browse the repository at this point in the history

  6. fix 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    761a146 View commit details
    Browse the repository at this point in the history

  7. support prefiltering 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    5246efc View commit details
    Browse the repository at this point in the history

  8. fmt 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    6c0b4fb View commit details
    Browse the repository at this point in the history

  9. fmt 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    5dd639f View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Merge branch 'main' of https://github.com/lancedb/lance into fts-exec

    @BubbleCal
    BubbleCal committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    d9b4ce7 View commit details
    Browse the repository at this point in the history

  2. sort posting list by row id 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    58cfff6 View commit details
    Browse the repository at this point in the history

  3. fix 

    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    @BubbleCal
    BubbleCal committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    9dbd6b8 View commit details
    Browse the repository at this point in the history