[ea-rus]

Description

Create IVF index for FAISS knowledge base

Example

CREATE INDEX ON KNOWLEDGE_BASE my_kb WITH (
  nlist=10,
  train_count=1000
)

Parameters:

• nlist: number of clusters for IVF. Default is 1024
• train_count: number of vectors to use for training. Default is 10k

It is not possible to create IVF index for empty faiss knowledge base because it requires data to train index. The size of the train data and also count of clusters can affect on index quality

Depends mindsdb/mindsdb_sql_parser#75

Fixes https://linear.app/mindsdb/issue/FQE-1868/faiss-ivf-index

Type of change

• ⚡ New feature (non-breaking change which adds functionality)

Verification Process

To ensure the changes are working as expected:

• Test Location: Specify the URL or path for testing.
• Verification Steps: Outline the steps or queries needed to validate the change. Include any data, configurations, or actions required to reproduce or see the new functionality.

Additional Media:

• I have attached a brief loom video or screenshots showcasing the new functionality or change.

Checklist:

• My code follows the style guidelines(PEP 8) of MindsDB.
• I have appropriately commented on my code, especially in complex areas.
• Necessary documentation updates are either made or tracked in issues.
• Relevant unit and integration tests are updated or added.

[github-actions]

All contributors have signed the CLA ✍️ ✅
_{Posted by the CLA Assistant Lite bot.}