Managing cardinality in an index

Cardinality is an important factor to consider when managing an index, as high cardinality can lead to performance issues, pod fullness, and a reduction in the number of possible vectors that can fit per pod.

Fortunately, there is a solution to this problem - Selective Metadata Indexing. Selective Metadata Indexing allows you to specify which fields need to be indexed and which do not, helping to reduce the overall cardinality of the metadata index while still ensuring that the necessary fields are able to be filtered.

In order to set up Selective Metadata Indexing, you will need to use the Pinecone API. With the API, you can create a metadata index and specify which fields need to be indexed. This will allow you to reduce the cardinality of the index while still ensuring that all of the necessary fields are indexed.

By using Selective Metadata Indexing, you can manage the cardinality of your index and ensure that your queries are fast and reliable. It is a simple and effective way to ensure that your index is optimized for performance and that your pod does not become full.

See Selective Metadata Indexing