Why Key-Prefix Multi-Tenancy Fails for AI Products
Most vector databases store every customer's embeddings in a single shared index. They separate tenants by prepending a key prefix — acme:, harbor: — to every record. If a developer omits or misconfigures the prefix, one tenant can read another's data. Performance isolation is equally fragile: a large indexing job by Tenant A can starve Tenant B's queries.
For AI products holding customer-specific memory (conversation histories, RAG context, personalization vectors), this risk is unacceptable. You need isolation that is enforced by the database engine, not by the application developer's discipline.