Vector recall

Late Fusion Vector Search: Multimodal Retrieval Across Embedding Spaces

Combine text, image, and code embeddings in a single ranked query using weighted late fusion. No second vector DB. No multimodal model required.

01

The Problem: Multiple Embedding Models, Multiple Databases

Modern AI products often embed content with multiple models — MiniLM for text, CLIP for images, CodeBERT for source code. Each produces vectors of different dimensions and semantics. The conventional solution is to run separate vector databases or separate collections per model, then merge results in application code.

That adds infrastructure cost, network latency, and application complexity. For per-tenant products, it multiplies by every customer.

02

How VFUSE Fuses Embedding Spaces

VFUSE searches each named SPACE graph independently using cosine similarity, then computes a weighted sum of per-space scores for every candidate document. Missing ids in one space score 0. The fused scores produce a single ranked result set.

Named spaces are extra mmap/HNSW files in the same tenant directory — backup, quota, and shred still hit one customer. The embeddings stay with the caller — DBX stores and indexes them but does not run CLIP, MiniLM, SigLIP, or any model.

RESP wire protocol

Fuse Text + Image Embeddings with VFUSE

RESP commands
# Store text embeddings in the "text" space
VADD text doc_001 0.012 -0.043 0.091 ...
VADD text doc_002 0.008 0.027 -0.055 ...

# Store image embeddings in the "image" space
VADD image doc_001 0.145 -0.023 0.067 ...
VADD image doc_002 -0.089 0.112 0.034 ...

# Fuse across spaces with custom weights (70% text, 30% image)
VFUSE 5 SPACE text 0.012 -0.043 0.091 ... SPACE image 0.145 -0.023 0.067 ... WEIGHTS 0.7 0.3

VFUSE is a weighted sum of per-space cosine, not a multimodal model. It does not perform sparse+dense hybrid search.

The Full Recall Surface

VFUSE completes a three-command recall surface that covers the queries an AI agent actually issues:

01

VSEARCH — semantic query

Caller-provided query vector, cosine over HNSW, top-k. Trailing MIN_SCORE, EF, SPACE, WITHDOCS, FILTER_CONTAINS.

02

VSIM — similar-to-id

"More like this memory" without re-embedding. Load the stored row, exclude self, same ANN. The id already lives in this tenant.

03

VFUSE — late fusion

Fuse cosine hits across named SPACE graphs with caller weights. Missing ids score 0. Send CLIP/SigLIP/MiniLM floats; DBX stores them.

Certified ANN p50 on the published profile is 2.304 ms — not sub-millisecond. This is not hybrid sparse+dense search and not a Qdrant/Milvus competitor. It is the recall surface for one customer's working set.