Skip to content

Milvus adapter end-to-end tire-kicking session (SPEC-81 verification) #1235

Description

@phernandez

Tracking issue for the manual end-to-end verification session of the Milvus vector-index
adapter (SPEC-81; PRs #1141, #1158, #1185). There is no automated end-to-end coverage —
every Milvus test uses fakes or bare Milvus Lite — so this session exercises the real
stack: Postgres + Milvus Lite through sync → manifest → search, adapter switches, reindex,
and failure drills, using a realistic 200+ note corpus.

Session checklist

  • Three-way baseline matrix: same corpus + embedding model through sqlite-vec /
    pgvector / Milvus Lite; compare top-5 membership, cosine scores, hybrid rankings,
    latency (~10 known-answer queries)
  • Fresh Milvus enablement via bm reindex --embeddings; collection naming verified
  • The silent-degraded window: config flipped to milvus before reindex → vector returns
    0, hybrid silently degrades to FTS (documented UX finding)
  • Manifest honesty: vector_index ownership flip; stale pgvector rows accounting
  • Switch-back fail-closed: SemanticVectorIndexExtensionError capture + recovery UX
  • Failure drills: missing extra, bad URI shapes, unreachable server (index vs query
    time, timeout/lock-hold), dimension mismatch refusal
  • Restart persistence (fix(core): load existing Milvus collections after restart #1185 in real flow)
  • Reranker + Milvus interplay (sanity + latency)
  • Redaction smoke (milvus_token/milvus_uri in config output)

Deliverables

  • Results recorded as a Basic Memory note with conclusions (dogfooding), linked here
  • Issues filed for any bugs/UX findings
  • Docs-gap follow-up list (local-Postgres quickstart, fresh-switch reindex step, .db
    URI requirements, Lite milvus_database caveat, degraded-window behavior)
  • SPEC-81 updated: draft → implemented-with-deviations (in-core extra, entry-point
    registry removed, namespace = DB-locator hash, collection identity excludes model/dims)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions