Add opt-in Intent discovery eval suite - #173

Merged

LadyBluenotes merged 13 commits into

mainfrom

eval/intent-discovery

Jun 20, 2026

Commits on Jun 20, 2026

Add intent discovery evaluation suite and related configurations
LadyBluenotes
committed
dd90404
Add intent discovery evaluation framework and related fixtures
LadyBluenotes
committed
4b548f5
Refactor intent discovery evaluation: streamline skill loading and command parsing
LadyBluenotes
committed
5c9b822
Implement live Copilot harness and error handling for intent discovery evaluation
LadyBluenotes
committed
99e6ed5
Enhance live Copilot harness: support opt-in command backend and capture command, skill, transcript, and diff evidence
LadyBluenotes
committed
6884f1d
Add live Copilot harness and evaluation metadata for intent discovery
LadyBluenotes
committed
174b452
Add live Copilot condition setup and enhance evaluation framework for intent discovery
LadyBluenotes
committed
391c3ed
Enhance intent discovery evaluation: update file writing logic and add skill package handling
LadyBluenotes
committed
d674d2b
Enhance intent discovery evaluation: add LLM judge and summary report generation, update command parsing for various package managers
LadyBluenotes
committed
818d211
ci: apply automated fixes
autofix-ci[bot]
authored
af482ee
Enhance intent discovery evaluation: add request timeout for LLM judge, improve error handling, and update fixture dependencies
LadyBluenotes
committed
c1b9ca1
ci: apply automated fixes
autofix-ci[bot]
authored
7bb199b
Refactor intent discovery types and functions: remove exports for internal types, update fixture handling, and enhance reference-only logic
LadyBluenotes
committed
50724d5