Skip to content

Add experimental reasoning prompt strategy - #20

Draft
ccarpene-blk wants to merge 3 commits into
codex/audit-integrityfrom
codex/prompt-strategy
Draft

ccarpene-blk wants to merge 3 commits into
codex/audit-integrityfrom
codex/prompt-strategy

Conversation

@ccarpene-blk

@ccarpene-blk ccarpene-blk commented Nov 4, 2026 •

Copy link
Copy Markdown
Collaborator

The existing prompt sets can overconstrain discovery on partial repositories or couple audit conclusions to requirements that are not available in source. Add an opt-in prompts/reasoning set with broad discovery, atomic claims, explicit uncertainty, and independent model-chosen audit verdicts. The default prompt set and verdict policies remain unchanged.

The legacy audit contract also gains allow_new_findings: false. Its response schema forbids additions, and the runtime preserves any excluded candidates as lineage observations with an explicit policy reason. This keeps validation-only prompt sets from rediscovering claims from other batches. The design review documents the contract trade-offs and evaluation requirements.

SARIF invocations also record UTC start and end timestamps so consumers can measure elapsed scan time.

Validation: Go 1.23.12 race test suite, lint, static Linux build, prompt assembly tests, and a regression covering an endpoint that ignores the no-additions schema.

Stacked on #19.

@shellz-n-stuff shellz-n-stuff left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants