chore(evals): Update model evaluations 2026-10-06

[rhacs-bot]

Automated weekly model evaluation update.

Models evaluated: gpt-5-mini
Date: 2026-10-06

This PR was automatically generated by the Model Evaluation workflow.

[coderabbitai]

Important

• 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

⚙️ Run configuration

• Configuration used: Repository YAML (base), Central YAML (inherited), Organization UI (inherited)
• Review profile: ASSERTIVE
• Plan: Advanced
• Run ID: 4ac1d376-263d-49d5-a478-f5c173747a9e

---

_{Comment @coderabbitai help to get the list of available commands.}

[github-actions]

E2E Test Results

Commit: 5b47f10
Workflow Run: View Details
Artifacts: Download test results & logs

=== Evaluation Summary ===

  ✓ list-clusters (assertions: 3/3)
  ✓ cve-cluster-list (assertions: 3/3)
  ✓ cve-cluster-does-not-exist (assertions: 3/3)
  ✗ cve-detected-clusters (assertions: 3/3)
      one or more verification steps failed
  ✓ cve-clusters-general (assertions: 3/3)
  ✓ rhsa-not-supported (assertions: 2/2)
  ✓ cve-log4shell (assertions: 3/3)
  ✓ cve-cluster-does-exist (assertions: 3/3)
  ✓ cve-multiple (assertions: 3/3)
  ✓ cve-detected-workloads (assertions: 3/3)
  ✓ cve-nonexistent (assertions: 3/3)

Tasks:      10/11 passed (90.91%)
Assertions: 32/32 passed (100.00%)
Tokens:     ~50284 (estimate - excludes system prompt & cache)
MCP schemas: ~12562 (included in token total)
Agent used tokens:
  Input:  7378 tokens
  Output: 19994 tokens
Judge used tokens:
  Input:  49075 tokens
  Output: 44382 tokens

[codecov-commenter]

❌ 3 Tests Failed:

Tests completed	Failed	Passed	Skipped
380	3	377	12

View the full list of 3 ❄️ flaky test(s)

::policy 1

Flake rate in main: 100.00% (Passed 0 times, Failed 166 times)

Stack Traces | 0s run time

- test violation 1
- test violation 2
- test violation 3

::policy 4

Flake rate in main: 100.00% (Passed 0 times, Failed 166 times)

Stack Traces | 0s run time

- testing multiple alert violation messages 1
- testing multiple alert violation messages 2
- testing multiple alert violation messages 3

github.com/stackrox/stackrox-mcp/smoke::TestSmoke_RealCluster

Flake rate in main: 9.52% (Passed 38 times, Failed 4 times)

Stack Traces | 360s run time

Failed

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}