Skip to content

fix(tests): skip flaky tests#105125

Merged
armcknight merged 2 commits intomasterfrom
jferg/disable-flaky-eventstream-tests
Dec 17, 2025
Merged

fix(tests): skip flaky tests#105125
armcknight merged 2 commits intomasterfrom
jferg/disable-flaky-eventstream-tests

Conversation

@JoshFerge
Copy link
Copy Markdown
Member

@JoshFerge JoshFerge commented Dec 17, 2025

These tests are failing intermittently in CI

Test run failures

Tests that are flaking:

  • tests/sentry/eventstream/test_item_helpers.py::test_encode_attributes_with_tags
  • tests/sentry/discover/test_dashboard_widget_split.py::test_unhandled_filter_sets_error_events_dataset
  • tests/sentry/discover/test_dataset_split.py::test_unhandled_filter_sets_error_events_dataset

Skip three flaky tests that are failing in CI due to non-deterministic
set ordering when encoding tag_keys as arrays:

- tests/sentry/eventstream/test_item_helpers.py::test_encode_attributes_with_tags
- tests/sentry/discover/test_dashboard_widget_split.py::test_unhandled_filter_sets_error_events_dataset
- tests/sentry/discover/test_dataset_split.py::test_unhandled_filter_sets_error_events_dataset

These tests fail with different tag orderings across runs because sets
are unordered in Python. Skipping to unblock CI while investigating fix.

Related: #105124
@JoshFerge
Copy link
Copy Markdown
Member Author

might be from #105074?

@JoshFerge JoshFerge changed the title test: Skip flaky tests with non-deterministic set ordering test: Skip flaky tests Dec 17, 2025
@JoshFerge JoshFerge changed the title test: Skip flaky tests fix(tests): skip flaky tests Dec 17, 2025
@armcknight armcknight merged commit a40fe7a into master Dec 17, 2025
68 checks passed
@armcknight armcknight deleted the jferg/disable-flaky-eventstream-tests branch December 17, 2025 03:24
@github-actions github-actions bot locked and limited conversation to collaborators Jan 1, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants