Skip to content

ci: capture iOS E2E failure diagnostics - #756

Draft
dcalhoun wants to merge 2 commits into
trunkfrom
ci/keep-ios-e2e-result-bundle
Draft

dcalhoun wants to merge 2 commits into
trunkfrom
ci/keep-ios-e2e-result-bundle

Conversation

@dcalhoun

@dcalhoun dcalhoun commented Oct 2, 2026

Copy link
Copy Markdown
Member

What?

Why?

How?

Testing Instructions

Accessibility Testing Instructions

Screenshots or screencast


AI-generated details

Adds diagnostics for the intermittent iOS E2E failure Expected a WKWebView to appear after editor loads (builds 3120, 3094, 3022, 3005; first seen Sep 23). Failing runs always wait the full 30s, so a longer timeout won't help, and CI keeps nothing that shows what the editor displayed.

  • make test-ios-app-e2e writes build/ios-e2e.xcresult; the Buildkite step zips it and uploads it as an artifact, even when tests fail.
  • When the WebView never appears, navigateToEditor attaches a screenshot and the accessibility hierarchy, and reports when the crash notice ("Reload Editor") replaced the WebView.
  • The next failure should show whether the editor crashed during boot, stalled on the loading indicator, or showed nothing.

Checked that the bundle doesn't capture environment secrets: a clean build with a sentinel env var left no trace in the build, action, or console logs (only Xcode build settings are exported). The pipeline is private, so artifacts need a Buildkite login.

Verified the UI test target builds and SwiftLint passes. testEditorWebViewBecomesVisible passed 100/100 locally on trunk, so the flake hasn't reproduced outside CI.

🤖 Generated with Claude Code

dcalhoun and others added 2 commits October 2, 2026 10:14
Failed iOS E2E runs leave only xcbeautify's summary: the .xcresult with
the failure screenshot and UI hierarchy is discarded with the VM. An
intermittent "Expected a WKWebView" failure can't be diagnosed without
seeing what the editor showed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The intermittent "Expected a WKWebView" failure doesn't say whether the
editor crashed, stalled on the loading indicator, or showed nothing.
Attach a screenshot and the accessibility hierarchy, and name the crash
notice when it is what replaced the WebView.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@dcalhoun dcalhoun added the [Type] Build Tooling Issues or PRs related to build tooling label Oct 2, 2026
@wpmobilebot

Copy link
Copy Markdown

XCFramework Build

This PR's XCFramework is available for testing. Add the following to your Package.swift:

.package(url: "https://github.com/wordpress-mobile/GutenbergKit", branch: "pr-build/756")

Built from fade5c0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

[Type] Build Tooling Issues or PRs related to build tooling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants