Skip to content

RUM-19011: Assemble only the tested variant in upload functional tests - #658

Merged
0xnm merged 1 commit into
developfrom
nogorodnikov/rum-19011/functional-tests-assemble-tested-variant
Oct 19, 2026
Merged

0xnm merged 1 commit into
developfrom
nogorodnikov/rum-19011/functional-tests-assemble-tested-variant

Conversation

@0xnm

@0xnm 0xnm commented Oct 16, 2026

Copy link
Copy Markdown
Member

What does this PR do?

Upload functional tests pick a single random variant, but ran assembleRelease beforehand, which builds and R8-shrinks all 4 variants (demo/full x Blue/Green) of the sample app. They now run assemble<Variant>Release for the chosen variant only.

Tests asserting on assembleRelease / assembleDebug themselves, the bundleRelease build ID test and the all-variants NDK upload test still build every variant.

Motivation

test:plugin is the longest job in the pipeline (~16 min on average on develop over the last 30 days), and DdAndroidGradlePluginFunctionalTest accounts for ~10.5 min of it.

Locally, the 13 affected tests go from 165s to 88s (-47%).

Additional Notes

Other speed-up ideas (TestKit cache in CI, Magic Mirror proxy for test projects, separate CI job, deterministic AGP/Gradle configuration) are tracked as follow-ups in RUM-19011.

Review checklist (to be filled by reviewers)

  • Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
  • Make sure you discussed the feature or bugfix with the maintaining team in an Issue
  • Make sure each commit and the PR mention the Issue number (cf the CONTRIBUTING doc)

🤖 Generated with Claude Code

@0xnm
0xnm requested review from a team as code owners October 16, 2026 10:32
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 16, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-19T09:14:03.782078Z 0091671 New commits
🔒 Security Review 🔄 Running since 2026-10-19T09:11:16.784686Z 0091671 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@datadog-datadog-prod-us1-2

datadog-datadog-prod-us1-2 Bot commented Oct 16, 2026 •

Copy link
Copy Markdown

🎯 Code Coverage (details)
• Patch Coverage: 100.00%
• Overall Coverage: 64.08% (-0.35%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 0091671 | Docs | Give us feedback!

@datadog-datadog-prod-us1-2 datadog-datadog-prod-us1-2 Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bits Code Review: PASS

More details

Variant-specific assembly supplies the artifacts expected by each upload test. Tests requiring all variants retain their aggregate builds and coverage.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Bits Code Review · Commit d1d5cfc

@maciejburda
maciejburda requested a review from satween October 19, 2026 07:11
@0xnm 0xnm added the ready-for-human-review Pull Request is ready for the human review, all agentic feedback is addressed. label Oct 19, 2026
satween
satween previously approved these changes Oct 19, 2026

@satween satween left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Upload functional tests pick a single random variant, but ran
`assembleRelease` beforehand, which builds and R8-shrinks all 4 variants of
the sample app. Run `assemble<Variant>Release` for the chosen variant only.

Tests asserting on `assembleRelease` / `assembleDebug` themselves, the
`bundleRelease` build ID test and the all-variants NDK upload test still
build every variant.

Locally the 13 affected tests go from 165s to 88s.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@0xnm
0xnm force-pushed the nogorodnikov/rum-19011/functional-tests-assemble-tested-variant branch from d1d5cfc to 0091671 Compare October 19, 2026 09:11
@0xnm
0xnm requested a review from satween October 19, 2026 09:30
@0xnm
0xnm merged commit c2563b1 into develop Oct 19, 2026
18 checks passed
@0xnm
0xnm deleted the nogorodnikov/rum-19011/functional-tests-assemble-tested-variant branch October 19, 2026 10:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready-for-human-review Pull Request is ready for the human review, all agentic feedback is addressed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants