Emulators

• Added 77.42.115.125 and 65.109.17.223 to our outbound IPs. There will be a grace period of two weeks before we start sending traffic from these addresses.
• Removed 157.180.105.69 from our outbound IP address list.

ew-cli 1.3.2

• Fixed: corner-case connectivity issue where ew-cli could stall for minutes before running any tests.

gradle-plugin 1.6.1

• Fixed: crash when using the Gradle Test Reporting API on Gradle 9.4.0 and later.
• Maintenance: bumped default ew-cli version to 1.3.2.

GitHub actions emulator-wtf/actions@v1.0.1

• Maintenance: bumped default ew-cli version to 1.3.2.

CircleCI orb 0.1.1 emulator-wtf/emulator-wtf@0.1.1

• Maintenance: bumped default ew-cli version to 1.3.2.

emulator.wtf API

• Fixed: SCIM compatibility issues with Okta and Microsoft Entra.

ew-cli 1.3.1

• Fixed: slow or stalled file uploads would not time out correctly, causing test runs to hang.

GitHub actions emulator-wtf/actions@v1.0.0

The emulator.wtf GitHub actions have moved!

Important

• emulator-wtf/run-tests@v1.0.0 is now emulator-wtf/actions/run-tests@v1.0.0.
• emulator-wtf/configure-credentials@v1.0.0 is now emulator-wtf/actions/configure-credentials@v1.0.0.

Changes since emulator-wtf/run-tests@v1.0.0-rc02:

• New: Sessions are now generally available for all users.
• New: use the emulator-wtf/actions/use-emulator@v1.0.0 action to make use of a generic adb-connected emulator in your workflows.
• Improved: reduced test setup overhead for runs with large APK files across many shards. You can expect up to 10x less time from test submission to the first test start when using a very large number of shards.
• Improved: the emulator-wtf/actions repository has immutable releases.
• Fixed: increased client-side test run timeout to account for repeat attempts of flaky tests.
• Fixed: report proper result-file download timing.
• Fixed: properly parse the GITHUB_REF_NAME env var when running in GitHub Actions.
• Maintenance: default ew-cli version has been bumped to 1.3.0.

Breaking changes in v1.0.0 compared to emulator-wtf/run-tests@v0.9.11:

We’ve made a bunch of breaking changes in v1.0.0. Read more about the 1.0.0 release and breaking changes.

• Breaking: GitHub Tokenless authentication via passing GITHUB_TOKEN as the token is no longer supported. Please switch to OIDC authentication instead. Read more here.
• Breaking: video recording is now enabled by default.
• Breaking: the default device is now Pixel7 30.
• Breaking: GPU acceleration is now turned on by default.
• Breaking: fixed pulled directories containing the root folder name twice.

ew-cli 1.3.0

• New: Sessions are now generally available for all users.
• Improved: reduced test setup overhead for runs with large APK files across many shards. You can expect up to 10x less time from test submission to the first test start when using a very large number of shards.

Test execution

• Fixed: support test targets that mix full class names and specific methods from legacy CLI versions.

CircleCI orb 0.1.0 emulator-wtf/emulator-wtf@0.1.0

• Maintenance: bumped default ew-cli version to 1.3.0.

gradle-plugin 1.6.0

• Maintenance: bumped default ew-cli version to 1.3.0.

ew-cli 1.2.2

• Fixed: you can now run multiple ew-cli instances with --egress-tunnel.

gradle-plugin 1.5.4

• Fixed: plugin no longer fails to apply on Kotlin Multiplatform projects with AGP 9 where withDeviceTest {} is declared after the plugins {} block.
• New: added support for com.android.kotlin.multiplatform.library plugin (AGP 9 KMP Android library), automatically creating testAndroidMainWithEmulatorWtf and related tasks.
• Maintenance: bumped default ew-cli version to 1.2.2.

ew-cli 1.2.1

• Fixed: report proper result-file download timing.
• Fixed: explicitly provided --scm-* parameters are now correctly honored and missing ones are guessed from environment when running on CI.
• Fixed: properly parse the GITHUB_REF_NAME env var when running in GitHub Actions.

Test execution

• Fixed: added a transparent workaround for rare process failed to attach crashes on API 34.

emulator.wtf web app

• The test run list rows are now actual links, making it easier to open them in a new tab.

emulator.wtf API

• New: The egress tunnel feature is now generally available. It is still considered experimental, however.

Test execution

• Fixed: reverted a bad deploy that caused the results XML output to change, affecting things like timing calculations and Develocity reports.

gradle-plugin 1.5.1

• Fixed: egressLocalhostForwardIp now properly forwards the value to ew-cli instead of crashing.

emulator.wtf web app

• Fixed: linking emulator.wtf with a GitHub organization from the web app.

Test execution

• Fixed: added a workaround for a rare occasion of test execution with Android Test Orchestrator getting stuck on API 34 devices.

ew-cli 1.2.0

• New: added --shard-unit flag with a test_classes option that ensures all test methods within a class run on the same shard (defaults to test_methods).
• Fixed: increased client-side test run timeout to account for repeat attempts of flaky tests.

gradle-plugin 1.5.0

• New: added shardUnit configuration option to control sharding granularity. Can be set to ShardUnit.TEST_CLASSES to shard at the test class level, or ShardUnit.TEST_METHODS (default) to shard at the test method level.
• Fixed: increased client-side test run timeout to account for repeat attempts of flaky tests.
• Maintenance: bumped default ew-cli version to 1.2.0.

CircleCI orb 0.0.5 emulator-wtf/emulator-wtf@0.0.5

• New: added shard_unit option to control sharding granularity. Can be set to either test_classes or test_methods (default), where test_classes will place whole test classes on the same shard, and test_methods will shard at the test method level.
• Fixed: increased client-side test run timeout to account for repeat attempts of flaky tests.
• Maintenance: bumped default ew-cli version to 1.2.0.

Emulators

• New: disabled captive portal detection. This will help in cases where the egress tunnel exits from a limited-network node and the emulator figures it’s completely offline.
• New: added API 36 emulator images. List of device combinations added:
  • device=Pixel2,version=36
  • device=Pixel7,version=36
  • device=NexusLowRes,version=36
  • device=Monitor,version=36
  • device=Tablet10,version=36
  • device=Pixel2Atd,version=36
  • device=Pixel7Atd,version=36
  • device=NexusLowResAtd,version=36
  • device=Tablet10Atd,version=36
  • See all available emulator images here.

ew-cli 1.1.0

• New: added flag --testcase-duration-hint to provide an average test-case runtime hint for --shard-target-runtime or --num-balanced-shards. More info: here.
• Fixed: ew-cli no longer hangs if setting up an adb session fails.

gradle-plugin 1.4.0

• New: added support for testcaseDurationHint. More info: here.
• Maintenance: bumped default ew-cli version to 1.1.0.

GitHub action emulator-wtf/run-tests@v1.0.0-rc02

• New: added support for testcase-duration-hint. More info: here.
• Maintenance: bumped default ew-cli version to 1.1.0.

CircleCI orb 0.0.4 emulator-wtf/emulator-wtf@0.0.4

• New: added support for testcase_duration_hint, num_balanced_shards and shard_target_runtime. More info: here.
• Maintenance: bumped default ew-cli version to 1.1.0.

Test execution

• Improved: --shard-target-runtime uses a better heuristic for guessing the number of shards when there’s no historical data available.

emulator.wtf web app

• Fixed: SSO login now correctly redirects to the test results page after having previously logged out from a different account.

Test execution

• Fixed: test times were off by 1000x when a device locale with non-US number formatting was used (e.g., es).

emulator.wtf web app

• New: added support for SCIM user provisioning. More info: SCIM user provisioning.

ew-cli 1.0.7

• Changed: decreased the maximum file cache TTL from 90d to 7d.

Test execution

• Fixed: video recordings for tablet emulators are now correctly oriented instead of displaying sideways.

ew-cli 1.0.6

• Fixed: ew-cli no longer checks for WRITE_EXTERNAL_STORAGE permission when both coverage and test storage service are enabled.

gradle-plugin 1.3.0

• New: The test targets string can now be configured directly using the testTargetsString property on the emulatorwtf {} dsl. Note that this will override any test targets specified via the testTargets property or the targets {} dsl.
• Fixed: the Gradle plugin no longer checks for WRITE_EXTERNAL_STORAGE permission when both coverage and test storage service are enabled.
• Maintenance: bumped default ew-cli version to 1.0.6.

gradle-plugin 1.2.1

• Fixed: APK selection when there were ABI splits without a universal split APK.

ew-cli 1.0.5

• New: you can now configure the locale of the emulator for both test runs and emulator sessions via the locale parameter of the --device option.

gradle-plugin 1.2.0

• New: support for configuring device locale.
• Fixed: setting ignoreFailures to true now only ignores test failures as promised in the Javadoc.
• Maintenance: bumped default ew-cli version to 1.0.5.

emulator.wtf web app

• Fixed: logging in now returns to the page you were on before being redirected to the login page.

gradle-plugin 1.1.0

• New: Added configurations {} block to the emulatorwtf {} dsl to enable multiple test run configurations within the same module.
• Fixed: Develocity reporting tasks should now correctly trigger when the test task fails.

CircleCI orb emulator-wtf/emulator-wtf@0.0.3

New emulator-wtf/emulator-wtf@0.0.3 orb with support for CircleCI OIDC, read more here.

gradle-plugin 1.0.4

• Fixed: the emulator.wtf Gradle plugin now supports Android Gradle Plugin 9.0 and later, in both the android.newDsl=false and android.newDsl=true modes.
• Fixed: using Gradle Managed Devices with emulator.wtf devices now works on AGP 9.0, regardless of the android.newDsl setting.

emulator.wtf web app

• Fixed: results page now correctly shows the count of flaky tests.