1222 Commits

Author SHA1 Message Date
auto-submit[bot]
3a075deede
Reverts "Marks Mac_arm64_ios hot_mode_dev_cycle_ios__benchmark to be flaky (#158242)" (#158891)
Reverts: flutter/flutter#158242
Initiated by: LouiseHsu
Reason for reverting: Flake rate is low, and the arm64 macs in the staging pools are having difficulties
Original PR Author: fluttergithubbot

Reviewed By: {LouiseHsu}

This change reverts the following previous change:
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64_ios hot_mode_dev_cycle_ios__benchmark"
}
-->
Issue link: https://github.com/flutter/flutter/issues/158241
2024-11-13 22:38:17 +00:00
Flutter GitHub Bot
a6d81aa8f1
Marks Mac_arm64_ios hot_mode_dev_cycle_ios__benchmark to be flaky (#158242)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64_ios hot_mode_dev_cycle_ios__benchmark"
}
-->
Issue link: https://github.com/flutter/flutter/issues/158241
2024-11-13 02:29:25 +00:00
Christopher Fujino
8e5bd5af86
force Linux plugin_test to run on Ubuntu 20.04 (#158529)
Work around propagation from https://github.com/flutter/flutter/issues/158521
2024-11-12 21:22:56 +00:00
Flutter GitHub Bot
f04b0f4b9e
Marks Linux analyzer_benchmark to be flaky (#158244)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux analyzer_benchmark"
}
-->
Issue link: https://github.com/flutter/flutter/issues/158243
2024-11-10 22:30:39 +00:00
Andrew Kolos
c9eb4ae9cc
remove bringup status for recently re-subsharded targets (#158217)
Cleans up https://github.com/flutter/flutter/pull/158196 and https://github.com/flutter/flutter/pull/158146

<details>

<summary> Pre-launch checklist </summary> 

</details>
2024-11-10 21:49:24 +00:00
Flutter GitHub Bot
893a0c8fcd
Marks Mac_benchmark complex_layout_scroll_perf_macos__timeline_summary to be flaky (#158252)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_benchmark complex_layout_scroll_perf_macos__timeline_summary"
}
-->
Issue link: https://github.com/flutter/flutter/issues/158251
2024-11-09 19:45:40 +00:00
Polina Cherkasova
1f1eec06f1
Make leak tracking bots blocking. (#157866)
See http://flutter.dev/go/leak-tracker-make-bots-blocking
2024-11-07 00:23:04 +00:00
Jenn Magder
a987694f43
Delete firebase_android_embedding_v2_smoke_test (#158223)
Delete the Android V2 embedding smoke test now that the V1 embedding has been deleted https://github.com/flutter/flutter/issues/143531.

Additionally, this was in bringup for months.

Fixes https://github.com/flutter/flutter/issues/158221
2024-11-06 18:21:07 +00:00
Flutter GitHub Bot
255a94139a
Marks Mac_benchmark animated_complex_opacity_perf_macos__e2e_summary to be flaky (#157424)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_benchmark animated_complex_opacity_perf_macos__e2e_summary"
}
-->
Issue link: https://github.com/flutter/flutter/issues/157423
2024-11-05 23:34:44 +00:00
Andrew Kolos
0401c37f29
Increase subsharding for Linux tool_integration_tests (#158196)
I've noticed Linux tool_integration_tests 5_5 has come very close to timing out. See https://github.com/flutter/flutter/issues/155317 for more context, I am not 100% confident that increasing the subsharding here will help given that we just very recently increased subsharding from 4 to 5, but the results could be interesting regardless.

<details>

<summary> Pre-launch checklist </summary> 

</details>
2024-11-05 23:20:10 +00:00
Andrew Kolos
29d40f7f68
increase subsharding for Windows build_tests from 8 to 9 (#158146)
Helps with https://github.com/flutter/flutter/issues/157845. See that thread for more info.

<details>

<summary> Pre-launch checklist </summary> 

</details>
2024-11-05 18:27:16 +00:00
Flutter GitHub Bot
48385ca016
Marks Linux_pixel_7pro flavors_test to be flaky (#156956)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro flavors_test"
}
-->
Issue link: https://github.com/flutter/flutter/issues/156955
2024-11-05 04:53:08 +00:00
Jackson Gardner
4a33136db8
Add benchmarks for single-threaded Skwasm. (#158027)
This adds benchmarks that run on single threaded skwasm.
2024-11-04 16:38:10 +00:00
Flutter GitHub Bot
f159136549
Marks Linux_pixel_7pro service_extensions_test to be flaky (#157853)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro service_extensions_test"
}
-->
Issue link: https://github.com/flutter/flutter/issues/157852
2024-11-01 16:40:20 +00:00
Jonah Williams
1050959d19
[flutter_driver] use mostly public screenshot API. (#157888)
Instead of completely private. This has been broken for Impeller for years, which shows how much this method is getting used.

Fixes https://github.com/flutter/flutter/issues/130461
2024-10-31 21:31:07 +00:00
Gray Mackall
42132e879b
Reland "Upgrade tests to AGP 8.7/Gradle 8.10.2/Kotlin 1.8.10" (#157617)
Reland of https://github.com/flutter/flutter/pull/157032.

Failed tests for initial land: 
https://flutter-dashboard.appspot.com/#/build?hashFilter=5ca6350a06fdae8d3e160f9adbece193f34d0302&repo=flutter&branch=master

These two tests run the same `flavors_test`
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_pixel_7pro%20flavors_test/4579/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Windows_mokey%20flavors_test_win/988/overview
which is now passing
https://ci.chromium.org/ui/p/flutter/builders/try/Linux_pixel_7pro%20flavors_test/37/overview
(fixed by 23c62df1dc)

The other failures seem to be flakes
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_pixel_7pro%20new_gallery_impeller_old_zoom__transition_perf/4902/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_2_5/1247/overview
the first is a timeout, the second passed in presubmit on the original PR and also on this PR.
2024-10-29 18:01:19 +00:00
Jonah Williams
8fc6dc2aa6
[impeller] re-enable impeller shard. (#157806)
This is fixed now
2024-10-29 17:53:35 +00:00
Zachary Anderson
1ab3c57ea4
Pin Mac tool_integration_test shards to arm64 (#157760)
Using `Mac_arm64` would require these to go through a `bringup: true`
dance, which would require not running in presubmit. Instead, this PR
just adds the `cpu` property to pin to `arm64` without changing the task
name.

Towards https://github.com/flutter/flutter/issues/157758
2024-10-28 19:32:32 -07:00
Reid Baker
bac39a3899
Update .ci.yaml have android sdk be 35v1 (#157621)
Bump the android sdk to 35v1 to see if doing so helps android 35 emulator stability.
2024-10-28 16:01:23 +00:00
auto-submit[bot]
b98d9a37ac
Reverts "Upgrade tests to AGP 8.7/Gradle 8.10.2/Kotlin 1.8.10 (#157032)" (#157559)
Reverts: flutter/flutter#157032
Initiated by: gmackall
Reason for reverting: https://github.com/flutter/flutter/pull/157032#issuecomment-2436336078
Original PR Author: gmackall

Reviewed By: {reidbaker, bartekpacia}

This change reverts the following previous change:
I recently noticed the following log when building an app in verbose mode:
```
This Android Gradle plugin (8.1.0) was tested up to compileSdk = 33 (and compileSdkPreview = "UpsideDownCakePrivacySandbox").
You are strongly encouraged to update your project to use a newer
Android Gradle plugin that has been tested with compileSdk = 35.
```

It looks like AGP would like us to use a newer AGP version if we want to use compileSdk 35 (which we do). This pr upgrades the tests, in advance of updating the templates.
2024-10-24 21:06:16 +00:00
Jonah Williams
b36a1316c3
Mark mac impeller as bringup. (#157551)
These started flaking and I don't know why. Mark as bringup until we can
investigate.
2024-10-24 13:18:18 -07:00
Gray Mackall
5ca6350a06
Upgrade tests to AGP 8.7/Gradle 8.10.2/Kotlin 1.8.10 (#157032)
I recently noticed the following log when building an app in verbose mode:
```
This Android Gradle plugin (8.1.0) was tested up to compileSdk = 33 (and compileSdkPreview = "UpsideDownCakePrivacySandbox").
You are strongly encouraged to update your project to use a newer
Android Gradle plugin that has been tested with compileSdk = 35.
```

It looks like AGP would like us to use a newer AGP version if we want to use compileSdk 35 (which we do). This pr upgrades the tests, in advance of updating the templates.
2024-10-24 20:08:45 +00:00
Flutter GitHub Bot
1f257cbc52
Marks Windows build_android_host_app_with_module_aar to be unflaky (#157419)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Windows build_android_host_app_with_module_aar"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Windows%20build_android_host_app_with_module_aar%22).
This test can be marked as unflaky.
2024-10-23 23:27:05 +00:00
Flutter GitHub Bot
0fd477d7f8
Marks Mac build_android_host_app_with_module_aar to be unflaky (#157411)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac build_android_host_app_with_module_aar"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac%20build_android_host_app_with_module_aar%22).
This test can be marked as unflaky.
2024-10-23 22:05:54 +00:00
Flutter GitHub Bot
8c978e9c23
Marks Linux build_android_host_app_with_module_aar to be unflaky (#157409)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux build_android_host_app_with_module_aar"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux%20build_android_host_app_with_module_aar%22).
This test can be marked as unflaky.
2024-10-23 22:02:00 +00:00
Andrew Kolos
eccf4ee226
fix test sharding (#156768)
Also cleans up https://github.com/flutter/flutter/issues/156762

<details>

<summary> Pre-launch checklist </summary> 

</details>
2024-10-23 19:36:09 +00:00
Flutter GitHub Bot
4faa4a415e
Marks Mac build_android_host_app_with_module_source to be unflaky (#157412)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac build_android_host_app_with_module_source"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac%20build_android_host_app_with_module_source%22).
This test can be marked as unflaky.
2024-10-23 17:51:15 +00:00
Flutter GitHub Bot
78d2acad72
Marks Windows build_android_host_app_with_module_source to be unflaky (#157420)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Windows build_android_host_app_with_module_source"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Windows%20build_android_host_app_with_module_source%22).
This test can be marked as unflaky.
2024-10-23 17:31:08 +00:00
Flutter GitHub Bot
272c4302c6
Marks Linux build_android_host_app_with_module_source to be unflaky (#157410)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux build_android_host_app_with_module_source"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux%20build_android_host_app_with_module_source%22).
This test can be marked as unflaky.
2024-10-23 17:27:04 +00:00
Reid Baker
4e8060eff5
Match framework and engine android emulator versions (#157291)
Related to https://buganizer.corp.google.com/issues/371020223 

See https://github.com/flutter/engine/pull/55591 where I updated the engine android 35 emulator version.
2024-10-21 22:34:25 +00:00
Jonah Williams
5bcb3073f4
[devicelab] remove flaky designation from flutter_driver_android_test (#157300)
https://github.com/flutter/engine/pull/55944 should have fixed all flakes and rolled into framework.
2024-10-21 22:27:52 +00:00
Gray Mackall
3baf9d4c60
Make android dependency version test suite run on changes to templates (#157196)
We have a group of tests that verifies that we can build a flutter app across the range of AGP, Kotlin, and Gradle versions we claim to support. They currently only run on postsubmit. 

This pr aims to make them run in presubmit as well, but only when changes are made to the templates (not just android templates, see https://github.com/flutter/flutter/pull/157196#discussion_r1807055791 as to why).
2024-10-21 15:36:45 +00:00
Flutter GitHub Bot
384f0cc6d3
Marks Mac flavors_test_macos to be flaky (#156944)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac flavors_test_macos"
}
-->
Issue link: https://github.com/flutter/flutter/issues/156943
2024-10-19 01:28:15 +00:00
Zachary Anderson
4ed8136610
Move analyzer_benchmark to the devicelab (#157127)
We want this benchmark to run in the devicelab rather than on a VM so that it will give consistent results across runs.

First run (results at the bottom):
https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8733793239434768065/+/u/run_analyzer_benchmark/stdout
2024-10-17 23:03:10 +00:00
Qun Cheng
23a721f9e9
Mark Linux_android_emu_34 flutter_driver_android_test bringup: true (#157069)
Mark `Linux_android_emu_34 flutter_driver_android_test` bringup: true

Related issue: https://github.com/flutter/flutter/issues/156903
2024-10-16 17:58:01 -07:00
Gray Mackall
d1d9954c45
Support host android apps with kts gradle files for add to app (#156502)
Allows applying of `include_flutter.groovy` via the `apply from:` syntax, which allows using a host app that is using the Gradle Kotlin DSL (the default these days when creating an Android app in AS).

Explanation: The `include_flutter.groovy` script is currently not able to be called by Kotlin gradle files, because it is [intended to be invoked with the following lines](https://docs.flutter.dev/add-to-app/android/project-setup#depend-on-the-modules-source-code):
```
setBinding(new Binding([gradle: this]))                                // new
evaluate(new File(                                                     // new
    settingsDir.parentFile,                                            // new
    'flutter_module/.android/include_flutter.groovy'                   // new
))
```

`setBinding` isn't part of the Kotlin gradle DSL, and there isn't (that I can find) an easy Kotlin equivalent. If this binding isn't set, the reference to `gradle` in `include_flutter.groovy` is wrong, which breaks the script.

This PR modifies `include_flutter.groovy` to also support being invoked through the standard way of invoking a script via the Gradle Groovy/Kotlin DSLs, which is `apply from:` (or it's slightly different Kotlin syntax). The start of the script identifies which of the two approaches is being used by checking if the binding is set, and then initializes some variables differently depending on the case.

If we land this, I believe we should update the example Gradle files for both the `kts` and `groovy` cases to prefer the `apply from` syntax as I think this is the syntax most developers would be more familiar with already seeing in their Gradle files.
2024-10-16 22:47:27 +00:00
Andrew Kolos
dacfa2d452
increase sharding of Windows build_tests (#156763)
Fixes https://github.com/flutter/flutter/issues/156762

<details>

<summary> Pre-launch checklist </summary> 

</details>
2024-10-14 22:52:24 +00:00
Jonah Williams
56e2a9d380
[devicelab] remove raster cache benchmarks. (#156600)
Death to the raster cache!
2024-10-11 19:46:21 +00:00
Andrew Kolos
514cf62d03
remove bringup from Windows tool_integration_tests_* (#156179)
Follow up to
* https://github.com/flutter/flutter/pull/156121

Removes bringup status from these tasks.
2024-10-04 19:49:14 +00:00
Andrew Kolos
58e0e00c63
further shard the Windows tool_integration_tests* targets (#156121)
Helps with https://github.com/flutter/flutter/issues/155012

Will remove `bringup` statuses after this merges.
2024-10-03 17:13:28 +00:00
Flutter GitHub Bot
4342887826
Marks Windows_mokey native_assets_android to be flaky (#156064)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Windows_mokey native_assets_android"
}
-->
Issue link: https://github.com/flutter/flutter/issues/156063
2024-10-02 13:35:26 +00:00
Christopher Fujino
3dc1e81526
mark {Linux,Windows} tool_integration_tests_* non-bringup (#155773)
Follow-up to https://github.com/flutter/flutter/pull/155631

These have not failed except one flake from gradle exhausting the java heap.
2024-10-02 02:17:06 +00:00
Gray Mackall
dec2091c03
Turn the packages roller bot back on (#155842)
Turns the roller bot back on, as it should have been fixed by https://github.com/flutter/flutter/pull/155794/.
2024-09-27 19:43:37 +00:00
Christopher Fujino
eb42a01302
mark linux packages autoroller bringup: true (#155705)
Unblock the tree while I investigate
https://github.com/flutter/flutter/issues/155704
2024-09-25 12:38:19 -07:00
Flutter GitHub Bot
538e7424d0
Marks Linux build_aar_module_test to be unflaky (#155349)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux build_aar_module_test"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux%20build_aar_module_test%22).
This test can be marked as unflaky.
2024-09-25 18:44:07 +00:00
Christopher Fujino
3d14246cee
increase both linux & windows tool integration test shards (#155631)
Fixes both:

- https://github.com/flutter/flutter/issues/155621
- https://github.com/flutter/flutter/issues/155317
2024-09-25 17:15:14 +00:00
Chris Bracken
0cd170798c
iOS: update provisioning profile for 2024-2025 cert (#155101)
Tells our iOS bots to use the provisioning profile stored in the flutter_internal/mac/mobileprovision CIPD packages tagged `version:to_2025`.

This CIPD package contains an updated provisioning profile which supports both the current development signing certificate expiring in October 2024, and the updated signing cert expiring in August 2025.

CIPD packages can be seen at:
https://chrome-infra-packages.appspot.com/p/flutter_internal/mac/mobileprovision

This is a reland of #155052, except without the removal of the CIPD dependency from the devicelab bots. After landing the original, many devicelab bots (and only devicelab bots) started failing with signing errors. The devicelab bots *should* be getting their certs/provisioning profile via the devicelab Salt configuration server (Googlers, see: go/flutter-salt) but it's possible some tests are fetching it from the CIPD package instead. This new patch simply updates the CIPD package version wherever it was already present. We can attempt to remove the CIPD package dependency from devicelab bots in a followup PR, and switch those over to using the profile installed via Salt (these are the same profile).

Required for: https://g-issues.chromium.org/issues/366034566
Issue: https://github.com/flutter/flutter/issues/152888
2024-09-12 18:15:58 +00:00
auto-submit[bot]
50a190caec
Reverts "iOS: update provisioning profile for 2024-2025 cert (#155052)" (#155059)
Reverts: flutter/flutter#155052
Initiated by: zanderso
Reason for reverting: The tree is red on this change: https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8737044980814837569/+/u/run_flutter_gallery_ios__compile/stdout.
Original PR Author: cbracken

Reviewed By: {christopherfujino, bdero}

This change reverts the following previous change:
Tells our iOS bots to use the provisioning profile stored in the flutter_internal/mac/mobileprovision CIPD packages tagged `version:to_2025`.

This CIPD package contains an updated provisioning profile which supports both the current development signing certificate expiring in October 2024, and the updated signing cert expiring in August 2025.

Also removes the CIPD dependency for devicelab tasks. On devicelab bots, the cert and provisioning profile are deployed via Salt, not via CIPD. We only need this dependency on the Chromium bots.

CIPD packages can be seen at:
https://chrome-infra-packages.appspot.com/p/flutter_internal/mac/mobileprovision

Required for: https://g-issues.chromium.org/issues/366034566

Issue: https://github.com/flutter/flutter/issues/152888
2024-09-12 01:47:46 +00:00
Chris Bracken
8bb8a03fa9
iOS: update provisioning profile for 2024-2025 cert (#155052)
Tells our iOS bots to use the provisioning profile stored in the flutter_internal/mac/mobileprovision CIPD packages tagged `version:to_2025`.

This CIPD package contains an updated provisioning profile which supports both the current development signing certificate expiring in October 2024, and the updated signing cert expiring in August 2025.

Also removes the CIPD dependency for devicelab tasks. On devicelab bots, the cert and provisioning profile are deployed via Salt, not via CIPD. We only need this dependency on the Chromium bots.

CIPD packages can be seen at:
https://chrome-infra-packages.appspot.com/p/flutter_internal/mac/mobileprovision

Required for: https://g-issues.chromium.org/issues/366034566

Issue: https://github.com/flutter/flutter/issues/152888
2024-09-12 00:26:17 +00:00
Flutter GitHub Bot
d4bfa2fd14
Marks Linux build_tests_3_5 to be unflaky (#154993)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux build_tests_3_5"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux%20build_tests_3_5%22).
This test can be marked as unflaky.
2024-09-11 17:59:39 +00:00