1683 Commits

Author SHA1 Message Date
Jonah Williams
d7f80fcdd3
[flutter_tools] configure screenshot on failure for all tasks (#68260) 2020-10-15 18:53:00 -07:00
Jonah Williams
ef205f7ebf
[devicelab] mark catalina not flaky and list iproxy processes before tet (#68239) 2020-10-15 14:21:40 -07:00
Dan Field
12f54e17f4
reland List queue search optimization (#68214)
* Revert "Revert "Improve performance of collectAllElements (#68065)" (#68207)"

This reverts commit 46ff57d6f19360da1da5fbdf0db70c49a716734a.

* use fewer elements for benchmark
2020-10-15 13:46:50 -07:00
Jonah Williams
0f88644883
[devicelab] allow the devicelab to take a screenshot if the iOS connection fails with FLUTTER_IOS_SCREENSHOT_ON_CONNECTION_FAILURE (#68156)
More attempts to remote diagnose the issues in the iOS devicelab
2020-10-15 13:13:28 -07:00
Jenn Magder
25857ce513
Use --device-timeout instead of deprecated --timeout in devicelab (#68230) 2020-10-15 12:45:59 -07:00
Jonah Williams
f5608f2b33
[devicelab] track any leaked processes (#68218) 2020-10-15 10:54:31 -07:00
Jonah Williams
2321b72dfb
[flutter_tools] move gradle download failure handling into tool (#68140)
This crash affects anyone using flutter, so move it into the tool where it can be tested and documented. Ensure it works on windows devicelab too.
2020-10-15 09:20:52 -07:00
Jonah Williams
46ff57d6f1
Revert "Improve performance of collectAllElements (#68065)" (#68207)
This reverts commit 8ba5732c4c874f08d853f30b10f1912efc992cc3.
2020-10-15 08:04:59 -07:00
Dan Field
8ba5732c4c
Improve performance of collectAllElements (#68065) 2020-10-14 21:32:04 -07:00
Jonah Williams
83e99f75c6
[devicelab] move test from flaky (#68141) 2020-10-14 14:47:41 -07:00
Jonah Williams
c11a64e944
[devicelab] turn down android X migration gradle tests (#68110)
These androidx migration tests require downloading firebase, which is a large library with a number of dependencies - this causes frequent enough flakes.

AndroidX migration is ~2 years in the past, and while it would be nice to confirm this still works, ideally that would be done in a reduced manner.
2020-10-14 13:24:22 -07:00
Jonah Williams
33903c17e1
[devicelab] delete disabled or not useful benchmarks (#68107)
- run_without_leak_tests: have been disabled for months
- build_benchmark: the tooling work here is mostly done and we're not tracking further improvements, free up more devicelab capacity
- system_debug_ios: does not work post iOS13
- mac_enable_twc: not adding more mac tests to devicelab
- hello_world_start_up: disabled

Any tests that we think will be valuable in the future can be resurrected from the git history.
2020-10-14 10:30:10 -07:00
Jonah Williams
06722679da
[devicelab] mark ios catalina as flaky (#68109) 2020-10-14 08:52:28 -07:00
Jonah Williams
751459df24
[flutter_tool] support --use-application-binary in flutter drive (#68060)
--use-application-binary allows running with an already built APK. This can be useful for speeding up CI test cases, or in our case eventually supporting some sort of build server. Demonstrate that this works by updating the old gallery test to use it. Fixes #56604

Co-authored-by: Jenn Magder <magder@google.com>
2020-10-13 19:27:30 -07:00
Jonah Williams
eb24393efe
remove missing argument (#67974) 2020-10-12 17:18:09 -07:00
Jonah Williams
5dfe7e6d51
[flutter_tools] attempt to stabilize hot restart benchmark the old fashioned way (#67971)
A change which sped up hot restart locally caused many of the devicelab measures to regress. I think this is because we do not measure when the isolate is actually "ready", so starting a reload or restart prematurely can cause time spent doing initialization to be registered as part of the reload operation.

A fix for this would be to have the framework include some sort of "initialization complete" event ... but it is not clear what the correct trigger would be. Perhaps after the first frame is successfully registered?

(9a3a0dc caused the benchmark regression - possibly since we spend less time syncing files now so we start the restart earlier)
2020-10-12 17:00:26 -07:00
Sam Rawlins
23c7ee9deb
Bump meta to 1.3.0-nullsafety.4 (#67744) 2020-10-12 09:50:30 -07:00
Jonah Williams
e53bb74694
Revert "Revert "Delete fast start unit test (#67757)" (#67763)" (#67765)
This reverts commit b33bfcef0ffbeea36c8a846c54aaeeaf73bf1f87.
2020-10-09 13:04:20 -07:00
Jonah Williams
b33bfcef0f
Revert "Delete fast start unit test (#67757)" (#67763)
This reverts commit 3eb2335a4e62aecf706628795850b61c2f5ee01b.
2020-10-09 13:01:42 -07:00
Jonah Williams
3eb2335a4e
Delete fast start unit test (#67757)
Now that fast-start syncs assets by default, this isn't testing anything. Retire the test
2020-10-09 12:41:32 -07:00
nturgut
a755c03819
Add web e2e to the flutter/flutter repo (#67693)
* adding tests that uses integration_test (e2e) package to flutter

* change the package name for the import

* fix licenses. fix README commands. add links

* adding dependency change auto generated by the tool

* more analyzer error fixes
2020-10-09 12:24:36 -07:00
Jenn Magder
98aeef2d98
Build xcarchive command (#67598) 2020-10-08 19:51:35 -07:00
Yuqian Li
98d1ad0195
Purge persistent cache for perf test runs (#67697) 2020-10-08 19:17:02 -07:00
Yuqian Li
e1e12fa658
Mark nonflaky tests as such (#67592) 2020-10-08 12:20:14 -07:00
Yuqian Li
684449a841
Remove measureIosCpuGpu (#67363) 2020-10-08 12:02:03 -07:00
Casey Hillers
9e206a0c93
Refactor devicelab logic to use TaskResult instead of JSON (#67550) 2020-10-07 16:37:09 -07:00
Jenn Magder
e5131fa31b
Increase device discovery timeout in devicelab health check (#67337) 2020-10-06 12:23:02 -07:00
Ming Lyu (CareF)
76c0d69b14
migrate textfield_perf to e2e (#64503) 2020-10-02 14:47:03 -07:00
Yuqian Li
e45157fc08
5x startup test repitition to reduce noise (#67147) 2020-10-02 12:22:05 -07:00
Ming Lyu (CareF)
db2532a949
migrate color_filter_and_fade_perf (#64484) 2020-10-01 17:32:02 -07:00
Yuqian Li
b92d250116
Let perf tests measure memory by default (#66570)
Fixes https://github.com/flutter/flutter/issues/66569
2020-10-01 15:20:17 -07:00
Jacob MacDonald
b95c3d7d56
update stack_trace dep (and others) (#67057) 2020-10-01 09:54:07 -07:00
Chris Yang
2d26bafec2
remove --trace-startup (#66568) 2020-09-29 17:22:04 -07:00
Ben Konyi
65a81c7cd3
Roll package:dds to 1.4.0 and update error handling (#66836) 2020-09-29 10:28:17 -07:00
Yuqian Li
4728892753
Roll gallery to the newest version (#66693)
The previously broken test should be fixed by
https://github.com/flutter/gallery/pull/331
2020-09-28 22:45:54 -07:00
Yuqian Li
04152f82d5
Mark nonflaky tests as such (#66595) 2020-09-28 10:26:52 -07:00
Yuqian Li
54ac7bc936
Reland "Default measureCpuGpu to true (#66386)" (#66604)
This reverts commit 2d9e500523a71f2da57f7eea9654ffa99f001a0d.

In addition, this fixes broken Android tests of the original PR.
2020-09-28 10:26:35 -07:00
Jenn Magder
65159afb55
Force plugins to inherit minimum iOS version from Flutter app (#66590) 2020-09-28 10:14:47 -07:00
Yuqian Li
3e8fb33c08
Revert "Roll gallery to the newest version (#66584)" (#66666)
This reverts commit 2ae09caace4545d9fbbfee281196a97f6db556ce.
2020-09-25 12:18:28 -07:00
Yuqian Li
2ae09caace
Roll gallery to the newest version (#66584)
This shouldn't break our tests as
https://github.com/flutter/gallery/issues/275 is closed.
2020-09-25 11:05:33 -07:00
Jenn Magder
a6a8a14d02
Do not cleanup Gradle in non-Android integration tests (#66487) 2020-09-24 18:34:07 -07:00
Yuqian Li
2d9e500523
Revert "Default measureCpuGpu to true (#66386)" (#66594)
This reverts commit 48ce83a833e7cb3c27e73e238f0d565470827139.
2020-09-24 15:17:57 -07:00
Yuqian Li
48ce83a833
Default measureCpuGpu to true (#66386) 2020-09-24 13:42:03 -07:00
godofredoc
57cda51f7e
Fix gradle_plugin_light_apk test. (#66496) 2020-09-23 16:52:02 -07:00
Jacob MacDonald
9cee75ba61
update to the latest null safe packages (#66384)
Updates all null safe dependencies to versions that allow 2.10 stable and 2.11 dev releases.

Also updates flutter_goldens and flutter_goldens_client to allow 2.11 dev.
2020-09-23 11:03:29 -07:00
Ming Lyu (CareF)
f681fcf32b
migrate backdrop_filter_perf (#64482) 2020-09-22 19:52:02 -07:00
Jenn Magder
d5b715d7cb
Stream logging from attached debugger on iOS 13+ (#66399) 2020-09-22 17:16:45 -07:00
Jenn Magder
68fd603dd0
Revert "Turn off flutter_gallery__transition_perf_e2e_ios32 in devicelab (#66187)" (#66302) 2020-09-22 12:22:06 -07:00
godofredoc
35c8f19f1e
Fix windows hostonly_devicelab tests. (#66195) 2020-09-22 12:07:05 -07:00
Yuqian Li
3907e490a0
Mark animated_placeholder_perf__e2e nonflaky (#66284) 2020-09-21 15:27:07 -07:00