1223 Commits

Author SHA1 Message Date
Jonah Williams
c11a64e944
[devicelab] turn down android X migration gradle tests (#68110)
These androidx migration tests require downloading firebase, which is a large library with a number of dependencies - this causes frequent enough flakes.

AndroidX migration is ~2 years in the past, and while it would be nice to confirm this still works, ideally that would be done in a reduced manner.
2020-10-14 13:24:22 -07:00
Jonah Williams
33903c17e1
[devicelab] delete disabled or not useful benchmarks (#68107)
- run_without_leak_tests: have been disabled for months
- build_benchmark: the tooling work here is mostly done and we're not tracking further improvements, free up more devicelab capacity
- system_debug_ios: does not work post iOS13
- mac_enable_twc: not adding more mac tests to devicelab
- hello_world_start_up: disabled

Any tests that we think will be valuable in the future can be resurrected from the git history.
2020-10-14 10:30:10 -07:00
Jonah Williams
06722679da
[devicelab] mark ios catalina as flaky (#68109) 2020-10-14 08:52:28 -07:00
Jonah Williams
751459df24
[flutter_tool] support --use-application-binary in flutter drive (#68060)
--use-application-binary allows running with an already built APK. This can be useful for speeding up CI test cases, or in our case eventually supporting some sort of build server. Demonstrate that this works by updating the old gallery test to use it. Fixes #56604

Co-authored-by: Jenn Magder <magder@google.com>
2020-10-13 19:27:30 -07:00
Jonah Williams
eb24393efe
remove missing argument (#67974) 2020-10-12 17:18:09 -07:00
Jonah Williams
5dfe7e6d51
[flutter_tools] attempt to stabilize hot restart benchmark the old fashioned way (#67971)
A change which sped up hot restart locally caused many of the devicelab measures to regress. I think this is because we do not measure when the isolate is actually "ready", so starting a reload or restart prematurely can cause time spent doing initialization to be registered as part of the reload operation.

A fix for this would be to have the framework include some sort of "initialization complete" event ... but it is not clear what the correct trigger would be. Perhaps after the first frame is successfully registered?

(9a3a0dc caused the benchmark regression - possibly since we spend less time syncing files now so we start the restart earlier)
2020-10-12 17:00:26 -07:00
Sam Rawlins
23c7ee9deb
Bump meta to 1.3.0-nullsafety.4 (#67744) 2020-10-12 09:50:30 -07:00
Jonah Williams
e53bb74694
Revert "Revert "Delete fast start unit test (#67757)" (#67763)" (#67765)
This reverts commit b33bfcef0ffbeea36c8a846c54aaeeaf73bf1f87.
2020-10-09 13:04:20 -07:00
Jonah Williams
b33bfcef0f
Revert "Delete fast start unit test (#67757)" (#67763)
This reverts commit 3eb2335a4e62aecf706628795850b61c2f5ee01b.
2020-10-09 13:01:42 -07:00
Jonah Williams
3eb2335a4e
Delete fast start unit test (#67757)
Now that fast-start syncs assets by default, this isn't testing anything. Retire the test
2020-10-09 12:41:32 -07:00
nturgut
a755c03819
Add web e2e to the flutter/flutter repo (#67693)
* adding tests that uses integration_test (e2e) package to flutter

* change the package name for the import

* fix licenses. fix README commands. add links

* adding dependency change auto generated by the tool

* more analyzer error fixes
2020-10-09 12:24:36 -07:00
Jenn Magder
98aeef2d98
Build xcarchive command (#67598) 2020-10-08 19:51:35 -07:00
Yuqian Li
98d1ad0195
Purge persistent cache for perf test runs (#67697) 2020-10-08 19:17:02 -07:00
Yuqian Li
e1e12fa658
Mark nonflaky tests as such (#67592) 2020-10-08 12:20:14 -07:00
Yuqian Li
684449a841
Remove measureIosCpuGpu (#67363) 2020-10-08 12:02:03 -07:00
Casey Hillers
9e206a0c93
Refactor devicelab logic to use TaskResult instead of JSON (#67550) 2020-10-07 16:37:09 -07:00
Jenn Magder
e5131fa31b
Increase device discovery timeout in devicelab health check (#67337) 2020-10-06 12:23:02 -07:00
Ming Lyu (CareF)
76c0d69b14
migrate textfield_perf to e2e (#64503) 2020-10-02 14:47:03 -07:00
Yuqian Li
e45157fc08
5x startup test repitition to reduce noise (#67147) 2020-10-02 12:22:05 -07:00
Ming Lyu (CareF)
db2532a949
migrate color_filter_and_fade_perf (#64484) 2020-10-01 17:32:02 -07:00
Yuqian Li
b92d250116
Let perf tests measure memory by default (#66570)
Fixes https://github.com/flutter/flutter/issues/66569
2020-10-01 15:20:17 -07:00
Jacob MacDonald
b95c3d7d56
update stack_trace dep (and others) (#67057) 2020-10-01 09:54:07 -07:00
Chris Yang
2d26bafec2
remove --trace-startup (#66568) 2020-09-29 17:22:04 -07:00
Ben Konyi
65a81c7cd3
Roll package:dds to 1.4.0 and update error handling (#66836) 2020-09-29 10:28:17 -07:00
Yuqian Li
4728892753
Roll gallery to the newest version (#66693)
The previously broken test should be fixed by
https://github.com/flutter/gallery/pull/331
2020-09-28 22:45:54 -07:00
Yuqian Li
04152f82d5
Mark nonflaky tests as such (#66595) 2020-09-28 10:26:52 -07:00
Yuqian Li
54ac7bc936
Reland "Default measureCpuGpu to true (#66386)" (#66604)
This reverts commit 2d9e500523a71f2da57f7eea9654ffa99f001a0d.

In addition, this fixes broken Android tests of the original PR.
2020-09-28 10:26:35 -07:00
Jenn Magder
65159afb55
Force plugins to inherit minimum iOS version from Flutter app (#66590) 2020-09-28 10:14:47 -07:00
Yuqian Li
3e8fb33c08
Revert "Roll gallery to the newest version (#66584)" (#66666)
This reverts commit 2ae09caace4545d9fbbfee281196a97f6db556ce.
2020-09-25 12:18:28 -07:00
Yuqian Li
2ae09caace
Roll gallery to the newest version (#66584)
This shouldn't break our tests as
https://github.com/flutter/gallery/issues/275 is closed.
2020-09-25 11:05:33 -07:00
Jenn Magder
a6a8a14d02
Do not cleanup Gradle in non-Android integration tests (#66487) 2020-09-24 18:34:07 -07:00
Yuqian Li
2d9e500523
Revert "Default measureCpuGpu to true (#66386)" (#66594)
This reverts commit 48ce83a833e7cb3c27e73e238f0d565470827139.
2020-09-24 15:17:57 -07:00
Yuqian Li
48ce83a833
Default measureCpuGpu to true (#66386) 2020-09-24 13:42:03 -07:00
godofredoc
57cda51f7e
Fix gradle_plugin_light_apk test. (#66496) 2020-09-23 16:52:02 -07:00
Jacob MacDonald
9cee75ba61
update to the latest null safe packages (#66384)
Updates all null safe dependencies to versions that allow 2.10 stable and 2.11 dev releases.

Also updates flutter_goldens and flutter_goldens_client to allow 2.11 dev.
2020-09-23 11:03:29 -07:00
Ming Lyu (CareF)
f681fcf32b
migrate backdrop_filter_perf (#64482) 2020-09-22 19:52:02 -07:00
Jenn Magder
d5b715d7cb
Stream logging from attached debugger on iOS 13+ (#66399) 2020-09-22 17:16:45 -07:00
Jenn Magder
68fd603dd0
Revert "Turn off flutter_gallery__transition_perf_e2e_ios32 in devicelab (#66187)" (#66302) 2020-09-22 12:22:06 -07:00
godofredoc
35c8f19f1e
Fix windows hostonly_devicelab tests. (#66195) 2020-09-22 12:07:05 -07:00
Yuqian Li
3907e490a0
Mark animated_placeholder_perf__e2e nonflaky (#66284) 2020-09-21 15:27:07 -07:00
Yegor
905feb7771
roll source_span 1.8.0-nullsafety.2 (#66290) 2020-09-21 15:02:07 -07:00
Jonah Williams
36a6ef6486
[devicelab] fix manifest definition (#66277) 2020-09-21 11:02:30 -07:00
Jonah Williams
689ca09cd0
[versions] update to latest source span and roll engine to 4b8477d11573d233e6791204191c0090f733b05d (#66136) 2020-09-19 11:22:07 -07:00
Jenn Magder
ae630b42a6
Turn off flutter_gallery__transition_perf_e2e_ios32 in devicelab (#66187) 2020-09-19 10:58:44 -07:00
Jenn Magder
c61c8f303b
Check that header exists instead of content (#65961) 2020-09-17 15:17:31 -07:00
Ben Konyi
a17b330980
Reland "Re-enable the Dart Development Service (DDS) (#64671)" (#65873)
This reverts commit 66b01c1f2905f6b4f845f7283abe3e458351fe2e.

* Add DDS ipv6 support

* Use --dds-port for DDS instead of hijacking --host-vmservice-port
2020-09-16 16:27:42 -07:00
Michael R Fairhurst
7f3c9b6bda
Remove unused 'dart:async' imports. (#65568) 2020-09-16 14:14:06 -07:00
Yuqian Li
82e459fcf3
Mark nonflaky tests as such (#65898) 2020-09-16 14:12:05 -07:00
George Wright
bb2ab8838a
[manual roll] Roll Engine from 1ef10b240e28 to f84e7a019663 (12 revisions) (#65949) 2020-09-16 11:22:02 -07:00
Ming Lyu (CareF)
b3f19a3e1a
migrate animated_placeholder_perf (#64478) 2020-09-16 07:47:03 -07:00