liyuqian
67b5bdf99b
Reland "Measure iOS CPU/GPU percentage ( #41234 )" ( #41426 )
...
This reverts commit f1e7fe8142a0b75da74617bec617589882a730a7.
This fix is in https://github.com/flutter/packages/pull/39
2019-09-28 14:24:46 -07:00
Jonah Williams
f1e7fe8142
Revert "Reland "Measure iOS CPU/GPU percentage ( #39439 )" ( #41234 )" ( #41400 )
2019-09-26 12:27:01 -07:00
liyuqian
406b44983a
Reland "Measure iOS CPU/GPU percentage ( #39439 )" ( #41234 )
...
This reverts commit 652be88ecd259407b47d0dbeb243f5fbbef81638.
This fix is in https://github.com/flutter/packages/pull/37
2019-09-26 10:39:24 -07:00
Kate Lovett
20d9a2441f
Revert "Benchmark for un-triaged image results on Flutter Gold ( #40634 )" ( #41232 )
...
This reverts commit 43932aa2ca0b16bcdda1efef7368877c8a8ca7e1.
2019-09-24 16:00:04 -07:00
Kate Lovett
43932aa2ca
Benchmark for un-triaged image results on Flutter Gold ( #40634 )
2019-09-24 12:38:28 -07:00
liyuqian
652be88ecd
Revert "Measure iOS CPU/GPU percentage ( #39439 )" ( #40624 )
...
This reverts commit af9f424d5db7694ad80006f97d8403500ecd9991.
Reverts flutter/flutter#39439
Reason: this passed the local device lab test on my Macbook but it failed in the actual device lab. Will investigate, fix, and reland.
TBR: @dnfield @goderbauer @tvolkert @Hixie
2019-09-16 15:00:27 -07:00
liyuqian
af9f424d5d
Measure iOS CPU/GPU percentage ( #39439 )
...
For https://github.com/flutter/flutter/issues/33899
Test added:
- simple_animation_perf_ios
Test modified:
- backdrop_filter_perf_ios__timeline_summary
We'll add the CPU/GPU measurement to more iOS tests
once it's proven to be non-flaky.
2019-09-16 13:14:38 -07:00
liyuqian
0ef89bb969
Remove all flaky marks ( #40441 )
...
Those tests are all non-flaky.
2019-09-14 15:34:29 -07:00
Jonah Williams
440a911034
Remove failing devicelab tests ( #40155 )
2019-09-10 08:35:06 -07:00
Tong Wu
b9d9156fa6
These Catalina tests are no longer flaky. ( #39772 )
2019-09-04 12:49:10 -07:00
liyuqian
6e555a9c34
Mark flutter_gallery__transition_perf as non-flaky ( #39580 )
...
One of our linux/android Moto G4 has alerts (emergency, amber, etc.)
turned on. That's probably the cause of the flakiness. I've turned it
off.
Let's mark this as non-flaky and see if it's fixed. If not, I'll move it
to mac/android and see if that fixes the flakiness.
I think the most important thing to do right now is to mark it as
non-flaky so those who really break the test could get a notification.
2019-09-03 09:36:24 -07:00
Jonah Williams
43e7c55900
disable low value windows tests ( #39626 )
2019-09-02 01:17:26 -07:00
Jonah Williams
ad2c3522f3
disable low value linux tests ( #39598 )
2019-08-30 20:22:09 -07:00
liyuqian
c1cb68004a
Move ios tests to the right section ( #39363 )
2019-08-28 10:33:43 -07:00
Tong Wu
a690b0b8e2
[devicelab] Reland adding smoke tests for Catalina/Android testing ( #39361 )
2019-08-27 17:47:32 -07:00
Tong Wu
2f58d08678
Revert "Add smoke tests for Catalina/Android testing. ( #39300 )" ( #39347 )
...
This reverts commit b38302b0c230f22347b200907381e7db15412646.
2019-08-27 12:27:12 -07:00
Tong Wu
b38302b0c2
Add smoke tests for Catalina/Android testing. ( #39300 )
2019-08-27 11:22:54 -07:00
Jenn Magder
2ba3054d90
Mark smoke_catalina_start_up not flaky ( #38999 )
2019-08-21 15:24:52 -07:00
liyuqian
bbcfdea101
Add iOS backdrop filter benchmarks ( #38814 )
...
For https://github.com/flutter/flutter/issues/36064
That performance regression is iOS-only so we'd better get the
benchmarks running on iOS.
2019-08-20 10:39:29 -07:00
Todd Volkert
083022b471
Fix stages of some iOS devicelab tests ( #38719 )
2019-08-16 15:34:56 -07:00
Tong Wu
066738324e
Add smoke tests to test every commit on a Catalina host. ( #38567 )
...
* Add a smoke test to test every commit on a Catalina host.
* Also add a hot-reload test.
Related issue: #36290 .
2019-08-14 15:09:35 -07:00
Michael Goderbauer
52fb11ec23
Unmark devicelab tests as flaky that are no longer flaky ( #37872 )
2019-08-09 10:53:37 -07:00
sjindel-google
abe240982f
Don't mark system_debug_ios as flaky. ( #37760 )
2019-08-07 10:39:45 +02:00
sjindel-google
0564f0a812
Tests for Engine ensuring debug-mode apps are attached on iOS. ( #37043 )
...
This PR contains the tests for flutter/engine#10186 .
2019-08-06 20:08:09 +02:00
liyuqian
e77237d6d3
Reland "Fix the first frame logic in tracing and driver ( #35297 )" ( #37192 )
...
This relands https://github.com/flutter/flutter/pull/35297
The followings have been done to fix the broken tests:
1. Add `didSendFirstFrameRasterizedEvent` extension and its tests
2. Wait for `didSendFirstFrameRasterizedEvent` instead of
`didSendFirstFrameEvent` during start up tests
3. Mark missed (probably newly added) start up tests as flaky
2019-07-31 11:01:52 -07:00
liyuqian
a0b69f3070
Mark backdrop_filter_perf test nonflaky ( #37030 )
2019-07-29 21:36:42 -07:00
Jonah Williams
3068fc4f7c
Revert "Fix the first frame logic in tracing and driver ( #35297 )" ( #37027 )
...
This reverts commit 68fc7231b33dcb3f7c9e705e321135f009afda49.
2019-07-26 13:08:36 -07:00
liyuqian
68fc7231b3
Fix the first frame logic in tracing and driver ( #35297 )
...
This should fix https://github.com/flutter/flutter/issues/31442 and https://github.com/flutter/flutter/issues/34867
2019-07-26 09:38:12 -07:00
Matt Carroll
9edce4f9a4
Mark splash test flaky until proved stable. ( #36895 )
2019-07-24 17:25:12 -07:00
Matt Carroll
a7387b127d
Added demo projects for splash screen support on Android. ( #35728 )
2019-07-24 13:44:13 -07:00
Todd Volkert
0f625196cc
Add plumbing for hello world startup test in devicelab ( #36410 )
...
This is the first step in getting esoteric devices wired
up to device lab to ensure that we can at least start Flutter
apps in profile mode on such devices.
https://github.com/flutter/flutter/issues/35838
2019-07-18 11:13:14 -07:00
Jenn Magder
b5c1b61c73
Add platform_interaction_test_swift to devicelab ( #35775 )
2019-07-10 14:13:01 -07:00
Jonah Williams
91e3b2d671
add iOS build benchmarks ( #35749 )
2019-07-08 18:09:00 -07:00
liyuqian
34e18d38ce
ios (iPhone6) and iPhone XS tiles_scroll_perf tests ( #35556 )
...
For https://github.com/flutter/flutter/issues/31086 .
Also test if our mac8 with iPhone XS is working
(https://github.com/flutter/flutter/issues/34590 ).
2019-07-08 14:13:33 -07:00
Alexander Aprelev
9f285aa9d9
Introduce image_list performance benchmark that runs on jit(debug) build. ( #35424 )
...
* Introduce image_list performance benchmark that runs on jit(debug) build.
We want to track performance of debug build because ongoing work on reducing the cost of spanwing new isolate will impact jit(debug) more than it will aot(release) configurations.
* Newlines and spaces
2019-07-08 08:23:06 -07:00
Jonah Williams
05b4c67550
add APK build time benchmarks ( #35481 )
2019-07-03 10:54:04 -07:00
Jonah Williams
6e705ea6a6
mark windows and macos chrome dev mode as flaky ( #35495 )
2019-07-02 16:43:41 -07:00
Alexander Aprelev
3badcf51a4
Introduce image loading performance test. ( #34823 )
...
* Introduce image loading performance test.
This example reports how long it takes to load images over the network(locally spawned server).
2019-06-28 15:14:03 -07:00
Jim Graham
f83fd9d467
Add test case for Flutter Issue #27677 as a benchmark. ( #34870 )
...
* Add test case for Flutter Issue #27677 as a benchmark.
See https://github.com/flutter/flutter/issues/27677
I got the following results running the test on a Moto E2 which
will help us determine how much we can gain by analyzing the
operations and eliminating unnecessary repaints based on
dirty rectangles/regions.
no blurs - avg 216.0 fps over 3 samples
blur the group - avg 22.9 fps over 3 samples
blur each txt - avg 3.4 fps over 3 samples
* Added the new benchmark to be tracked on the dashboard.
2019-06-24 20:53:22 -07:00
Todd Volkert
704009541f
Update flakiness of tests ( #34374 )
2019-06-12 23:06:20 -07:00
Jonah Williams
50ea6f32d3
add benchmarks to track web size ( #33892 )
2019-06-05 12:40:21 -07:00
Kaushik Iska
92bfc99132
Added a benchmark for ImageCache ( #33814 )
...
* Add an image cache benchmark for a monochrome image
2019-06-04 12:32:52 -07:00
Gary Qian
e0cb468865
Unmark flutter_gallery__back_button_memory as flaky ( #33861 )
2019-06-04 12:27:08 -07:00
Jonah Williams
83986acbdb
Add a real-er web restart, doctor, workflow ( #33786 )
2019-06-03 23:19:42 -07:00
Chris Bracken
98ea501995
Revert "Add real-er restart for web using webkit inspection protocol ( #33629 )" ( #33703 )
...
Revert "fix devicelab manfiest (#33698 )"
This reverts commit 5a6a00dc54cb9c5f6865fd31f930ca5665a0e4af.
This reverts commit 0d79f0fc79f1ab46f80a3d8d734fdadccea1fb4a.
2019-05-31 21:53:30 -07:00
Jonah Williams
0d79f0fc79
fix devicelab manfiest ( #33698 )
2019-05-31 17:44:19 -07:00
Jonah Williams
5a6a00dc54
Add real-er restart for web using webkit inspection protocol ( #33629 )
2019-05-31 17:37:01 -07:00
Gary Qian
8d658d4fa2
uncaught_image_error_linux is no longer particularly flaky ( #33596 )
2019-05-30 12:23:51 -07:00
Dan Field
0df3ec6bcb
Remove obsolete TOODs ( #33554 )
2019-05-30 08:09:15 -07:00
Todd Volkert
986d036fab
Mark flutter_gallery__back_button_memory as flaky ( #33549 )
2019-05-29 23:29:18 -07:00
