50 Commits

Author SHA1 Message Date
Yegor
18d9b20ffb add Android instrumentation test (#11063)
* add Android instrumentation test

* add devicelab test

* add to manifest.yaml

* rename _smoke_test.dart to _smoketest.dart to prevent flutter test from picking it up

* volatile fields; style fixes

* use ConditionVariable; fix sh script
2017-07-10 17:20:49 -07:00
Ian Hickson
bbea0c3d1a enable routing_test in devicelab (#10958) 2017-06-23 18:13:40 -07:00
Ian Hickson
9adb4a78a6 Deep linking: automatically push the route hiearchy on load. (#10894)
The main purpose of this PR is to make it so that when you set the
initial route and it's a hierarchical route (e.g. `/a/b/c`), it
implies multiple pushes, one for each step of the route (so in that
case, `/`, `/a`, `/a/b`, and `/a/b/c`, in that order). If any of those
routes don't exist, it falls back to '/'.

As part of doing that, I:

 * Changed the default for MaterialApp.initialRoute to honor the
   actual initial route.

 * Added a MaterialApp.onUnknownRoute for handling bad routes.

 * Added a feature to flutter_driver that allows the host test script
   and the device test app to communicate.

 * Added a test to make sure `flutter drive --route` works.
   (Hopefully that will also prove `flutter run --route` works, though
   this isn't testing the `flutter` tool's side of that. My main
   concern is over whether the engine side works.)

 * Fixed `flutter drive` to output the right target file name.

 * Changed how the stocks app represents its data, so that we can
   show a page for a stock before we know if it exists.

 * Made it possible to show a stock page that doesn't exist. It shows
   a progress indicator if we're loading the data, or else shows a
   message saying it doesn't exist.

 * Changed the pathing structure of routes in stocks to work more
   sanely.

 * Made search in the stocks app actually work (before it only worked
   if we happened to accidentally trigger a rebuild). Added a test.

 * Replaced some custom code in the stocks app with a BackButton.

 * Added a "color" feature to BackButton to support the stocks use case.

 * Spaced out the ErrorWidget text a bit more.

 * Added `RouteSettings.copyWith`, which I ended up not using.

 * Improved the error messages around routing.

While I was in some files I made a few formatting fixes, fixed some
code health issues, and also removed `flaky: true` from some devicelab
tests that have been stable for a while. Also added some documentation
here and there.
2017-06-23 14:58:29 -07:00
Yegor
480d628635 mark Linux tasks as stable (#10410) 2017-06-14 16:26:52 -07:00
Hans Muller
ede575a92e Refactor sample catalog screenshot production (#10676) 2017-06-14 09:05:53 -07:00
Michael Goderbauer
e2d4f9242e Benchmark for semantic overhead during transitions (#10678)
* Benchmark for semantic overhead during transitions

* review comments
2017-06-14 08:09:05 -07:00
Yegor
fde985b37d resurrect analyzer benchmarks (#10668)
* resurrect analyzer benchmarks

* move analyzer_benchmark to the more stable linux/android

* report average rather than best result
2017-06-13 13:14:16 -07:00
Michael Goderbauer
8bf17192f6 Adding first semantics perf test (#10649)
* Adding first semantics perf test

* review commnts and analyzer fixes

* fix analyzer warning
2017-06-13 12:49:07 -07:00
Chris Bracken
81eb140411 Mark all iOS devicelab tests flaky (#10609)
Host test runner is flaky. These should be re-enabled once the host
machine has been deflaked.
2017-06-09 17:30:04 -07:00
Hans Muller
dfc7788c8e update_devicelab_manifest (#10583) 2017-06-08 11:14:02 -07:00
Yegor
1b5b929c73 mark flutter_gallery_ios__transition_perf as flaky (#10420) 2017-05-31 15:40:14 -07:00
Yegor
06deba25ee move more tests to Linux hosts (#10413)
* move more tests to Linux hosts

* fix test
2017-05-31 15:13:08 -07:00
Yegor
7397bb9071 add tests to linux hosts (#10409) 2017-05-31 12:43:18 -07:00
Hans Muller
b4e41ff7d3 Add a devicelab task that generates sample app screenshots, etc (#10303) 2017-05-25 11:47:36 -07:00
Ian Hickson
a2235d910c Switch off my new test since it broke the build (#10231) 2017-05-20 11:23:19 -07:00
Ian Hickson
ab8202dc5a Track missing dartdocs (#10213)
This will help catch when we accidentally break --dartdocs.
2017-05-19 21:48:51 -07:00
Chris Bracken
7160ecfb07 Mark integration_ui, integration_ui_ios tests non-flaky (#10013) 2017-05-11 17:20:46 -07:00
Chris Bracken
2d437f51c3 Add end-to-end test to verify resize on keyboard dismissal (#10005)
Adds an initial integration test that:
1. captures laid-out widget size
2. focuses a text field to show the keyboard and resize the view
3. unfocuses the text field to dismiss the keyboard and resize the view
4. verify that the final widget size matches the initial size
2017-05-11 14:29:20 -07:00
Yegor
5ad06a502b re-enable devicelab tests that are no longer flaky (#9996) 2017-05-11 09:59:50 -07:00
Ian Hickson
bc32847fd4 Remove the flaky tests. (#9988)
They are causing nothing but trouble. We should fix these before turning them back on.

See https://github.com/flutter/flutter/issues/9986 https://github.com/flutter/flutter/issues/9987
2017-05-11 08:59:10 -07:00
Ian Hickson
f2e89681d9 Mark microbenchmarks_ios as flaky (#9656)
...because it clearly is.
2017-04-27 19:55:54 -07:00
Mikkel Nygaard Ravn
60bc1cfde7 Remove personal dev team from ios code sigining (#9631)
* Mark channels_integration_test_ios flaky

* Removed personal dev team from ios code siging

* Removed provisioning profile diffs against other samples
2017-04-27 11:07:52 +02:00
Mikkel Nygaard Ravn
70ff50f929 Integration test for channel communication (#9621) 2017-04-27 08:44:28 +02:00
Ian Hickson
96d8a2a3ad Mark some tests as flaky (#9489)
These tests have recently been turning the build red incorrectly. Until they are reliable, let's mark them flaky.
2017-04-20 00:11:31 -07:00
Yegor
7e3bb94d5f Mark complex_layout_scroll_perf__timeline_summary as flaky (#9405) 2017-04-14 17:15:34 -07:00
Yegor
9dfcc6ec79 Revert "temporarily mark iOS tests as flaky (#9314)" (#9333)
This reverts commit ff23a1ebfe5d01af8924761253cc574f23ac5295.

Our iOS lab hardware is back to normal.
2017-04-11 12:26:15 -07:00
Yegor
ff23a1ebfe temporarily mark iOS tests as flaky (#9314) 2017-04-10 10:51:31 -07:00
Yegor
d538c11486 update devicelab docs (#9274) 2017-04-06 16:27:29 -07:00
Yegor
57ca2b5ce8 obey custom timeout supplied by cocoon (#9260) 2017-04-06 10:48:45 -07:00
Chris Bracken
abfee824cd Re-enable iOS transitions test in devicelab (#9097)
This reverts commit 326355f0f913c954f92aa74612daa78be22755dd.
2017-03-29 19:19:57 -07:00
Ian Hickson
326355f0f9 Turn off this flaky test for now. (#9065)
cc @cbracken
2017-03-28 16:40:13 -07:00
Michael Goderbauer
506aea0316 enable windows tests with workaround (#9058) 2017-03-28 14:22:03 -07:00
Michael Goderbauer
cea7c66dfd Disable flaky WIndows test :( (#9029) 2017-03-27 14:04:50 -07:00
Sarah Zakarias
d274888be6 Rename platform_services to platform_channel (#9018)
* Rename platform_services to platform_channel

* rename in README

* renamed tests

* update modules.xml
2017-03-27 11:17:31 +02:00
Sarah Zakarias
47fc81f14d Revert "Remove flutter_view_ios__start_up.dart (#8978)" (#8996)
This reverts commit 38e4e48d06cd23cecc3168e9c89d686e88a683ef.
2017-03-24 11:45:57 +01:00
Sarah Zakarias
38e4e48d06 Remove flutter_view_ios__start_up.dart (#8978) 2017-03-23 16:06:09 +01:00
Sarah Zakarias
18db5a2e68 Add start-up test for flutter_view sample (#8892)
* Add start-up test for flutter_view sample

* add reportMetrics flag to startup test

* rewording in manifest.yaml
2017-03-23 13:20:00 +01:00
Sarah Zakarias
d1f73fd0ad Add integration test for the Platform Services app (#8826) 2017-03-20 22:19:03 +01:00
Michael Goderbauer
79002c7453 add tasks for Windows bots in device lab (#8827) 2017-03-16 13:47:14 -07:00
Ian Hickson
aff4e82891 Technical Debt tracker (#7667) 2017-01-26 17:04:37 -08:00
Yegor
3c7122a797 devicelab: fix basic_material_app_ios__size; add microbenchmarks (#7408) 2017-01-10 09:30:00 -08:00
Yegor
1df639b432 add microbenchmarks to devicelab (fixes #7081) (#7396) 2017-01-09 14:57:14 -08:00
Yegor
adf998cb2a remove mega_gallery__refresh_time superseded by hot_mode_dev_cycle__benchmark (#7171) 2016-12-06 12:20:54 -08:00
Jason Simmons
2fd786b567 A devicelab memory test for Android app suspend and resume (#7164) 2016-12-06 10:13:21 -08:00
Yegor
568a6e1e65 measure IPA size (#7158) 2016-12-05 12:46:59 -08:00
Jason Simmons
7da3ab634a Devicelab memory usage test that navigates repeatedly to a screen within Gallery (#7137) 2016-12-05 11:08:25 -08:00
Yegor
d7c215199d add hello_world__memory test to devicelab (#7143) 2016-12-02 16:50:27 -08:00
Jason Simmons
4da4ca89aa Add a devicelab test that captures memory usage metrics on Android (#7120) 2016-12-01 11:37:16 -08:00
Yegor
921287b412 migrate hot reload benchmark to the new devicelab framework (#5878) 2016-09-19 10:03:26 -07:00
Yegor
1ba1562293 move CI tests into the main repo (#5758) 2016-09-14 13:22:53 -07:00