Run Flutter Integration Tests on Devices Using AWS Services

Author image By Manish Patel  |  Wednesday, October 16, 2019 03:16 PM  |  4 min read  |   670

Run Flutter Integration Tests On Real Devices Using AWS Device Farm & Sylph?

Run Flutter Integration Tests On Real Devices- 3 Easy Steps!

Flutter app development is a popular web technology that enables businesses to develop hybrid applications. This open-source platform allows businesses to save their time and effort as one doesn’t have to develop two different applications for different operating systems. Flutter has boomed the market in the past few years and has become the number one choice of entrepreneurs. However, to test the Flutter app developers used to run flutter driver testers on the Android emulator and iOS emulator, depending on the operating system.

But now, flutter integration with an open-source command line utility called Sylph has made things more seamless. This out-of-the-box integration with AWS Device Farm will enable you to run tests on real devices that will give you a clear picture of the app’s performance.

What is Sylph, and how it will be useful?

AWS Device Farm provides a massive pool of Android and iOS devices for running integration tests on many real devices in one go. This is one of the best options that will help you ensure that your release builds are thoroughly checked before pushing out the app from the store. Previously, there was no quick way to use AWS Device Farm-flutter integration as the AWS Device Farm’s support list included Appium and native tests only. And flutter driver testers were not on the list of the supported framework!

Sylph was developed by Maurice McCabe, which actually opened the door to AWS Device Farm for flutter apps. Under the roof, Sylph makes it appear as if you’re running an Appium test. You can set it up locally on Linux, Mac, or Windows using command row, but it processes better in the CI environment. The complete AWS Device Farm test run configuration includes numerous test suites and the devices to be used for testing. This can be defined as a sylph.yaml file.

What are the steps to run flutter apps on real devices with AWS Device Farm and Sylph?

You should opt for flutter app development services that can provide you with both Sylph and AWS Device Farm integrated environments. This makes it really easy for flutter developers to use AWS Device Farm for testing applications. To run this application you need an AWS account and a trouble-free sylph.yaml file configuration in the repo for making these efficiently work. And in case, if you don’t have a sylph configuration file, then these service providers can help you with that.

Now let’s dive through the steps to configure your flutter driver tests on a real device with the AWS Device Farm integration:

Step 1: Begin with setting up AWS Device Farm

For running integration tests on AWS Device Farm, it can be enabled in App settings > Test. After that, you need to verify Enable Flutter Drive tests and then select where to run them. The moment you choose AWS Device Farm, you will notice the fields to enter your AWS access key ID and AWS secret access key. However, if you’re planning to run Flutter Driver tests on Android devices only, you can save the settings and end the process of setting them up here. In case your device collection contains iOS devices, all you will need is to set up a Fastlane match and add the iOS definite environment variables in App settings > Environment.

Setting up AWS Device Farm

Step 2: Initiate to build

If you’re satisfied with the app settings, click on the “Start new Build” option. During the building process, you need to explore the depository for a sylph.yaml file to configure the AWS Device Farm test run and creates a default configuration file if no available configuration is established. However, by default, you’ll find the project_root/test_driver folder.

Step 3: Check the results

As you can monitor the build logs while it runs, you will also view the results conveniently once the Testing step is accomplished. After the test run, you will see an advanced overview of how many tests failed, skipped, or passed on the results tab as well as a thorough test log on the Log tab.

Flutter Integration

Besides other details, the test log involves information concerning the status of the test on each testing device as well as optimized device minutes. And if you’re seeking more detailed information on the test run, you can also see videos, data about memory, CPU usage, and device logs. It is also available in your AWS Management Console.

Bottom line

Tests are always better on real devices. When you test flutter applications on real devices, it enables you to alter the performance and abolish potential device-specific bugs. All thanks to Sylph! AWS Device Farm can now be integrated into the build workflow so you can smoothly authenticate that your significant releases, not only pass the CI test but also pass the integration tests on a collection of real Android and iOS devices. Remember, you will need an account for using the AWS Device Farm!

Run flutter integration tests on devices using aws services

Contact Us


Author image

Manish Patel

Manish Patel is a Co-Founder of Concetto Labs, a leading mobile app development company specialized in android and iOS app development. We provide a one-stop solution for all IT related services.

Why Our Client Love Us?

  • Fast kick-off
  • Agile Ready
  • 98% Client Retention
  • 360-Degree solutions

Our integrity and process focuses largely on providing every customer the best recommendations for their respective business. Our clients become recurring customers because we always go beyond their expectations to deliver the best solutions.

Get In Touch
Mr. Sieva Savko
Customer for over 4 years Mr. Sieva Savko Norway

Concetto Labs have provided us with a tremendous amount of help. Their competence in various IT fields led to a positive outcome while facing different challenges. A lot of value was given by their helpful professional staff. To describe this company in three words: effectiveness, collaboration, trust. I would also like to personally thank Mr. Tejas Patel for his positive, friendly, and highly competent approach. The all-around support provided by him made every task at hand a no-brainer.

Miss. Caroline Jack
Customer for over 4 years Miss. Caroline Jack South Africa

It has been an absolute pleasure working with the Concetto Labs team! We have worked together on a few projects now, all of which have been successful. You can rely on good communication and response times from these guys. And they go above and beyond to ensure that the result is achieved. Because of their great service, they have become an integral part of our business and we will continue to use them going forward.

Mr. Richard Bartlett
Customer for over 3 years Mr. Richard Bartlett United States

Concetto Labs is a group of incredibly talented individuals. They are very responsive and communicate with you each and every step of the process. I worked with Manish Patel throughout the entire process and must say that I have never conducted business with a more honest and professional individual. Together with his team, Manish created exactly how we envisioned it to be. Thanks for all of your hard work.

Mr. Conrad Abraham
Customer for over 2 years Mr. Conrad Abraham United States

Concetto Labs team is my go-to for any simple or complex development projects. They have risen to the challenge. Great project management, communication, and super quick turnaround. I've done multiple projects with them and don't plan on changing that.

Mr. Edward Chin
Customer for over 4 years Mr. Edward Chin Canada

Concetto Labs was able to bring my complex idea to life. Throughout the project, Concetto Labs maintained constant communications and was always professional - considering I had no experience in what I wanted to create their welcoming attitude, patience, and knowledge in the field created the perfect environment to work in. I was so impressed with their work that I've kept them on board as my go-to experts. Thanks for the worthwhile experience and the breathtaking product.

Karuna Govind
Karuna Govind CTO & Co Founder (Coupay) London, UK

We started working with Concetto Labs due to the influx of work on mobile (Flutter) and frontend (React.js). It's been fantastic working with them. Good, consistent communication and good quality of work means they may be our first choice for many projects to come.

Arunabha Choudhury
Arunabha Choudhury Director (Fuzzann Technologies Private Limited) India

We are a healthcare IT company and wanted to build a Mobile Application for both Android and IOS using Flutter. The Concetto Lab team has been very patient with our project requirements and made sure all our queries are answered. It was a great show of professionalism and customer relationship. Even during the project, the team was very accommodating of all the changes we requested. The project was delivered successfully and we deployed the app in the Android Play Store. Overall, the entire process has been very transparent and the team was able to deliver exactly what we had envisioned the project outcome to look like.

Good Firms Clutch App Futura Microsoft Associate Mobile App Top Developers Gesia