Need advice about which tool to choose?Ask the StackShare community!

AWS Device Farm

75
178
+ 1
5
Loader.io

72
173
+ 1
18
Add tool

AWS Device Farm vs Loader.io: What are the differences?

Introduction

This markdown will compare the key differences between AWS Device Farm and Loader.io.

  1. Supported Testing Scenarios: AWS Device Farm is primarily used for mobile app testing, offering a wide range of real devices for testing iOS, Android, and web apps. On the other hand, Loader.io is focused on testing the performance of web applications by simulating user traffic and load testing servers.

  2. Deployment Environment: AWS Device Farm is a cloud-based service provided by Amazon Web Services, offering a ready-to-use environment for testing mobile apps. In contrast, Loader.io requires users to deploy their web applications on their servers for performance testing purposes.

  3. Reporting and Analysis Tools: AWS Device Farm provides detailed test reports, logs, and performance metrics for mobile apps, allowing developers to identify issues and optimize performance. Loader.io offers visualization tools, real-time monitoring, and in-depth analytics for understanding server performance under varying loads.

  4. Pricing Structure: AWS Device Farm follows a pay-as-you-go pricing model based on the number of device minutes used for testing. Loader.io offers both free and paid plans based on the number of client requests or connections made to the server for load testing.

  5. Integration Capabilities: AWS Device Farm seamlessly integrates with other AWS services such as AWS CodePipeline for continuous integration and delivery workflows. Loader.io provides integrations with popular tools like Jenkins, GitHub, and Slack for incorporating load testing into the development pipeline.

Summary

In Summary, AWS Device Farm specializes in mobile app testing on real devices, while Loader.io focuses on load testing web applications to assess server performance under various conditions.

Advice on AWS Device Farm and Loader.io
Ratan Sharmacharya
Needs advice
on
Apache JMeterApache JMeter
and
Loader.ioLoader.io

I have a team that is not heavy on programming skills. I am looking for a load testing tool that is easy to use. Preferably, the tool should be a record and playback tool without much programming. Also, the tool should be able to test APIs apart from web-based applications. What tool should I opt for?

See more
Replies (2)
Deepak Naik
Product Owner at Digite Infotech Private Limited · | 3 upvotes · 33.2K views

My choice would be Apache JMeter, It's free and opensource plus it comes with lots of plugins and extendability. Apache JMeter needs a small amount of a learning curve and a basic understanding of Network, Protocols (TCP/IP ports, HTTP(S) and REST/SOAP, etc.) for initial setup. But it doesn't require programming skills. it has a nice record and playback option. You can still carry on without the developer skillset if you follow these steps. 1. Take backup. 2. Start recording and interact with the application. 3. stop recording and save the test case. This will give you your test-bed, after this, after these steps, every time just do Restore from backup and then Playback and observer results.

If you have longer recordings then an understanding of how to modify the recorded scripts will come handy.

For some of the advanced features such as Configuring variables, implementing loops, throttling adding think time, and automating test scaling to the number of users will require good planning of test scenarios and a Developer experience but this is true for any tool (even loader.io)

See more
Pepe Ruiz
Head of Content at k6.io · | 2 upvotes · 32.8K views
Recommends
on
k6k6

Disclaimer: I work at k6, and I recommend you try our tool.

It might require some coding skills, but we support a few options to record a user session to autogenerate the load test. Read How to record a browser session with k6 OSS.

The k6 Cloud also supports recording a user session with a Browser Extension. Additionally, it provides a Test Builder UI to generate a load test for testing APIs.

If you have questions or need help, you can ask on Slack and the Community forum.

See more
Get Advice from developers at your company using StackShare Enterprise. Sign up for StackShare Enterprise.
Learn More
Pros of AWS Device Farm
Pros of Loader.io
  • 3
    1000 free minutes
  • 2
    Pay as you go pricing
  • 9
    Easy to use
  • 6
    Free tier
  • 3
    Heroku add-on

Sign up to add or upvote prosMake informed product decisions

Cons of AWS Device Farm
Cons of Loader.io
  • 1
    Records all sessions, blocks on processing when done
  • 1
    You need to remember to turn airplane mode off
    Be the first to leave a con

    Sign up to add or upvote consMake informed product decisions

    What is AWS Device Farm?

    Run tests across a large selection of physical devices in parallel from various manufacturers with varying hardware, OS versions and form factors.

    What is Loader.io?

    Loader.io is a free load testing service that allows you to stress test your web-apps/apis with thousands of concurrent connections.

    Need advice about which tool to choose?Ask the StackShare community!

    What companies use AWS Device Farm?
    What companies use Loader.io?
    See which teams inside your own company are using AWS Device Farm or Loader.io.
    Sign up for StackShare EnterpriseLearn More

    Sign up to get full access to all the companiesMake informed product decisions

    What tools integrate with AWS Device Farm?
    What tools integrate with Loader.io?
    What are some alternatives to AWS Device Farm and Loader.io?
    Xamarin Test Cloud
    Run your app on our huge (and growing) collection of real devices from around the world. Select devices based on form factor, manufacturer, operating system, or even popularity in your target market. We’re adding over 100 devices every month, and if there’s a specific device you need, we’re taking requests.
    Firebase
    Firebase is a cloud service designed to power real-time, collaborative applications. Simply add the Firebase library to your application to gain access to a shared data structure; any changes you make to that data are automatically synchronized with the Firebase cloud and with other clients within milliseconds.
    BrowserStack
    BrowserStack is the leading test platform built for developers & QAs to expand test coverage, scale & optimize testing with cross-browser, real device cloud, accessibility, visual testing, test management, and test observability.
    Xamarin
    Xamarin’s Mono-based products enable .NET developers to use their existing code, libraries and tools (including Visual Studio*), as well as skills in .NET and the C# programming language, to create mobile applications for the industry’s most widely-used mobile devices, including Android-based smartphones and tablets, iPhone, iPad and iPod Touch.
    Sauce Labs
    Cloud-based automated testing platform enables developers and QEs to perform functional, JavaScript unit, and manual tests with Selenium or Appium on web and mobile apps. Videos and screenshots for easy debugging. Secure and CI-ready.
    See all alternatives