Need advice about which tool to choose?Ask the StackShare community!
Amazon EC2 Container Service vs Sauce Labs: What are the differences?
Amazon EC2 Container Service: Container management service that supports Docker containers. Amazon EC2 Container Service lets you launch and stop container-enabled applications with simple API calls, allows you to query the state of your cluster from a centralized service, and gives you access to many familiar Amazon EC2 features like security groups, EBS volumes and IAM roles; Sauce Labs: Test mobile or web apps instantly across 700+ browser/OS/device platform combinations - without infrastructure setup. Cloud-based automated testing platform enables developers and QEs to perform functional, JavaScript unit, and manual tests with Selenium or Appium on web and mobile apps. Videos and screenshots for easy debugging. Secure and CI-ready.
Amazon EC2 Container Service and Sauce Labs are primarily classified as "Containers as a Service" and "Browser Testing" tools respectively.
Some of the features offered by Amazon EC2 Container Service are:
- Docker Compatibility
- Managed Clusters
- Programmatic Control
On the other hand, Sauce Labs provides the following key features:
- 700+ browser/OS/device combinations for cross-browser and platform testing to improve web and mobile app quality and eliminate the overhead of internal infrastructure
- Highly reliable, on-demand cloud for enterprise-grade scalability and industry standard security
- Optimized for popular testing frameworks, CI systems, and surrounding tools and services
"Backed by amazon" is the primary reason why developers consider Amazon EC2 Container Service over the competitors, whereas "Selenium-compatible" was stated as the key factor in picking Sauce Labs.
Instacart, PedidosYa, and Clever are some of the popular companies that use Amazon EC2 Container Service, whereas Sauce Labs is used by Lyft, Salesforce, and Sentry. Amazon EC2 Container Service has a broader approval, being mentioned in 784 company stacks & 374 developers stacks; compared to Sauce Labs, which is listed in 66 company stacks and 11 developer stacks.
I am looking to purchase one of these tools for Mobile testing for my team. It should support Native, hybrid, and responsive app testing. It should also feature debugging, parallel execution, automation testing/easy integration with automation testing tools like Selenium, and the capability to provide availability of devices specifically for us to use at any time with good speed of performing all these activities.
I have already used Perfecto mobile, and Sauce Labs in my other projects before. I want to know how different or better is AWS Device farm in usage and how advantageous it would be for us to use it over other mentioned tools
A SaaS offering like Sauce Labs (or BrowserStack or LambdaTest, etc) will provide a remote Selenium/Appium Grid including the ability to run test automation in parallel (up to the amount based your subscription level) an a wide array of browsers and mobile devices.
These tools can be expensive, but if you can afford them, the expertise and effort of maintaining the grid, browser updates, etc. is worth it.
AWS Device Farm can be significantly cheaper, but is much more work to setup and run. It will not give you as many devices, or the reporting and screen/video capture you get with the the services. And there is no support for AWS Device Farm, and very poor documentation. I have used it, but do not recommend it. Running your own grid and physical device lab is better, but I'd stick with a service like Sauce Labs or Perfecto which will save you time and give you better services despite the higher price tag.
Stability - Just works. Availability - More than 15 datacenters. Enterprise features like SSO, local testing and SOC2/GDPR compliant.
BitBar's Dedicated Devices would be a great option for you. It allows you to dedicate (reserve) devices for your use only which also having access to all of the devices in the shared cloud. BitBar has the features and integrations that you are looking for as well.
If you want to integrate your cluster and control end to end your pipeline with AWS tools like ECR and Code Pipeline your best option is ECS using a EC2 instance. There are pros and cons but it's easier to integrate using cloud formation templates and visual UI for approvals, etc. ECS is free, you need to pay only for the EC2 instance but unfortunately, it is not standard then you cannot use standard tools to see and manage your Kubernetes. EKS in the other hand uses standard Kubernates definitions but you need to pay for the service and also for the EC2 instance(s) you have in your cluster.
Pros of Amazon EC2 Container Service
- Backed by amazon100
- Familiar to ec272
- Cluster based53
- Simple API42
- Iam roles26
- Scheduler7
- Cluster management7
- Programmatic Control7
- Container-enabled applications4
- Socker support4
- No additional cost2
- Easy to use and cheap1
Pros of Sauce Labs
- Selenium-compatible60
- Webdriver compatible46
- Video recordings of every test35
- Qa31
- Mobile support29
- Any programming language26
- Developer tools23
- Test local and firewalled servers21
- Jenkins integration20
- Pristine VMs18
- CI Compatible17
- Appium support11
- Parallel testing9
- Rapid environment preparation8
- Mobile device support8
- Easy testing on almost any device7
- Allows me to Focus more test automation rather than IT7
- Secure testing and easy setup6
- Easy setup with CI and fast automated tests5
- Quick support response5
- Fast and reliable to host the automated tests4
- Easy to setup and understand,4
- Easy setup and integration with Travis Ci3
- Maintained browser matrix3
- Easy onboarding, do not need to manager VMs/OS/Browsers3
- Efficient tool to verify product quality2
- Teamcity Integration and mobile testing win2
- Hany for platform testing2
- Great documentation2
- Generous free trial2
- Easy. Straightforward. Scalable2
- Great way to integrate test suite on cloud2
- Simplicity of Sauce-connect2
- Very Good, Quick, flexible Infrastructure Support1
- It's great for my QA work1
- Awesome tech support1
- Having this available for CI servers is fantastic1
- Amazing service to do cloud cross browser testing1
- Depth of integrations1
- Because of its cloud based support for appium1
- Easy setup, Works great with selenium.1
- QE support1
- Manuals are not very well versed for beginners1
- Secure testing1
- Cheaper than browserstack1
- Stable1
- Simple to set up and integrate so many browser configs0
Sign up to add or upvote prosMake informed product decisions
Cons of Amazon EC2 Container Service
Cons of Sauce Labs
- Relatively slow2
- Expensive2