Karma vs Sauce Labs vs Selenium

Need advice about which tool to choose?Ask the StackShare community!

Karma

2.5K
602
+ 1
181
Sauce Labs

313
434
+ 1
438
Selenium

15.4K
12.3K
+ 1
525
Advice on Karma, Sauce Labs, and Selenium

I am looking to purchase one of these tools for Mobile testing for my team. It should support Native, hybrid, and responsive app testing. It should also feature debugging, parallel execution, automation testing/easy integration with automation testing tools like Selenium, and the capability to provide availability of devices specifically for us to use at any time with good speed of performing all these activities.

I have already used Perfecto mobile, and Sauce Labs in my other projects before. I want to know how different or better is AWS Device farm in usage and how advantageous it would be for us to use it over other mentioned tools

See more
Replies (3)
Aaron Evans
Testing Strategist at One Shore · | 3 upvotes · 8.7K views

A SaaS offering like Sauce Labs (or BrowserStack or LambdaTest, etc) will provide a remote Selenium/Appium Grid including the ability to run test automation in parallel (up to the amount based your subscription level) an a wide array of browsers and mobile devices.

These tools can be expensive, but if you can afford them, the expertise and effort of maintaining the grid, browser updates, etc. is worth it.

AWS Device Farm can be significantly cheaper, but is much more work to setup and run. It will not give you as many devices, or the reporting and screen/video capture you get with the the services. And there is no support for AWS Device Farm, and very poor documentation. I have used it, but do not recommend it. Running your own grid and physical device lab is better, but I'd stick with a service like Sauce Labs or Perfecto which will save you time and give you better services despite the higher price tag.

See more
Recommends
on
BrowserStackBrowserStack

Stability - Just works. Availability - More than 15 datacenters. Enterprise features like SSO, local testing and SOC2/GDPR compliant.

See more
Jaymie Falconi
Recommends
on
BitBarBitBar

BitBar's Dedicated Devices would be a great option for you. It allows you to dedicate (reserve) devices for your use only which also having access to all of the devices in the shared cloud. BitBar has the features and integrations that you are looking for as well.

See more
Needs advice
on
JestJestSeleniumSelenium
and
WebdriverIOWebdriverIO
in

we are having one web application developed in Reacts.js. in the application, we have only 4 to 5 pages that we need to test. I am having experience in selenium with java. Please suggets which tool I should use. and why ............................ ............................ .............................

See more
Replies (1)
Prashanth Marappa
Senior Software Engineer at Mphasis · | 1 upvotes · 218K views
Recommends
on
SeleniumSelenium

with the help of selenium we can automate react js for functional testing

See more
Get Advice from developers at your company using StackShare Enterprise. Sign up for StackShare Enterprise.
Learn More
Pros of Karma
Pros of Sauce Labs
Pros of Selenium
  • 61
    Test Runner
  • 35
    Open source
  • 27
    Continuous Integration
  • 22
    Great for running tests
  • 18
    Test on Real Devices
  • 11
    Backed by google
  • 5
    Easy Debugging
  • 2
    Remote Control
  • 60
    Selenium-compatible
  • 46
    Webdriver compatible
  • 35
    Video recordings of every test
  • 31
    Qa
  • 29
    Mobile support
  • 26
    Any programming language
  • 23
    Developer tools
  • 21
    Test local and firewalled servers
  • 20
    Jenkins integration
  • 18
    Pristine VMs
  • 17
    CI Compatible
  • 11
    Appium support
  • 9
    Parallel testing
  • 8
    Rapid environment preparation
  • 8
    Mobile device support
  • 7
    Easy testing on almost any device
  • 7
    Allows me to Focus more test automation rather than IT
  • 6
    Secure testing and easy setup
  • 5
    Easy setup with CI and fast automated tests
  • 5
    Quick support response
  • 4
    Fast and reliable to host the automated tests
  • 4
    Easy to setup and understand,
  • 3
    Easy setup and integration with Travis Ci
  • 3
    Maintained browser matrix
  • 3
    Easy onboarding, do not need to manager VMs/OS/Browsers
  • 2
    Efficient tool to verify product quality
  • 2
    Teamcity Integration and mobile testing win
  • 2
    Hany for platform testing
  • 2
    Great documentation
  • 2
    Generous free trial
  • 2
    Easy. Straightforward. Scalable
  • 2
    Great way to integrate test suite on cloud
  • 2
    Simplicity of Sauce-connect
  • 1
    Very Good, Quick, flexible Infrastructure Support
  • 1
    It's great for my QA work
  • 1
    Awesome tech support
  • 1
    Having this available for CI servers is fantastic
  • 1
    Amazing service to do cloud cross browser testing
  • 1
    Depth of integrations
  • 1
    Because of its cloud based support for appium
  • 1
    Easy setup, Works great with selenium.
  • 1
    QE support
  • 1
    Manuals are not very well versed for beginners
  • 1
    Secure testing
  • 1
    Cheaper than browserstack
  • 1
    Stable
  • 0
    Simple to set up and integrate so many browser configs
  • 175
    Automates browsers
  • 154
    Testing
  • 101
    Essential tool for running test automation
  • 24
    Record-Playback
  • 24
    Remote Control
  • 8
    Data crawling
  • 7
    Supports end to end testing
  • 6
    Easy set up
  • 6
    Functional testing
  • 4
    The Most flexible monitoring system
  • 3
    End to End Testing
  • 3
    Easy to integrate with build tools
  • 2
    Comparing the performance selenium is faster than jasm
  • 2
    Record and playback
  • 2
    Compatible with Python
  • 2
    Easy to scale
  • 2
    Integration Tests
  • 0
    Integrated into Selenium-Jupiter framework

Sign up to add or upvote prosMake informed product decisions

Cons of Karma
Cons of Sauce Labs
Cons of Selenium
  • 1
    Slow, because tests are run in a real browser
  • 1
    Requires the use of hacks to find tests dynamically
  • 2
    Relatively slow
  • 2
    Expensive
  • 8
    Flaky tests
  • 4
    Slow as needs to make browser (even with no gui)
  • 2
    Update browser drivers

Sign up to add or upvote consMake informed product decisions

- No public GitHub repository available -

What is Karma?

Karma is not a testing framework, nor an assertion library. Karma just launches a HTTP server, and generates the test runner HTML file you probably already know from your favourite testing framework. So for testing purposes you can use pretty much anything you like.

What is Sauce Labs?

Cloud-based automated testing platform enables developers and QEs to perform functional, JavaScript unit, and manual tests with Selenium or Appium on web and mobile apps. Videos and screenshots for easy debugging. Secure and CI-ready.

What is Selenium?

Selenium automates browsers. That's it! What you do with that power is entirely up to you. Primarily, it is for automating web applications for testing purposes, but is certainly not limited to just that. Boring web-based administration tasks can (and should!) also be automated as well.

Need advice about which tool to choose?Ask the StackShare community!

What companies use Karma?
What companies use Sauce Labs?
What companies use Selenium?

Sign up to get full access to all the companiesMake informed product decisions

What tools integrate with Karma?
What tools integrate with Sauce Labs?
What tools integrate with Selenium?

Sign up to get full access to all the tool integrationsMake informed product decisions

Blog Posts

What are some alternatives to Karma, Sauce Labs, and Selenium?
Jasmine
Jasmine is a Behavior Driven Development testing framework for JavaScript. It does not rely on browsers, DOM, or any JavaScript framework. Thus it's suited for websites, Node.js projects, or anywhere that JavaScript can run.
Jest
Jest provides you with multiple layers on top of Jasmine.
Mocha
Mocha is a feature-rich JavaScript test framework running on node.js and the browser, making asynchronous testing simple and fun. Mocha tests run serially, allowing for flexible and accurate reporting, while mapping uncaught exceptions to the correct test cases.
Protractor
Protractor is an end-to-end test framework for Angular and AngularJS applications. Protractor runs tests against your application running in a real browser, interacting with it as a user would.
JavaScript
JavaScript is most known as the scripting language for Web pages, but used in many non-browser environments as well such as node.js or Apache CouchDB. It is a prototype-based, multi-paradigm scripting language that is dynamic,and supports object-oriented, imperative, and functional programming styles.
See all alternatives