Pros of Karate DSL

• 11

  Easy CI integration via cross-platform executable / CLI
• 9

  Easy for even non-programmers to get started
• 9

  Simple and meaningful asserts for large responses
• 7

  Data-driven tests that can even use JSON or CSV sources
• 5

  Easy parameterized configuration / custom variables
• 5

  Very fast api testing tool
• 5

  Comprehensive documentation and examples
• 4

  Powerful and flexible payload assertions
• 4

  Simple, concise, readable and maintainable tests
• 4

  Easy re-use of JSON or JS / Java logic across tests
• 4

  IDE support - IntelliJ, Eclipse & Visual Studio Code
• 3

  Best option for testing GraphQL
• 3

  Java-interop so you never "hit a wall" in the framework
• 2

  Simple yet flexible Environment Switching built-in
• 1

  Optionally mix re-usable JavaScript logic into scripts
• 1

  Parallel Execution with Reports Aggregated
• 1

  Active, Responsive community on Stack Overflow
• 1

  Re-use functional tests as performance tests
• 1

  Super simple API mocking, within the firewall
• 1

  XML support, not just JSON
• 1

  Developer-friendly collaboration via standard SCM / Git
• 1

  Rich HTML reports with HTTP logs in-line
• 1

  Great Developer-Experience - Debug UI, HTML reports
• 1

  Websockets support
• 0

  Rest assured

Pros of Runscope

• 17

  Great features
• 15

  Easy to use
• 4

  Nicely priced
• 4

  Free plan
• 2

  No install needed - runs on cloud
• 2

  Decent
• 1

  Collections
• 1

  Dead simple and useful. Excellent
• 1

  Awesome customer support
• 1

  Import scripts from sources including Postman
• 1

  Shareable Collections
• 1

  Global & Collection level variables
• 1

  Graphical view of response times historically
• 1

  Integrations - StatusPage, PagerDuty, HipChat, Victorop
• 1

  Run tests from multiple locations across globe
• 1

  Schedule test collections to auto-run at intervals
• 1

  Auto Re-run failed scheduled tests before notifying
• 1

  Makes developing REST APIs easy
• 1

  History feature - call history and response history
• 1

  Restrict access by teams
• 1

  Fully featured without looking cluttered
• 1

  Can save and share scripts

Cons of Karate DSL

• 1

  Ode support becomes very time consuming and expensive b
• 1

  Finding errors in code is not easy
• 1

  There is no IntelliSense support in IDE
• 1

  Karate uses its own scripting language
• 1

  Complex folder structure, without a defined pattern
• 1

  Confusing report: Summarized by steps and not by featur

Cons of Runscope