Frequently Asked Questions

Selenium, Playwright, Puppeteer, Cypress, Appium, XCUITest, Espresso, and more. See the frameworks supported by Sauce Labs here, in addition to quickstart guides and sample code repos.

Sauce Labs runs different automation frameworks via saucectl, our test orchestration tool. Saucectl gives your team the flexibility to use the framework of your choice but test on one infrastructure.

Yes!

The right framework for your project depends on the kind of application you are working on. If you’re working on a web application, you’ll be using Selenium, Playwright, Puppeteer, or Cypress. If you're developing a mobile application, you will be using Appium, XCUI, or Espresso. Learn more in the blog post linked below.

Sauce Labs supports Appium, Espresso, and XCUITest frameworks for mobile app testing.

Selenium, Playwright, Puppeteer, TestCafe, Cucumber JS, and Cypress.

Yes, Sauce Labs integrates with the best tools for CI/CD.

Yes. You can run multiple live (manual) test sessions at the same time.

Sauce Labs supports the popular issue management and tracking tools you already love and work with.

Check out our product data sheets or our product docs.

Still have questions? Contact us here.

Our Android emulators and iOS simulators are a scalable, highly reliable, and economical way to run automated tests on your mobile apps early in the development process. We recommend using a mix of emulators, simulators, and real devices in your mobile testing to maximize your manual and automated testing efforts.

Sauce Labs supports thousands of combinations of browsers and operating systems, including the latest emulators and simulators, and the most extensive range iOS and Android devices.

Check out our best practices for how to choose mobile devices for testing, plus our recommended devices to test on by region and business size.

We provide access to real devices that will behave in a predictable and reliable way, and are not affected in any way by prior test sessions. Our real devices undergo a cleaning process after each test session. The device is reset to a default state, ready for the next test. The cleaning process also removes any private data which may have been part of the prior test. If we encounter any issues during the cleaning process, or we fail to clean the device, we put those devices aside for manual inspection to prevent data and security leaks.

To help mobile development teams quickly determine the root cause of errors in your code and test failures in the pipeline, the Sauce Real Device Cloud provides a comprehensive suite of diagnostic test information and quality signals. This includes error and crash reporting, API and network capture, device vitals, app interactions, and more.

Sauce Labs supports Appium, Espresso, and XCUITest frameworks for mobile app testing.

Yes. We offer an all-in one mobile beta testing solution for iOS and Android apps to help you manage app distribution, streamline development processes, create faster feedback loops, and enhance collaboration across different teams involved in mobile app quality.

Yes. Our mobile error reporting solution (Backtrace) helps you capture, prioritize, and resolve errors quickly. It's designed to automate the process of cross-platform crash and exception management so teams can focus on creating the best code and the best apps as quickly as possible.

Yes, you can run saucectl locally via Docker. Additionally, you can download our API mock server and bidirectional contract testing tool, Sauce Piestry, and instantly validate iterative code updates. With saucectl and Piestry, you can optimize quality engineering workflows as they build and test (frontend and backend) in parallel with no feedback delays. Seamless integration with Sauce Labs’ automation, low-code, AI/ML-driven insights and unified reporting tools on a collaborative DevX platform makes it easy to integrate and provision whatever you need to ensure quality at speed at any scale.

Yes. Sauce API Quality was built from the ground up for developer, mobile developer, and quality engineering workflows, including seamless collaboration with product and CX owners. Our power users build and test in a wide variety of development approaches that often shifts from project to project. To help support the flexibility and agility that modern teams require, Sauce API can auto-generate API tests as follows:

• Real device or virtual device mobile testing: Sauce Labs can use the .HAR files from Sauce mobile tests to instantly generate API functional tests that can easily be edited as needed and auto-updated in parallel with mobile tests.
• Postman collections, variables, and environments: Simply import Postman API Collections directly to Sauce API Quality to auto-generate tests for a project. Use the Vault to import and choose where to store Postman variables and environments.
• OpenAPI spec files: Choosing OpenAPI (OAS) spec files allows you to auto-generate API mocks, bidirectional contract tests and API functional tests (contract tests are defined as basic functional tests that check contracts between consumers and providers). Increasingly, users are auto-generating OpenAPI spec files from Postman Collections or API documentation using tools such as FastAPI (view this demo showing how easily you can go from docs to specs to contract tests).
• Other options: You may also record API traffic and generate functional tests from the API response with the help of a Sauce mock API server. Sauce API mocking can also be used to close microservices dependencies to eliminate feedback delays.

Sauce Labs does not currently offer a direct migration tool from Postman Collections to Sauce Labs test scripts. However, the nearly instant test auto-generation feature in Sauce Labs helps to significantly accelerate migrations. Further, Sauce Labs’ test automation consulting partners may help you make data-driven decisions about what really needs to be migrated and how to improve what you do migrate for improved test coverage, accuracy, efficiency, reliability and productivity. Sauce Insights helps to ensure that as you migrate API tests, you can quickly, easily understand patterns to ensure effective continuous improvement: understand which critical test cases may be better served by replacing with or adding API testing or other Sauce Labs solutions.

To accelerate iterative development without raising QA risk (i.e., breaking changes), development teams are increasingly adopting Test-driven Development (TDD or BDD, which is basically TDD documented in easy-to-understand language) that requires building/updating test cases prior to updating or hardening code. This approach really only works by automating API test automation to validate code updates before moving to the next step.

Sauce API offers two approaches to highly scalable API test automation:

• CI/CD pipeline integrations: Often includes integrations with a stack of Version Control Management (VCM) tools, PagerDuty or other issue management tools, test case management, model-based testing tools, API management platforms and more.
• Onboard scheduler: Some teams prefer to automate API tests via Sauce API, a single source of QA truth and test management–rather than depend on a CI/CD platform that may not provide non-flaky test results as teams continually update code throughout the lifecycle. High-performance teams use Sauce Insights to help them understand when it may make sense to use one or both methods for certain projects and test cases.

Faster, iterative development with shorter test sprints often decreases developer confidence and raises fears of small changes resulting in “breaking” an API or microservice. API testing teams are sometimes under pressure to reduce breaking changes and improve SLA performance. For these reasons, teams that excel at quality engineering and TDD/BDD approaches often reimagine API testing in terms of a living, continuously improving “helper” that is at your side throughout the lifecycle–continuous API mocking, testing, and monitoring.

In this white paper, A False Sense of Security: Why API Tests and Monitors Fail to Detect and Diagnose Many Bugs, explore five real customers who transformed SLA performance and increase release confidence by making simple changes to API testing with Sauce Labs to dramatically improve test coverage, reliability, productivity and debugging speeds. Essentially, frontend and backend automated test convergence plus unified reporting with AI/ML-driven insights are the three keys to continuous quality at speed. Sauce API’s seamless convergence with the Sauce Labs platform points to our full embrace of this modern approach to quality engineering.

Yes. Sauce API Quality users can mark variables as sensitive to obfuscate certain values in the UI and test reports. Users are restricted from editing a variable marked sensitive, and should delete and recreate the variable if necessary.

If your company has firewall rules that limit your ability to run tests on Sauce Labs, you can use our Sauce Connect Proxy feature to connect to Sauce Labs in the cloud without exposing your company's IT infrastructure to security risks. We offer your choice of setup types, from the Basic Sauce Connect Proxy Setup to the High Availability Sauce Connect Proxy Setup.

Sauce API is part of the Sauce Labs DevOps Test Toolchain and natively gives users built-in security and compliance of our SOC 2 Type II, ISO 27001, and ISO 27701 certification. With APIs identified by Gartner and many cybersecurity experts as the number one attack vector for cyber-criminals, it is critical to consider how API testing platforms utilize cloud proxying. Sauce Connect users gain the added confidence that they can achieve cloud scale with trusted tunnels for a simple proxy or multiple proxies.

Backtrace is a cross-platform crash and exception management tool that captures errors, bugs, crashes and exceptions from all runtime environments. With Backtrace integrated with your software or game development project, you can capture ANRs (Application not responding), OOMs (Out of memory) for iOS and Android, minidumps and full memory dumps across platforms.

Backtrace provides accurate callstacks and extracts memory and variable values when possible to get you to the root cause faster.

By using Backtrace, you can significantly reduce the average time to detect an issue and the average time to resolve an issue.

Backtrace supports all major programming languages, including C++, C#, Java, JS, PHP, Python/Python2/Python3/PyPy, Node.js. Additionally, Backtrace provides SDKs for game engines such as Unity, Unreal and O3DE.

Backtrace is currently the only error and crash reporting solution that is truly cross-platform with full support for consoles. Backtrace currently supports most major platforms including Windows, Mac, Linux, Web, Android, iOS, XBox, PS4, PS5, and Nintendo Switch.

Backtrace supports numerous third-party tools and plugins, connecting you to the tools you use throughout your software lifecycle. Everyday tools like Jira, Slack, Teams, Stride, Discord, Git, Perforce, Asana, Grafana, and others are supported.

With Jira, Backtrace provides two-way integration so that changes made on a Jira ticket in the Backtrace dashboard can be reflected in Jira and vice versa.

Additionally, you can use HTTP WebHooks to integrate other third-party plugins not already supported by Backtrace.

Backtrace takes security seriously and ships with a myriad of security and privacy features, meeting or exceeding requirements for GDPR, SOC-2 and and participates in the Privacy Shield program.

Sauce Labs provides a secure and scalable cloud computing platform for functional testing of web and mobile apps located in world-class data centers in North America and Europe and the Google Cloud Platform.

By providing both private and public cloud options our customers enjoy the security, scalability and efficiencies of choosing the option that best meets their own security and business requirements.

Yes. Sauce Labs is SOC 2 Type II certified. Please contact your account manager to initiate a request for this report or email Sauce Labs.

To ensure trust in its professional services, Sauce Labs has implemented a number of technical and organizational measures. This summary will provide an overview of what is being done at Sauce Labs to protect information as well as technical infrastructure.

Sauce Connect Proxy™ is a built-in HTTP proxy server that allows users to access Sauce Labs infrastructure from their local environment or behind a corporate firewall. This extra layer of security ensures that no sensitive data is exposed, and allows Sauce users to securely test their web and mobile applications.

Send us an email at support@saucelabs.com and let us know how we can help!

Our product docs, including quickstart guides, are here.

Yes! Check out our Developers page for quick links to everything you need to get started with automated testing or upskill your Sauce Labs knowledge.