Indeed, a global market leader in job boards and recruiting, connects millions of job seekers with employers across 60+ countries. With over 350 million monthly visitors and 3.5 million employers, Indeed is committed to delivering exceptional digital experiences that foster user satisfaction and enhance their platform's value.
Each positive interaction — whether a job poster publishes a role, a job seeker lands their dream job, or a recruiter fills a position — has a profound impact on individuals and businesses alike. This not only transforms the lives of the job seeker, but also drives the growth and competitiveness of small and mid-sized businesses (SMBs) and global enterprises.
Yet Indeed delivers its trusted digital experiences without a dedicated QA test group. Developers own much of their pre and post-release risk, overseeing a dev-test strategy with high automation and simplification across the SDLC. This approach has accelerated innovation, strengthened team collaboration, and enhanced DevEx. Indeed consistently ships iterative releases on schedule, making them highly responsive to the market with consistent quality at speed.
“Sauce Labs provides us with scalable testing capabilities, removing a major blocker to expanded testing.”
David Morgenthaler
Challenge
The launch of Indeed Flex, a product designed for the dynamic post-pandemic job market, faced challenges due to its need for fast and frequent updates. Traditional testing practices could not keep up, leading to quality bottlenecks, including repetitive manual testing, delayed feedback, and complex remediation. To overcome these, Indeed needed to reimagine their testing pyramid to increase innovation speed while ensuring good DevEx.
Solution: Quality Transformation
Indeed’s first step was to embrace iterative development by optimizing CI/CD pipelines. In close partnership with Sauce Labs, they accelerated their journey with four iterative testing strategies, including:
Atomic Testing: Indeed simplified and improved the stability of black box and compatibility testing by authoring atomic tests (for single functions) that are quick and easy to automate, maintain and refactor.
Parallel Testing: Indeed achieved massive improvements in test velocity and efficiency by running atomic tests in parallel with high concurrency. This gave developers more time to focus on user delight, experimental testing, and expanding test coverage for greater release confidence and risk management.
Shift-left/right Feedback: Indeed adopted continuous testing to give developers fast and early feedback, as well as late feedback in production environments to capture escaped issues.
Continuous Quality Platform: Indeed consolidated their virtual and real device test infrastructure along with Sauce Insights, ensuring a unified approach to testing, debugging, monitoring, analytics, and continuous improvement across different teams using different toolchains.
Mobile Testing Strategy
With Sauce Labs, Indeed has revamped its mobile strategy to better cater to their mobile users (who have surpassed total web users) with far more complex functional, integration, and compliance test cases. Indeed did this by implementing automated testing in more granular pipelines. Now, Indeed can segment a single project across multiple pipelines and geos, making it much more efficient for developers to handle frequent backend updates and reduce the risk of a cascading failure (crash).
Indeed further minimizes risk by making use of feature flagging across both frontend and backend updates. Developers are able to proactively remediate issues early, which minimizes rollbacks and feeds machine learning to predict failure patterns. This not only streamlines the process of continuous improvement but also ensures a consistent mobile experience.
Results
“Sauce Labs has helped us take a massively data-driven approach to quality in our CI/CD pipelines, giving us good DevEx and the confidence to ship faster. It took about half a year with our new test pyramid and Sauce Labs to regain valuable hours, which we used to extend our test suite and double our unit test coverage and also significantly expand black box coverage. Adding Sauce to our CI/CD pipelines has been key for growth and to predictively deliver new functionality to our customers.”
Maxim Stognev
By adopting a continuous quality strategy, Indeed has gained a deeper understanding of their users. Through a comprehensive diagnostic suite, they gather feedback about user scenarios such as authentication flows, network throttling, and more.
Indeed's continuous quality strategy is only as effective as the engineering team's ability to pull signals from the noise of countless test, error, and crash reports. Their expertise and dedication are crucial to the success of this strategy.
Here, Sauce Labs machine learning-driven Failure Analysis comes into play, drilling through the noise to provide a detailed description of failure patterns. This valuable insight enables Indeed's teams to better collaborate on improvements, driving success in iterative development and CI/CD pipelines.
With consistent YoY growth, surpassing $500 million in annual revenues and a 24% growth rate, Indeed continues to deliver quality digital experiences and maintain a highly trusted reputation among job seekers, employers, and partners.
This strategic transformation has empowered Indeed to continuously innovate and deliver exceptional quality experiences, reinforcing their position as a leader in the job market industry.
