A leading point-of-sale payment platform for retailers and consumers across the North American region has exceptional user experience and seamless integration at the top of its business priorities. To deliver a glitch-free user journey on its platform, the client has Automation testing as an integral part of its Quality Assurance process. With Automation testing, its payment platform undergoes a double-check to see that it delivers on desired features and functionalities.
Centralized Automation Testing Dashboard for Better Visibility
One of the challenges with Automation Testing that the client faced was a lack of visibility into the automation testing progress. However, historical data storage for reporting and comparison was unavailable, and in the absence of data, building reporting and dashboarding capabilities was difficult. The manual efforts spent to pull metrics and manage them in spreadsheets were time-consuming and prone to errors.
The client approached Codvo to build a centralized dashboard to visualize automation testing progress.
Data-driven Decision Making & Scalability with Automation Testing
The solution developed by our team for the client included a Test Rail Container Service using Spring Boot, designed to connect with TestRail, a popular test management tool. The Test Rail Container Service built by our team pulled expected metrics from TestRail and exposed endpoints to be scrapped. The team used Prometheus, a powerful and popular time-series database, to pull data from the endpoints exposed by the Test Rail container service.
Using Prometheus, the data was then persisted and visualized in Grafana, a leading open-source platform for data visualization and monitoring. The resulting automation testing dashboard provides a real-time view of automation testing progress, including metrics such as devices/desktop automation coverage, manual vs. automation coverage, and progress toward automation goals.
With the new automation dashboard in place, the client has
The tech stack used: Java, spring boot, Jenkins, JIRA, Confluence, Rest Assured, TestRail, Prometheus, draw.io, AWS ECR, Gradle, Grafana, InfluxDB, Micrometer.
-Gained real-time visibility into automation testing progress through a centralized dashboard
-Enabled data-driven decision-making by visualizing critical testing metrics and trends
-Reduced manual effort and reporting time by eliminating spreadsheet-based tracking
-Achieved better stakeholder alignment with automated reporting and transparent progress updates
-Improved automation coverage tracking across devices and desktops, supporting strategic test planning
-Delivered a scalable, maintainable, and robust solution integrated with existing testing and DevOps tools