Case studies

Codvo's Automation Testing Dashboard Empowers Payments Leaders

About the client

A leading point-of-sale payment platform for retailers and consumers across the North American region has exceptional user experience and seamless integration at the top of its business priorities.

To deliver a glitch-free user journey on its platform, the client has Automation testing as an integral part of its Quality Assurance process. With Automation testing, its payment platform undergoes a double-check to see that it delivers on desired features and functionalities. 

Overview

Automation testing played a critical role in ensuring the robustness and effectiveness of the client's payment platform. However, the absence of a centralized automation dashboard presented significant challenges. Without a unified view of automation progress and historical data for reporting and comparison, the client's testing process was hindered by time-consuming manual efforts and an increased risk of errors.

Business Challenge

Centralized Automation Testing Dashboard for Better Visibility

One of the challenges with Automation Testing that the client faced was a lack of visibility into the automation testing progress. However, historical data storage for reporting and comparison was unavailable, and in the absence of data, building reporting and dashboarding capabilities was difficult. The manual efforts spent to pull metrics and manage them in spreadsheets were time-consuming and prone to errors. 

 

The client approached Codvo to build a centralized dashboard to visualize automation testing progress. 

Our Approach and Solution

Data-driven Decision Making & Scalability with Automation Testing

The solution developed by our team for the client included a Test Rail Container Service using Spring Boot, designed to connect with TestRail, a popular test management tool. The Test Rail Container Service built by our team pulled expected metrics from TestRail and exposed endpoints to be scrapped. The team used Prometheus, a powerful and popular time-series database, to pull data from the endpoints exposed by the Test Rail container service. 

 

Using Prometheus, the data was then persisted and visualized in Grafana, a leading open-source platform for data visualization and monitoring. The resulting automation testing dashboard provides a real-time view of automation testing progress, including metrics such as devices/desktop automation coverage, manual vs. automation coverage, and progress toward automation goals. 

With the new automation dashboard in place, the client has

  • Access to a centralized and comprehensive view of automation progress in real-time.
  • The ability to make data-driven decisions and identify issues in their testing process.
  • Effective client communication in place to keep stakeholders and decision-makers abreast.
  • A robust, scalable, and effective solution for automation testing to address key business challenges.

Tech Stack

The tech stack used: Java, spring boot, Jenkins, JIRA, Confluence, Rest Assured, TestRail, Prometheus, draw.io, AWS ECR, Gradle, Grafana, InfluxDB, Micrometer.

Highlights

Business Impact

Increased Efficiency and Productivity in Automation Testing

The implementation of the centralized automation dashboard brought significant benefits to the client. It eliminated the manual efforts required to pull metrics, saving time and reducing errors. As mentioned above, the dashboard provides real-time visibility into automation testing progress and enables the organization to identify areas for improvement. The historical data stored in the database allows for comparison and trend analysis, providing insights for decision-making. 

 

With the implementation of the automation testing dashboard, the number of testing issues in a quarter came down by 66%, and the client was able to increase efficiency and productivity in their testing process.