- Home
- Case Studies
- QA for AI powered Media Marketplace
Jul 04, 2023 3 min read
QA for AI powered Media Marketplace
Platforms:
WebCountry:
SingaporeImplementation time:
Aug 2021 – Present
Subscribe to Our Newsletter
Stay tuned for useful articles, cases and exclusive offers from Luxe Quality!
about company
Vidiverse is one of the leading worldwide Microstock marketplaces for video makers internationally. The vibrant marketplace offers everything from stock videos, music, 3D models, After Effects, and Apple Motion templates bundled with transparent, royalty-free licensing.
For this project, Luxe Quality provided skilled Backend QA, Manual QA, and Automation QA / Team Lead. We strived to achieve maximum test coverage through automated testing, which was crucial in verifying the software system's functionality, performance, and reliability. By aiming for complete test coverage, we ensured that all critical scenarios and edge cases were thoroughly tested, reducing the risk of potential issues or regressions.
before
When we started working on this project, there were nearly 100 E2E tests, which took 1 hour to execute, and 200 Postman + Newman smoke tests for implementing API tests. There was no documentation on the project, and the test coverage was unknown.
Our task was to update the backend and frontend test frameworks for the client's project.
challenges and solutions
Challenges | Solutions |
|---|---|
Unknown coverage: probably less than 10% | Developed 2000 E2E automation tests with Allure reports, achieving almost 90% functionality test coverage |
Execution time: nearly 100 E2E tests took 1 hour to execute | Optimized tests and created standard methods, reducing the test execution time to approximately 30 minutes. Even though the number of cases has increased significantly |
Diverse testing requirements: needed to test front and backend | Utilized specific tools and methodologies, such as Postman and Runscope (BlazeMeter), to conduct API and contract testing for the backend. Developed test plans and checklists for frontend testing. Employed a combination of manual and automated testing to cover all testing requirements. Manual Testing: Functional, Usability, Accessibility, Regression, Security, E2E. AutomationTesting: Functional, |
No documentation | Created specific level test plans, checklists, and more than 1000 bug reports to document the testing process. Also, set up reporting after tests |
Unclear test results without a reporting system | Implemented a reporting system to generate clear and concise test reports. Test results were documented and shared with the project manager to inform them of progress and enable better decision-making |
Ensuring continuous improvement and adherence to standards | Introduced testing standards and best practices, such as Code freeze for release stability and standardized bug reporting. Conducted regular assessments and evaluations of the testing process to identify areas for improvement. Implemented state monitoring and focused on continuous learning and development within the QA team |
technologies, tools, approaches
The project utilized various technologies, including Webdriver.io, Postman, Burp Suite, Runscope, GitHub Actions, Allure Reporter, OpenAPI, CIrcleCI, AWS S3, GTM, Qase, and Jira. We also established Code Freeze for Release Stability, Standards for Bug Reports, and Testing Standards and focused on continuous improvement.
The implementation of these practices has had a positive impact on various aspects of application quality and user experience. Code freezes have provided a stable foundation for releases, reducing the risk of introducing new issues and ensuring excellent stability.
features of the project
The involvement of QA Engineers in requirements and development was a critical aspect of the project. Another significant aspect was the complete migration to a new backend and frontend framework. For this project, we also implemented TestOps.
results
- Migration to the latest technologies went smoothly and seamlessly. Users reported minimal issues on production. Any arising problems were mainly related to some extra or individual cases. The customer's requirements were effectively fulfilled, and the project received ongoing support.
- We had 2200 TMS test cases throughout our active collaboration covering all application roles. These cases were accompanied by 2000 E2E tests with an Allure report, deployed on the server, and saved in history. Test execution now takes nearly 30 min. We also have 1700 E2E API tests with contract testing.
- Code freezes provide a stable foundation for releases, minimizing the risk of introducing new issues. Implementing standardized bug reports improved communication between testers and developers, leading to faster bug resolution.
Adherence to testing standards facilitated a comprehensive and consistent approach to testing, ultimately enhancing the overall software quality. We implemented the best practices of QA to this project for testing and decreasing development risks. The application was successfully released.
Implementation Steps
1. User Stories Testing
2. Communication with Developers and Preparing Test Data
3. Develop a Proof of Concept (POC) and Present it to the Client and Stakeholders
4. Migrate to a New Testing Framework
5. Writing the First 300 Tests for the Highest-Priority Functionality
6. Generate a Report on the Coverage Achieved by Manual and Automated Tests
7. Performing Various Types of Testing with the Functionality That Was Developed
- Functional Testing
- Non-Functional Testing, such as Security, Usability, and Accessibility Testing
- Black-Box Testing and White-Box Testing,
- Acceptance and Regression Testing
- End-to-End (E2E) Testing,
- API Testing,
- Automation Testing
SEO Checks: Evaluating the application's adherence to search engine optimization best practices to improve its visibility and ranking in search engine results.
Our team helped ensure the system functions correctly, met requirements, performed well, and provided a secure and user-friendly experience. Once the setup was completed, we conducted re-tests and regression testing every sprint (2 weeks). Additionally, we provided testing reports to the project manager to keep them informed of our progress.
client's feedback
To read the client's review for this project, click here.
- Manual testing
- Regression testing
- Functional testing
- Automation testing
- Usability testing
- Accessibility testing
- Security testing
- API testing
Other Projects
READ MORE
DepreciMax
Australia
•Web
Implementation time:
Apr 2022 - present
About project:
The project allows for detailed modeling of fixed asset depreciation and lease calculation rules for accounting and tax.
Services:
Manual - Regression, Smoke, Functional, Integration testing, Usability, UI/UX testing
Automation testing
Result:
750+ test cases, 450 of which are automated, 80% of functionality is covered by automationFULL CASE STUDY
.png)
Interlink
United Kingdom
•Web, Mobile
Implementation time:
Sept 2022 - Nov 2023
About project:
Interlink solutions are designed to enhance website performance and user experience and implement advanced tools to drive efficiency and business growth.
Services:
Manual, Functional, Integration, Regression, Smoke testing
Automated, Security, Performance, Load testing
Result:
500+ manual tests were created, 300+ test cases were automated, and 150 bug reports were generatedFULL CASE STUDY
Lernix Assistant
USA
•Web
Implementation time:
Sept 2023 – May 2024
About project:
Lernix Assistant is actively integrating chatbots into the website of a network of public schools.
Services:
Manual, UI/UX, Localization, Compatibility testing
Automation, Regression, Integration, Security, Functional testing
Result:
Тhe 70% covered by auto teats, 300+ test cases automated, 250+ bug reports created.FULL CASE STUDY