Screen Content and Mouse Event Recording for Software Bug Reproduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Software testers face challenges in effectively communicating and reproducing bugs in complex application software, particularly game applications, due to intricate operation steps and geographical limitations, leading to reduced development efficiency and increased communication costs.
Innovation Solution
A content recording method and device that captures screen content and mouse/keyboard events during software development, processing them to generate a playable file that comprehensively records and illustrates the development process, enabling clear understanding and improved efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If bug descriptions are provided in words and speech, then communication can be established, but the developer cannot accurately and quickly understand what actually happened
Solution Approach 1:
The patent creates a playable file that is a copy of the actual software execution process, capturing screen content, mouse events, and keyboard events. This copy allows developers to directly observe and understand the bug reproduction process without relying on verbal or written descriptions, thereby reducing information loss and understanding time.
2Productivity
If the same bug is not recursed regularly by executing operation steps, then development efficiency is reduced, but requiring recurrence presentation increases communication requirements
Solution Approach 1:
The system automatically creates a playable file that copies the exact sequence of operations and screen states that led to the bug. This eliminates the need for manual recurrence presentations and ensures consistent bug reproduction, thereby improving development efficiency without adding complexity.
Solution Approach 2:
The system automatically captures and processes screen content along with mouse and keyboard events to generate the playable file without requiring additional manual intervention. This self-service approach improves efficiency while maintaining simplicity.
3Loss of information
If bug demonstration is required at the development site, then accurate understanding is achieved, but geographical restrictions make this impossible for outsourcing test tasks
Solution Approach 1:
The patent creates a playable file that captures the complete bug reproduction process including screen content and user interactions. This copy can be transmitted electronically to developers at any location, eliminating the need for physical presence at the development site while maintaining full clarity of bug description.
Solution Approach 2:
The playable file acts as an intermediary that carries the complete bug reproduction information between tester and developer, eliminating the need for direct geographical interaction while ensuring accurate information transfer.
4Loss of information
If comprehensive bug description is provided, then developer understanding is improved, but communication costs increase for outsourcing tasks
Solution Approach 1:
The system automatically generates a playable file that comprehensively captures all relevant information including screen content, mouse events, keyboard events, and timing data. This comprehensive copy can be transmitted once to the developer, eliminating the need for multiple communication iterations and reducing overall communication costs while maintaining complete information.
Data Source
AI summary
Disclosed are a content recording method and device, for use in software development. The method includes: capturing the content displayed on a screen in the software development process; acquiring a mouse event related to the content displayed on the screen; and processing the mouse event and the content displayed on the screen to obtain the recorded content, the recorded content containing the content displayed on the screen and the mouse event. The technical solution can record a screen capture and a mouse/keyboard operation related thereto in the software test development process, thus effectively recording the test and development process, and improving test and development efficiency.