Quality control method for collaborative crowdsourcing testing

A quality control method and collaborative technology, applied in software testing/debugging, error detection/correction, instruments, etc., can solve problems affecting the reputation of crowdsourcing platforms, difficulty in identifying valid reports, and uneven quality of bug reports, etc., to achieve Increased quality awareness, high accuracy, and improved ratio effects

Inactive Publication Date: 2021-02-09
NANJING MUCE INFORMATION TECH
View PDF2 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the crowdsourcing workers participating in the task are independent and anonymous, which inevitably leads to the emergence of malicious crowdsourcing workers among the crowdsourcing workers.
For personal benefit, such workers submit invalid bug

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Quality control method for collaborative crowdsourcing testing
  • Quality control method for collaborative crowdsourcing testing
  • Quality control method for collaborative crowdsourcing testing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to further understand the technical content of the present invention, the working mode of the quality control system is explained as follows in conjunction with the accompanying drawings.

[0027] figure 1 It is the architecture diagram of the quality control system, which mainly includes front-end, Nginx, server, Redis and external services. Combining with this diagram, the flow of the quality control system is introduced as follows.

[0028] Step 1: The user first enters the front end of the public testing system, which is built by the Angular2 framework, Bootstrap provides a visualization library, Echarts generates a visual chart, jQuery operates DOM objects, and PNotify provides message notifications.

[0029] Step 2: When a user submits a bug report or performs other operations, the front-end request is first sent to the Nginx server, and Nginx, as a reverse proxy, distributes the front-end request to a single or clustered server and receives the server re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a cooperative crowdsourcing test oriented quality control method, and realizes a cooperative crowdsourcing test oriented quality control system on the basis of the cooperative crowdsourcing test oriented quality control method. The method is characterized in that 1, each operation of the crowdsourcing workers is evaluated and fed back in real time, so the quality awareness of the crowdsourcing workers is improved, and the disastrous behaviors of the crowdsourcing workers are recorded; 2, the quality grade of the report is determined through automatic scoring of the report, and a favorable reference is provided for managers to identify effective reports; and 3, a report auditing function is provided, so that a manager can conveniently check all information of the report and quickly and accurately auditing the report. The invention has the beneficial effects that the quality consciousness of crowdsourcing workers is improved through various designed quality controlmethods, the ratio of effective Bug reports in test tasks is improved, and managers are helped to identify the Bug reports and the quality of the crowdsourcing workers more quickly and accurately.

Description

technical field [0001] The present invention relates to a quality control method for collaborative crowdsourcing testing, and a quality control system for realizing the quality control method. The purpose is to study related technologies and methods of quality control, including Bug report quality assessment methods, information gain assessment methods, Worker behavior evaluation and feedback methods, manager report review methods, etc., implement a quality control system to ensure that collaborative crowdsourcing testing collects high-quality bug reports. Background technique [0002] The collaborative crowdsourcing testing platform aims to gather public wisdom for software testing. By providing collaborative and auditing methods for crowdsourcing workers, it reduces the professional requirements of crowdsourcing testing for crowdsourcing workers. At the same time, it can generate high-quality test results by aggregating bug reports. Improve the quality of bug reports and r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/36
CPCG06F11/3692G06F11/3696
Inventor 陈振宇宋少行韩鹏飞房春荣冯洋
Owner NANJING MUCE INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products