64results about How to "Improve annotation quality" patented technology

The invention discloses a data annotation management method and device, electronic equipment and a readable storage medium. The method comprises the steps: obtaining a reference annotation data set according to to-be-annotated data corresponding to a to-be-annotated task and historical annotation behavior data corresponding to a target annotator; obtaining a first annotation result of the target annotator for the evaluation annotation data and first reference annotation data distributed in the evaluation annotation data, the evaluation annotation data being a part of the to-be-annotated data and having a correct annotation answer, and the first reference annotation data belonging to a reference annotation data set; If the accuracy corresponding to the first annotation result is greater than or equal to a preset accuracy threshold, determining whether to allow the target annotator to continue to execute the to-be-annotated task or not according to a second annotation result of the target annotator for second reference annotation data already distributed in the to-be-annotated data, the second reference annotation data belonging to a reference annotation data set. According to the embodiment of the invention, the quality and efficiency of data annotation can be improved.

The embodiment of the invention also provides a marking method of images, a marking apparatus of images, marking equipment of images, and a storage medium. The marking method of images includes the steps: acquiring a plurality of images to be marked for types, and dividing the images into a plurality of sections; allocating each section of divided images to at least two markers; for each section of divided images, acquiring marking result data of the at least two markers; for each image in each section of images, comparing whether the pre-marked type of the image is the same in the marking result data of the at least two markers, and determining the quantity of images with the same pre-marked type in the marking result data of the at least two markers in each section of images; and for each section of divided images, based on the proportion relation between the determined quantity of the images with the same pre-marked type and the total quantity of the section of images, determining the marked type of the images in the section of images. The marking method of images can improve the marking quality of the marking type of images.

The invention relates to an image labeling method and device, an electronic device and a storage medium. The method comprises: recognizing at least one set of collected to-be-labeled images, determining an image area where a target object is located in the at least one set of to-be-labeled images, each set of to-be-labeled images comprising at least two images, and the indication states of the target object in the at least two images being different; and according to the image area where the target object is located, determining labeling information of at least one group of to-be-labeled images. According to the embodiment of the invention, efficient and automatic labeling images of the image can be realized.

The invention discloses a semi-automatic word segmentation corpus labeling and training device, which aims to overcome the defects of the corpora used during the word segmentation corpus labeling and training process. The device of the invention is realized through the following technical schemes of using a text corpus annotation preparation module for managing the to-be-annotated corpora and the segmented word corpora; based on a plurality of word segmentation algorithms, such as the bidirectional maximum matching word segmentation based on an integrated dictionary, CRF, JIEBA, etc., submitting the word segmentation annotation work of the raw corpus to a semi-automatic corpus word segmentation annotation module; creating the segmented word tagging tasks, selecting a labeling applicable algorithm model, carrying out the automatic annotations, on the basis of automatic labeling result fusion, feeding back a training model corpus and a labeling model generated by the text corpus labeling preparation module to the feedback model learning training module; selecting and carrying out model learning training, calling a unified training model interface to generate a core dictionary, updating a word segmentation training model table, establishing a labeling algorithm comprehensive evaluation model to evaluate a model labeling effect, so that a new word segmentation labeling task is completed.

The invention discloses a point cloud entity labeling system, method and device, a point cloud entity labeling task setting method and device and electronic equipment. The point cloud entity labelingmethod comprises the following steps: displaying a three-dimensional scene graph corresponding to point cloud data to be labeled; determining two-dimensional bounding box information of a target entity in the three-dimensional scene graph; determining point cloud data corresponding to the target entity according to the two-dimensional bounding box; determining entity type information of the targetentity; and marking the point cloud data corresponding to the target entity as the entity type information. With application of the processing mode, labeling personnel only need to frame the target entity through the two-dimensional bounding box at a certain view angle of the three-dimensional scene graph, the system can automatically analyze the point cloud position which the two-dimensional bounding box hopes to frame, and the labeling personnel are automatically helped to locate the point cloud data corresponding to the target entity. Therefore, the point cloud entity labeling efficiency can be effectively improved, and the point cloud entity labeling quality can be effectively improved.

The invention discloses a data processing method. The data processing method comprises the steps of collecting data; and performing automatic tagging on the data. According to the data processing method, the collected data is automatically tagged, so that automatic data processing is realized, the manpower cost is reduced, and the tagging quality is high. In addition, the invention discloses a data processing apparatus and a computer readable storage medium.

The invention provides a data labeling method and device and data processing equipment, and the method comprises the steps: carrying out the at least one iteration processing of a classification model, so as to enable the accuracy of the classification model to meet a preset condition; and processing at least one part of the plurality of pieces of to-be-labeled data by utilizing the obtained classification model to obtain an automatic labeling result, wherein each iterative processing comprises the following steps of: respectively inputting other to-be-labeled data, except a target data set, in a plurality of pieces of to-be-labeled data into the classification model to obtain a classification result; selecting at least part of the to-be-labeled data of which the confidence coefficient ofthe classification result is within a preset range from the other to-be-labeled data, and adding the selected to-be-labeled data into a target data set; and training a classification module accordingto the manual labeling result of the to-be-annotated data in the target data set. Therefore, automatic labeling of batch data can be realized under the condition of improving the data labeling quality.

The embodiment of the invention discloses a region labeling method, device and equipment in the field of artificial intelligence and a storage medium. The method comprises the steps: acquiring N labeling points labeled for the boundary of a coverage region of a target curved text; determining four corner points of a to-be-labeled target curved region in the N labeling points; according to the fourcorner points, selecting marking points used for fitting a first curve from the N marking points to form a first marking point set, selecting marking points used for fitting a second curve from the Nmarking points to form a second marking point set, wherein the first curve and the second curve are two curve boundaries opposite to the target curved area; fitting a first curve according to the marking points in the first marking point set, and fitting a second curve according to the marking points in the second marking point set; and constructing a target curved region based on the first curveand the second curve. According to the method, the annotation quality of the curved text annotation area can be improved, and the annotation time cost can be reduced.

The invention relates to a power grid image intelligent annotation crowdsourcing platform and a working method, and belongs to the technical field of power grid image data processing. The working method comprises the following steps: collecting to-be-annotated picture collection, performing initial annotation, performing manual adjustment annotation, performing difference re-annotation and data storage. The power grid image intelligent annotation crowdsourcing platform comprises a to-be-annotated image collection module, an initial annotation module, a manual adjustment annotation module, a difference re-annotation module and a data storage module, and is used for executing the power grid image intelligent annotation crowdsourcing platform working method. According to the invention, the preset model is used to carry out initial annotation on the data; meanwhile, platform crowdsourcing is used for manually adjusting annotation; multi-person cooperation is achieved, the annotation efficiency is improved, the unqualified annotation result is modified according to IOU parameters, the annotation quality is effectively improved, meanwhile, the data classification and arrangement functionmeets the requirement for specific model training for a certain hidden danger, and powerful data support is provided for model training and model precision improvement in the future.

The embodiment of the invention provides a three-dimensional information processing method and device. The method comprises the steps of obtaining target image data for a target three-dimensional object; determining target two-dimensional projection information of the target three-dimensional object in the target image data; and obtaining target three-dimensional information of the target three-dimensional object according to the target two-dimensional projection information. According to the embodiment of the invention, the optimization of three-dimensional information labeling is realized, the three-dimensional information is obtained based on the two-dimensional information of the three-dimensional object, the dependence on a laser radar is avoided, and the labeling efficiency and quality of the three-dimensional information are improved.

The embodiment of the invention provides a video target labeling method and device and electronic equipment, and belongs to the technical field of data processing, and the method comprises the steps:obtaining a first labeling box formed for a first type of key frames in a target video; training a target detection module and a target tracking module for executing a labeling function based on the first type of key frames and the first labeling box after whether the number and quality of the first type of key frames meet preset requirements or not; the trained target detection module and the target tracking module are utilized to perform annotation operation on the remaining first type of key frames which are not annotated, and a second annotation box and a third annotation box are generated; after the second annotation box and the third annotation box are confirmed, marking the second annotation box and the third annotation box as a first annotation box again. Through the processing scheme of the invention, the labeling efficiency of the video target can be improved.

The invention discloses an automatic voice data labeling method and system for voice recognition, and particularly relates to the field of voice recognition. The system comprises a mute detection module, a volume screening module, a length screening module, a voice recognition module, a recognition result judgment module and a manual proofreading module, the mute detection module splits each voiceinto a plurality of voice segments through a mute detection algorithm, and the volume screening module is used for screening out voices meeting the requirements through a volume threshold value and removing voices not meeting the requirements. The invention discloses a combined system of multiple modules. According to the system, speech preprocessing and speech recognition are carried out, by a public cloud mode, recognition result judgment manual proofreading are carried out, voice data annotation is constructed, after multiple times of iteration of the processes, a new corpus is continuously trained, high-quality corpus data is obtained, manpower is reduced, the voice data annotation quality is improved, and the problems that the manual annotation period is long, the cost is high and the efficiency is low are solved.

The embodiment of the invention discloses a data screening method and device, a storage medium and electronic equipment, and the method comprises the steps: obtaining a sample identification of a datasample marked with a category, and obtaining an identification vector corresponding to the sample identification; then, taking the category number of the labeled categories as a clustering category number to carry out clustering processing on the identification vector; then, for each clustering category, obtaining the similarity between the clustering center identification vector and the non-clustering center identification vector; then, determining a target non-clustering center identification vector of which the similarity with the clustering center identification vector does not reach a preset similarity in each clustering category, and judging the labeled category of the data sample represented by the target non-clustering center identification vector as labeling noise; and finally, filtering out the data sample corresponding to the target non-clustering center identification vector in each clustering category, thereby achieving the purpose of improving the labeling quality of thedata sample, and providing a high-quality data sample for machine learning.

The invention discloses an information labeling method, device and system for medical image data. The method comprises the following steps: acquiring to-be-labeled medical image data; inputting medical image data to be labeled into an image pre-labeling model, obtaining pre-labeling information, and using the image pre-labeling model for conducting feature extraction on the medical image data to obtain a neural network model of the pre-labeling information; in response to displaying the medical image data containing the pre-annotation information on the target platform, obtaining adjustment information of the target platform for the pre-annotation information; and processing the adjustment information and the pre-annotation information to obtain target annotation information of the to-be-annotated medical image data. According to the method, the medical image data is labeled through the model, and the labeled information can be adjusted in combination with a man-machine interaction mode, so that the information labeling efficiency and quality of the medical image are improved.

The invention provides a point cloud instance labeling method and device, electronic equipment, a computer readable storage medium and a computer program product, relates to the technical field of computers, in particular to the technical field of data labeling and computer vision, and can be applied to a cloud platform. According to the implementation scheme, the method comprises the steps of obtaining to-be-labeled point cloud data; marking one or more instances on the point cloud data, wherein each instance comprises one or more point cloud areas in the point cloud data; and determining attributes of the one or more instances, the attributes being one or more of a group of attributes preset based on the scene corresponding to the point cloud.

The embodiment of the invention provides a visual small target automatic labeling method and device and electronic equipment, and belongs to the technical field of data processing, and the method comprises the steps: classifying video frames containing a visual small target, obtaining a first type of video frames and a second type of video frames, and enabling one or more second type of video frames to be included between each two adjacent first type of video frames; respectively executing target detection and tracking processing on the first type of video frames and the second type of video frames in a sequential mode to obtain a first detection result; performing target detection and tracking processing on the first type of video frames and the second type of video frames in an invertedorder mode to obtain a second detection result; and performing fusion processing on the first detection result and the second detection result by adopting a maximum suppression mode to obtain a finallabeling result for automatically labeling the small target. Through the processing scheme disclosed by the invention, the automatic labeling efficiency of the visual small target can be improved.

The invention discloses a data labeling method and a related device. The data labeling method comprises the following steps: inputting to-be-labeled data into a hierarchical labeling system, and determining a data label of the to-be-labeled data; if the to-be-labeled data is a non-class data label in the sub-label layer corresponding to the determined data label, searching for a data label meetinga preset condition from other data labels located at the same level as the determined data label; and if the data label meeting the preset condition is found, correspondingly labeling the data labelof the to-be-labeled data by using the sub-label of the data label meeting the preset condition and the data label of the upper layer of the sub-label of the data label meeting the preset condition. According to the scheme, the error annotation processing efficiency can be improved, and the data annotation quality is improved.

The invention relates to an image labeling method, a classification model training method and computer equipment. The image labeling method comprises the steps of obtaining a to-be-labelled image and an labeled image, wherein the labelled image comprises a target label; determining to-be-labelled image feature parameters corresponding to the to-be-labelled image and labelled image feature parameters corresponding to the labelled image, where the labelled image feature parameter comprises a target label; and determining a label corresponding to the to-be-labeled image according to the feature parameters of the to-be-labeled image and the feature parameters of the labeled image. According to the invention, the to-be-labeled image is labeled through the labeled image, and the labeling quality of the to-be-labeled image is unified with the labeling quality of the labeled image, so that the labeling quality of the to-be-labeled image is relatively high, repeated labeling adjustment is not needed, and the labeling efficiency is greatly improved.

The embodiment of the invention discloses an image recognition method and device and a computer readable storage medium. According to the embodiment of the invention, the method comprises the steps of after an image sample set is acquired, adopting a preset recognition model to perform feature extraction on the image samples in the image sample set to obtain an image feature set, then using the image samples as data nodes to construct the neighbor graph according to the image feature set, and then correcting the basic labels of the image samples based on the neighbor graph; obtaining a corrected image sample set, then training a preset recognition model by adopting the corrected image sample set, and recognizing the to-be-recognized image through the trained recognition model. According to the scheme, the image recognition accuracy can be improved.

The invention discloses a data labeling system and method based on an intelligent distribution algorithm, and specifically relates to the field of data processing. The system comprises a data analysismodule, a feature acquisition module and an intelligent distribution module. The output end of the data analysis module is connected with the input end of the feature acquisition module, and the output end of the feature acquisition module is connected with the input end of the intelligent distribution module. The method comprises the following specific processing steps: screening small-scale representative and instructive key data as advanced data by using a data analysis module; carrying out trial labeling, accurate labeling and analysis on the 'leading data' by a labeling person to obtaina 'standard answer', dynamically matching, and then taking the exclusive labeling feature of each labeling person; and using an intelligent distribution module to intelligently distribute the remaining data. According to the method, the manual processing error rate of the data can be reduced by utilizing an intelligent distribution algorithm, and in the manual processing task of the text type data, the manual error rate can be reduced by about 20-30%.