Labeling processing method, apparatus, and device, and storage medium
By obtaining service descriptions and tool information, using intelligent agents for annotation and combining with label dictionary detection, the efficiency and accuracy issues of service annotation processing are solved, and efficient and accurate annotation results are achieved.
Patent Information
- Application Number
- PCT/CN2024/133047
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-29
- Filing Date
- 2024-11-19
- Publication Date
- 2025-10-02
AI Technical Summary
In the existing technology, how to label services efficiently and accurately is a problem that needs to be solved urgently.
By obtaining the service description information and application tool information of the service to be labeled, calling the intelligent agent to perform labeling, combining the preset label dictionary to determine the label, merging and detecting the label to determine the labeling result.
It achieves efficient and accurate labeling of services and improves the efficiency and accuracy of labeling processing.
Smart Images

Figure CN2024133047_02102025_PF_FP_ABST
Abstract
Description
A marking processing method, device, equipment and storage medium
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on March 29, 2024, with application number 202410382720.2 and invention name “A marking processing method, device, equipment and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present disclosure relates to the field of data processing, and in particular to a labeling processing method, apparatus, device, and storage medium. Background Art
[0004] Currently, in some application areas, it is necessary to label data appropriately. For example, in the field of model training, a large amount of labeled data is required for model training. Therefore, how to label data is increasingly receiving attention from people in related fields. Summary of the Invention
[0005] Embodiments of the present disclosure provide a method, apparatus, device, and storage medium for annotation processing.
[0006] In a first aspect, the present disclosure provides a method for labeling, the method comprising:
[0007] Obtaining service description information and application tool information of the service to be annotated; wherein the application tool information is used to represent the application tool called by the service to be annotated;
[0008] Invoking a first labeling agent to label the service to be labeled based on the service description information to obtain a first label of the service to be labeled;
[0009] Determining a label corresponding to the application tool information based on a preset label dictionary as a second label for the service to be labeled; wherein the preset label dictionary includes a correspondence between application tools and labels;
[0010] Based on the first tag and the second tag, a tagging result tag of the service to be tagged is determined; wherein the tagging result tag is used to identify functions supported by the service to be tagged.
[0011] In an optional implementation, determining, based on a preset tag dictionary, a tag corresponding to the application tool information as the second tag of the service to be labeled includes:
[0012] Querying a preset tag dictionary to determine whether a tag corresponding to the application tool information exists;
[0013] If it is determined that the tag corresponding to the application tool information exists in the preset tag dictionary, the tag corresponding to the application tool information is used as the second tag of the service to be labeled.
[0014] In an optional implementation, the method further includes:
[0015] If it is determined that the label corresponding to the application tool information does not exist in the preset label dictionary, a second labeling agent is called to label the service to be labeled based on the application tool information to obtain a second label for the service to be labeled.
[0016] In an optional implementation, the method further includes:
[0017] Acquire application tool information of each service in a target service set; wherein the target service set includes the service to be marked;
[0018] A third annotation agent is called to determine a label corresponding to the application tool represented by the application tool information, and a correspondence between the application tool information and the label is stored in the preset label dictionary.
[0019] In an optional embodiment, before calling the first annotation agent to annotate the service to be annotated based on the service description information and obtaining the first label of the service to be annotated, the method further includes:
[0020] Obtaining service configuration information of the service to be marked; wherein the service configuration information includes at least one of information about tasks to be performed, role attribute information, and knowledge base information;
[0021] Correspondingly, the calling of the first annotation agent to annotate the service to be annotated based on the service description information to obtain a first label of the service to be annotated includes:
[0022] A first labeling agent is called to label the service to be labeled based on the service description information and the service configuration information to obtain a first label of the service to be labeled.
[0023] In an optional implementation, before determining the labeling result label of the service to be labeled based on the first label and the second label, the method further includes:
[0024] Determine a label corresponding to the service configuration information as a third label for the service to be labeled;
[0025] Accordingly, determining the labeling result label of the service to be labeled based on the first label and the second label includes:
[0026] Based on the first tag, the second tag, and the third tag, a tagging result tag of the service to be tagged is determined.
[0027] In an optional implementation, determining the labeling result label of the service to be labeled based on the first label and the second label includes:
[0028] Merging the first label and the second label to obtain an initial label set for the service to be labeled;
[0029] Calling a detection agent to determine whether the tags in the initial tag set meet the preset detection rules;
[0030] If it is determined whether the tags in the initial tag set comply with the preset detection rule, the tags in the initial tag set are determined as the tagging result tags of the service to be tagged.
[0031] In a second aspect, the present disclosure provides a labeling processing device, the device comprising:
[0032] A first acquisition module is configured to acquire service description information and application tool information of the service to be annotated; wherein the application tool information is used to represent the application tool called by the service to be annotated;
[0033] A first labeling module is configured to call a first labeling agent to label the service to be labeled based on the service description information to obtain a first label of the service to be labeled;
[0034] A first determining module is configured to determine a label corresponding to the application tool information based on a preset label dictionary as a second label for the service to be labeled; wherein the preset label dictionary includes a correspondence between application tools and labels;
[0035] The second determining module is configured to determine a labeling result label of the service to be labeled based on the first label and the second label; wherein the labeling result label is used to identify functions supported by the service to be labeled.
[0036] In a third aspect, the present disclosure provides a computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium. When the instructions are executed on a terminal device, the terminal device implements the above method.
[0037] In a fourth aspect, the present disclosure provides a labeling processing device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned method when executing the computer program.
[0038] In a fifth aspect, the present disclosure provides a computer program product, which includes a computer program / instructions, and the computer program / instructions implement the above method when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0040] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0041] FIG1 is a flowchart of a marking processing method provided by some embodiments of the present disclosure;
[0042] FIG2 is a schematic diagram of a processing flow of a marking processing method provided by some embodiments of the present disclosure;
[0043] FIG3 is a schematic diagram of the structure of a labeling processing device provided in some embodiments of the present disclosure;
[0044] FIG4 is a schematic diagram of the structure of a labeling processing device provided in some embodiments of the present disclosure. DETAILED DESCRIPTION
[0045] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features therein can be combined with each other in the absence of conflict.
[0046] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0047] With the continuous development of technology, services used to achieve certain functions also have labeling needs. Therefore, how to implement labeling processing for services is a technical problem that needs to be solved urgently.
[0048] To this end, the embodiment of the present disclosure provides a labeling processing method, which first obtains the service description information and application tool information of the service to be labeled, then calls a first labeling agent to label the service to be labeled based on the service description information, obtains a first label, and determines the label corresponding to the application tool information based on a preset label dictionary as a second label, and then determines the labeling result label of the service to be labeled based on the first label and the second label, wherein the labeling result label is used to identify the functions supported by the service to be labeled. It can be seen that the embodiment of the present disclosure can label the service to be labeled based on the service description information and application tool information of the service to be labeled, thereby realizing the labeling processing function for the service.
[0049] Specifically, an embodiment of the present disclosure provides a method for labeling. Referring to FIG1 , which is a flow chart of a method for labeling provided by an embodiment of the present disclosure, the method specifically includes:
[0050] S101: Obtain service description information and application tool information of the service to be marked.
[0051] The application tool information is used to represent the application tool called by the service to be annotated.
[0052] The service to be annotated in the embodiment of the present disclosure may be any type of service for implementing a specific function. Specifically, the service to be annotated may include any agent for implementing a specific function, such as an image processing agent, etc. The agent is created based on a model.
[0053] In the embodiment of the present disclosure, the service description information is used to describe the service characteristics of the service to be labeled. For example, the service description information includes the name and ID of the service to be labeled, characteristic description information, system prompt information, etc.
[0054] For example, the service description information of service 1 to be labeled includes:
[0055] name:A;
[0056] description:A teaches you how to use Buddhist knowledge to gain enlightenment and solve life's troubles.
[0057] In the embodiment of the present disclosure, the application tool information is used to characterize the application tool called by the service to be annotated. Specifically, the same service to be annotated can call one or more application tools. The type of application tool called by the service to be annotated can characterize the functions supported by the service to be annotated to a certain extent.
[0058] S102: Calling a first labeling agent to label the service to be labeled based on the service description information to obtain a first label of the service to be labeled.
[0059] Wherein, the first annotation agent is created based on the model.
[0060] In the embodiment of the present disclosure, after obtaining the service description information of the service to be labeled, the service description information is sent to the first labeling agent, which labels the service to be labeled based on the service description information and outputs the first label of the service to be labeled.
[0061] In order to further improve the accuracy of the labels annotated for the objects to be annotated, the embodiments of the present disclosure may also obtain service configuration information of the services to be annotated, so as to annotate the services to be annotated.
[0062] Specifically, service configuration information characterizes the configuration features of the object to be annotated. This information may include at least one of the following: information about the tasks to be performed, information about the role attributes, and information about the knowledge base. This information can, to a certain extent, reflect the functionality supported by the service.
[0063] For example, if the service to be labeled is configured with an intelligent question and answer knowledge base, it means that the service to be labeled supports the intelligent question and answer function. Therefore, the label of the service to be labeled can be determined more accurately in combination with the service configuration information configured for the service to be labeled.
[0064] In actual applications, a first labeling agent is called to label the service to be labeled based on the service description information and service configuration information of the service to be labeled, thereby obtaining a first label for the service to be labeled. Specifically, the first label may include multiple labels, including first-level labels and second-level labels in a preset label directory.
[0065] In an optional implementation, the preset tag directory may include a two-level directory stored in a tree structure, for example:
[0066] Q&A: Knowledge Q&A, Industry Q&A, Customer Service, Other
[0067] Workplace: efficient office, business analysis, job recruitment, team management, other
[0068] Among them, the first-level tags include: Q&A, workplace; the second-level tags include: knowledge Q&A, industry Q&A, customer service, efficient office, business analysis, job recruitment, and team management; the first-level tags and second-level tags have a corresponding relationship. A service with a certain second-level tag usually has the first-level tag to which the second-level tag belongs.
[0069] In the embodiment of the present disclosure, the first annotation agent may be created based on a model.
[0070] S103: Determine a label corresponding to the application tool information based on a preset label dictionary as a second label for the service to be labeled.
[0071] The preset tag dictionary includes the correspondence between application tools and tags.
[0072] In the disclosed embodiment, the preset tag dictionary pre-stores the correspondence between application tools and tags. After obtaining the application tool information of the service to be labeled, the preset tag dictionary is queried to determine whether a corresponding tag exists for the application tool information of the service to be labeled. If so, the corresponding tag is obtained as the second tag for the service to be labeled. Specifically, the second tag may include multiple tags, including primary tags and secondary tags from the preset tag directory.
[0073] In an optional implementation, if it is determined that the label corresponding to the application tool information of the service to be labeled does not exist in the preset label dictionary, the second labeling agent is called to label the service to be labeled based on the application tool information to obtain a second label for the service to be labeled.
[0074] Among them, the second annotation agent is created based on the model.
[0075] In actual applications, for the application tool information of the service to be labeled, a third labeling agent can be called to determine the label corresponding to the application tool represented by the application tool information, and store the label and the application tool information in a preset label dictionary for use in label query.
[0076] Among them, the third annotation agent is created based on the model.
[0077] S104: Determine a labeling result label of the service to be labeled based on the first label and the second label.
[0078] The labeling result tag is used to identify the functions supported by the service to be labeled.
[0079] In the embodiment of the present disclosure, after obtaining the first label and the second label of the service to be labeled, the first label and the second label are merged to obtain an initial label set for the service to be labeled.
[0080] In an optional embodiment, to improve the accuracy of the labeling, each label in the initial label set of the service to be labeled is corrected or filtered. Specifically, labels in the initial label set that clearly do not meet the characteristics of the service to be labeled are removed from the initial label set.
[0081] In addition, for the labels in the initial label set of the service to be labeled that do not exist in the above-mentioned preset label directory, the label with the highest similarity to the label is determined in the preset label directory, and the label is added to the initial label set of the service to be labeled to replace the corresponding label with high similarity, so as to achieve correction processing of the label.
[0082] In an optional implementation, since the service configuration information of the service to be labeled can directly reflect the functional characteristics of the service to be labeled, for example, the information on tasks to be executed in the service configuration information can reflect the type of tasks that the service to be labeled needs to perform, and thus reflect the function of the service to be labeled, the embodiment of the present disclosure can use the label corresponding to the functional characteristics directly reflected by the service configuration information as the third label of the service to be labeled, which is used to determine the labeling result label of the service to be labeled.
[0083] In actual applications, after obtaining the first label, the second label, and the third label of the service to be labeled, the first label, the second label, and the third label are merged to obtain an initial label set for the service to be labeled.
[0084] It is worth noting that the first label of the service to be labeled in the embodiment of the present disclosure may include one or more labels obtained by labeling the service to be labeled based on the service description information, and the one or more labels may also include a label obtained by labeling the service to be labeled based on the service description information and service configuration information.
[0085] In the embodiment of the present disclosure, the second label of the service to be labeled may include one or more labels determined based on the application tool information. Similarly, the third label of the service to be labeled may include one or more labels corresponding to the service configuration information.
[0086] In the annotation processing method provided by the embodiment of the present disclosure, first, the service description information and application tool information of the service to be annotated are obtained, and then the first annotation agent is called to annotate the service to be annotated based on the service description information to obtain a first label, and the label corresponding to the application tool information is determined based on a preset label dictionary as a second label, and then the annotation result label of the service to be annotated is determined based on the first label and the second label, wherein the annotation result label is used to identify the functions supported by the service to be annotated. It can be seen that the embodiment of the present disclosure can annotate the service to be annotated based on the service description information and application tool information of the service to be annotated, thereby realizing the annotation processing function for the service.
[0087] On the basis of the above embodiments, in order to further improve the accuracy of the labeling results of the service to be labeled, the embodiment of the present disclosure further provides a label detection function for the labeling result of the service to be labeled.
[0088] Specifically, after merging the first, second, and third tags of the service to be labeled, an initial tag set for the service to be labeled is obtained. A detection agent is called to determine whether each tag in the initial tag set meets the preset detection rules. If it is determined that each tag in the initial tag set meets the preset detection rules, the tags in the initial tag set can be determined as the labeled result tags for the service to be labeled.
[0089] If it is determined that there are labels in the initial label set of the service to be labeled that do not comply with the preset detection rules, the service to be labeled may be re-labeled to obtain labels that comply with the preset detection rules.
[0090] In an optional embodiment, the preset detection rules may include one or more pre-configured detection rules, such as calling a detection agent to determine whether the labeling result label of the service to be annotated falls within a preset reasonable range, wherein the preset reasonable range includes, for example, the preset label directory. In addition, the detection rules may also include whether the label outside the preset label directory is reasonable, for example, the similarity between the label and a label in the preset label directory is high. In addition, the detection rules may also determine whether the labeling result label of the service to be annotated is complete, for example, determining whether it is complete from the perspective of natural language judgment.
[0091] In order to more clearly introduce the annotation processing method provided by the embodiment of the present disclosure, the present disclosure provides a processing flow diagram of the annotation processing method, see Figure 2.
[0092] The target service set includes multiple services that need to be labeled. Before labeling the services in the target service set, first determine whether the services to be labeled have been labeled. If not, obtain the service description information, application tool information, and service configuration information of the services to be labeled. The service description information may include the service ID, name, feature description information, system prompt information, etc. The application tool information may include the tool called by the service to be labeled, or a workflow composed of multiple tool calls.
[0093] Then, the first annotation agent is called to annotate the service to be annotated based on the concatenated service description information and service configuration information to obtain a first label; and a third label is determined for the service to be annotated based on the service configuration information. Furthermore, a label corresponding to the application tool information of the service to be annotated is determined by querying a preset label dictionary. If a label corresponding to the application tool information is not found in the preset label dictionary, a second annotation agent is called to annotate the service to be annotated based on the application tool information to obtain a second label.
[0094] Furthermore, after obtaining the first label, second label and third label of the service to be marked, the first label, second label and third label are merged, and then the initial label set obtained after the merging process is sent to the detection agent, and the detection agent detects each label in the initial label set, and finally obtains the labeling result label corresponding to the service to be marked.
[0095] In practical applications, the annotation result labels corresponding to the service to be annotated can represent the functions supported by the service to be annotated, and the annotation result labels can be used to functionally classify the services to be annotated. For example, the label "image generation" can identify the service used for image generation.
[0096] The annotation processing method provided by the embodiment of the present disclosure annotates the service to be annotated based on the service description information and application tool information of the service to be annotated, thereby realizing the annotation processing function for the service. In addition, compared with the manual annotation method, the embodiment of the present disclosure can improve the efficiency and accuracy of service annotation.
[0097] Based on the above method embodiment, the present disclosure further provides a labeling processing device. Reference 3 is a structural diagram of a labeling processing device provided in an embodiment of the present disclosure, and the device includes:
[0098] The first acquisition module 301 is used to acquire service description information and application tool information of the service to be annotated; wherein the application tool information is used to represent the application tool called by the service to be annotated;
[0099] A first labeling module 302 is configured to call a first labeling agent to label the service to be labeled based on the service description information to obtain a first label of the service to be labeled;
[0100] A first determining module 303 is configured to determine a label corresponding to the application tool information based on a preset label dictionary as a second label for the service to be labeled; wherein the preset label dictionary includes a correspondence between application tools and labels;
[0101] The second determining module 304 is configured to determine a labeling result label of the service to be labeled based on the first label and the second label; wherein the labeling result label is used to identify functions supported by the service to be labeled.
[0102] In an optional implementation, the first determining module includes:
[0103] A query submodule, configured to query a preset tag dictionary for a tag corresponding to the application tool information;
[0104] The first determining submodule is configured to use the label corresponding to the application tool information as the second label of the service to be labeled if it is determined that the label corresponding to the application tool information exists in the preset label dictionary.
[0105] In an optional embodiment, the device further includes:
[0106] The second labeling module is used to call a second labeling agent to label the service to be labeled based on the application tool information if it is determined that the label corresponding to the application tool information does not exist in the preset label dictionary, so as to obtain a second label for the service to be labeled.
[0107] In an optional embodiment, the device further includes:
[0108] A second acquisition module is configured to acquire application tool information of each service in a target service set, wherein the target service set includes the service to be labeled;
[0109] The third determination module is used to call a third annotation agent to determine a label corresponding to the application tool represented by the application tool information, and store the corresponding relationship between the application tool information and the label in the preset label dictionary.
[0110] In an optional embodiment, the device further includes:
[0111] A third acquisition module is configured to acquire service configuration information of the service to be annotated; wherein the service configuration information includes at least one of information on tasks to be performed, role attribute information, and knowledge base information;
[0112] Accordingly, the second annotation module is specifically used to:
[0113] A first labeling agent is called to label the service to be labeled based on the service description information and the service configuration information to obtain a first label of the service to be labeled.
[0114] In an optional embodiment, the device further includes:
[0115] A fourth determining module is configured to determine a label corresponding to the service configuration information as a third label for the service to be labeled;
[0116] Accordingly, the second determining module is specifically configured to:
[0117] Based on the first tag, the second tag, and the third tag, a tagging result tag of the service to be tagged is determined.
[0118] In an optional implementation, the second determining module includes:
[0119] a merging submodule, configured to merge the first label and the second label to obtain an initial label set for the service to be labeled;
[0120] A second determination submodule is configured to call a detection agent to determine whether the tags in the initial tag set conform to a preset detection rule;
[0121] The third determining submodule is configured to determine the tags in the initial tag set as the tagging result tags of the service to be tagged if it is determined whether the tags in the initial tag set meet the preset detection rules.
[0122] In the annotation processing device provided by the embodiment of the present disclosure, first, the service description information and application tool information of the service to be annotated are obtained, and then, the first annotation agent is called to annotate the service to be annotated based on the service description information to obtain a first label, and the label corresponding to the application tool information is determined based on a preset label dictionary as a second label, and then, the annotation result label of the service to be annotated is determined based on the first label and the second label, wherein the annotation result label is used to identify the functions supported by the service to be annotated.
[0123] It can be seen that the embodiment of the present disclosure can annotate the service to be annotated based on the service description information and application tool information of the service to be annotated, thereby realizing the annotation processing function for the service.
[0124] In addition to the above-mentioned method and apparatus, the embodiments of the present disclosure further provide a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device implements the annotation processing method described in the embodiments of the present disclosure.
[0125] The embodiments of the present disclosure further provide a computer program product, which includes a computer program / instructions. When the computer program / instructions are executed by a processor, the annotation processing method described in the embodiments of the present disclosure is implemented.
[0126] In addition, the embodiment of the present disclosure further provides a labeling processing device, as shown in FIG4 , which may include:
[0127] Processor 401, memory 402, input device 403, and output device 404. The number of processors 401 in the annotation processing device can be one or more, and Figure 4 uses one processor as an example. In some embodiments of the present disclosure, processor 401, memory 402, input device 403, and output device 404 can be connected via a bus or other means, wherein Figure 4 uses bus connection as an example.
[0128] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing of the annotation processing device by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. The input device 403 can be used to receive input digital or character information, and generate signal input related to user settings and function control of the annotation processing device.
[0129] Specifically in this embodiment, the processor 401 will load the executable files corresponding to the processes of one or more applications into the memory 402 according to the following instructions, and the processor 401 will run the applications stored in the memory 402, thereby realizing the various functions of the above-mentioned annotation processing device.
[0130] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.
[0131] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but rather to be construed in the broadest manner consistent with the principles and novel features disclosed herein.
Claims
1. A marking processing method, comprising: Obtaining service description information and application tool information of the service to be annotated; wherein the application tool information is used to represent the application tool called by the service to be annotated; Invoking a first labeling agent to label the service to be labeled based on the service description information to obtain a first label of the service to be labeled; Determining a label corresponding to the application tool information based on a preset label dictionary as a second label for the service to be labeled; wherein the preset label dictionary includes a correspondence between application tools and labels; Based on the first tag and the second tag, a tagging result tag of the service to be tagged is determined; wherein the tagging result tag is used to identify functions supported by the service to be tagged.
2. The method according to claim 1, wherein The determining, based on a preset label dictionary, a label corresponding to the application tool information as a second label for the service to be labeled includes: Querying a preset tag dictionary to determine whether a tag corresponding to the application tool information exists; If it is determined that the tag corresponding to the application tool information exists in the preset tag dictionary, the tag corresponding to the application tool information is used as the second tag of the service to be labeled.
3. The method according to claim 2, further comprising: If it is determined that the label corresponding to the application tool information does not exist in the preset label dictionary, a second labeling agent is called to label the service to be labeled based on the application tool information to obtain a second label for the service to be labeled.
4. The method according to claim 1, further comprising: Acquire application tool information of each service in a target service set; wherein the target service set includes the service to be marked; A third annotation agent is called to determine a label corresponding to the application tool represented by the application tool information, and a correspondence between the application tool information and the label is stored in the preset label dictionary.
5. The method according to claim 1, wherein Before calling the first annotation agent to annotate the service to be annotated based on the service description information and obtaining the first label of the service to be annotated, the method further includes: Obtaining service configuration information of the service to be marked; wherein the service configuration information includes at least one of information about tasks to be performed, role attribute information, and knowledge base information; Correspondingly, the calling of the first annotation agent to annotate the service to be annotated based on the service description information to obtain a first label of the service to be annotated includes: A first labeling agent is called to label the service to be labeled based on the service description information and the service configuration information to obtain a first label of the service to be labeled.
6. The method according to claim 5, wherein: Before determining the labeling result label of the service to be labeled based on the first label and the second label, the method further includes: Determine a label corresponding to the service configuration information as a third label for the service to be labeled; Accordingly, determining the labeling result label of the service to be labeled based on the first label and the second label includes: Based on the first tag, the second tag, and the third tag, a tagging result tag of the service to be tagged is determined.
7. The method according to claim 1, wherein The determining, based on the first label and the second label, a labeling result label of the service to be labeled includes: Merging the first label and the second label to obtain an initial label set for the service to be labeled; Calling a detection agent to determine whether the tags in the initial tag set meet the preset detection rules; If it is determined that the tags in the initial tag set meet the preset detection rules, the tags in the initial tag set are determined as the tagging result tags of the service to be tagged.
8. A labeling processing device, comprising: A first acquisition module is configured to acquire service description information and application tool information of the service to be annotated; wherein the application tool information is used to represent the application tool called by the service to be annotated; A first labeling module is configured to call a first labeling agent to label the service to be labeled based on the service description information to obtain a first label of the service to be labeled; A first determining module is configured to determine a label corresponding to the application tool information based on a preset label dictionary as a second label for the service to be labeled; wherein the preset label dictionary includes a correspondence between application tools and labels; The second determining module is configured to determine a labeling result label of the service to be labeled based on the first label and the second label; wherein the labeling result label is used to identify functions supported by the service to be labeled.
9. A computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium. When the instructions are executed on a terminal device, the terminal device implements the method according to any one of claims 1 to 7.
10. A labeling processing device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.
11. A computer program product, comprising a computer program / instruction, wherein when the computer program / instruction is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Dictionary-based multi-label emotion classification method and device, equipment and storage medium
CN112527963A
Data labeling method and device, electronic equipment and storage medium
CN114691954A
Cross labeling method and device of image data, equipment and storage medium
CN115795076A
Label processing method and device, equipment and storage medium
CN118551215A
System and method for processing unlabeled interaction data with contextual understanding
US20230281387A1