An intelligent annotation method and system

Abstract

The present invention relates to the field of human-computer interaction technology, and discloses an intelligent annotation method and system thereof, which includes the following steps: collecting user multimodal behavior data; using the user multimodal behavior data as input to a user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and predicts the original user operation expectations; performing a consistency analysis between the original user operation expectations and the user operation mode report to screen the original user operation expectations that meet the requirements, and thus obtain the final user operation expectations; dynamically adjusting the annotation tool and / or the annotation interface based on the final user operation expectations, and responding to the user's annotation operation. This method realizes personalized dynamic adjustment of the annotation interface and annotation tool, simplifies the user operation steps, and allows users to obtain a good personalized experience. It solves the technical problems of the existing technology of inconvenient operation and lack of personalized experience, and significantly improves user experience and operation efficiency.

Description

Technical Field

[0001] The present invention relates to the field of human-computer interaction technology, and in particular to an intelligent annotation method and system thereof. Background Art

[0002] At present, reviewing and annotating documents through electronic systems is a basic requirement for designers to carry out their work and collaborative design. Establishing a communication platform between designers and between designers and reviewers through review and annotation plays an important role in improving the speed and quality of modern product design.

[0003] Existing annotation systems adjust their interfaces and tools with each version update. This results in a fixed interface layout and a wide variety of tools, making it impossible to adjust the interface and tools in real time based on user habits. Furthermore, the wide variety of tools makes it difficult to simplify the invocation process, resulting in inconvenient annotation operations and a lack of personalized experience, resulting in a poor user experience and low operational efficiency. Therefore, designing an effective annotation method to improve user experience and operational efficiency is an urgent issue to be addressed. Summary of the Invention

[0004] The present invention aims to provide an intelligent annotation method to solve the above technical problems, so that the annotation interface and annotation tools can be dynamically adjusted according to user needs without having to make fixed changes with version updates, so as to simplify user operations and improve user experience and operating efficiency.

[0005] In order to solve the above technical problems, the present invention provides an intelligent annotation method, comprising the following steps:

[0006] Collect user multimodal behavior data;

[0007] Using the user multimodal behavior data as input to a preset user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and further predicts the original user operation expectation;

[0008] Perform a consistency analysis between the original user operation expectations and the preset user operation mode report to screen the original user operation expectations that meet the preset requirements, and then obtain the final user operation expectations;

[0009] Dynamically adjust the annotation tool and / or annotation interface based on the end user's operational expectations and respond to user annotation operations.

[0010] The above solution makes full use of the obtained user multimodal behavior data to predict user operation expectations, and then realizes personalized dynamic adjustment of the annotation interface and annotation tools, so that users can obtain the required annotation tools and adjust the annotation interface in a timely manner, simplifying the user operation steps, allowing users to get a good personalized experience, solving the technical problems of inconvenient operation and lack of personalized experience in existing technologies, and significantly improving user experience and operation efficiency.

[0011] Furthermore, the preset requirement may be that the matching rate between the original user operation expectation and the preset user operation mode report reaches a high percentage.

[0012] Furthermore, the method for obtaining the user operation mode report may be:

[0013] Collect user multimodal behavior data; use the user multimodal behavior data as input to a preset user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and obtains a user operation mode report.

[0014] Preferably, the above solution further includes screening and / or generating matching annotation tools and annotation layouts according to the user operation mode report data, and then recommending the annotation tools and annotation layouts to the user.

[0015] Preferably, the user multimodal behavior data described in the above scheme includes at least one of the following: stylus position, pressure, speed, voice commands, gestures; the device used to collect user multimodal behavior data includes at least one of the following: touch sensor, microphone, camera.

[0016] Preferably, the above solution further includes preprocessing the user multimodal behavior data, and the preprocessing method includes denoising and normalization processing to improve the accuracy of user behavior prediction.

[0017] The data preprocessing step improves the quality and reliability of user multimodal behavior data, thereby improving the performance and accuracy of the user behavior prediction model.

[0018] Preferably, the above scheme also includes obtaining user annotation content based on user annotation operations; using the user annotation content as input to a preset natural language processing model, so that the natural language processing model performs semantic analysis on the user annotation content, and then identifies the annotation subject and emotion; based on the annotation subject and emotion, provides preset annotation suggestions and classifies the user annotation content.

[0019] Suggested annotations can include highlighting keywords within the text, generating a brief summary of the document, adding sentiment tags to the text, and providing contextually relevant supplementary information and / or references. Providing annotation suggestions to users through semantic analysis can help them better understand and process the text content. Furthermore, categorizing user annotations can improve the user experience and efficiency during document review and collaborative annotation.

[0020] Preferably, the above scheme also includes collecting user operation instructions; inputting the user operation instructions into a preset virtual assistant so that the preset virtual assistant automatically performs annotation operations and / or provides preset annotation suggestions; wherein, the user operation instructions include voice instructions and text instructions.

[0021] The introduction of the virtual assistant uses command recognition methods such as voice command recognition and text command recognition to automatically perform complex annotation operations on behalf of the user, thereby eliminating the steps of manual annotation operations required by traditional annotation methods and improving the user experience.

[0022] Preferably, the above solution further includes obtaining user annotation content based on the user annotation operation; and automatically saving the user annotation content as an annotation history version, so that the user can view and trace back the annotation history version.

[0023] Automatic saving of the annotation content can help prevent the loss of annotation data, ensure that the user's work progress is saved and backed up in a timely manner, and thus eliminate the need for the user to frequently manually save the annotation content, thereby improving user experience and operational efficiency.

[0024] Preferably, the above scheme also includes obtaining user annotation content based on the user annotation operation; using the user annotation content as input of a preset language model, and the language model automatically detects grammatical and / or logical errors in the user annotation content according to a preset language rule database to issue corresponding prompts and modification suggestions to the user.

[0025] The language model detects grammatical and / or logical errors in the annotation content, which can significantly improve the quality and accuracy of the user's annotation documents, thereby improving the user's annotation efficiency.

[0026] Preferably, the above scheme also includes obtaining user annotation content based on user annotation operations; uploading user multimodal behavior data and user annotation content to the cloud database in real time; when users log in to different devices to make annotations, data synchronization of user multimodal behavior data and user annotation content is achieved through data transmission between the cloud database and the device local database; wherein, the cloud database can be used for multiple devices to download its stored cloud data.

[0027] The cross-device data synchronization function of the above-mentioned different devices allows users to process and annotate documents on different devices at any time without having to worry about file storage and transfer, which simplifies user operations and improves user annotation efficiency and annotation experience.

[0028] Furthermore, after uploading the user multimodal behavior data and user annotation content to the cloud database in real time, when multiple users log in to multiple devices to make annotations, the annotation content collected by each device is uploaded to the cloud database via the Internet, so that the cloud server can be used to organize the annotation content, and the organized annotation content is synchronously transmitted to each user device via the Internet; wherein, the cloud server is connected to the cloud database.

[0029] Furthermore, when multiple users log in to multiple devices to make annotations, the network connection status of the devices is judged; when the network connection is stable, the annotation content collected by each device is uploaded to the cloud database via the Internet, so that the cloud server can organize the annotation content, and the organized annotation content is synchronously transmitted to each user device via the Internet; when the network connection is unstable, the annotation content collected by each device is saved locally, waiting for the network connection to become stable again.

[0030] The multi-user, multi-device data synchronization feature enables multiple users to annotate the same document simultaneously, enabling collaborative annotation and sharing of annotation content. Furthermore, data synchronization over the internet disregards physical distance between users, improving teamwork efficiency. Furthermore, users can invite other users to join in the annotation process on the same document and limit the scope of annotation content sharing.

[0031] Preferably, the above solution further includes collecting user suggestions and feedback to optimize the above algorithms and models based on the user suggestions and feedback, thereby further improving any of the above intelligent annotation methods.

[0032] The present invention also provides an intelligent annotation system, comprising:

[0033] User data collection module, used to collect user multimodal behavior data;

[0034] A user behavior analysis module is used to use the user multimodal behavior data as input to a preset user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and further predicts the original user operation expectation;

[0035] The user operation expectation prediction module is used to analyze the consistency between the original user operation expectations and the preset user operation mode report to screen the original user operation expectations that meet the preset requirements and then obtain the final user operation expectations;

[0036] The dynamic adjustment module is used to dynamically adjust the annotation tool and / or annotation interface based on the end user's operation expectations and respond to the user's annotation operation.

[0037] The above system architecture is simple and easy to implement. It can realize an intelligent annotation method, realize personalized dynamic adjustment of the annotation interface, simplify user operation steps, and provide users with a personalized annotation experience.

[0038] Preferably, the system also includes an intelligent semantic analysis module with a preset natural language processing model, which is used to obtain user annotation content and use the user annotation content as input to the natural language processing model so that the natural language processing model performs semantic analysis on the user annotation content and then identifies the annotation subject and emotion; based on the annotation subject and emotion, provides preset annotation suggestions and classifies the user annotation content.

[0039] Preferably, the system also includes a virtual assistant module with a preset virtual assistant, which is used to collect user operation instructions and input the user operation instructions into the virtual assistant so that the preset virtual assistant automatically performs annotation operations and / or provides preset annotation suggestions.

[0040] Preferably, the system further comprises an annotation backtracking control module for acquiring user annotation content and automatically saving the user annotation content as an annotation history version, so that the user can view and backtrack the annotation history version.

[0041] Preferably, the system also includes an intelligent feedback module for obtaining user annotation content, taking the user annotation content as input of a preset language model, and the language model automatically detecting grammatical and / or logical errors in the user annotation content according to a preset language rule database; and issuing corresponding prompts and modification suggestions to the user based on the grammatical and / or logical errors.

[0042] Preferably, the system also includes a cross-platform synchronization module for obtaining user annotation content and uploading user multimodal behavior data and user annotation content to the cloud database in real time; when users log in to different devices to make annotations, data synchronization of user multimodal behavior data and user annotation content is achieved through data transmission between the cloud database and the device's local database; wherein, the cloud database can be used for multiple devices to download its stored cloud data.

[0043] Preferably, the system also includes a real-time collaboration module, which is used to upload the annotation content collected by each device to the cloud database via the Internet when multiple users log in to multiple devices to make annotations, so as to use the cloud server to organize the annotation content, and synchronously transmit the organized annotation content to each user device via the Internet; wherein the cloud server is connected to the cloud database.

[0044] The intelligent annotation method and system provided by the present invention have at least the following advantages over the prior art:

[0045] It enables personalized dynamic adjustment of the annotation interface and annotation tools, allowing users to obtain the annotation tools they need and adjust the annotation interface in a timely manner, simplifying the user operation steps and providing users with a good personalized experience. Furthermore, by introducing intelligent semantic analysis, virtual assistant assistance, annotation history version backtracking, annotation intelligent error correction and suggestions, cross-platform data synchronization, and multi-user collaborative sharing of annotation functions, the user annotation experience is significantly improved and the efficiency of user annotation is effectively increased. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 This is a flow chart of an intelligent annotation method provided by one embodiment of the present invention;

[0047] Figure 2 This is a schematic diagram of the architecture of an intelligent annotation system provided by one embodiment of the present invention. DETAILED DESCRIPTION

[0048] Below in conjunction with the drawings and Examples, the specific embodiment of the present invention is described in further detail.The following detailed description is all exemplary description, and is intended to provide further detailed description of the present invention.Unless otherwise indicated, all technical terms adopted in the present invention are identical with the meaning generally understood by those of ordinary skill in the art to which the present invention belongs.Terms used in the present invention are only to describe specific embodiment, and are not intended to limit exemplary embodiments according to the present invention.

[0049] See Figure 1 , an embodiment of the present invention preferably provides an intelligent annotation method, comprising the following steps:

[0050] S1: Collect user multimodal behavior data;

[0051] S2: using the user multimodal behavior data as input to a preset user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and further predicts the original user operation expectation;

[0052] S3: Perform a consistency analysis between the original user operation expectations and the preset user operation mode report to screen the original user operation expectations that meet the preset requirements, and then obtain the final user operation expectations;

[0053] S4: Dynamically adjust the annotation tool and / or annotation interface based on the end user's operation expectations and respond to the user's annotation operation.

[0054] This embodiment uses the obtained user multimodal behavior data to predict the user's operation expectations, and then realizes personalized dynamic adjustment of the annotation interface and annotation tools, so that users can obtain the required annotation tools and adjust the annotation interface in a timely manner, simplifying the user operation steps, allowing users to obtain a good personalized experience, solving the technical problems of the existing technology of inconvenient operation and lack of personalized experience, and significantly improving user experience and operation efficiency.

[0055] Preferably, the preset requirement may be that the matching rate between the original user operation expectation and the preset user operation mode report reaches a high percentage.

[0056] Specifically, when the original user operation expectation and the preset user operation pattern report achieve a high degree of consistency, it usually means that the original user operation expectation can well explain and predict the user's actual operation expectation, and therefore can be selected as the final user operation expectation. This consistency assessment can be performed through various methods, including:

[0057] Data comparison method: By comparing the original user operation expectation data and the data recorded in the user operation pattern report, the deviation between the two is intuitively displayed.

[0058] Statistical analysis methods: Use statistical methods to analyze the differences between original user operation expectations and user operation pattern reports, such as calculating the root mean square error (RMSE), mean, standard deviation, etc.

[0059] The consistency evaluation method provided in this embodiment can effectively evaluate the accuracy of original user operation expectations based on user operation mode reports, thereby improving the accuracy of user behavior prediction.

[0060] Preferably, the method for obtaining the user operation mode report may be:

[0061] Collect user multimodal behavior data; use the user multimodal behavior data as input to a preset user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and obtains a user operation mode report.

[0062] Preferably, this embodiment further includes filtering and / or generating matching annotation tools and annotation layouts according to the user operation mode report data, and then recommending the annotation tools and annotation layouts to the user.

[0063] Preferably, the user multimodal behavior data described in this embodiment includes at least one of the following: stylus position, pressure, speed, voice commands, gestures; the device used to collect user multimodal behavior data includes at least one of the following: touch sensor, microphone, camera.

[0064] Preferably, this embodiment further includes preprocessing the user multimodal behavior data, and the preprocessing method includes denoising and normalization processing to improve the accuracy of user behavior prediction.

[0065] Specifically, the method for preprocessing the data of the stylus position may be: standardizing the coordinate values ​​so as to keep them within the same range, thereby eliminating the differences between styluses of different models.

[0066] Specifically, the method for preprocessing the data of the stylus pressure may be: normalizing the pressure value to ensure that the data is on a uniform scale.

[0067] Specifically, the method for preprocessing the data of the stylus pen velocity may be: calculating the velocity between touch points and performing smoothing processing to reduce noise.

[0068] Specifically, the method for data preprocessing of voice commands can be denoising, which includes using a filter to remove background noise; feature extraction, which includes extracting features such as Mel-frequency cepstral coefficients (MFCC) for subsequent voice recognition; and normalization, which includes standardizing the amplitude of the audio signal.

[0069] Specifically, the method of data preprocessing for gesture data may be smoothing, which includes using a filter to smooth the gesture trajectory and reduce jitter; and feature extraction, which includes extracting key points and motion features, such as speed and acceleration.

[0070] The data preprocessing method provided in this embodiment can improve the quality and reliability of user multimodal behavior data, reduce the abnormal impact of data collection on subsequent user behavior analysis and user behavior prediction, and thus improve the performance and accuracy of the user behavior prediction model.

[0071] Preferably, this embodiment also includes obtaining user annotation content based on user annotation operations; using the user annotation content as input to a preset natural language processing model so that the natural language processing model performs semantic analysis on the user annotation content, and then identifies the annotation subject and emotion; based on the annotation subject and emotion, provides preset annotation suggestions and classifies the user annotation content.

[0072] Specifically, the annotation suggestions may include: highlighting keywords in the text, generating a brief summary of the document, adding sentiment tags to the text, and providing relevant supplementary information and / or reference materials based on the context.

[0073] Specifically, natural language processing models include word embedding models, such as Word2Vec, GloVe, and FastText. Word2Vec can be trained using methods such as Bag-of-Words (CBOW) and Skip-Gram. These models learn word embeddings from a training corpus, placing semantically similar words closer together in the vector space. Applying word embedding models to annotation methods facilitates calculating semantic similarity between annotation content, identifying annotation topics and sentiment, and classifying the annotation text.

[0074] This embodiment performs semantic analysis through the natural language processing model to provide users with annotation suggestions, which can help users better understand and process text content. At the same time, it classifies user annotation content, which can improve users' personal experience and annotation efficiency in the process of document review and annotation, and collaborative annotation.

[0075] Preferably, this embodiment also includes collecting user operation instructions; inputting the user operation instructions into a preset virtual assistant so that the preset virtual assistant automatically performs annotation operations and / or provides preset annotation suggestions; wherein, the user operation instructions include voice instructions and text instructions.

[0076] Specifically, the algorithms and models used by the virtual assistant include:

[0077] Word embedding models, such as Word2Vec, GloVe, and FastText. Word2Vec can be trained using Bag-of-Words (CBOW) and Skip-Gram.

[0078] Recurrent Neural Networks (RNNs), whose basic structure consists of an input layer, a hidden layer, and an output layer. The hidden layer is processed using Recurrent Neural Units (RUs). RUs can memorize previous hidden states and process sequential data.

[0079] Self-Attention Mechanism: The self-attention mechanism can help the model better focus on the key information in the input sequence. The calculation formula of self-attention is shown in the following formula 1:

[0080]

[0081] Where Q is the query vector, K is the key vector, V is the value vector, and d k is the dimension of the key vector;

[0082] The core structure of the Transformer is Multi-Head Self-Attention and Position-wise Feed-Forward Networks. Multi-Head Self-Attention can process different relationships in the input sequence in parallel, improving the computational efficiency of the model. Position-wise Feed-Forward Networks are a single-layer fully connected neural network that can process position information in the sequence.

[0083] The virtual assistant provided in this embodiment achieves accurate identification of user instructions through technical means such as word embedding vector models, recurrent neural networks, self-attention mechanisms, and Transformers, and then automatically performs complex annotation operations on behalf of users, thereby eliminating the steps required by traditional annotation methods for users to manually perform annotation operations and improving user experience.

[0084] Preferably, this embodiment further includes obtaining user annotation content based on the user annotation operation; and automatically saving the user annotation content as an annotation history version, so that the user can view and trace back the annotation history version.

[0085] Preferably, this embodiment also includes obtaining user annotation content based on the user annotation operation; using the user annotation content as input to a preset language model, and the language model automatically detects grammatical and / or logical errors in the user annotation content according to a preset language rule database to issue corresponding prompts and modification suggestions to the user.

[0086] Specifically, the language model is the natural language processing model mentioned above; the language rule database can be an SQL language rule database, a natural language processing (NLP) rule database, a programming language rule database, etc.

[0087] The language model provided in this embodiment detects grammatical and / or logical errors in the annotation content, which can significantly improve the quality and accuracy of the user's annotations to the document, thereby improving the user's annotation efficiency.

[0088] Preferably, this embodiment also includes obtaining user annotation content based on user annotation operations; uploading user multimodal behavior data and user annotation content to the cloud database in real time; when users log in to different devices to make annotations, data synchronization of user multimodal behavior data and user annotation content is achieved through data transmission between the cloud database and the device's local database; wherein the cloud database can be used for multiple devices to download its stored cloud data.

[0089] Furthermore, after uploading the user multimodal behavior data and user annotation content to the cloud database in real time, when multiple users log in to multiple devices to make annotations, the annotation content collected by each device is uploaded to the cloud database via the Internet, so that the cloud server can be used to organize the annotation content, and the organized annotation content is synchronously transmitted to each user device via the Internet; wherein, the cloud server is connected to the cloud database.

[0090] Furthermore, when multiple users log in to multiple devices to make annotations, the network connection status of the devices is judged; when the network connection is stable, the annotation content collected by each device is uploaded to the cloud database via the Internet, so that the cloud server can organize the annotation content, and the organized annotation content is synchronously transmitted to each user device via the Internet; when the network connection is unstable, the annotation content collected by each device is saved locally, waiting for the network connection to become stable again.

[0091] Preferably, this embodiment further includes collecting user suggestions and feedback to optimize the above algorithms and models based on the user suggestions and feedback, thereby further improving any of the above intelligent annotation methods.

[0092] See Figure 2 This embodiment also proposes an intelligent annotation system, including:

[0093] User data collection module, used to collect user multimodal behavior data;

[0094] A user behavior analysis module is used to use the user multimodal behavior data as input to a preset user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and further predicts the original user operation expectation;

[0095] The user operation expectation prediction module is used to analyze the consistency between the original user operation expectations and the preset user operation mode report to screen the original user operation expectations that meet the preset requirements and then obtain the final user operation expectations;

[0096] A dynamic adjustment module, configured to dynamically adjust the annotation tool and / or annotation interface based on the end user's operational expectations and respond to user annotation operations;

[0097] Preferably, the system also includes an intelligent semantic analysis module with a preset natural language processing model, which is used to obtain user annotation content and use the user annotation content as input to the natural language processing model so that the natural language processing model performs semantic analysis on the user annotation content and then identifies the annotation subject and emotion; based on the annotation subject and emotion, provides preset annotation suggestions and classifies the user annotation content.

[0098] Preferably, the system also includes a virtual assistant module with a preset virtual assistant, which is used to collect user operation instructions and input the user operation instructions into the virtual assistant so that the preset virtual assistant automatically performs annotation operations and / or provides preset annotation suggestions.

[0099] Preferably, the system further comprises an annotation backtracking control module for acquiring user annotation content and automatically saving the user annotation content as an annotation history version, so that the user can view and backtrack the annotation history version.

[0100] Preferably, the system also includes an intelligent feedback module for obtaining user annotation content, taking the user annotation content as input of a preset language model, and the language model automatically detecting grammatical and / or logical errors in the user annotation content according to a preset language rule database; and issuing corresponding prompts and modification suggestions to the user based on the grammatical and / or logical errors.

[0101] Preferably, the system also includes a cross-platform synchronization module for obtaining user annotation content and uploading user multimodal behavior data and user annotation content to the cloud database in real time; when users log in to different devices to make annotations, data synchronization of user multimodal behavior data and user annotation content is achieved through data transmission between the cloud database and the device's local database; wherein, the cloud database can be used for multiple devices to download its stored cloud data.

[0102] Preferably, the system also includes a real-time collaboration module, which is used to upload the annotation content collected by each device to the cloud database via the Internet when multiple users log in to multiple devices to make annotations, so as to use the cloud server to organize the annotation content, and synchronously transmit the organized annotation content to each user device via the Internet; wherein the cloud server is connected to the cloud database.

[0103] The system architecture provided by this embodiment is simple and easy to implement. It can realize an intelligent annotation method, realize personalized dynamic adjustment of the annotation interface, and simplify user operation steps. The system can provide users with annotation suggestions and classify annotation content through intelligent semantic analysis; help users perform annotation operations through a virtual assistant; save annotation content for users to review and review; issue corresponding prompts and modification suggestions to users based on grammatical and / or logical errors in the annotation content; and provide cross-platform data synchronization and multi-user collaborative sharing of annotation functions, significantly improving the user annotation experience and effectively improving user annotation efficiency.

[0104] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and substitutions can be made without departing from the technical principles of the present invention. These improvements and substitutions should also be regarded as the scope of protection of the present invention.

Claims

1. An intelligent annotation method, characterized in that: The following steps are involved: Collecting user multimodal behavior data; the user multimodal behavior data includes stylus position, stylus pressure, stylus speed, voice commands and gestures; the equipment used to collect the user multimodal behavior data includes touch sensors, microphones and cameras; Using the user multimodal behavior data as input to a preset user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and further predicts the original user operation expectation; Perform a consistency analysis between the original user operation expectations and the preset user operation mode report to screen the original user operation expectations that meet the preset requirements, and then obtain the final user operation expectations; Dynamically adjust annotation tools and / or annotation interfaces based on end-user operational expectations and respond to user annotation operations; screening and / or generating matching annotation tools and annotation layouts according to the user operation mode report data, and then recommending the annotation tools and the annotation layouts to the user; Obtain user annotation content based on user annotation operation; Using the user's annotation content as input to a preset natural language processing model, so that the natural language processing model performs semantic analysis on the user's annotation content and further identifies the annotation theme and sentiment; Provide preset annotation suggestions and classify user annotation content based on annotation topics and emotions; The annotation suggestions include: highlighting keywords in the text, generating a brief summary of the document, adding sentiment tags to the text, and providing relevant supplementary information and / or references based on the context.

2. The intelligent annotation method according to claim 1, characterized in that: Also includes: Collect user operation instructions; The user operation instruction is input into a preset virtual assistant, so that the preset virtual assistant automatically performs the annotation operation and / or provides preset annotation suggestions.

3. The intelligent annotation method according to claim 1, characterized in that: Also includes: Obtain user annotation content based on user annotation operation; The user's annotation content is automatically saved as an annotation history version, so that the user can view and review the annotation history version.

4. The intelligent annotation method according to claim 1, characterized in that: Also includes: Obtain user annotation content based on user annotation operation; The user annotation content is used as input to a preset language model, and the language model automatically detects grammatical and / or logical errors in the user annotation content according to a preset language rule database, so as to issue corresponding prompts and modification suggestions to the user.

5. An intelligent annotation system, characterized in that: include: User data collection module, used to collect user multimodal behavior data; The user multimodal behavior data includes stylus position, stylus pressure, stylus speed, voice commands and gestures; the equipment used to collect the user multimodal behavior data includes a touch sensor, a microphone and a camera; A user behavior analysis module, which is pre-installed with a user behavior analysis model and is used to use user multimodal behavior data as input to the user behavior analysis model, so that the user behavior analysis model analyzes the user multimodal behavior data and further predicts the original user operation expectation; A user operation expectation prediction module, which is pre-set with a user operation pattern report and is used to perform a consistency analysis between the original user operation expectations and the user operation pattern report to screen the original user operation expectations that meet the preset requirements, and then obtain the final user operation expectations; A dynamic adjustment module, which is used to dynamically adjust the annotation tool and / or annotation interface based on the end user's operation requirements and operation intentions, and respond to the user's annotation operations; The dynamic adjustment module further filters and / or generates matching annotation tools and annotation layouts according to the user operation mode report data, and then recommends the annotation tools and the annotation layouts to the user; An intelligent semantic analysis module, which is pre-installed with a natural language processing model and is used to obtain user annotation content and use the user annotation content as input to the natural language processing model so that the natural language processing model can perform semantic analysis on the user annotation content and further identify the annotation theme and sentiment; Provide preset annotation suggestions and classify user annotation content based on annotation topics and emotions; The annotation suggestions include: highlighting keywords in the text, generating a brief summary of the document, adding sentiment tags to the text, and providing relevant supplementary information and / or references based on the context.

6. The intelligent annotation system according to claim 5, characterized in that: It also includes a virtual assistant module with a preset virtual assistant, which is used to collect user operation instructions and input the user operation instructions into the preset virtual assistant so that the virtual assistant automatically performs annotation operations and / or provides preset annotation suggestions.

7. The intelligent annotation system according to claim 5, characterized in that: It also includes an annotation backtracking control module for obtaining user annotation content; automatically saving the user annotation content as an annotation history version, so that the user can view and backtrack the annotation history version.

8. The intelligent annotation system according to claim 5, characterized in that: It also includes an intelligent feedback module for obtaining user annotation content; using the user annotation content as input to a preset language model, and the language model automatically detecting grammatical and / or logical errors in the user annotation content based on a preset language rule database; and issuing corresponding prompts and modification suggestions to the user based on the grammatical and / or logical errors.

Images