Interactive display method and system based on digital human control Web page
By embedding digital human models in web pages and using natural language processing, the problem of the single and unintelligent interaction methods of traditional web pages is solved, diversified interaction and intelligent services are achieved, and user experience and operation simplicity is improved.
Patent Information
- Application Number
- CN202410943071.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-15
- Publication Date
- 2024-11-29
AI Technical Summary
Traditional web page interaction methods rely on mouse and keyboard, with a single interaction form, limited user experience, lack of fun and interaction, making it difficult to attract and maintain user attention. Especially for users who are not familiar with computer operations, learning costs are high, and Lack of intelligent processing capabilities and cannot understand and respond to natural language instructions.
By embedding the configured digital human model into the web front-end page, initializing the instruction library, and receiving the user's natural language or voice commands, matching and executing corresponding actions, dynamically operating DOM elements, and real-time feedback results, providing a variety of interactive methods and intelligence Serving services.
It improves the flexibility and immediacy of web page interaction, reduces operation difficulty, provides a diversified user experience, simplifies complex operations, reduces learning costs, and enhances the intelligence level of the system.
Smart Images

Figure CN119045653A_ABST
Abstract
Description
Technical Field
[0001] This document relates to the field of human-computer interaction technology, and in particular to an interactive display method and system based on digital human controlling a Web page. Background Art
[0002] With the development of Internet technology, web pages have become an important carrier for information display and user interaction. Traditional web page interaction methods mainly rely on input devices such as mouse and keyboard, which have problems such as single interaction form and limited user experience. With the popularization of generative large model capabilities, the development of digital human technology has provided new possibilities for web page interaction. Virtual digital humans can not only simulate human behavior and language, but also realize intelligent interactive control through technologies such as natural language processing.
[0003] First, traditional Web pages mainly rely on hardware devices such as mouse and keyboard for interaction. Users need to interact with the page by clicking, dragging, inputting, etc. Secondly, the existing Web page interaction form is relatively mechanical, and users may feel bored during use. It lacks fun and interactivity, and it is difficult to attract and maintain users' attention. In addition, for some complex operations and functions, users need to spend more time and energy to understand and master them. Especially for users who are not familiar with computer operations, the learning cost is high. At the same time, traditional Web page interaction also mainly relies on preset program logic, lacks intelligent processing capabilities, and is difficult to understand and respond to users' natural language commands, and cannot provide intelligent interactive services. Summary of the invention
[0004] One or more embodiments of this specification provide an interactive display method based on digital human controlling a web page, including:
[0005] Embed the configured digital human model into the Web front-end page and initialize the digital human model instruction library;
[0006] Matching the received user instruction with the instruction content in the instruction library, and obtaining the corresponding instruction action according to the matching result;
[0007] The digital human model is controlled to perform actions according to the acquired command actions, and the action execution results are fed back to the user.
[0008] Furthermore, before embedding the digital human model into the Web front-end page, the digital human model is configured, including:
[0009] Configuring basic data and a behavior library of the digital human model, wherein the basic data includes the appearance and sound of the digital human model, and the behavior library includes the action data of the digital human model;
[0010] Set the page range for displaying the digital human model, including global display and partial display;
[0011] After the configured digital human model is embedded in the Web front-end page, the configuration data of the digital human model is loaded.
[0012] Furthermore, the input method of the user command includes text input and voice input, and the input content is a natural language command;
[0013] The received user instruction is matched with the instruction content in the instruction library, and the specific method for obtaining the corresponding instruction action according to the matching result is as follows:
[0014] Receiving command information input by a user, and if the information input by the user is voice command information, performing voice recognition on the received voice command information to obtain text command information;
[0015] Perform fuzzy matching between the text instruction information and the instruction content in the instruction library, and determine whether there is corresponding instruction content of the text instruction information in the instruction library according to the matching similarity;
[0016] If the match is successful, the corresponding instruction action will be fed back according to the matched instruction content.
[0017] Furthermore, the method further comprises:
[0018] If the information input by the user is voice command information, after the received voice command information is converted into text command information, the content of the obtained text command information is announced to the user by voice broadcast to confirm whether the obtained text command information is correct.
[0019] Furthermore, the digital human model is controlled to perform actions through the acquired command actions, and the action execution results are fed back to the user. The specific method is:
[0020] By acquiring the command action, the pointing, clicking and input actions of the digital human are controlled according to the command action information;
[0021] According to the actions performed by the digital human, dynamically operate DOM elements to achieve interactive display of pages;
[0022] Provide real-time feedback to users on the results of execution.
[0023] Furthermore, the results of the execution are fed back to the user in real time, including:
[0024] In response to the user's natural language input and operation, the execution results of the command action are fed back to the user in real time through the digital human's dynamic movements and voice broadcasts, maintaining interaction with the user.
[0025] Furthermore, the method further comprises:
[0026] When the received user instruction is matched with the instruction content in the instruction library, if no instruction action is matched, the digital human will notify the user to update the instruction library information;
[0027] The instruction library information at least includes instruction content and corresponding instruction actions.
[0028] One or more embodiments of this specification provide an interactive display system based on digital human controlling a web page, including:
[0029] Initial configuration module: used to embed the configured digital human model into the Web front-end page and initialize the digital human model instruction library;
[0030] Instruction matching module: used to match the received user instructions with the instruction content in the instruction library, and obtain the corresponding instruction action according to the matching result;
[0031] Action execution module: used to control the digital human model to perform actions through the acquired instruction actions, and feed back the action execution results to the user.
[0032] One or more embodiments of the present specification provide an electronic device, including:
[0033] processor; and,
[0034] A memory arranged to store computer executable instructions, which, when executed, enable the processor to implement the steps of the above-mentioned interactive display method based on digital human controlling Web pages.
[0035] One or more embodiments of the present specification provide a storage medium for storing computer executable instructions, which, when executed, implement the steps of the above-mentioned interactive display method based on digital human controlling a Web page.
[0036] By adopting the embodiment of the present invention, by introducing the digital human technology, the interaction of the web page is made more flexible and controllable. The interaction of the web page is controlled by the digital human, and the digital human provides real-time feedback on the user's operations and instructions, thereby improving the immediacy and effectiveness of the interaction and enabling the user to obtain a quick response and confirmation.
[0037] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate one or more embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0039] Figure 1 A flowchart of an interactive display method based on digital human controlling a Web page provided in one or more embodiments of this specification;
[0040] Figure 2 A schematic diagram of an implementation flow of an interactive display method based on digital human controlling a Web page provided in one or more embodiments of this specification;
[0041] Figure 3 A schematic diagram of the composition of an interactive display system based on digital human controlling a Web page provided in one or more embodiments of this specification;
[0042] Figure 4 A schematic diagram of the structure of an electronic device provided for one or more embodiments of this specification. DETAILED DESCRIPTION
[0043] In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the following will be combined with the drawings in one or more embodiments of this specification to clearly and completely describe the technical solutions in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on one or more embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this document.
[0044] Method Embodiment
[0045] According to an embodiment of the present invention, a method for interactive display of a web page based on digital human control is provided. Figure 1 A flowchart of an interactive display method based on digital human controlling a Web page provided in one or more embodiments of this specification, such as Figure 1 As shown, the interactive display method based on digital human controlling a Web page according to an embodiment of the present invention specifically includes:
[0046] S1. Embed the configured digital human model into the Web front-end page and initialize the digital human model instruction library.
[0047] Before embedding the digital human model into the Web front-end page, you need to configure the digital human model, including:
[0048] Configure the basic data and behavior library of the digital human model. The basic data includes the appearance and voice of the digital human model, and the behavior library includes the action data of the digital human model, to ensure that the digital human can be naturally presented and interacted on the page;
[0049] Set the page range for displaying the digital human model, that is, configure on which pages the digital human model is displayed, including global display and partial display;
[0050] After the configured digital human model is embedded in the Web front-end page, the above configuration data of the digital human model is loaded.
[0051] At the same time, the instruction library information is initialized to ensure that the digital human can retrieve the corresponding instructions and response results from the instruction library during the interaction with the human, so as to trigger the opening, switching, clicking and other operations of the Web page. In order to ensure the flexibility of operation and deal with emergencies, the instruction library can be updated in real time during the interaction of the digital human. At the same time, in order to ensure the rapid retrieval and execution of instruction information, the instruction library is obtained in advance in json format [{open xxx system: / pages / portal / index},{click xxx button: / click / button / xxx},{delete xxx data: / delete / data / xxx},...] and stored in the browser cache.
[0052] The instruction library information at least includes instruction content and corresponding instruction actions.
[0053] S2. Match the received user instruction with the instruction content in the instruction library, and obtain the corresponding instruction action according to the matching result.
[0054] The user command input method includes text input and voice input. The user interacts with the digital human by inputting natural language commands through voice or text, such as "Please open the grid electronic map", "Please open the event system and query the number of events today" and "Please delete the data titled xxx added today", etc.;
[0055] When voice command information or text command information is received from a user, if the information input by the user is voice command information, voice recognition is performed on the received voice command information to obtain text command information; optionally, after the received voice command information is converted into text command information, the content of the obtained text command information can be confirmed with the user through voice broadcast to determine whether the obtained text command information is correct.
[0056] After confirmation, the text instruction information is matched with the instruction content in the instruction library, and the corresponding instruction action is obtained according to the matching result. The specific method is as follows:
[0057] The text instruction information is fuzzily matched with the instruction content in the instruction library, and it is determined whether the instruction library has the corresponding instruction content of the text instruction information based on the matching similarity; if the match is successful, the corresponding instruction action is fed back based on the matched instruction content; if the instruction action is not matched, the digital human will notify the user to update the instruction library information.
[0058] S3. Control the digital human model to perform actions through the acquired instruction actions, and feed back the action execution results to the user.
[0059] Through the obtained command actions, the digital human is controlled to perform page operations according to the command action information, and the digital human is controlled to perform actions such as pointing, clicking, dragging and inputting; according to the actions performed by the digital human and the results generated by the digital human's actions, the rendering and interaction of Web elements are dynamically controlled to trigger operations such as opening, switching, and clicking of Web pages, and dynamically operate DOM elements to realize page interactive display, such as: expanding the event list, displaying the details of a certain event, jumping to the event supervision system and page navigation, etc.; the results after execution are fed back to the user in real time, etc.
[0060] When providing feedback, in response to the user's natural language input and operation, the execution results of the command action are fed back to the user in real time through the dynamic movements and voice broadcasts of the digital human, such as "The electronic map system has been opened. Currently, the system has gathered xxx pieces of human factor information and xxx pieces of organizational factor information. xxx new items were added today..." to maintain interaction with the user.
[0061] During the entire interaction process, the digital human responds to the user's natural language input and operations in real time, and maintains interaction with the user through dynamic movements and voice feedback. The user can continue to input new instructions, and the system loops through the above steps to complete the continuous interaction process.
[0062] Figure 2 A schematic diagram of an implementation flow of an interactive display method based on digital human controlling a Web page provided in one or more embodiments of this specification, such as Figure 2 As shown, in combination with the above implementation, the specific process steps of the interactive display method based on digital human controlling Web pages are as follows:
[0063] S101. Initialize the digital human model and instruction library;
[0064] S102. Recognize and analyze the natural language input by the user, including voice and text;
[0065] S103. Match the input natural language with the instructions in the instruction library, and obtain the instruction action to be executed;
[0066] S104. Determine whether the natural language and the instructions in the instruction library can match. If not, execute S105. If they can match, directly execute S106;
[0067] S105. Prompt the user through voice and update the instruction library information, and notify the digital human to execute according to the updated instruction action;
[0068] S106. After the action is executed, the result of the execution is displayed on the page;
[0069] S107. Based on the displayed page content, the digital human broadcasts the page content in real time to provide feedback to the user.
[0070] The beneficial effects of the present invention are as follows:
[0071] By adopting the embodiments of the present invention, by introducing virtual digital humans, users can interact with Web pages in various ways such as natural language and gestures, which greatly enriches the interaction methods and improves the diversity and flexibility of user experience; digital humans can simulate human behaviors and actions, and interact with users through voice and actions, making user interaction of Web applications simpler and more concise; users can complete complex operations through simple natural language instructions, which greatly reduces the difficulty of operation, is more friendly to users who are not familiar with computer operations, and reduces the learning cost; using natural language processing and artificial intelligence technology, the system can understand and respond to users' natural language instructions, provide intelligent interactive services, and improve the intelligence level of the system.
[0072] System Example
[0073] According to an embodiment of the present invention, there is provided an interactive display system based on digital human controlling a web page. Figure 3 A schematic diagram of an interactive display system based on digital human controlling a Web page provided in one or more embodiments of this specification, such as Figure 3 As shown, the interactive display system based on digital human controlling web pages according to an embodiment of the present invention specifically includes:
[0074] Initial configuration module 30: used to embed the configured digital human model into the Web front-end page and initialize the digital human model instruction library;
[0075] Instruction matching module 32: used to match the received user instruction with the instruction content in the instruction library, and obtain the corresponding instruction action according to the matching result;
[0076] The action execution module 34 is used to control the digital human model to perform actions according to the acquired instruction actions, and to feed back the action execution results to the user.
[0077] The embodiment of the present invention is a system embodiment corresponding to the above-mentioned method embodiment. The specific operations of each module can be understood by referring to the description of the method embodiment, which will not be repeated here.
[0078] Device Example 1
[0079] An embodiment of the present invention provides an electronic device, such as Figure 4 As shown, it includes: a memory 40, a processor 42, and a computer program stored in the memory 40 and executable on the processor 42. When the computer program is executed by the processor 42, the following method steps are implemented:
[0080] S1. Embed the configured digital human model into the Web front-end page and initialize the digital human model instruction library;
[0081] S2. Match the received user instruction with the instruction content in the instruction library, and obtain the corresponding instruction action according to the matching result;
[0082] S3. Control the digital human model to perform actions through the acquired instruction actions, and feed back the action execution results to the user.
[0083] Device Example 2
[0084] An embodiment of the present invention provides a computer-readable storage medium, on which a program for implementing information transmission is stored. When the program is executed by the processor 42, the following method steps are implemented:
[0085] S1. Embed the configured digital human model into the Web front-end page and initialize the digital human model instruction library;
[0086] S2. Match the received user instruction with the instruction content in the instruction library, and obtain the corresponding instruction action according to the matching result;
[0087] S3. Control the digital human model to perform actions through the acquired instruction actions, and feed back the action execution results to the user.
[0088] The computer-readable storage medium in this embodiment includes, but is not limited to, ROM, RAM, magnetic disk or optical disk, etc.
[0089] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for interactive display of Web pages based on digital human control, characterized in that: include: Embed the configured digital human model into the Web front-end page and initialize the digital human model instruction library; Matching the received user instruction with the instruction content in the instruction library, and obtaining the corresponding instruction action according to the matching result; The digital human model is controlled to perform actions according to the acquired command actions, and the action execution results are fed back to the user.
2. The method according to claim 1, characterized in that Before embedding the digital human model into the Web front-end page, configure the digital human model, including: Configuring basic data and a behavior library of the digital human model, wherein the basic data includes the appearance and sound of the digital human model, and the behavior library includes the action data of the digital human model; Set the page range for displaying the digital human model, including global display and partial display; After the configured digital human model is embedded in the Web front-end page, the configuration data of the digital human model is loaded.
3. The method according to claim 1, characterized in that The input method of the user instruction includes text input and voice input, and the input content is a natural language instruction; The received user instruction is matched with the instruction content in the instruction library, and the specific method for obtaining the corresponding instruction action according to the matching result is as follows: Receiving command information input by a user, and if the information input by the user is voice command information, performing voice recognition on the received voice command information to obtain text command information; Perform fuzzy matching between the text instruction information and the instruction content in the instruction library, and determine whether there is corresponding instruction content of the text instruction information in the instruction library according to the matching similarity; If the match is successful, the corresponding instruction action will be fed back according to the matched instruction content.
4. The method according to claim 3, characterized in that The method further comprises: If the information input by the user is voice command information, after the received voice command information is converted into text command information, the content of the obtained text command information is announced to the user by voice broadcast to confirm whether the obtained text command information is correct.
5. The method according to claim 1, characterized in that The specific method of controlling the digital human model to perform actions through the acquired command actions and feeding back the action execution results to the user is as follows: By acquiring the command action, the pointing, clicking and input actions of the digital human are controlled according to the command action information; According to the actions performed by the digital human, dynamically operate DOM elements to achieve interactive display of pages; Provide real-time feedback to users on the results of execution.
6. The method according to claim 5, characterized in that The results of the execution are fed back to the user in real time, including: In response to the user's natural language input and operation, the execution results of the command action are fed back to the user in real time through the digital human's dynamic movements and voice broadcasts, maintaining interaction with the user.
7. The method according to claim 1, characterized in that The method further comprises: When the received user instruction is matched with the instruction content in the instruction library, if no instruction action is matched, the digital human will notify the user to update the instruction library information; The instruction library information at least includes instruction content and corresponding instruction actions.
8. An interactive display system based on digital human controlling web pages, characterized in that: include: Initial configuration module: used to embed the configured digital human model into the Web front-end page and initialize the digital human model instruction library; Instruction matching module: used to match the received user instructions with the instruction content in the instruction library, and obtain the corresponding instruction action according to the matching result; Action execution module: used to control the digital human model to perform actions through the acquired instruction actions, and feed back the action execution results to the user.
9. An electronic device, characterized in that: include: processor; as well as, A memory arranged to store computer executable instructions, wherein when the computer executable instructions are executed, the processor implements the steps of the interactive display method based on digital human controlling a Web page as claimed in any one of claims 1 to 7.
10. A storage medium, characterized in that: Used to store computer executable instructions, which, when executed, implement the steps of the interactive display method based on digital human controlling a Web page as described in any one of claims 1 to 7.
Citation Information
Cited By
Man-machine interaction method and system of multi-mode intelligent digital human
CN120196212A
A human-computer interaction method and system for multimodal intelligent digital human
CN120196212B
