Multi-terminal digital human collaborative personality guidance system, control method, medium, program product and electronic terminal

Abstract

According to the multi-terminal digital human collaborative personality guidance system, the control method, the medium, the program product and the electronic terminal provided by the invention, unified personality feature configuration is managed in a centralized manner through the central collaborative control server and is issued to each terminal, and meanwhile, a context synchronization and semantic caching mechanism is established to integrate context information in guidance processing; after a new terminal recognizes the same user, a session is automatically recovered, and the same tone, name, expression style and the like are continued, so that cross-terminal collaboration of unification of personality, continuous semantics and context synchronization is realized. According to the method and the device, digital persons on a plurality of terminals can share unified personality definition, language style and context state, so that the continuous service experience of the same'virtual navigator 'is still kept during cross-terminal interaction of users.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, and in particular to multi-terminal digital human collaborative personality guidance systems, control methods, media, program products and electronic terminals. Background Technology

[0002] Currently, existing public space navigation or service robot systems often consist of multiple independent terminals, such as shopping mall information screens, interactive terminals next to elevators, and digital human assistants at entrances and exits.

[0003] However, these systems have the following drawbacks: the digital human appearance, tone, language, and memory are inconsistent across different terminals within the system, making each user interaction feel like a "restart"; users cannot have a continuous experience when asking for directions, consulting, or receiving guidance across terminals, lacking the feeling of "having a guide with them"; and the system has difficulty sharing dialogue history and user status, resulting in repeated questions and semantic fragmentation.

[0004] Therefore, existing systems typically exist in a "multi-terminal, independent" form. The appearance, tone, knowledge, and memory of digital humans lack uniformity across different terminals. When crossing terminals, previous dialogues and task states cannot be inherited, causing users to frequently "start from scratch" when asking for directions, consulting, or receiving continuous guidance. This results in a fragmented experience, low efficiency, and difficulty in achieving stable emotional and trust connections. Summary of the Invention

[0005] In view of the shortcomings of the prior art, the present invention provides a multi-terminal digital human collaborative personality guidance system, control method, medium, program product and electronic terminal to solve the problems of existing systems being unable to inherit previous dialogue and task states when crossing terminals, causing users to frequently "start from scratch" during asking for directions, consulting or continuous guidance, resulting in a fragmented experience, low efficiency and difficulty in achieving stable emotional and trust connections.

[0006] To achieve the above and other related objectives, a first aspect of this application provides a multi-terminal digital human collaborative personality guidance system, comprising: a central collaborative control server and multiple terminals connected to the central collaborative control server; the central collaborative control server controls the multiple terminals to interactively guide the same user using the same digital human personality characteristics; each terminal includes a human-computer interaction module and a user identification module; the human-computer interaction module is used to acquire the interaction information between the current user and the current terminal; the user identification module is used to process the interaction information between the current user and the current terminal to generate the current user's identification feature information and send the identification feature information to the central collaborative control server; the central collaborative control server includes a personality configuration module and a context synchronization module; the personality configuration module is used to acquire the configured digital human personality characteristics corresponding to the current user based on the identification feature information; the context synchronization module is used to acquire and analyze the interaction information between the current user and the current terminal and the historical context information of the current user and other terminals, generate corresponding guidance information based on the configured digital human personality characteristics, and send it to the current terminal.

[0007] In some embodiments of the first aspect of this application, the process of processing the interaction information between the current user and the current terminal to generate the current user's identification feature information includes: performing feature extraction based on the interaction information between the current user and the current terminal using a feature extraction algorithm to obtain the current user's body feature vector; and performing anonymous encoding processing based on the current user's body feature vector to obtain the current user's identification feature information on the current terminal.

[0008] In some embodiments of the first aspect of this application, the personality configuration module includes: a matching judgment unit, used to perform matching calculations on the current user's identification feature information and a number of temporarily stored user identification feature codes to obtain a matching calculation result; and a personality configuration unit, used to retrieve the corresponding digital human personality features configured by the current user according to the matching calculation result.

[0009] In some embodiments of the first aspect of this application, the personality configuration unit is further configured to define digital human personality traits and store digital human personality traits configured by each user.

[0010] In some embodiments of the first aspect of this application, each terminal includes a local semantic cache module; the local semantic cache module is used to process the interaction information between the current user and the current terminal and the guidance information sent to the current terminal, generate current context information and temporarily store it.

[0011] In some embodiments of the first aspect of this application, the central collaborative control server further includes a semantic cache management module; the semantic cache management module is used to store historical context information of different users and multiple terminals.

[0012] To achieve the above and other related objectives, a second aspect of this application provides a control method applied to the multi-terminal digital human collaborative personality guidance system. The system includes a central collaborative control server and multiple terminals connected to the central collaborative control server. The method includes: acquiring interaction information between the current user and the current terminal; processing the interaction information to generate identification feature information of the current user and sending the identification feature information to the central collaborative control server; acquiring the configured digital human personality features corresponding to the current user based on the identification feature information; acquiring and analyzing the interaction information between the current user and the current terminal, as well as the historical context information of the current user with other terminals, generating corresponding guidance information based on the configured digital human personality features, and sending it to the current terminal.

[0013] To achieve the above and other related objectives, a third aspect of this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the control method.

[0014] To achieve the above and other related objectives, a fourth aspect of this application provides a computer program product comprising computer program code that, when executed on a computer, causes the computer to implement the control method.

[0015] To achieve the above and other related objectives, a fifth aspect of this application provides an electronic terminal, including a memory, a processor, and a computer program stored in the memory; the processor executes the computer program to implement the control method.

[0016] As described above, the multi-terminal digital human collaborative personality guidance system, control method, medium, program product, and electronic terminal provided in this application have the following beneficial effects:

[0017] (1) This application achieves consistent voice, appearance and speech across multiple physical terminals by using unified digital human personality characteristics;

[0018] Ensure consistency in appearance, voice, and scripts across different devices to significantly reduce style inconsistencies;

[0019] (2) This application enables the new terminal to load key information in milliseconds by synchronizing context information, so that users do not need to repeatedly enter information to obtain continuous response;

[0020] (3) This application uses anonymous encoding to identify users, which balances the robustness of identification with the protection of users' personal privacy;

[0021] (4) The digital human in this application exhibits the same tone and expression across different terminals, maintaining the same address and emotional tone on different terminals, thus enhancing the sense of immersion. Attached Figure Description

[0022] Figure 1 The diagram shown is a structural schematic of a multi-terminal digital human collaborative personality guidance system according to an embodiment of this application.

[0023] Figure 2 The diagram shown is a structural schematic of a terminal according to an embodiment of this application.

[0024] Figure 3 The diagram shown is a structural schematic of a central collaborative control server according to an embodiment of this application.

[0025] Figure 4 The diagram shown is a structural schematic of a personality configuration module in one embodiment of this application.

[0026] Figure 5 The diagram shown is a flowchart illustrating a guidance system control method according to an embodiment of this application.

[0027] Figure 6 The diagram shown is a structural schematic of an electronic terminal according to an embodiment of this application. Detailed Implementation

[0028] The following specific examples illustrate the implementation of this application. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification. This application can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this application. It should be noted that, unless otherwise specified, the following embodiments and features in the embodiments can be combined with each other.

[0029] Before providing a further detailed description of the present invention, the nouns and terms used in the embodiments of the present invention are explained, and the nouns and terms used in the embodiments of the present invention are subject to the following interpretations:

[0030] Digital human systems: Digital human systems refer to systems that can simulate human appearance, voice, facial expressions, or movements, and engage in natural and fluent dialogue with users. Digital human systems can not only provide services such as information retrieval, entertainment, and education, but also serve as social partners, satisfying users' emotional and social needs.

[0031] To facilitate understanding of the embodiments of this application, firstly, in conjunction with Figure 1 and Figure 2 Detailed explanation. Figure 1 and Figure 2This illustration shows a schematic diagram of a multi-terminal digital human collaborative personality guidance system according to an embodiment of the present invention. The system in this embodiment includes: a central collaborative control server 100 and multiple terminals 200 connected to the central collaborative control server 100; the central collaborative control server 100 controls the multiple terminals 200 to provide interactive guidance to the same user using the same digital human personality characteristics. Specifically, when user 1 seeks guidance consultation on one of the multiple terminals in a target area, the digital human on that terminal plays corresponding guidance information based on the consultation. Then, when user 1 moves to another terminal in the target area and seeks guidance consultation again, the central collaborative control server 100 can control the digital human on the other terminal to output corresponding guidance information using the same digital human personality characteristics as the previous terminal. Similarly, when user 2 seeks guidance consultation on different terminals, the different terminals will also output corresponding guidance information using the same digital human personality characteristics for user 2.

[0032] like Figure 1 and Figure 2 As shown, each terminal 200 includes a human-computer interaction module 201 and a user identification module 202; the human-computer interaction module 201 is used to acquire the interaction information between the current user and the current terminal; the user identification module 202 is used to process the interaction information between the current user and the current terminal to generate the identification feature information of the current user, and send the identification feature information to the central collaborative control server 100.

[0033] In this embodiment, the terminal may take the form of a digital human, a mobile robot, a wall-mounted or suspended display screen, etc.

[0034] In this embodiment, multiple terminals are distributed and deployed in various physical locations (such as shopping mall entrances and exits, subway station entrances and exits, elevator entrances, passageway nodes, service desks, etc.) within the target area (such as commercial complexes, transportation hubs, parks, exhibition halls, homes, etc.) for real-time human-computer interaction with users.

[0035] In this embodiment, users include on-site staff, visitors, passengers, customers, etc. in the target area.

[0036] In this embodiment, the human-computer interaction module 201 includes a display screen, a touch screen, a microphone, a speaker, a camera, a projection device, etc., and is used to capture and acquire the interaction information between the current user and the current terminal.

[0037] In this embodiment, the interactive information includes visual interactive data and behavioral interactive data. The visual interactive data is image data such as the user's face, body contours, and posture collected by a camera or other means. The behavioral interactive data is touch pressure distribution, touch trajectory, voice data, text data, etc., collected synchronously by the user through interaction with the terminal via a touch screen or touch operation screen, voice, etc.

[0038] Specifically, before a user moves to any terminal location, the human-computer interaction module 201 can perform operations such as voice inquiries and touch gestures, and present a human-like digital human image on the display screen for conversational navigation guidance. The human-computer interaction module can also drive the virtual image, lip movements, facial expressions, gestures, etc., and output guidance information to the user through voice broadcasts, screen displays, and directional pointing.

[0039] In one embodiment of this application, the process of processing the interaction information between the current user and the current terminal to generate the current user's identification feature information includes: performing feature extraction based on the interaction information between the current user and the current terminal using a feature extraction algorithm to obtain the current user's body feature vector; and performing anonymous encoding processing based on the current user's body feature vector to obtain the current user's identification feature information on the current terminal.

[0040] It should be noted that multiple terminals within the target area can provide guidance and consultation services to different users, and the same digital human personality traits can be used to interact and guide the current user. Therefore, user identification is required to determine whether the user in front of the terminal has a configured digital human personality trait on the central collaborative control server 100, that is, to determine whether the user has interacted on other terminals.

[0041] In this embodiment, the feature extraction algorithm adopts an image recognition algorithm, including convolutional neural networks, graph neural networks, recurrent neural networks, long short-term memory networks, support vector machines, etc., which are selected according to actual needs and are not limited here.

[0042] For example, when a user approaches the current terminal, the human-computer interaction module 201 collects the user's visual image data through a camera, sensors, etc. It then uses a feature extraction algorithm to perform image recognition processing on the user's visual image data, identifying the user's body feature vector. This body feature vector includes features such as shoulders, elbows, hips, and knees. It is important to note that the body feature vector does not include the user's facial features to protect user privacy. The user's shoulder, elbow, hip, and knee feature vectors are then combined and anonymized to obtain the user's identification feature information on the current terminal, such as generating an anonymous identification feature code.

[0043] In addition, temporary visitor identifiers or user login identifiers can be generated based on the interaction information obtained by the human-computer interaction module 201, so as to link them to the user's interaction records on other terminals.

[0044] In this embodiment, the anonymization encoding method includes, but is not limited to, hash encoding algorithms, homomorphic encryption algorithms, differential privacy encoding algorithms, etc.

[0045] It needs to be explained that the shape feature vector is directly associated with the user's real identity information. In order to protect user privacy, anonymous identification feature codes are generated through anonymous encoding. The purpose is to retain the uniqueness of the features while ensuring that the identification function is not affected.

[0046] Combination Figure 1 , Figure 2 and Figure 3 The central collaborative control server 100 includes a personality configuration module 101 and a context synchronization module 102. The personality configuration module 101 is used to obtain the configured digital human personality characteristics of the current user based on identification feature information. The context synchronization module 102 is used to analyze and process the interaction information between the current user and the current terminal, as well as the historical context information between the current user and other terminals, and generate corresponding guidance information based on the configured digital human personality characteristics, then send it to the current terminal. It should be explained that after obtaining the identification feature information of the current user, the current terminal sends the identification feature information to the central collaborative control server 100. The central collaborative control server is communicatively connected to multiple terminals, used to store and distribute unified personality configurations, uniformly cache and manage user contexts, receive and distribute dialogue summaries and status information from each terminal, and push the latest session information to subsequent terminals as needed.

[0047] The central collaborative control server 100 can be selected from processors such as ARM (Advanced RISC Machines), FPGA (Field Programmable Gate Array) processors, SoC (System on Chip) processors, DSP (Digital Signal Processing) processors, MCU (Microcontroller Unit) processors, CPU (Central Processing Unit) central processing units, one or more application-specific integrated circuits (ASICs); or it can be a computer including components such as memory, memory controller, one or more processing units (CPUs), peripheral interfaces, RF circuits, input / output (I / O) subsystems, other output or control devices, and external ports, etc. This embodiment is not limited.

[0048] Specifically, in the central collaborative control server, the personality configuration module 101 receives the current user's identification feature information, finds the digital human personality feature configured for the current user based on the user's identification feature information, and can send the digital human personality feature to the current terminal. Furthermore, the context synchronization module 102 enables the sharing of the user's interaction context state across multiple terminals. Through the central collaborative control server, the current user can use the same digital human personality feature when facing different terminals, allowing digital humans distributed across different terminals to work collaboratively, maintaining personality consistency and context continuity, thus improving the user experience.

[0049] In one embodiment of this application, as Figure 4 As shown, the personality configuration module 101 includes: a matching judgment unit 1011, used to perform matching calculations between the current user's identification feature information and several temporarily stored user identification feature codes to obtain a matching calculation result; and a personality configuration unit 1012, used to retrieve the corresponding digital human personality features configured by the current user based on the matching calculation result. The personality configuration module manages personality parameters such as the appearance, voice features, tone, titles, word usage habits, facial expression style, and knowledge domain of the terminal digital human.

[0050] In one embodiment of this application, as Figure 4 As shown, the personality configuration unit 1012 is also used to define digital human personality characteristics and store the digital human personality characteristics configured by each user. The digital human personality characteristics include, but are not limited to: appearance and image settings (same character, same image), language style and word usage habits (such as how to address users, level of politeness, tone of voice), voice characteristics (voice timbre, speech rate, emotional tone), and behavior and expression style (such as facial expressions, actions, emotional expression templates such as comforting and encouraging), so that the digital human of the same user has consistent personality characteristics when facing terminals in different locations.

[0051] Specifically, when any user interacts with a terminal, a corresponding identification code is generated. All user identification codes across different terminals are temporarily stored on a central collaborative control server. This temporary storage refers to storing the code for a certain period. When the storage time of a user's identification code exceeds a preset range, the code is cleared to ensure user privacy and security.

[0052] Digital human personality traits are defined and stored in the personality configuration unit 1012. For example, when the current user conducts the first guidance consultation on multiple terminals, new digital human personality traits are configured for the current user and temporarily stored in the personality configuration unit. When the current user moves to another terminal for the second guidance consultation, the digital human personality traits temporarily stored in the first consultation can be retrieved from the personality configuration unit and used as the personality traits of the current terminal's digital human to play guidance information. When the current user moves to other terminals, the corresponding personality traits are also configured or called by the personality configuration unit and provided to the terminal.

[0053] Furthermore, the matching judgment unit 1011 can judge the current user to determine whether they have consulted on other terminals and whether they have configured digital human personality characteristics. Specifically, the judgment method involves calculating the similarity between the current user's identification feature information obtained from the current terminal and all temporarily stored user identification feature codes. If the similarity value between the current user's identification feature information and any user identification feature code is greater than or equal to a similarity threshold, it indicates that the current user has consulted on other terminals and has configured digital human personality characteristics. In this case, the corresponding digital human personality characteristics for the current user are retrieved in the personality configuration unit. If the similarity value between the current user's identification feature information and all user identification feature codes is less than a similarity threshold, it indicates that the current user does not have corresponding configured digital human personality characteristics within a preset storage time range. In this case, a new digital human personality characteristic is configured for the current user in the personality configuration unit.

[0054] Furthermore, in the context synchronization module 102, the interaction information between the current user and the current terminal, as well as the historical context information between the current user and other terminals, are analyzed and processed. Combined with the map information and operation management information of the target area, a path planning algorithm is used to obtain the planned path. Based on the planned path and the digital human personality characteristics, dialogue text and visual cues are constructed to generate guidance information. The digital human of the current terminal outputs the guidance information according to the digital human personality characteristics configured for the current user, so that the current user can navigate according to the guidance information.

[0055] It should be noted that in the context synchronization module, if the current user has interacted and been guided across multiple terminals, the multiple terminals can share the context information after the interaction. That is, the current terminal can comprehensively analyze the historical context information of the user's interaction with previous terminals to obtain the user's guidance information.

[0056] For example, if the user's current goal or task intent in the interaction information with the current terminal is "I want to go to the parking lot"; and the user has already received guidance steps after interacting with previous terminals, such as "We just said to go to elevator number 2 first," then the current terminal's output of the current navigation or service progress considers not only the current goal or task intent but also the previous guidance steps. When the user moves from terminal A to terminal B, terminal B can obtain the historical context information with terminal A through the context synchronization module, and continue responding to the guidance information from terminal A, instead of starting over. For example, if terminal A and terminal B are identified as belonging to the same user, terminal B will output a continuous dialogue to the user, such as "We have just planned the xx route for you, now please turn right and go to the elevator," thereby achieving a unified personality and semantic continuity of context across multiple terminals, rather than repeating questions and answers.

[0057] In one embodiment of this application, as Figure 2 As shown, each terminal includes a local semantic cache module 203; the local semantic cache module 203 is used to process the interaction information between the current user and the current terminal, as well as the guidance information sent to the current terminal, to generate current context information and temporarily store it. The processing of interaction information and guidance information is as follows: summarizing, compressing, and structured archiving (for example, extracting "user destination = warehouse level 3 in area B" instead of the complete interactive dialogue).

[0058] It's important to explain that when the current user interacts with the current terminal, the interaction is a continuous process. The user will continue to interact based on the output; for example, after asking how to get there, the next step might be to ask for restaurant recommendations. Therefore, a local semantic caching module is used to temporarily store contextual information such as the question-and-answer summary, target intent, and current navigation stage between the current terminal and the current user. This facilitates rapid response and avoids requesting the complete context from the central collaborative control server during each interaction. After the current terminal completes the guidance consultation for the current user, the corresponding context information can be generated and sent to the central collaborative control server for storage.

[0059] In one embodiment of this application, as Figure 3 As shown, the central collaborative control server 100 also includes a semantic cache management module 103; the semantic cache management module 103 is used to store historical context information of different users and multiple terminals.

[0060] Specifically, each terminal generates corresponding context information after interacting with the user. To ensure context synchronization across different terminals, the context information is temporarily stored in the semantic cache management module of the central collaborative control server. When the user moves from terminal A to terminal B, the historical context information of the user and terminal A stored in the semantic cache management module is called. This allows for a comprehensive analysis of the user's target needs, and terminal B can continue to reply based on the information from terminal A.

[0061] The semantic cache management module 103 is used to summarize and manage the context information reported by each terminal, and can also annotate the context information. Annotated important information can be synchronized to the next terminal, while annotated unimportant information is only retained on the current terminal. The semantic cache management module 103 stores short, clear, and inheritable context information obtained by each terminal, rather than a large amount of raw voice content.

[0062] The multi-terminal digital human collaborative personality guidance system provided in this application enables users to enjoy a seamless dialogue and guidance experience with "the same guide continuously accompanying them" even when they are on different physical location terminals. Experiments have shown that the cross-terminal path completion rate is increased by about 13%, and the mid-journey abandonment rate is reduced by about 18%, proving that this collaborative personality mechanism has significant effectiveness in continuous guidance scenarios.

[0063] In this embodiment, the central collaborative control server is further configured to perform statistical learning and retraining based on the acquired interaction information, context information, and updated unified digital human personality characteristics to form a collaborative personality model. This collaborative personality model enables the terminal digital human to better match user preferences and scenario requirements.

[0064] To facilitate understanding of the multi-terminal digital human collaborative personality guidance system of this application, the following specific embodiments are provided for illustration.

[0065] Example 1:

[0066] Three types of terminals—entrance screens, elevator lobby screens, and exhibition hall screens—were deployed at different locations within a three-story commercial complex. Each terminal was equipped with a human-computer interaction module and retrieved a digital personality characteristic parameter package (e.g., voice timbre = mezzo-soprano, politeness level = high, address rule = "you + title") from a central collaborative control server for the current user. When a user inquired at the entrance screen about "how to get to the art exhibition hall," the system generated guidance information "entrance → elevator 2 → third-floor exhibition hall" and uploaded contextual information. Upon reaching the elevator lobby screen, the user was identified as the same user through feature matching, and the elevator lobby screen directly continued the dialogue, "We just mentioned taking elevator 2 to the third floor. After arriving, please turn right to enter the exhibition area," and finally, the question and answer were completed on the exhibition hall screen. In a two-week experiment (112 users, three-stage cross-terminal path), the system showed that the cross-terminal repeated question rate decreased by approximately 41% compared to traditional systems, and the median first response latency remained between 250-320ms.

[0067] It should be emphasized that the multi-terminal digital human collaborative personality guidance system provided in this application has the following beneficial effects:

[0068] (1) This application achieves consistent voice, appearance and speech across multiple physical terminals by using unified digital human personality characteristics;

[0069] Ensure consistency in appearance, voice, and scripts across different devices to significantly reduce style inconsistencies;

[0070] (2) This application enables the new terminal to load key information in milliseconds by synchronizing context information, so that users do not need to repeatedly enter information to obtain continuous response;

[0071] (3) This application uses anonymous encoding to identify users, which balances the robustness of identification with the protection of users' personal privacy;

[0072] (4) The digital human in this application exhibits the same tone and expression across different terminals, maintaining the same address and emotional tone on different terminals, thus enhancing the sense of immersion.

[0073] The multi-terminal digital human collaborative personality guidance system proposed in this application centrally manages and distributes unified personality feature configurations to each terminal through a central collaborative control server. Simultaneously, it establishes a context synchronization and semantic caching mechanism to integrate contextual information during guidance processing. Upon recognizing the same user on a new terminal, it automatically resumes the conversation and maintains the same tone, address, and facial expression style, achieving cross-terminal collaboration with unified personality, semantic continuity, and context synchronization. This application enables digital humans on multiple terminals to share a unified personality definition, language style, and contextual state, thus maintaining a continuous service experience from the same "virtual guide" when users interact across terminals.

[0074] In the embodiments of this application, the terms "first" and "second" are used to distinguish identical or similar items with essentially the same function and effect, without limiting their order. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that the terms "first" and "second" do not necessarily imply that they are different.

[0075] It should be noted that, in the embodiments of this application, the words "exemplary" or "for example" indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0076] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0077] Figure 5 A schematic block diagram of the control method for the multi-terminal digital human collaborative personality guidance system provided in this application embodiment is shown below. Figure 5 As shown, the method is applied to the multi-terminal digital human collaborative personality guidance system described above, the system comprising: a central collaborative control server and multiple terminals connected to the central collaborative control server; the method comprising:

[0078] Step S51: Obtain the interaction information between the current user and the current terminal;

[0079] Step S52: Process the interaction information between the current user and the current terminal to generate the current user's identification feature information, and send the identification feature information to the central collaborative control server;

[0080] Step S53: Obtain the digital human personality characteristics configured for the current user based on the identification feature information;

[0081] Step S54: Analyze and process the interaction information between the current user and the current terminal, as well as the historical context information between the current user and other terminals, and generate corresponding guidance information based on the configured digital human personality characteristics and send it to the current terminal.

[0082] It should be understood that the specific process of performing the above-mentioned steps has been described in detail in the above system embodiments, and will not be repeated here for the sake of brevity.

[0083] It should also be understood that the module division in the embodiments of this application is illustrative and only represents a logical functional division; in actual implementation, there may be other division methods. Furthermore, the functional modules in the various embodiments of this application can be integrated into a single processor, exist as separate physical entities, or be integrated into a single module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0084] Figure 6 This is a schematic block diagram of the electronic terminal provided in an embodiment of this application. Figure 6 As shown, the electronic terminal includes at least one processor 601, a memory 602, at least one network interface 603, and a user interface 605. The various components in the device are coupled together via a bus system 604. It is understood that the bus system 604 is used to implement communication between these components. In addition to a data bus, the bus system 604 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in… Figure 6 The general will label all buses as bus systems.

[0085] The user interface 605 may include a monitor, keyboard, mouse, trackball, clicker, button, touchpad, or touch screen.

[0086] It is understood that memory 602 can be volatile memory or non-volatile memory, or both. Non-volatile memory can be read-only memory (ROM) or programmable read-only memory (PROM), which serves as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM) and synchronous static random access memory (SSRAM). The memories described in the embodiments of this invention are intended to include, but are not limited to, these and any other suitable categories of memory.

[0087] In this embodiment of the invention, the memory 602 is used to store various types of data to support the operation of the electronic terminal 600. Examples of this data include: any executable program for operation on the electronic terminal 600, such as the operating system 6021 and application programs 6022; the operating system 6021 contains various system programs, such as the framework layer, core library layer, driver layer, etc., for implementing various basic services and handling hardware-based tasks. The application program 6022 may contain various applications, such as a media player, browser, etc., for implementing various application services. The control method provided in this embodiment of the invention can be included in the application program 6022.

[0088] The methods disclosed in the above embodiments of the present invention can be applied to processor 601, or implemented by processor 601. Processor 601 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in processor 601 or by instructions in the form of software. The processor 601 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Processor 601 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. General-purpose processor 601 may be a microprocessor or any conventional processor, etc. The steps of the accessory optimization method provided in the embodiments of the present invention can be directly reflected as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, which is located in a memory. The processor reads the information in the memory and combines it with its hardware to complete the steps of the aforementioned method.

[0089] In an exemplary embodiment, the electronic terminal 600 may be used to execute the aforementioned method by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), or complex programmable logic devices (CPLDs).

[0090] According to the method provided in the embodiments of this application, this application also provides a computer program product, which includes: computer program code, which, when run on a computer, causes the computer to execute the control method of any of the embodiments shown in the examples.

[0091] According to the method provided in the embodiments of this application, this application also provides a computer-readable storage medium storing program code that, when run on a computer, causes the computer to execute the control method of any of the embodiments shown.

[0092] As used in this specification, the terms "component," "module," "system," etc., are used to refer to computer-related entities, hardware, firmware, combinations of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or a computer. As illustrated, applications running on computing devices and computing devices can both be components. One or more components may reside in a process and / or an execution thread, and components may be located on a single computer and / or distributed among two or more computers. Furthermore, these components can be executed from various computer-readable media on which various data structures are stored. Components can communicate, for example, via local and / or remote processes based on signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system, and / or a network, such as the Internet interacting with other systems via signals).

[0093] Those skilled in the art will recognize that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0094] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0095] In the embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0096] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0097] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0098] In the above embodiments, the functions of each functional unit can be implemented entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. A computer program product includes one or more computer instructions (programs). When the computer program instructions (programs) are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., high-density digital video discs, DVDs), or semiconductor media (e.g., solid-state disks, SSDs, etc.).

[0099] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0100] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0101] In summary, the multi-terminal digital human collaborative personality guidance system, control method, medium, program product, and electronic terminal provided in this application include: a central collaborative control server and multiple terminals connected to the central collaborative control server; the central collaborative control server controls multiple terminals to interactively guide the same user using the same digital human personality characteristics; each terminal includes a human-computer interaction module and a user identification module; the human-computer interaction module is used to acquire the interaction information between the current user and the current terminal; the user identification module is used to process the interaction information between the current user and the current terminal to generate the current user's identification feature information and send the identification feature information to the central collaborative control server; the central collaborative control server includes a personality configuration module and a context synchronization module; the personality configuration module is used to acquire the configured digital human personality characteristics of the current user according to the identification feature information; the context synchronization module is used to acquire and analyze the interaction information between the current user and the current terminal and the historical context information of the current user and other terminals, generate corresponding guidance information based on the configured digital human personality characteristics, and send it to the current terminal.

[0102] This application centrally manages and distributes unified personality feature configurations to various terminals through a central collaborative control server. Simultaneously, it establishes a context synchronization and semantic caching mechanism to integrate contextual information during the guidance process. Upon recognizing the same user on a new terminal, it automatically resumes the conversation and maintains the same tone, address, and facial expression style, achieving cross-terminal collaboration with unified personality, semantic continuity, and context synchronization. This application enables digital humans on multiple terminals to share a unified personality definition, language style, and contextual state, thus maintaining a continuous service experience of the same "virtual guide" when users interact across terminals. Therefore, this application effectively overcomes the various shortcomings of existing technologies and has high industrial application value.

[0103] The above embodiments are merely illustrative of the principles and effects of this application and are not intended to limit this application. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in this application should still be covered by the claims of this application.

Claims

1. A multi-terminal digital human collaborative personality guidance system, characterized in that, include: A central collaborative control server and multiple terminals connected to the central collaborative control server; the central collaborative control server controls the multiple terminals to interact and guide the same user using the same digital human personality characteristics. Each terminal includes a human-computer interaction module and a user identification module; The human-computer interaction module is used to acquire the interaction information between the current user and the current terminal; The user identification module is used to process the interaction information between the current user and the current terminal to generate the identification feature information of the current user, and send the identification feature information to the central collaborative control server. The central collaborative control server includes a personality configuration module and a context synchronization module; The personality configuration module is used to obtain the digital human personality characteristics configured for the current user based on the recognition feature information; The context synchronization module is used to acquire and analyze the interaction information between the current user and the current terminal, as well as the historical context information between the current user and other terminals. Based on the configured digital human personality characteristics, it generates corresponding guidance information and sends it to the current terminal.

2. The multi-terminal digital human collaborative personality guidance system according to claim 1, characterized in that, The process of processing the interaction information between the current user and the current terminal to generate the current user's identification feature information includes: Based on the interaction information between the current user and the current terminal, a feature extraction algorithm is used to extract features and obtain the current user's body feature vector. Anonymize the current user's body feature vector to obtain the current user's identification feature information on the current terminal.

3. The multi-terminal digital human collaborative personality guidance system according to claim 1, characterized in that, The personality configuration module includes: The matching and judgment unit is used to perform matching calculations between the current user's identification feature information and several temporarily stored user identification feature codes to obtain the matching calculation results; The personality configuration unit is used to retrieve the corresponding digital human personality characteristics configured by the current user based on the matching calculation results.

4. The multi-terminal digital human collaborative personality guidance system according to claim 3, characterized in that, The personality configuration unit is also used to define digital human personality traits and store the digital human personality traits configured by each user.

5. The multi-terminal digital human collaborative personality guidance system according to claim 1, characterized in that, Each terminal includes a local semantic cache module; the local semantic cache module is used to process the interaction information between the current user and the current terminal and the guidance information sent to the current terminal, generate current context information and temporarily store it.

6. The multi-terminal digital human collaborative personality guidance system according to claim 1, characterized in that, The central collaborative control server also includes a semantic cache management module; the semantic cache management module is used to store historical context information of different users and multiple terminals.

7. A control method, characterized in that, The multi-terminal digital human collaborative personality guidance system, as described in any one of claims 1 to 6, comprises: a central collaborative control server and multiple terminals connected to the central collaborative control server; the method comprises: Obtain interaction information between the current user and the current terminal; The interaction information between the current user and the current terminal is processed to generate the current user's identification feature information, and the identification feature information is sent to the central collaborative control server; Based on the identification feature information, obtain the digital human personality characteristics configured for the current user; The system acquires and analyzes the interaction information between the current user and the current terminal, as well as the historical context information between the current user and other terminals. Based on the configured digital human personality characteristics, it generates corresponding guidance information and sends it to the current terminal.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the control method of claim 7.

9. A computer program product, characterized in that, The computer program product includes computer program code, which, when run on a computer, causes the computer to implement the control method as described in claim 7.

10. An electronic terminal, comprising a memory, a processor, and a computer program stored in the memory, characterized in that, The processor executes the computer program to implement the control method of claim 7.

Images