Digital human data interaction method and device, equipment and medium

Abstract

The invention relates to a digital human data interaction method, device and equipment and a medium, and the method comprises the steps: obtaining a plurality of groups of different types of digital human interaction data; uniformly packaging a plurality of groups of different types of digital human interaction data into a mixed data stream; extracting and analyzing the mixed data stream to obtain a plurality of groups of to-be-executed data; and controlling the digital human to execute corresponding operation according to the to-be-executed data. Different types of digital human interaction data are uniformly packaged into the mixed data stream, the mixed data stream is analyzed to obtain multiple groups of to-be-executed data, and the digital human is controlled to perform uniform execution on the to-be-executed data, so that standardization of a data format is realized, the interaction data integration and processing flow is simplified, and the data processing efficiency is improved. The real-time performance and continuity of digital human interaction are improved, simultaneous processing and output of multiple data type identifications are achieved, the efficiency and effect of digital human interaction are remarkably improved, and high expandability is achieved.

Description

Technical Field

[0001] The present invention relates to the field of digital human technology, and in particular to a digital human data interaction method, device, equipment and medium. Background Art

[0002] Digital Human refers to a virtual being created using digital technologies (such as artificial intelligence, virtual reality, augmented reality, etc.) that simulates human appearance, behavior, voice, and thinking. Digital Human is not just a digitized character image, but also includes human-like cognition, emotion, and decision-making capabilities through computer simulation, human-computer interaction, and intelligent algorithms.

[0003] With the rapid development of digital technology, digital humans are increasingly used in various fields, such as virtual anchors, game characters, online education, virtual customer service, etc. The interactive ability of digital humans is the key to whether they can realistically simulate human behavior and achieve efficient human-computer interaction. Traditional digital human interaction methods often rely on a single data type identifier, such as text, voice or image, and these data are usually transmitted and processed in an independent form. This approach has the following main problems: 1. Inconsistent data format: Different types of interactive data (such as voice, expression, action, etc.) use different encoding and transmission protocols, which makes data integration and processing complicated. 2. Poor data synchronization: Due to the different processing speeds and transmission delays of different data type identifiers, data inconsistency or delay is prone to occur, affecting the real-time and continuity of digital human interaction. 3. Low interaction efficiency: The processing of a single data type identifier is usually simple, but it is difficult to meet the needs of complex interaction scenarios, such as the simultaneous output of voice and expression, which increases the system's processing burden and interaction delay. 4. Poor scalability: With the continuous development of digital human interaction technology, new data types and interaction methods continue to emerge, and traditional methods are difficult to flexibly adapt to these changes. Summary of the invention

[0004] The purpose of the present invention is to overcome the deficiencies of the prior art and provide a digital human data interaction method, device, equipment and medium.

[0005] In order to solve the above technical problems, the present invention adopts the following technical solutions:

[0006] In a first aspect, this embodiment provides a digital human data interaction method, comprising the following steps:

[0007] Acquire several groups of different types of digital human interaction data;

[0008] Unifying and encapsulating several groups of different types of digital human interaction data into a mixed data stream;

[0009] Extracting and parsing the mixed data stream to obtain several groups of data to be executed;

[0010] The digital human is controlled to perform corresponding operations according to the data to be executed.

[0011] Furthermore, the step of packaging several groups of digital human interaction data of different types into a mixed data stream comprises the following steps:

[0012] Create a unified data structure;

[0013] Several groups of the digital human interaction data of different types are encapsulated in the data structure to form the mixed data stream.

[0014] Furthermore, the step of encapsulating several groups of the digital human interaction data of different types into the data structure to form the mixed data stream comprises the following steps:

[0015] Dividing the digital human interaction data into a plurality of frame data;

[0016] Adding a data type identifier and a timestamp identifier to the frame data;

[0017] Encapsulating the frame data and the corresponding data type identifier and timestamp identifier into an independent data unit;

[0018] All of the independent data units are encapsulated in the data structure to form the mixed data stream.

[0019] Furthermore, the step of parsing the mixed data stream to obtain several groups of data to be executed includes the following steps:

[0020] extracting the independent data unit from the mixed data stream;

[0021] Parsing the independent data unit to obtain the frame data and the corresponding data type identifier and timestamp identifier;

[0022] Sorting the frame data according to the timestamp identifier to obtain the sorted frame data;

[0023] The sorted frame data is converted into corresponding data to be executed according to the data type identifier.

[0024] In a second aspect, this embodiment provides a digital human data interaction device, including: an acquisition unit, a packaging unit, an extraction and analysis unit, and a control unit;

[0025] The acquisition unit is used to acquire several groups of digital human interaction data of different types;

[0026] The encapsulation unit is used to uniformly encapsulate several groups of digital human interaction data of different types into a mixed data stream;

[0027] The extraction and parsing unit is used to extract and parse the mixed data stream to obtain a plurality of groups of data to be executed;

[0028] The control unit is used to control the digital human to perform corresponding operations according to the data to be executed.

[0029] Further, the encapsulation unit includes a creation module and an encapsulation module;

[0030] The creation module is used to create a unified data structure;

[0031] The encapsulation module is used to encapsulate several groups of different types of digital human interaction data into the data structure to form the mixed data stream.

[0032] Further, the encapsulation module includes a division submodule, an addition submodule, a first encapsulation submodule and a second encapsulation submodule;

[0033] The division submodule is used to divide the digital human interaction data into a plurality of frames of data;

[0034] The division submodule is used to add a data type identifier and a timestamp identifier to the frame data;

[0035] The first encapsulation submodule is used to encapsulate the frame data and the corresponding data type identifier and timestamp identifier into an independent data unit;

[0036] The second encapsulation submodule is used to encapsulate all the independent data units into the data structure to form the mixed data stream.

[0037] In a third aspect, this embodiment provides a computer device, which includes a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the digital human data interaction method as described above is implemented.

[0038] In a fourth aspect, this embodiment provides a storage medium storing a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the digital human data interaction method described above can be implemented.

[0039] Compared with the prior art, the present invention has the following beneficial effects: by uniformly encapsulating different types of digital human interaction data into a mixed data stream, the standardization and unification of data formats are achieved, the process of data integration and processing is simplified, all interactive data contained in the mixed data stream is kept synchronized during transmission and processing, effectively avoiding data inconsistency or delay, improving the real-time and continuity of digital human interaction, obtaining the data to be executed by parsing the mixed data stream, and controlling the digital human to uniformly execute the data to be executed, realizing the simultaneous processing and output of multiple data type identifiers, and significantly improving the efficiency and effect of digital human interaction; the technical solution of the present invention can flexibly adapt to new data type identifiers and interaction methods, and only needs to add corresponding data fields in the mixed data stream to support new functions, reducing the cost of system upgrades and maintenance. As the real-time, continuity and efficiency of data interaction are improved, the behavior of digital humans is more realistic and natural, thereby significantly optimizing the user experience and enhancing the sense of interaction and immersion between users and digital humans.

[0040] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0042] Figure 1 A schematic diagram of a flow chart of a digital human data interaction method provided by an embodiment of the present invention;

[0043] Figure 2 A schematic block diagram of a digital human data interaction device provided by an embodiment of the present invention;

[0044] Figure 3 A schematic block diagram of a computer device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0045] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0046] It should be understood that when used in this specification and the appended claims, the terms "include" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0047] It should also be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0048] It should be further understood that the term "and / or" used in the present description and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0049] See also Figure 1 In the specific embodiment shown, the present invention discloses a digital human data interaction method, comprising the following steps:

[0050] S1, obtain several groups of different types of digital human interaction data.

[0051] Specifically, the type and source of each group of digital human interaction data are different. The types of digital human interaction data include but are not limited to voice data, text data and digital human action data. The sources of each type of digital human interaction data are independent of each other, which facilitates the classification of different digital human interaction data and other subsequent operations. At the same time, it also provides diversified interaction information for digital humans, making the interaction of digital humans more flexible and enabling digital humans to better simulate human behavior. Through the above step S1, the original data is provided for the entire data interaction process, which is the basis for subsequent operations.

[0052] For example, in actual applications, voice data can be obtained through voice input devices such as microphones, and movements and expressions can be captured as digital human movement data through dynamic capture devices such as cameras and sensors. Text data can be obtained through keyboards, external file reading, or voice conversion, etc.

[0053] S2, encapsulating several groups of different types of digital human interaction data into a mixed data stream.

[0054] Specifically, step S2 includes the following steps:

[0055] Create a unified data structure.

[0056] Specifically, by designing a unified data structure to encapsulate all interactive data, a clear storage framework is provided for the storage of digital human interactive data, which facilitates the storage and management of data, avoids chaotic storage of data, and facilitates subsequent operations.

[0057] Specifically, in this embodiment, a data structure is created that includes but is not limited to fields such as data type identifier, data content, and timestamp identifier. Through such a data structure, not only the data itself can be encapsulated, but also the type and time of the data can be recorded, providing more information for subsequent processing and being able to easily adapt to the growth of data volume or the demand for new data types.

[0058] Several groups of the digital human interaction data of different types are encapsulated in the data structure to form the mixed data stream.

[0059] By storing various types of digital human interaction data in an orderly manner in the created data structure, a complete data flow is formed, thereby improving the integrity of data processing, avoiding the complexity and incoherence of decentralized processing of data of different data types, facilitating subsequent data transmission and analysis, and facilitating system maintenance and expansion.

[0060] Furthermore, the step of encapsulating several groups of digital human interaction data of different types into the data structure to form the mixed data stream includes the following steps:

[0061] Dividing the digital human interaction data into a plurality of frame data;

[0062] Specifically, digital human interaction data usually includes one or more frame data, and one frame data contains interaction information within a period of time. In particular, voice data and digital human action data usually include several continuous frame data, and one frame data usually contains an image (video frame, action frame) or a period of audio (audio frame). By dividing the digital human interaction data into several frame data, the data processing unit is refined, which facilitates more refined management and processing of digital human interaction data, improves the flexibility and accuracy of data processing, facilitates subsequent addition of identification and storage, and also facilitates accurate processing and synchronization of data in time.

[0063] A data type identifier and a timestamp identifier are added to the frame data.

[0064] Specifically, the data type of the corresponding frame data can be identified according to the acquisition source or characteristics of the digital human interaction data, for example: if the acquisition source of the digital human interaction data is a voice input device such as a microphone, or the digital human interaction data is an audio file, then the data type of the corresponding frame data is voice data; if the acquisition source of the digital human interaction data is a dynamic capture device such as a camera, or the digital human interaction data is a list or array containing action parameters, then the data type of the corresponding frame data is digital human action data; if the acquisition source of the digital human interaction data is a text input device such as a keyboard or text information in an external file, or the digital human interaction data is a string, then the data type of the corresponding frame data is text data. Adding a corresponding data type identifier to the corresponding frame data according to the identified data type can help directly identify the data type of the frame data in subsequent operations, so that the system can select the appropriate processing module according to the data type identifier in the subsequent processing process, and ensure that the playback or rendering of each data meets expectations.

[0065] Timestamp identifiers record the time when frame data is generated or should be processed, which is crucial for time-sensitive system operations. When processing continuous data, such as video playback, action sequence execution, or audio playback, it is necessary to process it in chronological order to ensure data continuity and synchronization. Timestamp identifiers can ensure that frame data is processed at the correct time point, avoiding data disorder and operation confusion, and also help to sort, synchronize, and playback data on the timeline.

[0066] More specifically, in this embodiment, for frame data of voice data type, the timestamp identifier records the start time of voice playback. For frame data of text data type, the timestamp identifier records the time of text display. For frame data of digital human action data type, the timestamp identifier records the time when the action starts to be executed.

[0067] The addition of data type identifiers is intended to clearly classify frame data of different sources and natures so that subsequent processing modules can perform corresponding operations and processing based on the data type. Different types of frame data may require different processing logic and algorithms. For example, voice data may require voice processing technology, text data requires natural language processing, and digital human motion data requires motion analysis algorithms. The addition of timestamp identifiers is to record the time when the data is generated, which is crucial for the time series management and sorting of data and the time correlation analysis of events, ensuring that the system can process data in chronological order, especially in scenarios with multiple users and multiple events concurrently, which helps the synchronization and orderly operation of the system.

[0068] Each group of the frame data and its corresponding data type identifier and timestamp identifier are encapsulated as an independent data unit.

[0069] In order to ensure the integrity and independence of the data, the digital human interaction data, data type identifier and timestamp identifier are encapsulated into an independent data unit to avoid information loss or confusion during subsequent transmission and processing. At the same time, it is convenient to perform independent operations and processing on each data group, thereby improving the modularity and manageability of data processing.

[0070] It is understandable that in other embodiments, the digital human interaction data may not be divided into frame data, but the data type identifier and timestamp identifier may be directly added to the entire digital human interaction data, thereby reducing the steps of data division and reorganization, reducing processing complexity, and thus improving the efficiency of digital human interaction.

[0071] All of the independent data units are encapsulated in the data structure to form the mixed data stream.

[0072] Specifically, by encapsulating all independent data units in a data structure and forming a mixed data stream, it is convenient to uniformly manage and operate multiple independent data units, so that the system can process data from different sources and different types as a whole, and provide a unified data object for the subsequent transmission, parsing, and execution of mixed data streams, thereby realizing the data integration and overall processing capabilities of the system, and improving the convenience of data processing and the scalability of the system. At the same time, it is easy to transfer and operate data between different modules, which is beneficial to the overall architecture and performance optimization of the system.

[0073] S3, parsing the mixed data stream to obtain several groups of data to be executed.

[0074] Specifically, when the mixed data stream is delivered to the execution end of the digital human, it is necessary to extract independent data units from the encapsulated mixed data stream, process and sort them according to their timestamps and data types, and finally convert them into executable data. This process is a key step in the entire data interaction method, ensuring that the digital human interaction data (such as voice, text, and actions, etc.) can be executed in the expected time sequence and correct format, thereby realizing the interaction and behavior simulation of the digital human.

[0075] Specifically, step S3 includes the following steps:

[0076] The independent data unit is extracted from the mixed data stream.

[0077] Specifically, the mixed data stream contains multiple types of independent data units, and each group of independent data units is accompanied by frame data (such as voice, text, action, etc.), data type identifier and timestamp identifier. The parsing process is to extract these independent data units from the mixed data stream in preparation for subsequent operations. When obtaining independent data units, the entire mixed data stream is traversed and all independent data units are taken out, so that multiple groups of independent data units generated in the same time period are completely extracted. Each independent data unit contains complete frame data and additional identification information (data type identifier and timestamp identifier).

[0078] The independent data unit is parsed to obtain the frame data and its corresponding data type identifier and timestamp identifier.

[0079] Specifically, by extracting key information from independent data units (in this embodiment, the frame data and its corresponding data type identifier and timestamp identifier), an accurate data basis is provided for subsequent operations based on the data type identifier and timestamp identifier. This is an important intermediate step in converting independent data units into directly executable data to be executed, thereby ensuring the accuracy and pertinence of data processing.

[0080] The frame data is sorted according to the timestamp identifier to obtain the sorted frame data.

[0081] Specifically, the timestamp identifier records the time when the frame data is generated or the operation occurs. Sorting the frame data according to the timestamp can ensure that the processing order of the frame data conforms to the time logic and ensures the smoothness of the processing. By sorting, it can be ensured that the frame data is processed in the order of time, avoiding the confusion of the operation order caused by the different arrival order of the data. The sorting algorithm can be simply arranged in ascending order by timestamp, or in a high concurrency environment, using an efficient sorting algorithm (such as quick sort, heap sort, etc.). By using the timestamp identifier to sort the frame data, it is ensured that the data is executed in the correct time order, avoiding the execution problems caused by the disorder of the processing order, such as voice playback later than text display, or action execution and voice are not synchronized. More specifically, in this embodiment, different types of frame data are sorted in a unified time axis according to their respective timestamp identifiers, which facilitates the time synchronization and coordinated processing of different types of data, thereby ensuring that at the same time, the changes in the execution operations of the digital human such as voice, action and text are synchronized and coordinated, providing users with a coherent experience, especially in a multimodal interactive system, avoiding the incoordination caused by the time difference between different data types, making the system more smooth and natural.

[0082] The sorted frame data is converted into corresponding data to be executed according to the data type identifier.

[0083] Specifically, according to different data type identifiers, different types of frame data are respectively handed over to appropriate processing modules, and the processing modules convert the frame data into directly executable data to be executed, thereby facilitating the execution of digital human interaction data. For example: frame data of the type of voice data is handed over to the voice synthesis module and converted into a playable audio stream. Frame data of the type of text data is handed over to the text rendering module and converted into displayable text. Frame data of the type of digital human action data is handed over to the action analysis module and converted into executable action instructions to drive the action of the digital human.

[0084] In step S3 of this embodiment, the frame data is sorted by using a timestamp identifier, and the sorted frame data is converted into corresponding to-be-executed data according to the data type identifier, so as to ensure that all frame data are executed in the correct time sequence, thereby improving the timeliness of the interaction. For example, the voice playback will not be delayed, and the text display and action execution can be synchronized with the real-time nature of the user interaction. The data type identifier is assigned to different processing modules, which is helpful for modular system design. Each module is responsible for processing a specific type of data, which not only improves the maintainability of the code, but also makes the system easy to expand and optimize. This step integrates information from different data sources and different data types (such as voice, text, and action) by parsing the mixed data stream, making the interaction of the digital human richer and more flexible. The system can process multiple types of data to ensure that the interaction between the user and the digital human is more natural and smooth. Through the synchronous control of the timestamp and the precise conversion of the data type, the system can effectively avoid the phenomenon of data processing confusion, delay or incoordination, thereby improving the user's interactive experience. The behavior of the digital human is more in line with the user's expectations, and the interaction appears more natural. At the same time, by sorting first and then converting into to-be-executed data, the confusion of the operation order between different types of digital human interaction data can be avoided, ensuring the natural and smooth interaction. And the data processing method of sorting first and then converting can ensure that the data is arranged in chronological order from the beginning, and no additional timing adjustment is required for subsequent processing. In addition, as the amount of data grows and the complexity increases, the order of sorting and data type conversion will directly affect system performance and response speed. Sorting first and then converting can better adapt to system expansion and data complexity, ensuring that each processing step is seamlessly connected.

[0085] S4, controlling the digital human to perform corresponding operations according to the data to be executed.

[0086] Specifically, according to the different data types of the data to be executed, the digital human is controlled to call different execution modules to perform corresponding operations. Among them, after the voice data is processed by the voice synthesis module, an audio stream is generated and played. After the text data is processed by the text rendering module, a display text is generated and displayed on the interface. After the digital human action data is processed by the action analysis module, the digital human is driven to perform corresponding actions, such as facial expressions, body movements, etc. At the same time, since the frame data has been sorted according to the timestamp identifier in step S3, the data to be executed formed by the conversion of the sorted frame data will also be executed according to the corresponding timestamp identifier, thereby ensuring that the data to be executed is triggered at the appropriate time. When there are multiple different types of data to be executed (such as voice data, text data, digital human action data, etc.) in the same time period, the timestamp identifier can ensure that different data types are executed synchronously in the time period. Different modules are independent of each other, and they perform corresponding operations according to different execution modules in sequence. Through such a design, the synchronization, timing and diversified processing of data are guaranteed, and the flexibility and accuracy of digital human interaction are enhanced.

[0087] See also Figure 2 As shown, the present invention also discloses a digital human data interaction device, comprising: an acquisition unit 10, a packaging unit 20, an extraction and analysis unit 30 and a control unit 40;

[0088] The acquisition unit 10 is used to acquire several groups of different types of digital human interaction data;

[0089] The encapsulation unit 20 is used to uniformly encapsulate several groups of different types of digital human interaction data into a mixed data stream;

[0090] The extraction and parsing unit 30 is used to extract and parse the mixed data stream to obtain a plurality of groups of data to be executed;

[0091] The control unit 40 is used to control the digital human to perform corresponding operations according to the data to be executed.

[0092] In one embodiment, the encapsulation unit 20 includes a creation module and an encapsulation module;

[0093] The creation module is used to create a unified data structure;

[0094] The encapsulation module is used to encapsulate several groups of different types of digital human interaction data into the data structure to form the mixed data stream.

[0095] In one embodiment, the encapsulation module includes a division submodule, an addition submodule, a first encapsulation submodule, and a second encapsulation submodule;

[0096] The division submodule is used to divide the digital human interaction data into a plurality of frames of data;

[0097] The division submodule is used to add a data type identifier and a timestamp identifier to the frame data;

[0098] The first encapsulation submodule is used to encapsulate the frame data and the corresponding data type identifier and timestamp identifier into an independent data unit;

[0099] The second encapsulation submodule is used to encapsulate all the independent data units into the data structure to form the mixed data stream.

[0100] In one embodiment, the extraction and analysis unit 30 includes an extraction module, an analysis module, a sorting module and a conversion module;

[0101] The extraction module is used to extract the independent data unit from the mixed data stream;

[0102] The parsing module is used to parse the independent data unit to obtain the frame data and the corresponding data type identifier and timestamp identifier;

[0103] The sorting module is used to sort the frame data according to the timestamp identifier to obtain the sorted frame data;

[0104] The conversion module is used to convert the sorted frame data into the corresponding data to be executed according to the data type identifier.

[0105] It should be noted that those skilled in the art can clearly understand that the specific implementation process of the above-mentioned digital human data interaction device and each unit can refer to the corresponding description in the aforementioned method embodiment, and for the convenience and brevity of description, it will not be repeated here.

[0106] The above-mentioned digital human data interaction device can be implemented in the form of a computer program. The computer program can be used in Figure 3 Runs on the computer device shown.

[0107] See also Figure 3 , Figure 3 is a schematic block diagram of a computer device provided in an embodiment of the present application; the computer device 500 may be a terminal or a server, wherein the terminal may be an electronic device with communication functions such as a smart phone, a tablet computer, a laptop computer, a desktop computer, a personal digital assistant, and a wearable device. The server may be an independent server or a server cluster composed of multiple servers.

[0108] See also Figure 3The computer device 500 includes a processor 502 , a memory and a network interface 505 connected via a system bus 501 , wherein the memory may include a non-volatile storage medium 503 and an internal memory 504 .

[0109] The non-volatile storage medium 503 can store an operating system 5031 and a computer program 5032. The computer program 5032 includes program instructions, and when the program instructions are executed, the processor 502 can execute a digital human data interaction method.

[0110] The processor 502 is used to provide computing and control capabilities to support the operation of the entire computer device 500 .

[0111] The internal memory 504 provides an environment for the operation of the computer program 5032 in the non-volatile storage medium 503. When the computer program 5032 is executed by the processor 502, the processor 502 can execute a digital human data interaction method.

[0112] The network interface 505 is used to communicate with other devices over the network. Figure 3 The structure shown in the figure is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device 500 to which the solution of the present application is applied. The specific computer device 500 may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0113] The processor 502 is used to run the computer program 5032 stored in the memory to implement the following steps:

[0114] Acquire several groups of different types of digital human interaction data; uniformly encapsulate the several groups of different types of digital human interaction data into a mixed data stream; extract and parse the mixed data stream to obtain several groups of to-be-executed data; and control the digital human to perform corresponding operations according to the to-be-executed data.

[0115] It should be understood that in the embodiment of the present application, the processor 502 may be a central processing unit (CPU), and the processor 502 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0116] It can be understood by those skilled in the art that all or part of the processes in the method for implementing the above embodiment can be completed by instructing the relevant hardware through a computer program. The computer program includes program instructions, and the computer program can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the process steps of the embodiment of the above method.

[0117] Therefore, the present invention also provides a storage medium. The storage medium may be a computer-readable storage medium. The storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the above-mentioned digital human data interaction method can be implemented. The storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the above-mentioned method can be implemented. The program instructions include the following steps:

[0118] Acquire several groups of different types of digital human interaction data; uniformly encapsulate the several groups of different types of digital human interaction data into a mixed data stream; extract and parse the mixed data stream to obtain several groups of to-be-executed data; and control the digital human to perform corresponding operations according to the to-be-executed data.

[0119] The storage medium may be a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk, etc., which are computer-readable storage media that can store program codes.

[0120] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0121] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of each unit is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or skipped.

[0122] The steps in the method of the embodiment of the present invention can be adjusted in order, combined and deleted according to actual needs. The units in the device of the embodiment of the present invention can be combined, divided and deleted according to actual needs. In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0123] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, terminal, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention.

[0124] The above embodiments are preferred implementation schemes of the present invention. In addition, the present invention may also be implemented in other ways. Any obvious replacement without departing from the concept of the present technical solution is within the protection scope of the present invention.

Claims

1. A digital human data interaction method, characterized in that: The following steps are involved: Acquire several groups of different types of digital human interaction data; Unifying and encapsulating several groups of different types of digital human interaction data into a mixed data stream; Extracting and parsing the mixed data stream to obtain several groups of data to be executed; The digital human is controlled to perform corresponding operations according to the data to be executed.

2. The digital human data interaction method according to claim 1, characterized in that: The step of packaging several groups of digital human interaction data of different types into a mixed data stream comprises the following steps: Create a unified data structure; Several groups of the digital human interaction data of different types are encapsulated in the data structure to form the mixed data stream.

3. The digital human data interaction method according to claim 2, characterized in that: The step of encapsulating several groups of digital human interaction data of different types into the data structure to form the mixed data stream comprises the following steps: Dividing the digital human interaction data into a plurality of frame data; Adding a data type identifier and a timestamp identifier to the frame data; Encapsulating the frame data and the corresponding data type identifier and timestamp identifier into an independent data unit; All of the independent data units are encapsulated in the data structure to form the mixed data stream.

4. The digital human data interaction method according to claim 3, characterized in that: The step of parsing the mixed data stream to obtain a plurality of groups of data to be executed comprises the following steps: extracting the independent data unit from the mixed data stream; Parsing the independent data unit to obtain the frame data and the corresponding data type identifier and timestamp identifier; Sorting the frame data according to the timestamp identifier to obtain the sorted frame data; The sorted frame data is converted into corresponding data to be executed according to the data type identifier.

5. A digital human data interaction device, characterized in that: include: Acquisition unit, encapsulation unit, extraction and analysis unit and control unit; The acquisition unit is used to acquire several groups of digital human interaction data of different types; The encapsulation unit is used to uniformly encapsulate a plurality of groups of digital human interaction data of different types into a mixed data stream; The extraction and parsing unit is used to extract and parse the mixed data stream to obtain a plurality of groups of data to be executed; The control unit is used to control the digital human to perform corresponding operations according to the data to be executed.

6. The digital human data interaction device according to claim 5, characterized in that: The encapsulation unit includes a creation module and an encapsulation module; The creation module is used to create a unified data structure; The encapsulation module is used to encapsulate several groups of different types of digital human interaction data into the data structure to form the mixed data stream.

7. The digital human data interaction device according to claim 6, characterized in that: The encapsulation module includes a division submodule, an addition submodule, a first encapsulation submodule and a second encapsulation submodule; The division submodule is used to divide the digital human interaction data into a plurality of frames of data; The division submodule is used to add a data type identifier and a timestamp identifier to the frame data; The first encapsulation submodule is used to encapsulate the frame data and the corresponding data type identifier and timestamp identifier into an independent data unit; The second encapsulation submodule is used to encapsulate all the independent data units into the data structure to form the mixed data stream.

8. The digital human data interaction device according to claim 7, characterized in that: The extraction and analysis unit includes an extraction module, an analysis module, a sorting module and a conversion module; The extraction module is used to extract the independent data unit from the mixed data stream; The parsing module is used to parse the independent data unit to obtain the frame data and the corresponding data type identifier and timestamp identifier; The sorting module is used to sort the frame data according to the timestamp identifier to obtain the sorted frame data; The conversion module is used to convert the sorted frame data into the corresponding data to be executed according to the data type identifier.

9. A computer device, characterized in that: The computer device comprises a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the digital human data interaction method according to any one of claims 1 to 4 is implemented.

10. A storage medium, characterized in that: The storage medium stores a computer program, which includes program instructions. When the program instructions are executed by a processor, the digital human data interaction method according to any one of claims 1 to 4 is implemented.

Images