Intelligent interaction system and method based on holographic display device

By generating personalized contextual events on the user terminal and using cloud servers to identify and drive holographic animation types, the problem of lack of personalization in the interaction between mobile terminals and holographic display devices is solved, a more intelligent and personalized holographic image display is achieved, and the user experience is improved.

WO2025189568A1PCT designated stage Publication Date: 2025-09-18ZHEJIANG PRISM HOLOGRAPHIC TECH CO LTD

Patent Information

Application Number
PCT/CN2024/095958
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-03-11
Filing Date
2024-05-29
Publication Date
2025-09-18

AI Technical Summary

Technical Problem

In the prior art, the interaction between mobile terminals and holographic display devices lacks personalization and intelligence, resulting in insufficient user interaction experience in different application scenarios.

Method used

By generating personalized contextual events on the user terminal, using the cloud server to identify and drive the holographic animation type, and combining the animation drive module of the holographic display device, personalized holographic image display based on user behavior data and interaction preference information can be achieved.

Benefits of technology

The intelligence and personalization of the holographic animation interaction between the user terminal and the holographic display device are improved, and the user experience is enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024095958_18092025_PF_FP_ABST
    Figure CN2024095958_18092025_PF_FP_ABST
Patent Text Reader

Abstract

Provided in the present application are an intelligent interaction system and method based on a holographic display device. The system comprises a cloud server, a user terminal and a holographic display device, wherein on the basis of the current contextual information of an application program, a contextual situation event generation module in the user terminal generates a first target contextual situation event associated with a user; a contextual situation event recognition module in the cloud server generates an associated first holographic animation type on the basis of the first target contextual situation event, and sends to the holographic display device a first digital-object-driven message carrying the first holographic animation type; and a holographic animation driver module in the holographic display device parses the first digital-object-driven message, constructs first animation sequence data on the basis of the first holographic animation type, and drives a digital object associated with the user to perform holographic image display. The present application can improve the intelligence and personalization of holographic animation interaction behaviors between a user terminal and a holographic display device, thereby enhancing the usage experience of users.
Need to check novelty before this filing date? Find Prior Art

Description

Intelligent interactive system and method based on holographic display device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application number 2024102699866, filed with the China Patent Office on March 11, 2024, entitled “Intelligent interactive system and method based on holographic display device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present application relates to the field of computer and holographic display technology, and in particular to an intelligent interaction system and method based on a holographic display device. Background Art

[0004] With the development of artificial intelligence and holographic display technology, holographic display devices have emerged that can display holographic animations of three-dimensional human figures (also known as digital objects). Holographic display devices utilize optical projection technology to project three-dimensional images through reflection and / or transmission of optical lenses. The digital object is the three-dimensional human figure projected by the holographic display device. Holographic display devices can serve as digital assistants for users, providing a more natural, realistic, and visual interactive experience compared to traditional computer terminals.

[0005] In the prior art, there have been systems that use mobile terminals, cloud servers, and holographic display devices to achieve multimodal interaction with users. For example, patent document CN108037829B discloses a multimodal interaction system based on a holographic device. The system obtains multimodal input data on the mobile terminal, generates an imaging event on the mobile terminal, and controls the holographic device by the mobile terminal to display a holographic image of a virtual image in order to perform multimodal interaction with the user. Among them, the generation of an imaging event by the mobile terminal requires certain conditions or prerequisites, including the opening of a program for running the virtual image, the awakening of the virtual image, and the occurrence of a system event associated with the imaging event on the mobile terminal. Specifically, the occurrence of a system event associated with the imaging event on the mobile terminal includes the following: when the program receives an imaging message pushed by a system service, when the mobile terminal receives a call or text message, and when the mobile terminal background service detects a change in the system status, the execution of the imaging event can be triggered.

[0006] However, in the above-mentioned existing technical solutions, the interaction between the mobile terminal and the holographic display device is to identify the occurrence of system events on the mobile terminal that are associated with imaging events. These system events are usually pre-set in the mobile terminal. As a result, the interaction between the user and the holographic display device lacks personalization and the user lacks the intelligent interactive experience in different application scenarios. Therefore, an improved technical solution is urgently needed to solve the above problems.

[0007] Summary of the Invention

[0008] In view of this, the purpose of this application includes, for example, providing an intelligent interaction system and method based on a holographic display device to improve the intelligence and personalization of the holographic animation interaction behavior between the user terminal and the holographic display device, and further enhance the user experience.

[0009] The embodiments of the present application can be implemented as follows:

[0010] In a first aspect, an embodiment of the present application provides an intelligent interactive system based on a holographic display device, comprising: a cloud server, and a user terminal and a holographic display device respectively connected to the cloud server via a network;

[0011] The user terminal includes a contextual situation event generation module configured to generate a user-associated first target contextual situation event based on current context information of an application running on the user terminal, and send the generated first target contextual situation event to the cloud server;

[0012] The cloud server includes a contextual situation event recognition module configured to generate an associated first holographic animation type based on the first target contextual situation event, and send a first digital object driving message carrying the first holographic animation type to the holographic display device;

[0013] The holographic display device includes a holographic animation driving module, which is configured to parse the first holographic animation type from the first digital object driving message, construct first animation sequence data associated with the first target context situation event according to the first holographic animation type, and drive the user-associated digital object to display a holographic image based on the first animation sequence data.

[0014] Optionally, the cloud server further includes a contextual situation event learning module configured to generate a set of contextual situation events associated with the user based on the user's learning and training of historical behavior data and interaction preference information of the application installed on the user terminal.

[0015] Optionally, the context situation event generation module is further configured to generate the first target context situation event and send it to the cloud server when it determines that the current context information of the application running on the user terminal is suitable for generating the first target context situation event based on the context situation event set associated with the user.

[0016] Optionally, the context situation event generation module is further configured to generate a general situation event and send it to the cloud server when it is determined that the current context information of the application running on the user terminal is not suitable for generating the first target context situation event based on the context situation event set associated with the user.

[0017] Optionally, the contextual situation event recognition module is further configured to generate a first preset holographic animation type based on the general situation event sent by the user terminal, and send a first preset digital object driving message carrying the first preset holographic animation type to the holographic display device;

[0018] The holographic animation driving module is further configured to parse the first preset holographic animation type from the first preset digital object driving message, obtain first preset animation sequence data according to the first preset holographic animation type, and drive the user-associated digital object to display a holographic image based on the first preset animation sequence data.

[0019] Optionally, the context situation event generation module is further configured to generate at least one context situation sub-event according to the temporal process of the first target context situation event, and send the generated sub-event to the cloud server;

[0020] The contextual situation event recognition module is further configured to generate a second preset holographic animation type based on the at least one contextual situation sub-event, and send a second preset digital object driving message carrying the second preset holographic animation type to the holographic display device;

[0021] The holographic animation driving module is further configured to parse the second preset holographic animation type from the second preset digital object driving message, obtain second preset animation sequence data according to the second preset holographic animation type, and drive the user-associated digital object to display a holographic image based on the second preset animation sequence data.

[0022] Optionally, the holographic animation driving module is further configured to parse the action type, expression type, lip shape type, special effect type and decoration type according to the first holographic animation type, and construct action control data, expression control data, lip shape control data, special effect control data and decoration control data according to the action type, expression type, lip shape type, special effect type and decoration type respectively, and construct the first animation sequence data based on the action control data, expression control data, lip shape control data, special effect control data and decoration control data as well as the voice response data.

[0023] Optionally, the context situation event generation module is further configured to generate a user-associated second target context situation event based on current context information of the application running on the user terminal, and send the generated second target context situation event to the cloud server;

[0024] The contextual situation event identification module is further configured to identify the relative priority of the second target contextual situation event, generate an associated second holographic animation type based on the second target contextual situation event, and send a second digital object driving message carrying the second holographic animation type and the relative priority to the holographic display device;

[0025] The animation driving module is further configured to parse the second holographic animation type and the relative priority from the second digital object driving message, construct second animation sequence data associated with the second target context situation event according to the second holographic animation type, and while driving the user-associated digital object to display the current holographic image based on the first animation sequence data, interrupt the current holographic image display according to the relative priority, and drive the user-associated digital object to display the second holographic image based on the second animation sequence data.

[0026] In a second aspect, an embodiment of the present application further provides an intelligent interactive system based on a holographic display device, comprising: a cloud server, and a first user terminal, a second user terminal, and a holographic display device respectively connected to the cloud server via a network;

[0027] The first user terminal includes a first context situation event generation module configured to generate a user-associated first target context situation event based on current context information of an application running on the first user terminal, and send the event to the cloud server; the second user terminal includes a second context situation event generation module configured to generate a user-associated second target context situation event based on current context information of an application running on the second user terminal, and send the event to the cloud server;

[0028] The cloud server includes a contextual situation event recognition module configured to generate an associated first holographic animation type based on the first target contextual situation event, generate an associated second holographic animation type based on the second target contextual situation event, and send a first digital object driving message carrying the first holographic animation type or a second digital object driving message carrying the second holographic animation type to the holographic display device;

[0029] The holographic display device includes a holographic animation driving module, which is configured to parse the first holographic animation type from the first digital object driving message, construct the first animation sequence data associated with the first target context situation event according to the first holographic animation type, and drive the digital object associated with the user to display a first holographic image based on the first animation sequence data; or parse the second holographic animation type from the second digital object driving message, construct the second animation sequence data associated with the second target context situation event according to the second holographic animation type, and drive the digital object associated with the user to display a second holographic image based on the second animation sequence data.

[0030] Optionally, the cloud server also includes a contextual situation event learning module, which is configured to generate a set of contextual situation events associated with the user based on the user's learning and training of historical behavior data and interaction preference information of applications installed on the first user terminal and the second user terminal.

[0031] Optionally, the context situation event identification module is further configured to identify the relative priority of the second target context situation event, and send a second digital object driving message carrying the second holographic animation type and the relative priority to the holographic display device;

[0032] The holographic animation driving module is further configured to parse the second holographic animation type and the relative priority from the second digital object driving message, and while driving the user-associated digital object to display a first holographic image based on the first animation sequence data, interrupt the first holographic image display according to the relative priority, and drive the user-associated digital object to display a second holographic image based on the second animation sequence data.

[0033] In a third aspect, the present application also provides an intelligent interaction method based on a holographic display device, including:

[0034] generating a user-associated first target contextual situation event based on current context information of an application running on the user terminal, and sending the event to the cloud server;

[0035] The cloud server generates an associated first holographic animation type based on the first target contextual event, and sends a first digital object driving message carrying the first holographic animation type to the holographic display device;

[0036] The holographic display device parses the first holographic animation type from the first digital object drive message, constructs first animation sequence data associated with the first target context situation event according to the first holographic animation type, and drives the user-associated digital object to display a holographic image based on the first animation sequence data.

[0037] The embodiments of the present application can achieve at least the following beneficial effects:

[0038] The embodiment of the present application can generate a personalized first target context situation event associated with the user based on the current context information of the user for multiple applications on the user terminal. Then, based on the first target context situation event, an associated first holographic animation type is generated, thereby driving the digital object associated with the user on the holographic display device to display a holographic image. Since the first target context situation event is a personalized context situation event generated based on the user's learning and training of the historical behavior data and interaction preference information of the applications installed on the user terminal, it is different from the system events pre-set on the user terminal in the prior art. Compared with the traditional method of triggering the holographic image display of the holographic display device by pre-setting system events, the intelligence and personalization of the holographic animation interaction behavior between the user terminal and the holographic display device can be improved, which further improves the user experience compared to the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments of the present application. It should be understood that the following drawings only illustrate certain embodiments of the present application and should not be regarded as limiting the scope of the present application.

[0040] FIG1 is one of exemplary architecture diagrams of an intelligent interactive system based on a holographic display device provided in an embodiment of the present application;

[0041] FIG2 is a second exemplary architecture diagram of an intelligent interactive system based on a holographic display device provided in an embodiment of the present application;

[0042] FIG3 is one of the exemplary working principle diagrams of the intelligent interactive system based on the holographic display device provided in an embodiment of the present application;

[0043] FIG4 is a second schematic diagram of an exemplary working principle of an intelligent interactive system based on a holographic display device provided in an embodiment of the present application;

[0044] FIG5 is a third exemplary schematic diagram of the working principle of the intelligent interactive system based on the holographic display device provided in an embodiment of the present application;

[0045] FIG6 is a fourth schematic diagram of an exemplary working principle of an intelligent interactive system based on a holographic display device provided in an embodiment of the present application;

[0046] FIG7 is a third exemplary architecture diagram of an intelligent interactive system based on a holographic display device provided in an embodiment of the present application;

[0047] FIG8 is a fourth exemplary architecture diagram of an intelligent interactive system based on a holographic display device provided in an embodiment of the present application;

[0048] FIG9 is a flow chart of an intelligent interaction method based on a holographic display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings of the embodiments of the present application. However, it should be understood that the described embodiments are only some exemplary embodiments of the present application, not all embodiments, and therefore the following detailed description of the embodiments of the present application is not intended to limit the scope of protection claimed in this application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of this application.

[0050] It should be noted that the terms "first", "second", etc. in the description and claims of this application are only used to distinguish and describe similar objects, rather than to describe a specific order or sequence, and cannot be understood as indicating or implying relative importance.

[0051] As mentioned above, in the prior art, in systems that utilize mobile terminals, cloud servers, and holographic display devices to implement multimodal interaction with users, the interaction between the mobile terminal and the holographic display device is usually achieved by identifying system events associated with imaging events that occur in the mobile terminal. These system events are usually pre-set in the mobile terminal, resulting in a lack of personalization in the interaction between the user and the holographic display device, affecting the user's intelligent interaction experience in different application scenarios. To this end, the present application proposes an intelligent interaction system based on a holographic display device to improve the intelligence and personalization of holographic animation interaction behaviors between user terminals, including but not limited to mobile terminals and vehicle-mounted terminals, and holographic display devices, and further enhance the user experience.

[0052] Figure 1 is a schematic diagram of an exemplary architecture of an intelligent interactive system 100 based on a holographic display device provided in an embodiment of the present application. As shown in Figure 1, the system 100 includes a user terminal 110, a cloud server 120, and a holographic display device 130. The user terminal 110 and the holographic display device 130 are each connected to the cloud server 120 via a network.

[0053] The user terminal 110 may include a mobile terminal such as a smart phone, tablet computer, portable computer or personal digital assistant, or may include a vehicle-mounted terminal or smart TV, etc. The user terminal 110 is installed with multiple applications that provide different content function services to the user.

[0054] In this embodiment, the user terminal 110 includes a context situation event generation module 111, which is configured to generate a user-associated first target context situation event based on the current context information of the application running on the user terminal 110, and send it to the cloud server 120. The current context information of the application running on the user terminal 110 may include the current application running by the user on the user terminal 110, whether the current application is suitable for triggering holographic animation interaction with the holographic display device 130, the application function accessed by the user in the current application, and the user's input information on the current application.

[0055] Since the current context information of the application running on the user terminal 110 is related to the personalized historical behavior data and interaction preference information of the current user for multiple applications on the user terminal 110, the user-associated first target context situation event generated based on the current context information of the application running on the user terminal 110 is a personalized context situation event associated with the current user, which may be different for different users. The personalized target context situation event associated with the user in this embodiment is different from the system event pre-set on the user terminal in the prior art. Compared with the traditional method of triggering the holographic image display of the holographic display device 130 by pre-setting the system event, it can significantly enhance the user's intelligent and personalized experience.

[0056] In this embodiment, the cloud server 120 includes a contextual situation event recognition module 121, which is configured to generate an associated first holographic animation type based on a first target contextual situation event generated by the contextual situation event generation module 111 in the user terminal 110, and send a first digital object drive message carrying the first holographic animation type to the holographic display device 130. Each user-associated target contextual situation event generated by the contextual situation event generation module 111 has an associated holographic animation type. The holographic animation type is used to characterize the morphological characteristics of the user-associated digital object displayed as a holographic image on the holographic display device 130.

[0057] In one embodiment, the holographic animation type may include the action type, expression type, lip type, special effect type and decoration type of the digital object. Different contextual situation events associated with the user can have different holographic animation types to provide the user with an intelligent interactive experience of digital objects in the usage scenarios of different applications. For example, when the current application running on the user terminal 110 is a weather application, when the contextual situation event generation module 111 generates a first target contextual situation event based on the current context information of the current application, the holographic animation type associated with the current first target contextual situation event can be the animation type that is most similar to the application scenario of the current application. For example, the special effect type of the digital object can be a special effect type that shows weather conditions such as rainy days or sunshine, and the decoration type of the digital object can be a type of clothing that reflects the weather conditions such as rainy days or sunshine. Accordingly, the action type and expression type of the digital object can also be actions and expressions that match the current weather conditions.

[0058] In one embodiment, the holographic animation type generation module (not shown in FIG1 ) built into the cloud server 120 can pre-generate a holographic animation type associated with each contextual situation event for each contextual situation event associated with the user based on a pre-trained artificial intelligence (AI) model.

[0059] After generating the first holographic animation type associated with the first target contextual event based on the contextual event generation module 111, the contextual event recognition module 121 sends a first digital object drive message carrying the first holographic animation type to the holographic display device 130. The digital object drive message is a command message used between the cloud server 120 and the holographic display device 130 to drive the digital object to display a holographic animation.

[0060] In this embodiment, the holographic display device 130 includes a holographic animation driver module 131, configured to parse a first digital object drive message to determine a first holographic animation type, construct first animation sequence data associated with a first target contextual event based on the first holographic animation type, and drive the user's associated digital object to display a holographic image based on the first animation sequence data. The holographic display device 130 utilizes optical projection technology to project three-dimensional images through reflection and / or transmission of optical lenses. The digital object associated with the user is a three-dimensional character image projected by the holographic display device. Each user has an associated digital object, which is stored in a predetermined format on the cloud server 120.

[0061] In one embodiment, the holographic animation driving module 131 can construct the first animation sequence data associated with the first target context situation event based on the first holographic animation type based on local rendering or cloud rendering. Specifically, the holographic animation driving module 131 can request the animation control data and voice response data associated with the first target context situation event from the cloud server 120 based on the first holographic animation type. The voice response data can be obtained by parsing the input information through the pre-trained AI large model in the cloud server 120, and the input information is the information input by the user on the current application running on the user terminal 110. For example, if the input information of the user on the current application running on the user terminal 110 is a text keyword, then the pre-trained AI large model in the cloud server 120 can perform natural language processing and semantic recognition on the text keywords input by the user based on the application function scenario and input information of the application currently accessed by the user, and output the voice response data that best matches the user's current text keywords. Alternatively, if the input information of the user on the current application running on the user terminal 110 is voice information, then the pre-trained AI large model in the cloud server 120 can convert the voice information into text information based on the application function scenario of the application currently accessed by the user and the input voice information, and then perform natural language processing and semantic recognition on the converted text information to output voice response data that best matches the voice information currently input by the user.

[0062] In one embodiment, the animation control data associated with the first target contextual situation event may include action control data, expression control data, lip shape control data, special effect control data, and decoration control data that match the action type, expression type, lip shape type, special effect type, and decoration type of the digital object, respectively. Action control data is control data used to drive the physical actions of the digital object. Expression control data is control data used to drive the facial expressions and emotional expressions of the digital object. Lip shape control data is control data used to drive the lip shape of the digital object and synchronize the lip shape with the output of the voice response data. Special effect control data is control data used to drive the visual effects of the digital object. Decoration control data is control data used to drive the appearance of the clothing of the digital object.

[0063] In the case of a local rendering-based approach, after requesting the animation control data and voice response data associated with the first target context situation event from the cloud server 120, the holographic animation driving module 131 constructs the first animation sequence data associated with the first target context situation event through a rendering engine locally on the holographic display device 130 based on the animation control data and the voice response data, thereby driving the digital object associated with the user to display a holographic image based on the first animation sequence data.

[0064] In the case of a cloud-based rendering approach, after the holographic animation driving module 131 requests the animation control data and voice response data associated with the first target context situation event from the cloud server 120, the rendering engine deployed by the cloud server 120 constructs the first animation sequence data associated with the first target context situation event based on the animation control data and the voice response data, and sends the data to the holographic animation driving module 131 of the holographic display device 130. The holographic animation driving module 131 uses the first animation sequence data received in real time from the cloud server 120 to drive the digital object associated with the user to display a holographic image.

[0065] For example, when the current application running on the user terminal 110 is a weather application, and the user enters a specified city to query the weather forecast for the specified city, the context situation event generation module 111 determines to generate a first target context situation event based on the current context information of the current application. The holographic animation driving module 131 requests that the animation control data associated with the current first target context situation event can be action control data, expression control data, lip control data, special effect control data, and decoration control data that match the holographic animation type that is most similar to the application scenario of the weather status of the specified city queried by the user. That is, the holographic animation driving module 131 can drive the digital object associated with the user to perform a voice broadcast of the weather forecast for the specified city based on the action control data, expression control data, lip control data, special effect control data, and decoration control data that are most similar to the application scenario of the weather status of the specified city queried by the user, thereby enhancing the user's personalized interactive experience.

[0066] In summary, the intelligent interactive system based on the holographic display device of this embodiment generates a first target context situation event associated with the user based on the current context information of the application running on the user terminal 110 through the context situation event generation module 111 in the user terminal 110. The context situation event recognition module 121 of the cloud server 120 generates an associated first holographic animation type based on the first target context situation event, and sends a first digital object drive message carrying the first holographic animation type to the holographic display device 130. Finally, the holographic animation drive module 131 in the holographic display device 130 parses the first holographic animation type from the first digital object drive message, constructs the first animation sequence data associated with the first target context situation event according to the first holographic animation type, and drives the digital object associated with the user to display a holographic image based on the first animation sequence data. Thus, this embodiment can generate a personalized first target contextual situation event associated with the user based on the current contextual information related to the user's personalized historical behavior data and interaction preference information for multiple applications on the user terminal 110, and then generate an associated first holographic animation type based on the first target contextual situation event, ultimately achieving the holographic image display of the user-associated digital object on the holographic display device 130. This improves the intelligence and personalization of the holographic animation interaction behavior between the user terminal 110 and the holographic display device 130, further enhancing the user experience compared to the existing technology.

[0067] FIG2 is a second exemplary architecture diagram of an intelligent interactive system 200 based on a holographic display device according to an embodiment of the present application. As shown in FIG2 , system 200, based on the aforementioned embodiment, further includes a contextual event learning module 122 on the cloud server 120, which is configured to generate a user-associated contextual event set based on user historical behavior data and interaction preference information for applications installed on the user terminal 110.

[0068] In this embodiment, the contextual situation event learning module 122 can collect the user's historical behavior data and interaction preference information for multiple applications installed on the user terminal 110 to construct a training sample set. The user's historical behavior data for the multiple applications installed on the user terminal 110 may include the user's usage frequency and usage habits for the multiple applications. For example, the usage frequency may include the average number of times the user uses each application on the user terminal 110 over a period of time. The usage habits may include the user's access frequency, access order, and input information for each application function in each application on the user terminal 110. By training and clustering the user's historical behavior data for multiple applications installed on the user terminal 110, the contextual situation event learning module 122 can learn to obtain the most frequently used application set for each user and the personalized usage habits related to these applications. For example, assume that the user terminal 110 has multiple applications installed, including weather application APP1, news application APP2, music application APP3, map application APP4, and video application APP5. Based on user A's frequency of use and habits of these applications, we can learn the set of applications that user A uses most frequently, including weather application APP1, news application APP2, and map application APP4. We can also learn the personalized usage habits of each of these applications, namely user A's application function preferences and input preferences for each application. Taking news application APP2 as an example, we can find that user A's favorite application functions are the hot topics section and the international news section, and the most common input preference is text keyword input. Taking map application APP4 as an example, we can find that user A's favorite application function is navigation, and the most common input preference is voice message input.

[0069] In this embodiment, the user's interaction preference information for multiple applications installed on the user terminal 110 may include personalized preference information regarding whether the applications running on the user terminal 110 are suitable for triggering holographic animation interactions with the holographic display device 130. For example, assume that based on user A's interaction preference information, it is determined that user A prefers to trigger holographic animation interactions with the holographic display device 130 when accessing and using weather application APP1 and news application APP2, but prefers not to trigger holographic animation interactions with the holographic display device 130 when accessing and using music application APP3, map application APP4, and video application APP5. For user A, weather application APP1 and news application APP2 are suitable applications for triggering holographic animation interactions with the holographic display device 130, while music application APP3, map application APP4, and video application APP5 are not suitable applications for triggering holographic animation interactions with the holographic display device 130. Similarly, if based on user B's interaction preference information, it is determined that user B prefers to trigger holographic animation interactions with the holographic display device 130 when accessing and using music application APP3 and map application APP4, For user B, the music application APP3 and the map application APP4 are applications suitable for triggering holographic animation interaction with the holographic display device 130, while the weather application APP1, the news application APP2, and the video application APP5 are applications not suitable for triggering holographic animation interaction with the holographic display device 130.

[0070] Therefore, the contextual situation event learning module 122 can obtain the characteristic information of each user's most commonly used application set, personalized usage habits related to the application set, and whether the application set is suitable for triggering holographic animation interaction with the holographic display device 130 by learning and training the user's historical behavior data and interaction preference information for multiple applications installed on the user terminal 110. Thus, based on the characteristic information of each user's most commonly used application set, personalized usage habits related to the application set, and whether the application set is suitable for triggering holographic animation interaction with the holographic display device 130, a contextual situation event set associated with each user is generated. Among them, the contextual situation event set associated with each user represents the set of the most commonly used personalized application access events that each user hopes to trigger holographic animation interaction with the holographic display device 130. The i-th contextual situation event associated with each user can be represented as event i (userid) = (eventid, appid, functionid, inputType) four-tuple, then each user-associated context event set can be expressed as EventSet(userid) = {event i(userid)|i∈[1,N]}. Where userid represents the user's unique identifier; eventid represents the event's unique identifier; appid represents the application's unique identifier; functionid represents the application function identifier of the current application; inputType represents the user's input type for the application function of the current application, and exemplary values ​​may include text input and voice input identifiers; and N represents the number of contextual events in the contextual event set associated with each user.

[0071] In summary, in this embodiment, based on the user's learning and training of historical behavior data and interaction preference information of applications installed on the user terminal 110, the generated user-associated contextual event set is significantly different from the system event set pre-set on the user terminal in the prior art. Compared with the traditional method of triggering the holographic image display of the holographic display device 130 by pre-setting system events, it can significantly enhance the user's intelligent and personalized experience.

[0072] FIG3 is a schematic diagram of an exemplary working principle of an intelligent interactive system based on a holographic display device according to an embodiment of the present application. As shown in FIG3 , the contextual situation event generation module 111 is further configured to, based on the user-associated contextual situation event set, determine that the current context information of the application running on the user terminal 110 is suitable for generating a user-associated first target contextual situation event (see 310 in FIG3 ), generate the user-associated first target contextual situation event, and send it to the cloud server 120 (see 320 in FIG3 ).

[0073] The contextual situation event recognition module 121 is configured to generate an associated first holographic animation type (see 330 in Figure 3) based on the first target contextual situation event generated by the contextual situation event generation module 111, and send a first digital object driving message carrying the first holographic animation type to the holographic display device 130 (see 340 in Figure 3).

[0074] The holographic animation driving module 131 is configured to parse the first holographic animation type from the first digital object driving message (see 350 in Figure 3), construct the first animation sequence data associated with the first target context situation event according to the first holographic animation type (see 360 ​​in Figure 3), and drive the digital object associated with the user to display a holographic image based on the first animation sequence data (see 370 in Figure 3).

[0075] In this embodiment, the contextual situation event generation module 111 can obtain the current context information of the application running on the user terminal 110. Based on the similarity matching between the current context information and the set of contextual situation events associated with the user, it can determine whether the current context information of the application running on the user terminal 110 is suitable for generating a first target contextual situation event associated with the user. If it is determined that the current context information of the application running on the user terminal 110 is suitable for generating a first target contextual situation event associated with the user, the first target contextual situation event associated with the user is generated. Thus, when the user terminal 110 detects the user's most frequently used personalized application access behavior, the first target contextual situation event can be automatically generated. The cloud server 120 can then identify the associated first holographic animation type based on the first target contextual situation event, thereby causing the holographic animation driving module 131 in the holographic display device 130 to obtain animation control data and voice response data associated with the first holographic animation type, construct first animation sequence data associated with the first target contextual situation event, and drive the user-associated digital object on the holographic display device 130 to display a holographic image based on the first animation sequence data. Thus, the user is provided with a more intelligent and personalized experience of the holographic animation interaction behavior between the user terminal 110 and the holographic display device 130, which further improves the user experience compared with the existing technology.

[0076] FIG4 is a second exemplary schematic diagram of the working principle of the intelligent interactive system based on a holographic display device provided in an embodiment of the present application. As shown in FIG4 , the contextual situation event generation module 111 is further configured to generate a general situation event and send it to the cloud server 120 (see 420 in FIG4 ) when it determines, based on the set of contextual situation events associated with the user, that the current context information of the application running on the user terminal 110 is not suitable for generating the first target contextual situation event associated with the user (see 410 in FIG4 ).

[0077] The contextual situation event recognition module 121 is also configured to generate a first preset holographic animation type (see 430 in Figure 4) based on the general situation event generated by the contextual situation event generation module 111, and send a first preset digital object drive message carrying the first preset holographic animation type to the holographic display device 130 (see 440 in Figure 4).

[0078] The holographic animation driving module 131 is further configured to parse a first preset holographic animation type from the first preset digital object driving message (see 450 in FIG. 4 ), construct first preset animation sequence data according to the first preset holographic animation type (see 460 in FIG. 4 ), and drive the digital object associated with the user to display a holographic image based on the first preset animation sequence data (see 470 in FIG. 4 ).

[0079] In this embodiment, the contextual situation event generation module 111 can obtain the current context information of the application running on the user terminal 110. Based on the similarity matching between the current context information and the set of contextual situation events associated with the user, if it is determined that the current context information of the application running on the user terminal 110 is not suitable for generating the first target contextual situation event associated with the user, only a general situation event is generated. Therefore, when the user terminal 110 detects the user's uncommon application access behavior, the cloud server 120 can identify a default first preset holographic animation type, such as a standby animation type, based on the general situation event. This in turn causes the holographic animation driving module 131 in the holographic display device 130 to obtain the default animation control data and voice response data associated with the first preset holographic animation type, construct first preset animation sequence data, and drive the user-associated digital object on the holographic display device 130 to display a holographic image based on the first preset animation sequence data. This allows for a more natural transition when the user interacts with the holographic animation provided by the user terminal 110 and the holographic display device 130, providing the user with a more intelligent and personalized user experience.

[0080] Figure 5 is a third exemplary schematic diagram of the working principle of the intelligent interactive system based on a holographic display device provided in an embodiment of the present application. As shown in Figure 5, the contextual event generation module 111 is further configured to generate at least one contextual sub-event based on the temporal progression of the first target contextual event and send it to the cloud server 120 (see 510 in Figure 5).

[0081] The contextual situation event recognition module 121 is also configured to generate an associated second preset holographic animation type (see 520 in Figure 5) based on at least one contextual situation sub-event, and send a second preset digital object drive message carrying the second preset holographic animation type to the holographic display device 130 (see 530 in Figure 5).

[0082] The holographic animation driving module 131 is further configured to parse a second preset holographic animation type from the second preset digital object driving message (see 540 in FIG5 ), obtain second preset animation sequence data according to the second preset holographic animation type (see 550 in FIG5 ), and drive the user-associated digital object to display a holographic image based on the second preset animation sequence data (see 560 in FIG5 ).

[0083] In this embodiment, the context situation event generation module 111 can generate at least one context situation sub-event according to the temporal process of the first target context situation event. For example, assuming that the first target context situation event of user A is a personalized access event to the news application APP2 in the context situation event set associated with the user A, the personalized access event indicates that user A is accessing the international news column of the news application APP2. Then the first target context situation event can be split into multiple context situation sub-events according to the temporal process of the user accessing the news application APP2, namely the first context situation sub-event in which the user starts the news application APP2 and clicks on the international news column and the second context situation sub-event in which the user enters a text keyword. Then, the context situation event generation module 111 can generate these context situation sub-events in sequence according to the user's access process, so that the context situation event identification module 121 in the cloud server 120 can generate the associated second preset holographic animation type accordingly based on at least one context situation sub-event in real time. For example, when the first contextual situation sub-event is detected, in which user A launches the news application APP2 and clicks on the international news section, a preset digital object drive message carrying a listening animation type is sent to the holographic display device 130. The listening animation type indicates that the digital object performs a listening action and expression. When the second contextual situation sub-event is detected, in which user A further enters a text keyword in the international news section, a preset digital object drive message carrying a thinking animation type is sent to the holographic display device 130. The thinking animation type indicates that the digital object performs a movement and expression indicating that the user intends to understand.

[0084] Thus, when the user terminal 110 detects the user's frequently used personalized application access behavior, the cloud server 120 can drive the holographic display device 130 to provide more natural, realistic and fast-responding digital object interaction behavior based on at least one contextual situation sub-event, providing the user with a more intelligent and personalized usage experience.

[0085] Figure 6 is a fourth exemplary schematic diagram of the working principle of the intelligent interactive system based on a holographic display device provided in an embodiment of the present application. As shown in Figure 6, the contextual situation event generation module 111 is further configured to generate a user-associated second target contextual situation event based on the current context information of the application running on the user terminal and send it to the cloud server 120 (see 610 in Figure 6).

[0086] The contextual situation event identification module 121 is also configured to identify the relative priority of the second target contextual situation event (see 620 in Figure 6), generate an associated second holographic animation type based on the second target contextual situation event (see 630 in Figure 6), and send a second digital object drive message carrying the second holographic animation type and the relative priority to the holographic display device 130 (see 640 in Figure 6).

[0087] The holographic animation driving module 131 is further configured to parse the second digital object drive message to obtain a second holographic animation type and relative priority (see 650 in FIG6 ), and construct second animation sequence data associated with the second target contextual event based on the second holographic animation type (see 660 in FIG6 ). While the current holographic image display of the user-associated digital object is being driven based on the first animation sequence data, the current holographic image display is interrupted based on the relative priority (see 670 in FIG6 ), and the second holographic image display of the user-associated digital object is driven based on the second animation sequence data (see 680 in FIG6 ).

[0088] In this embodiment, the relative priority of the second target context situation event is used to characterize the priority of the second target context situation event relative to the first target context situation event. In one embodiment, the relative priority of the target context situation event can be represented by positive priority and negative priority. Positive priority means that the priority of the second target context situation event is greater than the priority of the first target context situation event, and negative priority means that the priority of the second target context situation event is not greater than the priority of the first target context situation event. In one embodiment, the priority of the target context situation event can be generated by the context situation event learning module 122 at the same time when generating the context situation event set associated with the user. At this time, the i-th context situation event associated with each user can be represented as event i(userid) = (eventid, appid, functionid, inputType, priority) quintuple. Among them, priority represents the priority corresponding to each context situation event in the context situation event set associated with the user. In this way, when the context situation event identification module 121 identifies the second target context situation event sent by the user terminal 110, it can determine the relative priority of the second target context situation event based on the comparison between the priority of the second target context situation event and the previous first target context situation event. Thus, on the one hand, when the relative priority of the second target context situation event is a positive priority relative to the first target context situation event, the current holographic image display of the digital object on the holographic display device 130 can be interrupted in real time, and the holographic image display associated with the second target context situation event can be provided to the user in a timely manner. On the other hand, when the relative priority of the second target context situation event is a negative priority relative to the first target context situation event, the current holographic image display of the digital object on the holographic display device 130 can be maintained, and the holographic image display associated with the second target context situation event can be provided to the user after the current holographic image display is completed.

[0089] In this embodiment, while the holographic display device 130 is driving the user-associated digital object to display the current holographic image based on the first animation sequence data, if a second target contextual event is further detected on the user terminal 110, the holographic image display of the digital object can be quickly switched based on the relative priority of the second target contextual event, without requiring the user to manually operate the holographic display device 130 to exit the current holographic image display or interrupt the current holographic image display based on a dedicated voice command input by the user, as in traditional digital object interaction methods. Thus, when multiple target contextual events are detected on the user terminal 110, the holographic image display of the digital object can be quickly and efficiently switched and maintained, providing the user with a more intelligent and personalized user experience.

[0090] Figure 7 is a third exemplary architecture diagram of an intelligent interactive system 300 based on a holographic display device provided in an embodiment of the present application. As shown in Figure 7, the system 300 includes a cloud server 120, and a first user terminal 110-1, a second user terminal 110-2, and a holographic display device 130, each connected to the cloud server 120 via a network.

[0091] The first user terminal 110-1 may include a mobile terminal such as a smartphone, tablet computer, laptop computer, or personal digital assistant. The second user terminal 110-2 may include other user terminals such as an in-vehicle terminal or a smart TV. Both the first user terminal 110-1 and the second user terminal 110-2 are installed with multiple applications that provide different content and functional services to the user.

[0092] The first user terminal 110-1 includes a first context situation event generation module 111-1, which is configured to generate a user-associated first target context situation event based on the current context information of the application running on the first user terminal 110-1, and send the event to the cloud server 120. The second user terminal 110-2 includes a second context situation event generation module 111-2, which is configured to generate a user-associated second target context situation event based on the current context information of the application running on the second user terminal 110-2, and send the event to the cloud server 120.

[0093] The cloud server 120 includes a contextual situation event recognition module 121, which is configured to generate an associated first holographic animation type based on a first target contextual situation event, generate an associated second holographic animation type based on a second target contextual situation event, and send a first digital object drive message carrying the first holographic animation type or a second digital object drive message carrying the second holographic animation type to the holographic display device 130.

[0094] The holographic display device 130 includes a holographic animation driving module 131, which is configured to parse a first holographic animation type from a first digital object driving message, construct a first animation sequence data associated with a first target context situation event according to the first holographic animation type, and drive the digital object associated with the user to display a first holographic image based on the first animation sequence data; or, parse a second holographic animation type from a second digital object driving message, construct a second animation sequence data associated with a second target context situation event according to the second holographic animation type, and drive the digital object associated with the user to display a second holographic image based on the second animation sequence data.

[0095] In the intelligent interactive system based on a holographic display device provided in this embodiment, the cloud server 120 can simultaneously receive target contextual events generated by contextual event generation modules in multiple user terminals. For example, a single user can simultaneously interact with holographic animations of digital objects on the holographic display device 130 from both a mobile terminal and an in-vehicle terminal, using different access scenarios. It should be noted that the technical features of any of the aforementioned embodiments are applicable to this embodiment and will not be further elaborated here.

[0096] FIG8 is a fourth exemplary architecture diagram of an intelligent interactive system 400 based on a holographic display device provided in an embodiment of the present application. As shown in FIG8 , based on the aforementioned embodiment, the system 400 further includes a contextual situation event learning module 122 in the cloud server 120. The contextual situation event learning module 122 can simultaneously generate a user-associated contextual situation event set based on the user's learning and training of historical behavior data and interaction preference information of applications installed on the first user terminal 110-1 and the second user terminal 110-2. In other words, the user-associated contextual situation event set covers the most commonly used personalized application access events that the user hopes to trigger holographic animation interactions with the holographic display device 130 in multiple user terminals used by the user.

[0097] Because the user's historical behavior data and interaction preference information for multiple applications installed on the first user terminal 110-1 (e.g., mobile terminal) and the second user terminal 110-2 (e.g., vehicle-mounted terminal) may be different. For example, in the mobile terminal, the most commonly used application set of user A may include weather application APP1, news application APP2, and map application APP4, but the most commonly used application set in the vehicle-mounted terminal may only include weather application APP1 and map application APP4. At the same time, user A's personalized preference information on whether the applications in the mobile terminal and the vehicle-mounted terminal are suitable for triggering holographic animation interaction with the holographic display device 130 may also be different. For example, it is assumed that based on the interaction preference information of user A in the mobile terminal, it is determined that user A is more inclined to trigger holographic animation interaction with the holographic display device 130 when accessing and using weather application APP1 and news application APP2, but is not inclined to trigger holographic animation interaction with the holographic display device 130 when accessing and using map application APP4. However, based on the interaction preference information in the vehicle terminal, it may be determined that user A is more inclined to trigger holographic animation interaction with the holographic display device 130 when accessing and using the map application APP4, but is less inclined to trigger holographic animation interaction with the holographic display device 130 when accessing and using the weather application APP1. In this case, the user-associated contextual event set generated by the contextual situation event learning module 122 based on the learning and training of the historical behavior data and interaction preference information of applications on multiple user terminals can reflect the personalized application access events of users in different user terminals.

[0098] Thus, this embodiment can generate user-associated personalized first target context situation events and second target context situation events based on the user's current context information for different applications on multiple user terminals, and then generate associated first holographic animation types and second holographic animation types based on the first target context situation events and the second target context situation events, respectively. Accordingly, the user-associated digital objects are driven on the holographic display device 130 to display associated holographic images, further enhancing the intelligent and personalized experience of the holographic animation interaction between different user terminals and the holographic display device 130, and further improving the user experience compared to the existing technology.

[0099] In one embodiment, the contextual situation event identification module 121 is further configured to identify the relative priority of the second target contextual situation event and send a second digital object driving message carrying the second holographic animation type and the relative priority to the holographic display device 130.

[0100] The holographic animation driving module 131 is further configured to parse the second holographic animation type and relative priority from the second digital object driving message, and while driving the user-associated digital object to display the first holographic image based on the first animation sequence data, interrupt the first holographic image display according to the relative priority, and drive the user-associated digital object to display the second holographic image based on the second animation sequence data.

[0101] Thus, on the one hand, when the relative priority of the second target context situation event is a positive priority relative to the first target context situation event, the display of the first holographic image of the digital object on the holographic display device 130 can be interrupted in real time, and the second holographic image associated with the second target context situation event can be provided to the user in a timely manner. On the other hand, when the relative priority of the second target context situation event is a negative priority relative to the first target context situation event, the display of the first holographic image of the digital object on the holographic display device 130 can be maintained, and after the display of the first holographic image is completed, the second holographic image associated with the second target context situation event can be provided to the user.

[0102] In this embodiment, while the holographic display device 130 is driving the user-associated digital object to display a first holographic image using the first animation sequence data based on the first target context situation event generated on the first user terminal 110-1, if a second target context situation event is further detected on the second user terminal 110-2, the holographic image display of the digital object can be quickly switched based on the relative priority of the second target context situation event, without requiring the user to manually operate the holographic display device 130 to exit the first holographic image display or to interrupt the first holographic image display based on a dedicated voice command input by the user, as in traditional digital object interaction methods. Thus, when multiple target context situation events are detected from different user terminals, the holographic image display of the digital object can be quickly and efficiently switched and maintained, providing the user with a more intelligent and personalized user experience.

[0103] Figure 9 is a flow chart of an intelligent interaction method based on a holographic display device according to an embodiment of the present application. The intelligent interaction method based on a holographic display device according to an embodiment of the present application includes the following steps:

[0104] Step S910 , generating a user-associated first target contextual event based on current context information of an application running on the user terminal, and sending the event to a cloud server;

[0105] Step S920: The cloud server generates an associated first holographic animation type based on the first target contextual event, and sends a first digital object driving message carrying the first holographic animation type to the holographic display device;

[0106] In step S930, the holographic display device parses the first holographic animation type from the first digital object drive message, constructs first animation sequence data associated with the first target context situation event according to the first holographic animation type, and drives the digital object associated with the user to display a holographic image based on the first animation sequence data.

[0107] In a possible implementation, the interaction method provided in this embodiment further includes:

[0108] The cloud server generates a set of contextual situation events associated with the user based on the user's learning and training of historical behavior data and interaction preference information of the application programs installed on the user terminal.

[0109] In a possible implementation, the interaction method provided in this embodiment further includes:

[0110] When it is determined, based on the set of contextual situation events associated with the user, that the current context information of the application running on the user terminal is suitable for generating the first target contextual situation event, the first target contextual situation event is generated and sent to the cloud server.

[0111] In a possible implementation, the interaction method provided in this embodiment further includes:

[0112] When it is determined, based on the set of contextual situation events associated with the user, that the current context information of the application running on the user terminal is not suitable for generating the first target contextual situation event, a general contextual event is generated and sent to the cloud server.

[0113] It should be noted that the technical features in any of the aforementioned embodiments are applicable to the embodiments of this method and will not be repeated here.

[0114] Furthermore, an embodiment of the present application also provides an electronic device, which may include: a processor and a memory. The memory stores computer program instructions, and the processor can call the computer program instructions in the memory to execute all or part of the steps of the method described in any embodiment of the present application. The computer program instructions in the memory can be implemented in the form of a software functional unit and stored in a computer-readable storage medium when sold or used as a standalone product.

[0115] Furthermore, an embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program. When the computer-readable storage medium is connected to a computer device and the computer program is executed by one or more processors of the computer device, it can execute all or part of the steps of the method described in any embodiment of the present application.

[0116] Furthermore, an embodiment of the present application also provides a non-transitory computer-readable storage medium on which a computer program is stored. The computer program can be executed by one or more processors to perform all or part of the steps of the method described in any embodiment of the present application.

[0117] Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments of the present application can be implemented by means of software or software combined with the necessary general hardware platform, and of course can also be implemented by hardware functions. Based on such an understanding, the technical solution of the present application can be essentially or partially reflected in the form of a software product that contributes to the prior art. The software product is stored in a storage medium and includes a number of instructions to enable a computer device, such as but not limited to a personal computer, a server, or a network device, to execute all or part of the steps of the method described in any embodiment of the present application. The aforementioned storage medium may include: various media that can store computer program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0118] While the exemplary embodiments of the present application have been described above, it should be understood that the exemplary embodiments are illustrative rather than restrictive, and the scope of protection of the present application is not limited thereto. It should be understood that those skilled in the art may modify and alter the embodiments of the present application without departing from the spirit and scope of the present application, and such modifications and alterations are intended to be within the scope of protection of the present application. Industrial Applicability

[0119] In summary, the present application provides an intelligent interaction system and method based on a holographic display device, which can improve the intelligence and personalization of the holographic animation interaction behavior between the user terminal and the holographic display device, and enhance the user experience.

Claims

1. An intelligent interactive system based on a holographic display device, characterized in that: include: A cloud server, and a user terminal and a holographic display device respectively connected to the cloud server via a network; The user terminal includes a contextual situation event generation module configured to generate a user-associated first target contextual situation event based on current context information of an application running on the user terminal, and send the generated first target contextual situation event to the cloud server; The cloud server includes a contextual situation event recognition module configured to generate an associated first holographic animation type based on the first target contextual situation event, and send a first digital object driving message carrying the first holographic animation type to the holographic display device; The holographic display device includes a holographic animation driving module, which is configured to parse the first holographic animation type from the first digital object driving message, construct first animation sequence data associated with the first target context situation event according to the first holographic animation type, and drive the user-associated digital object to display a holographic image based on the first animation sequence data.

2. The intelligent interactive system based on the holographic display device according to claim 1, characterized in that: The cloud server also includes a contextual situation event learning module configured to generate a set of contextual situation events associated with the user based on the user's learning and training of historical behavior data and interaction preference information of the application installed on the user terminal.

3. The intelligent interactive system based on the holographic display device according to claim 2, characterized in that: The context situation event generation module is also configured to generate the first target context situation event and send it to the cloud server when it determines that the current context information of the application running on the user terminal is suitable for generating the first target context situation event based on the context situation event set associated with the user.

4. The intelligent interactive system based on the holographic display device according to claim 2 or 3, characterized in that: The context situation event generation module is also configured to generate a general situation event and send it to the cloud server when it determines that the current context information of the application running on the user terminal is not suitable for generating the first target context situation event based on the context situation event set associated with the user.

5. The intelligent interactive system based on holographic display device according to claim 4, characterized in that: The contextual situation event recognition module is further configured to generate a first preset holographic animation type based on the general situation event sent by the user terminal, and send a first preset digital object driving message carrying the first preset holographic animation type to the holographic display device; The holographic animation driving module is further configured to parse the first preset holographic animation type from the first preset digital object driving message, obtain first preset animation sequence data according to the first preset holographic animation type, and drive the user-associated digital object to display a holographic image based on the first preset animation sequence data.

6. The intelligent interactive system based on holographic display device according to claim 5, characterized in that: The context situation event generation module is further configured to generate at least one context situation sub-event according to the temporal process of the first target context situation event and send it to the cloud server; The contextual situation event recognition module is further configured to generate a second preset holographic animation type based on the at least one contextual situation sub-event, and send a second preset digital object driving message carrying the second preset holographic animation type to the holographic display device; The holographic animation driving module is further configured to parse the second preset holographic animation type from the second preset digital object driving message, obtain second preset animation sequence data according to the second preset holographic animation type, and drive the user-associated digital object to display a holographic image based on the second preset animation sequence data.

7. The intelligent interactive system based on the holographic display device according to claim 2 or 6, characterized in that: The holographic animation driving module is further configured to parse the action type, expression type, lip shape type, special effect type and decoration type according to the first holographic animation type, and construct action control data, expression control data, lip shape control data, special effect control data and decoration control data according to the action type, expression type, lip shape type, special effect type and decoration type respectively, and construct the first animation sequence data based on the action control data, expression control data, lip shape control data, special effect control data and decoration control data as well as the voice response data.

8. The intelligent interactive system based on holographic display device according to claim 7, characterized in that: The context situation event generation module is further configured to generate a second target context situation event associated with the user based on current context information of the application running on the user terminal, and send the second target context situation event to the cloud server; The contextual situation event identification module is further configured to identify the relative priority of the second target contextual situation event, generate an associated second holographic animation type based on the second target contextual situation event, and send a second digital object driving message carrying the second holographic animation type and the relative priority to the holographic display device; The animation driving module is further configured to parse the second holographic animation type and the relative priority from the second digital object driving message, construct second animation sequence data associated with the second target context situation event according to the second holographic animation type, and while driving the user-associated digital object to display the current holographic image based on the first animation sequence data, interrupt the current holographic image display according to the relative priority, and drive the user-associated digital object to display the second holographic image based on the second animation sequence data.

9. An intelligent interactive system based on a holographic display device, characterized in that: include: A cloud server, and a first user terminal, a second user terminal, and a holographic display device respectively connected to the cloud server via a network; The first user terminal includes a first contextual situation event generation module configured to generate a user-associated first target contextual situation event based on current context information of an application running on the first user terminal, and send the generated first target contextual situation event to the cloud server; The second user terminal includes a second context situation event generation module configured to generate a user-associated second target context situation event based on current context information of an application running on the second user terminal, and send the generated second target context situation event to the cloud server; The cloud server includes a contextual situation event recognition module configured to generate an associated first holographic animation type based on the first target contextual situation event, generate an associated second holographic animation type based on the second target contextual situation event, and send a first digital object driving message carrying the first holographic animation type or a second digital object driving message carrying the second holographic animation type to the holographic display device; The holographic display device includes a holographic animation driving module, which is configured to parse the first holographic animation type from the first digital object driving message, construct a first animation sequence data associated with the first target context situation event according to the first holographic animation type, and drive the digital object associated with the user to display a first holographic image based on the first animation sequence data; or parse the second holographic animation type from the second digital object driving message, and construct a first holographic image associated with the target context situation event according to the second holographic animation type. The second animation sequence data associated with the second target contextual event drives the digital object associated with the user to display a second holographic image based on the second animation sequence data.

10. The intelligent interactive system based on holographic display device according to claim 9, characterized in that: The cloud server also includes a contextual situation event learning module, which is configured to generate a set of contextual situation events associated with the user based on the user's learning and training of historical behavior data and interaction preference information of applications installed on the first user terminal and the second user terminal.

11. The intelligent interactive system based on a holographic display device according to claim 9 or 10, characterized in that: The contextual situation event identification module is further configured to identify the relative priority of the second target contextual situation event and send a second digital object driving message carrying the second holographic animation type and the relative priority to the holographic display device; The holographic animation driving module is further configured to parse the second holographic animation type and the relative priority from the second digital object driving message, and while driving the user-associated digital object to display a first holographic image based on the first animation sequence data, interrupt the first holographic image display according to the relative priority, and drive the user-associated digital object to display a second holographic image based on the second animation sequence data.

12. An intelligent interaction method based on a holographic display device, characterized in that: include: generating a user-associated first target contextual situation event based on current context information of an application running on the user terminal, and sending the event to the cloud server; The cloud server generates an associated first holographic animation type based on the first target contextual event, and sends a first digital object driving message carrying the first holographic animation type to the holographic display device; The holographic display device parses the first holographic animation type from the first digital object drive message, constructs first animation sequence data associated with the first target context situation event according to the first holographic animation type, and drives the user-associated digital object to display a holographic image based on the first animation sequence data.

13. The intelligent interaction method based on the holographic display device according to claim 12, characterized in that: The method further comprises: The cloud server generates a set of contextual situation events associated with the user based on the user's learning and training of historical behavior data and interaction preference information of the application programs installed on the user terminal.

14. The intelligent interaction method based on the holographic display device according to claim 13, characterized in that: The method further comprises: When it is determined, based on the set of contextual situation events associated with the user, that the current context information of the application running on the user terminal is suitable for generating the first target contextual situation event, the first target contextual situation event is generated and sent to the cloud server.

15. The intelligent interaction method based on a holographic display device according to claim 12 or 13, characterized in that: The method further comprises: When it is determined, based on the set of contextual situation events associated with the user, that the current context information of the application running on the user terminal is not suitable for generating the first target contextual situation event, a general contextual event is generated and sent to the cloud server.

Citation Information

Patent Citations

  • Virtual image interaction method and system based on front-projected holographic display equipment

    CN107831905A

  • Multimodal interaction method and system based on holographic equipment

    CN108037829A

  • Animation interaction method, device and equipment and storage medium

    CN111833418A

  • VR interaction method and device based on artificial intelligence, computer equipment and medium

    CN112099628A

  • Information interaction method and device, electronic equipment, medium and program product

    CN113392201A

Cited By

  • A multimodal interactive holographic table setting and its control method

    CN122412858A