Immersive interactive intelligent central control screen based on VR technology

Abstract

The present invention provides an immersive interactive intelligent central control screen based on VR technology, wherein the central control screen includes: an interactive space information acquisition subsystem for acquiring interactive space information selected by a target interactive party; an immersive interactive scene construction subsystem for constructing an immersive interactive scene based on the interactive space information based on VR technology; an interactive action acquisition subsystem for acquiring the interactive action of the target interactive party in the immersive interactive scene; an interactive feedback determination subsystem for determining interactive feedback based on interactive actions; and an intelligent interactive subsystem for performing intelligent interaction based on interactive feedback. The immersive interactive intelligent central control screen based on VR technology of the present invention introduces VR technology, constructs an immersive interactive scene based on the interactive space information selected by the target interactive party, determines instant feedback and a list of expected future feedback as interactive feedback based on interactive actions, and intelligently interacts based on interactive feedback, with a higher response rate and more humane.

Description

Technical Field

[0001] The present invention relates to the field of VR equipment technology, and in particular to an immersive interactive intelligent central control screen based on VR technology. Background Art

[0002] VR technology, or Virtual Reality (VR for short), is a technology that uses computers to simulate a three-dimensional virtual world, providing users with visual, auditory, and tactile simulations, making them feel as if they are actually there. This technology creates an immersive environment, allowing users to interact and experience the virtual world.

[0003] VR technology allows users to experience various scenarios in an immersive way, such as home, office, and entertainment venues. This immersive experience enables users to understand and control various devices more intuitively, thereby improving efficiency and comfort.

[0004] The invention patent with application number: CN202110726237.8 discloses a VR interaction method, system, mobile terminal and computer-readable storage medium. The method includes: determining the scene to be interacted according to the VR interaction instruction, performing three-dimensional image projection on the scene to be interacted, and obtaining a VR interaction scene; collecting action features of the user in the VR interaction scene to obtain action collection features, performing time synchronization processing on the action collection features to obtain action timing features, and the action timing features include skeleton timing features and force timing features; determining the user's somatosensory posture according to the skeleton timing features, and determining the posture strength of the corresponding somatosensory posture according to the force timing features; generating VR interaction information according to the somatosensory posture and posture strength, and performing VR interaction operations on the VR interaction scene according to the VR interaction information. In the above invention, users can directly perform VR interaction based on the operation posture, without the need to use an operating handle for VR interaction, which improves the user's experience.

[0005] However, the above-mentioned existing technologies can only perform VR interaction according to the real-time actions of the user. In some specific application scenarios, the same interactive operations exist, and the actions need to be recognized each time. The interactive response efficiency is low and not user-friendly enough.

[0006] In view of this, an immersive interactive smart central control screen based on VR technology is urgently needed to at least solve the above-mentioned shortcomings. Summary of the invention

[0007] One of the purposes of the present invention is to provide an immersive interactive intelligent central control screen based on VR technology, introduce VR technology, construct an immersive interactive scene according to the interactive space information selected by the target interactive party, determine instant feedback and an expected future feedback list as interactive feedback according to the acquired interactive actions of the target interactive party in the immersive interactive scene, perform intelligent interaction according to the interactive feedback, improve the response rate, and be more humane.

[0008] The immersive interactive intelligent central control screen based on VR technology provided by the embodiment of the present invention includes:

[0009] An interactive space information acquisition subsystem is used to acquire the interactive space information selected by the target interactive party;

[0010] Immersive interactive scene construction subsystem, used to build immersive interactive scenes based on VR technology and interactive space information;

[0011] The interactive action acquisition subsystem is used to acquire the interactive actions of the target interactive party in the immersive interactive scene;

[0012] The interactive feedback determination subsystem is used to determine the interactive feedback according to the interactive action. The interactive feedback includes: immediate feedback and a list of expected future feedback;

[0013] The intelligent interaction subsystem is used to perform intelligent interaction based on interaction feedback.

[0014] Preferably, the interactive space information acquisition subsystem includes:

[0015] An instruction acquisition module is used to acquire an interactive space information selection instruction of a target interactive party, wherein the interactive space information selection instruction includes: an active input instruction of the target interactive party and a passive trigger instruction of the target interactive party;

[0016] The interactive space information determination module is used to select instructions according to the interactive space information and determine the interactive space information.

[0017] Preferably, the immersive interactive scene construction subsystem includes:

[0018] The scene construction resource acquisition module is used to schedule the scene construction resource library and obtain scene construction resources according to the interactive space information;

[0019] The construction module is used to build resources according to the scene based on VR technology and build immersive interactive scenes.

[0020] Preferably, the interactive action acquisition subsystem includes:

[0021] A target interaction information acquisition module, used to acquire target interaction information;

[0022] The interaction action determination module is used to determine the interaction action according to the target interaction information.

[0023] Preferably, the target interaction information acquisition module includes:

[0024] A first interaction information acquisition submodule is used to acquire first interaction information of an external operation device of a target interaction party, wherein the first interaction information includes: operation information of the external operation device and a first operation priority;

[0025] A second interaction information acquisition submodule, configured to acquire second interaction information of the interaction sight of the target interaction party, the second interaction information including: tracking information of the interaction sight and a second operation priority;

[0026] A third interaction information acquisition submodule is used to acquire third interaction information of the control voice of the target interaction party, where the third interaction information includes: semantic control information of the control voice and a third operation priority;

[0027] A fourth interaction information acquisition submodule is used to acquire fourth interaction information of the operation gesture of the target interaction party, wherein the fourth interaction information includes: gesture control information of the operation gesture and a fourth operation priority;

[0028] The target interaction information determination submodule is used to take the first interaction information, the second interaction information, the third interaction information and the fourth interaction information as target interaction information.

[0029] Preferably, the interactive action determination module includes:

[0030] An interaction conflict determination submodule is used to determine whether there is an interaction conflict based on the target interaction information;

[0031] The first interaction action determination submodule is used to directly determine the interaction action if it does not exist;

[0032] A comparison information acquisition submodule, used to obtain comparison information of operation priority, if any;

[0033] A first determination value acquisition submodule, used to acquire a first determination value of the conflicting action according to the comparison information of the operation priority;

[0034] A first preceding interaction action acquisition submodule, used to acquire a first preceding interaction action before an interaction conflict occurs;

[0035] A second determined value acquisition submodule, used for acquiring a second determined value of the conflicting action according to the first preceding interactive action and the conflicting action;

[0036] The interactive action second determination submodule is used to calculate the first determination value and the second determination value of the conflicting action, obtain the determination sum value of the conflicting action, and take the conflicting action with the largest determination sum value as the interactive action.

[0037] Preferably, the interactive feedback determination subsystem includes:

[0038] An instant feedback determination module, used to determine instant feedback according to the interactive action;

[0039] A second preceding interaction action acquisition module, used to acquire a second preceding interaction action;

[0040] An interaction action sequence determination module, used to determine an interaction action sequence according to an interaction action and a second preceding interaction action;

[0041] An action number calculation module, used to calculate the number of actions in an interactive action sequence;

[0042] The first interactive feedback determination module is used to use the immediate feedback as interactive feedback if the number of actions is less than or equal to a preset action number threshold;

[0043] An expected future feedback list determination module is used to determine an expected future feedback list according to the interaction action sequence if the number of actions is greater than a preset action number threshold;

[0044] The second interactive feedback determination module is used to take the immediate feedback and the expected future feedback list together as interactive feedback.

[0045] Preferably, the module for determining the expected future feedback list includes:

[0046] A history control list acquisition submodule is used to acquire a history control list, wherein the history control list includes: a plurality of history interaction action sequences and corresponding first history feedbacks;

[0047] The inclusion relationship determination submodule is used to determine whether the interactive action sequence is included in the historical interactive action sequence;

[0048] The first determination submodule of the expected future feedback list is used to determine that the expected future feedback list is empty if the interactive action sequence is not included in any historical interactive action sequence;

[0049] A second historical feedback determination submodule, configured to determine, if the interactive action sequence is included in the historical interactive action sequence, the first historical feedback of the corresponding historical interactive action sequence as the second historical feedback;

[0050] A feedback number acquisition submodule is used to acquire the feedback number of the second historical feedback;

[0051] The second determination submodule of the expected future feedback list is used to obtain the usage frequency of the second historical feedback if the number of feedbacks is greater than or equal to the preset feedback number threshold, and filter the second historical feedbacks of the feedback number threshold number in descending order of usage frequency to obtain the expected future feedback list;

[0052] The third determination submodule of the expected future feedback list is configured to generate an expected future feedback list based on the second historical feedback if the number of feedbacks is less than a preset feedback number threshold.

[0053] The immersive interaction method based on VR technology provided by an embodiment of the present invention includes:

[0054] Step 1: Obtain the interaction space information selected by the target interaction party;

[0055] Step 2: Based on VR technology and interactive space information, build an immersive interactive scene;

[0056] Step 3: Obtain the target interaction party's interaction actions in the immersive interaction scene;

[0057] Step 4: Determine the interactive feedback based on the interactive action. The interactive feedback includes: immediate feedback and a list of expected future feedback;

[0058] Step 5: Conduct intelligent interaction based on interaction feedback.

[0059] Preferably, step 2: constructing an immersive interactive scene based on VR technology and interactive space information, including:

[0060] Dispatch the scene construction resource library and obtain scene construction resources based on the interactive space information;

[0061] Based on VR technology, resources are built according to the scene to create immersive interactive scenes.

[0062] The beneficial effects of the present invention are:

[0063] The present invention introduces VR technology, constructs an immersive interaction scene according to the interaction space information selected by the target interaction party, determines instant feedback and a list of expected future feedback as interaction feedback according to the acquired interaction actions of the target interaction party in the immersive interaction scene, and performs intelligent interaction according to the interaction feedback, thereby improving the response rate and being more humane.

[0064] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures specifically pointed out in the present application documents.

[0065] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0067] Figure 1 Schematic diagram of an immersive interactive intelligent central control screen based on VR technology in an embodiment of the present invention;

[0068] Figure 2 Schematic diagram of an immersive interaction method based on VR technology in an embodiment of the present invention. DETAILED DESCRIPTION

[0069] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0070] The embodiment of the present invention provides an immersive interactive intelligent central control screen based on VR technology, such as Figure 1 As shown, including:

[0071] The interactive space information acquisition subsystem 1 is used to acquire the interactive space information selected by the target interactive party; wherein the target interactive party is: a person who uses the smart central control screen for immersive interaction; the interactive space information is: a space where the target interactive party wants to have an immersive interactive experience, such as: home, office and entertainment venue;

[0072] The immersive interactive scene construction subsystem 2 is used to construct an immersive interactive scene based on the VR technology and the interactive space information; wherein the immersive interactive scene is: a virtual reality space corresponding to the interactive space information constructed based on the VR technology;

[0073] The interactive action acquisition subsystem 3 is used to acquire the interactive actions of the target interactive party in the immersive interactive scene; wherein the interactive actions are: actions performed by the target interactive party in the immersive interactive scene, such as: head rotation, hand movement, and grabbing virtual objects, etc.;

[0074] The interactive feedback determination subsystem 4 is used to determine the interactive feedback according to the interactive action. The interactive feedback includes: immediate feedback and a list of expected future feedback; wherein the immediate feedback is: a virtual response operation directly determined according to the interactive action; the list of expected future feedback is: a list of virtual response operations that may respond in the future. The list of expected future feedback is for the target interactive party to select. After selecting the expected future feedback, the system automatically executes the subsequent interactive steps;

[0075] The intelligent interaction subsystem 5 is used to perform intelligent interaction according to the interaction feedback. When performing intelligent interaction according to the interaction action, the user can understand and control various devices more intuitively, thereby improving the use efficiency and comfort.

[0076] The working principle and beneficial effects of the above technical solution are:

[0077] This application introduces VR technology to construct an immersive interaction scene based on the interaction space information selected by the target interaction party, determine immediate feedback and a list of expected future feedback as interaction feedback based on the interaction actions of the target interaction party in the immersive interaction scene, and perform intelligent interaction based on the interaction feedback, thereby improving the response rate and being more humane.

[0078] In one embodiment, the interactive space information acquisition subsystem includes:

[0079] The instruction acquisition module is used to acquire the interactive space information selection instruction of the target interactive party, wherein the interactive space information selection instruction includes: the active input instruction of the target interactive party and the passive trigger instruction of the target interactive party; the active input instruction is: the interactive space information selection instruction directly input by the target interactive party through the intelligent central control screen; the passive trigger instruction is: the trigger instruction of the target interactive party indirectly triggering the interactive space information selection result through voice interaction or the like;

[0080] The interactive space information determination module is used to select instructions according to the interactive space information and determine the interactive space information.

[0081] The working principle and beneficial effects of the above technical solution are:

[0082] The present application introduces two methods of obtaining interactive space information selection instructions, namely, active input instructions and passive trigger instructions of the target interactive party, thereby improving the comprehensiveness and timeliness of obtaining interactive space information selection instructions.

[0083] In one embodiment, the immersive interactive scene construction subsystem includes:

[0084] A scene construction resource acquisition module is used to schedule a scene construction resource library and acquire scene construction resources according to interactive space information; wherein the scene construction resource library includes pre-stored virtual scene construction resources of multiple interactive spaces;

[0085] The construction module is used to build resources according to the scene based on VR technology and build immersive interactive scenes.

[0086] The working principle and beneficial effects of the above technical solution are:

[0087] This application obtains scene construction resources corresponding to interactive space information by scheduling the scene construction resource library, and then builds an immersive interactive scene based on VR technology, thereby improving the rationality of scene construction.

[0088] In one embodiment, the interaction action acquisition subsystem includes:

[0089] The target interaction information acquisition module is used to acquire the target interaction information; wherein the target interaction information is: confirmation information of the interaction action when the target interaction party interacts, such as: the hand action of the target interaction party, the eye sight of the target interaction party, etc.;

[0090] The interaction action determination module is used to determine the interaction action according to the target interaction information.

[0091] The working principle and beneficial effects of the above technical solution are:

[0092] The present application obtains multi-dimensional target interaction information of the target interaction party, determines the interaction action according to the target interaction information, and improves the suitability of determining the interaction action.

[0093] In one embodiment, the target interaction information acquisition module includes:

[0094] The first interaction information acquisition submodule is used to acquire the first interaction information of the external operation device of the target interaction party, wherein the first interaction information includes: operation information of the external operation device and a first operation priority; wherein the external operation device is: a peripheral connected to the smart central control screen; the operation information is: an operation result of the external operation device; and the first operation priority is: the operation priority of the external operation device;

[0095] The second interaction information acquisition submodule is used to acquire the second interaction information of the interaction sight of the target interaction party, the second interaction information including: tracking information of the interaction sight and a second operation priority; wherein the tracking information of the interaction sight is acquired based on the sight tracking technology; the second operation priority is: the priority of the operation corresponding to the tracking information;

[0096] The third interaction information acquisition submodule is used to acquire the third interaction information of the control voice of the target interaction party, wherein the third interaction information includes: semantic control information of the control voice and a third operation priority; wherein the semantic control information is: the control operation of the control voice; and the third operation priority is: the priority of the control operation of the control voice;

[0097] The fourth interaction information acquisition submodule is used to acquire fourth interaction information of the operation gesture of the target interaction party, wherein the fourth interaction information includes: gesture control information of the operation gesture and a fourth operation priority; wherein the gesture control information is: the control operation corresponding to the operation gesture; and the fourth operation priority is: the priority of the control operation of the operation gesture;

[0098] The target interaction information determination submodule is used to take the first interaction information, the second interaction information, the third interaction information and the fourth interaction information as target interaction information.

[0099] The working principle and beneficial effects of the above technical solution are:

[0100] When obtaining interactive information, it is not convenient enough to obtain interactive information through a single method. For example, if a target interactive user wants to save a virtual scene within the desired range of a certain scene, it is cumbersome to rely solely on voice control to capture image descriptions. Accessing a virtual mouse through peripherals is too dependent on devices. Semantic control and line of sight tracking technology can be combined to determine the desired virtual scene. Therefore, the present application introduces first interactive information of an external operating device, second interactive information of interactive line of sight, third interactive information of control voice, and fourth interactive information of operating gestures. The first interactive information, second interactive information, third interactive information and fourth interactive information are collectively used as target interactive information, which improves the comprehensiveness of the target interactive information. Target interactive information of different types of interactive information can be coordinated for interactive operations, which is more user-friendly.

[0101] In one embodiment, the interaction action determination module includes:

[0102] The interaction conflict determination submodule is used to determine whether there is an interaction conflict based on the target interaction information; wherein the interaction conflict exists because different types of target interaction information may point to different interaction operations, and these interaction operations may be mutually exclusive, for example: the 3D video being watched by voice control fast-forwards 5s, while the progress bar dragged by gesture control fast-forwards the 3D video by 10s;

[0103] The first interaction action determination submodule is used to directly determine the interaction action if it does not exist;

[0104] The comparison information acquisition submodule is used to obtain the comparison information of the operation priority if any; wherein the comparison information is: which operation priority is higher and how much higher among the conflicting target interaction information;

[0105] A first determination value acquisition submodule is used to acquire a first determination value of the conflicting action according to the comparison information of the operation priority; wherein the conversion relationship between the comparison information and the first determination value is manually preset;

[0106] A first preceding interaction action acquisition submodule is used to acquire a first preceding interaction action before the interaction conflict occurs; wherein the first preceding interaction action is: an interaction action that has been triggered before the interaction conflict occurs;

[0107] A second determination value acquisition submodule is used to acquire a second determination value of the conflicting action according to the first preceding interactive action and the conflicting action; wherein the second determination value is determined according to the continuity rationality of the first preceding interactive action and the conflicting action, and the continuity rationality is the rationality of executing the conflicting action next after the first preceding interactive action, and the higher the continuity rationality, the higher the second determination value;

[0108] The interactive action second determination submodule is used to calculate the first determination value and the second determination value of the conflicting action, obtain the determination sum value of the conflicting action, and take the conflicting action with the largest determination sum value as the interactive action.

[0109] The working principle and beneficial effects of the above technical solution are:

[0110] Although collecting target interaction information of multiple dimensions can complement each other and bring a better interactive experience, there is a possibility that different interactive operations pointed to by different types of target interaction information will repel each other. Therefore, the present application performs interaction conflict judgment. If there is no interaction conflict, the interaction action is directly determined. If there is, the comparison information of the operation priority is obtained, and the first determination value of the conflicting action is determined based on the comparison information. In addition, the interaction action that has been triggered before the interaction conflict is obtained, and the continuation rationality of the conflicting action is determined based on the first preceding interaction action and the conflicting action, and then the second determination value is determined based on the continuation rationality. The first determination value and the second determination value of the conflicting action are calculated to obtain the determination and value of the conflicting action, and the conflicting action with the largest determination and value is used as the interaction action, which improves the accuracy of the determination of the interaction action.

[0111] In one embodiment, the interactive feedback determination subsystem includes:

[0112] An instant feedback determination module is used to determine instant feedback according to the interactive action; wherein the instant feedback is: interactive feedback directly triggered by the interactive action;

[0113] A second preceding interaction action acquisition module is used to acquire a second preceding interaction action; wherein the second preceding interaction action is: an interaction action that has been triggered before the interaction action;

[0114] An interactive action sequence determination module is used to determine an interactive action sequence according to an interactive action and a second preceding interactive action; wherein the interactive action sequence is an action sequence that sorts the interactive action and the second preceding interactive action based on the time at which the action occurs;

[0115] The action number calculation module is used to calculate the number of actions in the interactive action sequence; wherein the action number is: the number of actions in the interactive action sequence;

[0116] The first interactive feedback determination module is used to use the immediate feedback as interactive feedback if the number of actions is less than or equal to a preset action number threshold; wherein the preset action number threshold is manually preset;

[0117] The module for determining the expected future feedback list is used to determine the expected future feedback list according to the interactive action sequence if the number of actions is greater than a preset action number threshold; wherein the expected future feedback list includes: a list of expected possible final feedback;

[0118] The second interactive feedback determination module is used to take the immediate feedback and the expected future feedback list together as interactive feedback.

[0119] The working principle and beneficial effects of the above technical solution are:

[0120] When users interact, there will be an ultimate interaction purpose, and there will be transitional steps in the middle of achieving this ultimate interaction purpose. Therefore, when determining the interactive feedback, first determine the immediate feedback directly based on the interactive action. In addition, obtain the second preceding interactive action of the interactive action, determine the interactive action sequence based on the interactive action and the second preceding interactive action, and calculate the number of actions in the interactive action sequence. Considering that there is less information available for identification with a small number of actions, when the number of actions is less than or equal to the action number threshold, directly use the immediate feedback as the interactive feedback. When the number of actions is greater than the action number threshold, determine the expected future feedback list based on the interactive action sequence, and use the immediate feedback and the expected future feedback list together as the interactive feedback. The expected future feedback list is provided for the target interactive party to choose, and the target interactive party can independently choose the desired interaction method, which is more convenient and more humane.

[0121] In one embodiment, the module for determining the expected future feedback list includes:

[0122] The historical control list acquisition submodule is used to acquire the historical control list, which includes: multiple historical interaction action sequences and corresponding first historical feedbacks; wherein the historical interaction action sequence is: a sequence formed based on the execution order of historical interaction actions in the historical interaction process, and the first historical feedback is: the final interaction feedback of the historical interaction action sequence;

[0123] The inclusion relationship determination submodule is used to determine whether the interactive action sequence is included in the historical interactive action sequence;

[0124] The first determination submodule of the expected future feedback list is used to determine that the expected future feedback list is empty if the interactive action sequence is not included in any historical interactive action sequence;

[0125] A second historical feedback determination submodule, configured to determine, if the interactive action sequence is included in the historical interactive action sequence, the first historical feedback of the corresponding historical interactive action sequence as the second historical feedback;

[0126] The feedback number acquisition submodule is used to acquire the feedback number of the second historical feedback; wherein the feedback number is: the number of the second historical feedback;

[0127] The second determination submodule of the expected future feedback list is used to obtain the usage frequency of the second historical feedback if the number of feedbacks is greater than or equal to the preset feedback number threshold, and filter the second historical feedbacks of the feedback number threshold number in descending order of usage frequency to obtain the expected future feedback list; wherein the preset feedback number threshold number is manually pre-set, and is specifically determined according to the number of feedbacks that can be displayed on the interface presenting the expected future feedback list; the usage frequency is: the triggering frequency of the second historical feedback within the past preset time period (for example: one month);

[0128] The third determination submodule of the expected future feedback list is configured to generate an expected future feedback list based on the second historical feedback if the number of feedbacks is less than a preset feedback number threshold.

[0129] The working principle and beneficial effects of the above technical solution are:

[0130] The present application obtains a historical control list including multiple historical interaction action sequences and corresponding first historical feedbacks, and determines whether the interaction action sequence is included in the historical interaction action sequence. If not, the expected future feedback list is not displayed. If included, the second historical feedback is obtained. Since the final target interaction party wants only one feedback, a feedback number threshold is introduced. When the number of feedbacks of the second historical feedback is greater than the feedback number threshold, the second historical feedbacks of the feedback number threshold number are filtered in order of usage frequency from high to low and the expected future feedback list is constructed. If the number of feedbacks is less than the preset feedback number threshold, the expected future feedback list is directly generated based on the second historical feedback, thereby improving the suitability of the generation of the expected future feedback list.

[0131] The embodiment of the present invention provides an immersive interaction method based on VR technology, such as Figure 2 As shown, including:

[0132] Step 1: Obtain the interaction space information selected by the target interaction party;

[0133] Step 2: Based on VR technology and interactive space information, build an immersive interactive scene;

[0134] Step 3: Obtain the target interaction party's interaction actions in the immersive interaction scene;

[0135] Step 4: Determine the interactive feedback based on the interactive action. The interactive feedback includes: immediate feedback and a list of expected future feedback;

[0136] Step 5: Conduct intelligent interaction based on interaction feedback.

[0137] In one embodiment, step 2: constructing an immersive interactive scene based on VR technology and interactive space information includes:

[0138] Dispatch the scene construction resource library and obtain scene construction resources based on the interactive space information;

[0139] Based on VR technology, resources are built according to the scene to create immersive interactive scenes.

[0140] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An immersive interactive intelligent central control screen based on VR technology, characterized by: include: An interactive space information acquisition subsystem is used to acquire the interactive space information selected by the target interactive party; Immersive interactive scene construction subsystem, used to build immersive interactive scenes based on VR technology and interactive space information; The interactive action acquisition subsystem is used to acquire the interactive actions of the target interactive party in the immersive interactive scene; The interactive feedback determination subsystem is used to determine the interactive feedback according to the interactive action. The interactive feedback includes: immediate feedback and a list of expected future feedback; Intelligent interaction subsystem, used to perform intelligent interaction based on interaction feedback; The interactive feedback determines the subsystem, including: An instant feedback determination module, used to determine instant feedback according to the interactive action; A second preceding interaction action acquisition module, used to acquire a second preceding interaction action; An interaction action sequence determination module, used to determine an interaction action sequence according to an interaction action and a second preceding interaction action; An action number calculation module, used to calculate the number of actions in an interactive action sequence; The first interactive feedback determination module is used to use the immediate feedback as interactive feedback if the number of actions is less than or equal to a preset action number threshold; An expected future feedback list determination module is used to determine an expected future feedback list according to the interaction action sequence if the number of actions is greater than a preset action number threshold; The second interactive feedback determination module is used to take the immediate feedback and the expected future feedback list as interactive feedback; The modules to be determined in the expected future feedback list include: A history control list acquisition submodule is used to acquire a history control list, wherein the history control list includes: a plurality of history interaction action sequences and corresponding first history feedbacks; The inclusion relationship determination submodule is used to determine whether the interactive action sequence is included in the historical interactive action sequence; The first determination submodule of the expected future feedback list is used to determine that the expected future feedback list is empty if the interactive action sequence is not included in any historical interactive action sequence; A second historical feedback determination submodule, configured to determine, if the interactive action sequence is included in the historical interactive action sequence, the first historical feedback of the corresponding historical interactive action sequence as the second historical feedback; A feedback number acquisition submodule is used to acquire the feedback number of the second historical feedback; The second determination submodule of the expected future feedback list is used to obtain the usage frequency of the second historical feedback if the number of feedbacks is greater than or equal to the preset feedback number threshold, and filter the second historical feedbacks of the feedback number threshold number in descending order of usage frequency to obtain the expected future feedback list; The third determination submodule of the expected future feedback list is configured to generate an expected future feedback list based on the second historical feedback if the number of feedbacks is less than a preset feedback number threshold.

2. The immersive interactive intelligent central control screen based on VR technology according to claim 1, characterized in that: Interactive space information acquisition subsystem, including: An instruction acquisition module is used to acquire an interactive space information selection instruction of a target interactive party, wherein the interactive space information selection instruction includes: an active input instruction of the target interactive party and a passive trigger instruction of the target interactive party; The interactive space information determination module is used to select instructions according to the interactive space information and determine the interactive space information.

3. The immersive interactive intelligent central control screen based on VR technology according to claim 1, characterized in that: Immersive interactive scene construction subsystem, including: The scene construction resource acquisition module is used to schedule the scene construction resource library and obtain scene construction resources according to the interactive space information; The construction module is used to build resources according to the scene based on VR technology and build immersive interactive scenes.

4. The immersive interactive intelligent central control screen based on VR technology according to claim 1, characterized in that: Interaction action acquisition subsystem, including: A target interaction information acquisition module, used to acquire target interaction information; The interaction action determination module is used to determine the interaction action according to the target interaction information.

5. The immersive interactive intelligent central control screen based on VR technology as claimed in claim 4, characterized in that: The target interaction information acquisition module includes: A first interaction information acquisition submodule is used to acquire first interaction information of an external operation device of a target interaction party, wherein the first interaction information includes: operation information of the external operation device and a first operation priority; A second interaction information acquisition submodule, configured to acquire second interaction information of the interaction sight of the target interaction party, the second interaction information including: tracking information of the interaction sight and a second operation priority; A third interaction information acquisition submodule is used to acquire third interaction information of the control voice of the target interaction party, where the third interaction information includes: semantic control information of the control voice and a third operation priority; A fourth interaction information acquisition submodule is used to acquire fourth interaction information of the operation gesture of the target interaction party, wherein the fourth interaction information includes: gesture control information of the operation gesture and a fourth operation priority; The target interaction information determination submodule is used to take the first interaction information, the second interaction information, the third interaction information and the fourth interaction information as target interaction information.

6. The immersive interactive intelligent central control screen based on VR technology as claimed in claim 4, characterized in that: The interactive action determination module includes: An interaction conflict determination submodule is used to determine whether there is an interaction conflict based on the target interaction information; The first interaction action determination submodule is used to directly determine the interaction action if it does not exist; A comparison information acquisition submodule, used to obtain comparison information of operation priority, if any; A first determination value acquisition submodule, used to acquire a first determination value of the conflicting action according to the comparison information of the operation priority; A first preceding interaction action acquisition submodule, used to acquire a first preceding interaction action before an interaction conflict occurs; A second determined value acquisition submodule, used for acquiring a second determined value of the conflicting action according to the first preceding interactive action and the conflicting action; The interactive action second determination submodule is used to calculate the first determination value and the second determination value of the conflicting action, obtain the determination sum value of the conflicting action, and take the conflicting action with the largest determination sum value as the interactive action.

7. An immersive interaction method based on VR technology, characterized in that: include: Step 1: Obtain the interaction space information selected by the target interaction party; Step 2: Based on VR technology and interactive space information, build an immersive interactive scene; Step 3: Obtain the target interaction party's interaction actions in the immersive interaction scene; Step 4: Determine the interactive feedback based on the interactive action. The interactive feedback includes: immediate feedback and a list of expected future feedback; Step 5: Conduct intelligent interaction based on interaction feedback; Step 4: Determine interactive feedback according to the interactive action, where the interactive feedback includes: immediate feedback and a list of expected future feedback, including: Determine immediate feedback based on interactive actions; Get the second preceding interaction action; Determine an interaction action sequence according to the interaction action and the second preceding interaction action; Count the number of actions in the interactive action sequence; If the number of actions is less than or equal to the preset action number threshold, the immediate feedback is used as interactive feedback; If the number of actions is greater than a preset action number threshold, a list of expected future feedback is determined based on the interaction action sequence; Combine immediate feedback with a list of expected future feedback as interactive feedback; If the number of actions is greater than a preset action number threshold, determining an expected future feedback list according to the interactive action sequence includes: Obtaining a history control list, the history control list including: a plurality of history interaction action sequences and corresponding first history feedbacks; Determine whether the interactive action sequence is included in the historical interactive action sequence; If the interaction action sequence is not included in any historical interaction action sequence, the expected future feedback list is empty; If the interactive action sequence is included in the historical interactive action sequence, determining the first historical feedback of the corresponding historical interactive action sequence and using it as the second historical feedback; Get the number of feedbacks of the second historical feedback; If the number of feedbacks is greater than or equal to a preset feedback number threshold, the usage frequency of the second historical feedback is obtained, and the second historical feedbacks with the feedback number threshold are filtered in descending order of usage frequency to obtain a list of expected future feedbacks; If the number of feedbacks is less than a preset feedback number threshold, an expected future feedback list is generated based on the second historical feedback.

8. The immersive interaction method based on VR technology according to claim 7, characterized in that: Step 2: Based on VR technology and interactive space information, build an immersive interactive scene, including: Dispatch the scene construction resource library and obtain scene construction resources based on the interactive space information; Based on VR technology, resources are built according to the scene to create immersive interactive scenes.

Images