Immersive interactive content creation method, device and storage medium
By deploying an intelligent editor on the terminal device, using robots to interact with users to collect information data sets and allow real-time adjustments, the problem of low user autonomy in immersive technology is solved, and virtual interactive content creation is achieved that is highly matched with user needs.
Patent Information
- Application Number
- CN202110362269.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-02
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-04-02
AI Technical Summary
When creating virtual interactive content, existing immersive technologies have low user autonomy, resulting in the content created by the system that does not match the user's expectations.
By deploying an intelligent editor on the terminal device, using robots to interact with users to collect information data sets, create interactive content corresponding to users, and display interactive scenes through preview, allowing users to enter operation instructions in interactive scenes and adjust content in real time. Interactive content that meets high matching user needs.
Improve users' autonomy and content matching in creating virtual interactive content, ensuring that the interactive content created by the smart editor is highly consistent with user needs.
Smart Images

Figure CN113012300B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of immersive technology, and in particular to a method, device and storage medium for creating immersive interactive content. Background Art
[0002] Immersive technology refers to technology that blurs the boundaries between the physical world and the simulated world, thereby creating a sense of immersion. Immersive technology can mix reality and virtuality, and can use computers to generate simulated environments. With the help of VR devices, users can enter virtual space and gain an immersive feeling. Immersive technology is one of the emerging technologies now. Compared with other technologies, its biggest feature is that it can give users the most intuitive feeling. It will have huge development space in industries such as audio and video entertainment, medical care and education. Most of the applications involved in current immersive technology are guided by the system to make prescribed actions by the user, collect user behavior information through a command-and-action method, and then directly create an interactive content based on the collected user behavior information. However, this method has high limitations and low user autonomy. For users, it is not possible to act autonomously and arbitrarily according to actual needs, resulting in the interactive content created by the system not matching the user's expectations.
[0003] Currently, no effective solution has been proposed to the technical problem that in the process of creating virtual interactive content, users have high limitations and low autonomy, which leads to the interactive content created by the system not matching the user's expectations. Summary of the invention
[0004] The embodiments of the present application provide a method, device and storage medium for creating immersive interactive content, so as to at least solve the technical problem in the prior art that in the process of creating virtual interactive content, users have high limitations and low autonomy, which leads to the mismatch between the interactive content created by the system and the user's expectations.
[0005] According to one aspect of an embodiment of the present application, a method for creating immersive interactive content is provided, which is applied to a terminal device, wherein an intelligent editor is deployed on the terminal device, comprising: collecting various information required in a preset information data set template through interaction with a user by a robot; creating an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user; creating first interactive content corresponding to the user based on the information data set, and displaying a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with a virtual character and / or an object in the first interactive scene; receiving an operation instruction related to the virtual character and / or the object input by the user in the first interactive scene, wherein the operation instruction is a voice instruction and / or a gesture instruction; and creating second interactive content corresponding to the user based on the first interactive content in response to the operation instruction.
[0006] According to another aspect of an embodiment of the present application, a storage medium is further provided, the storage medium including a stored program, wherein when the program is running, a processor executes any one of the above methods.
[0007] According to another aspect of an embodiment of the present application, there is also provided an apparatus for creating immersive interactive content, which is applied to a terminal device, wherein an intelligent editor is deployed on the terminal device, including: an information collection module, which is used to interact with a user through a robot to collect various information required in a preset information data set template; an information data set creation module, which is used to create an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user; a first interactive content creation module, which is used to create first interactive content corresponding to the user based on the information data set, and display a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with a virtual character and / or an object in the first interactive scene; an instruction receiving module, which is used to receive an operation instruction related to a virtual character and / or an object input by the user in the first interactive scene, wherein the operation instruction is a voice instruction and / or a gesture instruction; and a second interactive content creation module, which is used to create a second interactive content corresponding to the user based on the first interactive content in response to the operation instruction.
[0008] According to another aspect of an embodiment of the present application, there is also provided an apparatus for creating immersive interactive content, which is applied to a terminal device, wherein an intelligent editor is deployed on the terminal device, comprising: a processor; and a memory connected to the processor, for providing the processor with instructions for processing the following processing steps: collecting various information required in a preset information data set template through interaction between a robot and a user; creating an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user; creating first interactive content corresponding to the user based on the information data set, and displaying a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with a virtual character and / or an object in the first interactive scene; receiving operation instructions related to the virtual character and / or the object input by the user in the first interactive scene, wherein the operation instructions are voice instructions and / or gesture instructions; and creating second interactive content corresponding to the user based on the first interactive content in response to the operation instructions.
[0009] In an embodiment of the present application, the intelligent editor deployed on the terminal device collects various information required by the information data set template according to the interactive content between the robot and the user, creates an information data set, and then creates the first interactive content according to the information data set, and displays the first interactive scene in a preview mode. The user interacts with the virtual object in the first interactive scene to create the second interactive content. Therefore, in the process of creating the interactive scene, the intelligent editor can independently create according to the user's own ideas, and does not only rely on the set program to collect user behavior information in a command-and-action manner, but collects the information data set used to create immersive interactive content in real time through the interaction between the robot and the user, and then creates the first interactive content corresponding to the user for secondary editing and detail adjustment through the intelligent editor based on the collected information data set, and displays the first interactive scene corresponding to the first interactive content in a preview mode. Thus, the user can enter the corresponding operation instruction in the first interactive scene, and the intelligent editor creates the second interactive content based on the first interactive content according to the operation instruction. It can be seen that the user can continuously adjust the interactive content created by the intelligent editor without limitation and autonomously according to actual needs until an immersive interactive content with a high degree of matching with the user's needs is obtained.
[0010] Therefore, compared with the existing method of collecting user behavior information through a command-and-action method and then creating an interactive content, the method for creating immersive interactive content proposed in this embodiment no longer collects user behavior information through a command-and-action method, but the user informs the robot of information data related to the interactive content to be created according to his expectations, and after the intelligent editor creates an interactive content based on the information data collected by the robot, the user can also independently and continuously adjust the interactive content according to actual needs until an immersive interactive content with a high degree of match with the user's needs is obtained. Therefore, in the process of creating virtual interactive content in this application, the user has high autonomy and low limitations, so that the immersive interactive content created by the intelligent editor has a high degree of match with the user's needs. This solves the technical problem that in the process of creating virtual interactive content in the prior art, the user has high limitations and low autonomy, which leads to the mismatch between the interactive content created by the system and the user's expectations. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0012] Figure 1 is a hardware structure block diagram of a computing device for implementing the method according to Embodiment 1 of the present application;
[0013] Figure 2 is a flowchart of a method for creating immersive interactive content according to the first aspect of Embodiment 1 of the present application;
[0014] Figure 3 It is a schematic diagram of the necessary resource structure of the method for creating immersive interactive content according to the first aspect of Example 1 of the present application;
[0015] Figure 4 is a schematic diagram of the purposeful structure of the method for creating immersive interactive content according to the first aspect of Example 1 of the present application;
[0016] Figure 5 is a schematic diagram of a first interactive scene of the method for creating immersive interactive content according to the first aspect of Embodiment 1 of the present application;
[0017] Figure 6 is a schematic diagram of a second interactive scene of the method for creating immersive interactive content according to the first aspect of Example 1 of the present application;
[0018] Figure 7 is a flowchart of a method for creating immersive interactive content according to the first aspect of Embodiment 1 of the present application;
[0019] Figure 8 is a schematic diagram of an immersive interactive content creation device according to the first aspect of Embodiment 2 of the present application; and
[0020] Fig. 9 It is a schematic diagram of an immersive interactive content creation device according to the first aspect of Example 3 of the present application. DETAILED DESCRIPTION
[0021] In order to enable those skilled in the art to better understand the technical solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only embodiments of a part of the present application, not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present application.
[0022] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0023] Example 1
[0024] According to this embodiment, an embodiment of a method for creating immersive interactive content is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0025] The method embodiment provided in this embodiment can be executed in a mobile terminal, a computer terminal, a server or a similar computing device. Figure 1 FIG. 1 shows a hardware structure block diagram of a computing device for implementing a method for creating immersive interactive content. Figure 1As shown, the computing device may include one or more processors (the processor may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory for storing data, and a transmission device for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the I / O interface), a network interface, a power supply and / or a camera. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.
[0026] It should be noted that the one or more processors and / or other data processing circuits described above may generally be referred to herein as "data processing circuitry". The data processing circuitry may be embodied in whole or in part as software, hardware, firmware, or any other combination thereof. In addition, the data processing circuitry may be a single independent processing module, or may be incorporated in whole or in part into any of the other components in the computing device. As described in the embodiments of the present application, the data processing circuitry serves as a processor control (e.g., selection of a variable resistor terminal path connected to an interface).
[0027] The memory can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the method for creating immersive interactive content in the embodiment of the present application. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, the method for creating immersive interactive content of the above-mentioned application is realized. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the computing device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0028] The transmission device is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the computing device. In one example, the transmission device includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device can be a radio frequency (Radio Frequency, RF) module, which is used to communicate with the Internet wirelessly.
[0029] The display may be, for example, a touch screen liquid crystal display (LCD) that may enable a user to interact with a user interface of the computing device.
[0030] It should be noted that, in some optional embodiments, the above Figure 1 The computing device shown may include hardware elements (including circuits), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware elements and software elements. Figure 1 This is merely one example of a particular embodiment and is intended to illustrate the types of components that may be present in the computing devices described above.
[0031] In the above operating environment, according to the first aspect of this embodiment, a method for creating immersive interactive content is provided, which is applied to a terminal device, such as but not limited to immersive terminals such as holographic projection and virtual reality headsets, and traditional terminals such as mobile phones and computers, wherein an intelligent editor is deployed on the terminal device. Figure 2 A schematic diagram showing the process of the method is shown in FIG. Figure 2 As shown, the method includes:
[0032] S202: Collecting various information required in a preset information data set template through interaction between the robot and the user;
[0033] S204: Creating an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user;
[0034] S206: creating first interactive content corresponding to the user based on the information data set, and displaying a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with the virtual character and / or the object in the first interactive scene;
[0035] S208: receiving an operation instruction related to a virtual character and / or an object input by a user in a first interactive scene, wherein the operation instruction is a voice instruction and / or a gesture instruction; and
[0036] S210: In response to the operation instruction, creating second interactive content corresponding to the user based on the first interactive content.
[0037] Specifically, the intelligent editor first virtualizes the robot into a 3D virtual avatar from the user's main perspective, and also pre-sets an information data set template to provide multiple pieces of information that need to be collected. Figure 3 as well as Figure 4 As shown, the information data set template needs to collect multiple pieces of information including interactive scene resources, virtual characters, 3D objects, other art resources, voice learning objectives, and knowledge and skill learning objectives. The robot asks questions to the user based on the information that needs to be collected on the information data set template, and the user answers according to the robot's questions. The robot then designs questions based on the information data set template and the user's answers, and asks the user again, and so on. The intelligent editor collects and organizes multiple or multiple voice messages of the user to fill in the preset information data set template (S202).
[0038] Then the intelligent editor enters the information collected by the robot and the user through the gradual dialogue into the information data set template for filling. After the filling is completed, the intelligent editor will create an information data set corresponding to the user based on the collected information, so that the intelligent editor can create interactive content corresponding to the user based on the information data set (S204). In a specific application scenario, the user wants to design an indoor living room scene, which includes multiple virtual objects (for example, chairs, sofas, potted plants, tables, and TVs, etc.), and the user can interact with the virtual objects to learn English corresponding to each virtual object. At this time, the intelligent editor collects various information through the interaction between the robot and the user, such as but not limited to the scene resources of the indoor living room scene, the object information of each virtual object (such as object status, object size and art style, etc.), other art resources, and relevant information about English language acquisition (such as acquisition status and acquisition type, etc.). Thus, the intelligent editor can create an information data set corresponding to the user based on the collected information, and the information data set includes the collected information and the association between the information, thereby laying the foundation for the subsequent creation of interactive content corresponding to user needs one by one.
[0039] Furthermore, the intelligent editor creates first interactive content corresponding to the user based on the successfully created information data set, and displays a first interactive scene corresponding to the first interactive content in a preview manner. The user can interact with the virtual character or virtual object in the first interactive scene (S206). Exemplarily, the first interactive content corresponding to the user includes setting the indoor space size of the indoor living room to 5m long x 3m wide x 3m high, the fixed objects are a sofa (Sofa), a coffee table (Table) and a TV (TV), and the interactive objects are a chair (Chair) and a potted plant (Flower). The first interactive scene corresponding to the first interactive content is as follows: Figure 5 As shown, in the first interactive scene, the virtual objects such as sofa, coffee table, TV, chair and potted plant are displayed in an initial state in the user's main perspective, and the initial state of each virtual object is determined by the association relationship between the various object information corresponding to each virtual object contained in the information data set. Thus, in the displayed first interactive scene, the user can interact with each virtual object, perform secondary editing and detail adjustments to the first interactive scene, such as adjusting the size of the indoor space, adjusting the position, size and association relationship of each virtual object, etc. In addition, the user can also add new virtual objects or virtual characters to the first interactive scene, and can also delete a virtual object in the first interactive scene, which is not specifically limited here.
[0040] Furthermore, during the process of the user performing secondary editing and detail adjustment on the first interactive scene, the terminal device receives the operation instructions related to the virtual character and / or the object input by the user in the first interactive scene. The operation instructions are voice instructions and / or gesture instructions (S208). For example: the voice instruction input by the user in the first interactive scene is to adjust the indoor space size of the indoor living room to 7m long x 3.5m wide x 3.5m high, and the gesture instructions input by the user in the first interactive scene are to move the five virtual objects of sofa (Sofa), coffee table (Table), TV (TV), chair (Chair) and potted plant (Flower) to the specified position and adjust the association relationship between them.
[0041] At this time, after receiving the above-mentioned voice command and gesture command, the terminal device adjusts the indoor space size information of the indoor living room, the position information and association relationship of each virtual character based on the first interactive content through the intelligent editor according to the command, thereby creating the second interactive content corresponding to the user (S210). Among them, the second interactive content corresponding to the user includes, for example, setting the indoor space size of the indoor living room to 7m long x 3.5m wide x 3.5m high, the fixed state objects are sofa (Sofa), coffee table (Table) and TV (TV), the interactive state objects are chair (Chair) and potted plant (Flower), and the position information of these five objects. Among them, the position information of these five objects is, for example, that a chair (Chair), a sofa (Sofa) and a potted plant (Flower) are located side by side in the upper half of the indoor living room, the coffee table (Table) is located in the middle part of the indoor living room, the TV (TV) is located in the lower half of the indoor living room, and the sofa (Sofa), the coffee table (Table) and the TV (TV) are located side by side in the middle of the indoor living room, the chair (Chair) is located on the left side of the sofa (Sofa), and the potted plant (Flower) is located on the right side of the sofa (Sofa).
[0042] As described in the background technology, most of the current immersive technology applications involve the system guiding users to perform prescribed actions, collecting user behavior information through a command-to-action method, and then directly creating an interactive content based on the collected user behavior information. However, this method has high limitations and low user autonomy. Users cannot act autonomously and arbitrarily according to actual needs, resulting in the interactive content created by the system not matching the user's expectations.
[0043] In view of the technical problems described above, through the technical solution of this embodiment, the intelligent editor deployed on the terminal device collects various information required by the information data set template according to the interactive content between the robot and the user, creates an information data set, and then creates the first interactive content according to the information data set, and displays the first interactive scene in a preview mode. The user interacts with the virtual object in the first interactive scene to create the second interactive content. Therefore, in the process of creating the interactive scene, the intelligent editor can independently create according to the user's own ideas, and does not only rely on the set program to collect user behavior information in a command-and-action manner, but collects the information data set used to create immersive interactive content in real time through the interaction between the robot and the user, and then creates the first interactive content corresponding to the user for secondary editing and detail adjustment through the intelligent editor based on the collected information data set, and displays the first interactive scene corresponding to the first interactive content in a preview mode. Thus, the user can enter the corresponding operation instruction in the first interactive scene, and the intelligent editor creates the second interactive content based on the first interactive content according to the operation instruction. It can be seen that the user can continuously adjust the interactive content created by the intelligent editor without limitation and autonomously according to actual needs until an immersive interactive content with a high degree of matching with the user's needs is obtained.
[0044] Therefore, compared with the existing method of collecting user behavior information through a command-and-action method and then creating an interactive content, the method for creating immersive interactive content proposed in this embodiment no longer collects user behavior information through a command-and-action method, but the user informs the robot of information data related to the interactive content to be created according to his expectations, and after the intelligent editor creates an interactive content based on the information data collected by the robot, the user can also independently and continuously adjust the interactive content according to actual needs until an immersive interactive content with a high degree of match with the user's needs is obtained. Therefore, in the process of creating virtual interactive content in this application, the user has high autonomy and low limitations, so that the immersive interactive content created by the intelligent editor has a high degree of match with the user's needs. This solves the technical problem that in the process of creating virtual interactive content in the prior art, the user has high limitations and low autonomy, which leads to the mismatch between the interactive content created by the system and the user's expectations.
[0045] In addition, during the process of filling in the information dataset template, when the intelligent editor determines that the collected user's voice information cannot completely fill in the information dataset template, the robot will ask the user again based on the missing information items in the information dataset template until the information dataset template is filled to a usable state.
[0046] Optionally, the information data set includes necessary resources for creating the first interactive content and purpose information corresponding to the first interactive content. And based on the information data set, the operation of creating the first interactive content corresponding to the user includes: listing all virtual characters and all objects required for interacting with the user according to pre-set rules and constraints and the necessary resources for creating the first interactive content in the information data set; connecting the interactive path for interacting with the user in a linear timeline according to the purpose information corresponding to the first interactive content in the information data set, wherein each interactive node in the interactive path includes interactive content of the user interacting with the virtual character and / or object; and encapsulating each interactive node into an independent module and constructing the first interactive content, wherein the user edits the corresponding interactive content based on the independent module.
[0047] Specifically, the information data set created by the smart editor includes two parts: Figure 3 as well as Figure 4 As shown, the first part is the necessary resources for constructing the first interactive content. In the interactive scene, the necessary resources include but are not limited to interactive scene resources, virtual characters, 3D objects and other art resources. The second part is the purpose information corresponding to the first interactive content. For example, in the interactive scene for learning, the purpose information includes but is not limited to the purpose of language learning and the purpose of knowledge and skills acquisition, which mainly records whether the user has mastered the knowledge after learning, including language ability, learning habits, knowledge ability, topics of interest and learning skills.
[0048] Furthermore, the smart editor also pre-sets rules and constraints. For example, Figure 5As shown, after the necessary resources related to the first interactive content in the information data set are created, the necessary resources such as sofa, tea table, TV, chair and potted plant are listed in the first interactive scene. According to the pre-set rules and constraints, the positions of these necessary resources are in the initial state. For example, the sofa is leaning against the corner, the potted plant is placed on the tea table, and the chair and TV are randomly placed in the lower left corner of the indoor living room, but these objects are not piled up or overlapped, which conforms to the real logic. In addition, after the user interacts with the necessary resources such as sofa, tea table, TV, chair and potted plant in the first interactive scene, the intelligent editor will create the purpose information in the information data set according to these interactive contents, and then form an interactive path with these interactive nodes, such as the user interacts with the chair first and then with the sofa, mainly in series through the linear timeline. Finally, each interactive node is encapsulated into an independent module, and the first interactive content is constructed. Afterwards, the user can re-edit the corresponding interactive content by reconstructing, adding or deleting the encapsulated independent module.
[0049] Thus, the intelligent editor arranges the listed virtual characters and objects according to the pre-set rules and constraints, making the interactive scene more standardized and more in line with the real logic. In addition, the intelligent editor connects the interactive paths with the user in a linear timeline according to the purpose information, and encapsulates each interactive node into an independent module, so that the user can re-edit the corresponding interactive content by reconstructing, adding or deleting the encapsulated independent modules. In addition, the necessary resources and purpose information in the information data created by the intelligent editor make the scene more substantial, increase the authenticity, and give the user a sense of being in the scene.
[0050] Optionally, in response to an operation instruction, an operation of creating a second interactive content corresponding to the user based on the first interactive content includes: in response to the operation instruction, based on the first interactive content, adjusting the interactive content in the first interactive scene for the user to interact with the virtual character and / or object; in response to the operation instruction, adjusting the interactive path for interacting with the user; and creating the second interactive content based on the adjusted interactive content and the adjusted interactive path.
[0051] Specifically, after the first interactive scene is displayed in a preview mode in the user's main perspective, the user interacts with the virtual character or object displayed in the first interactive scene to adjust the first interactive content, and the intelligent editor adjusts the interactive content in the first interactive scene and the interactive path with the user according to the operation instruction input by the user, and finally creates the second interactive content according to the adjusted interactive content and the adjusted interactive path. Figure 5 as well as Figure 6 As shown, in the first interactive scene, the indoor space size of the indoor living room is set to 5m long x 3m wide x 3m high, and the user can interact with the sofa (Sofa), coffee table (Table), TV (TV), chair (Chair) and potted plants (Flower) in turn, and these virtual objects are displayed in the user's main perspective in an initial state without clear position information. When the user wants to adjust the space size of the indoor living room and the position information of the five objects of sofa (Sofa), coffee table (Table), TV (TV), chair (Chair) and potted plants (Flower) in the first interactive scene, the user enters the corresponding operation instruction. Among them, the operation instruction entered by the user includes adjusting the space size information of the indoor living room and adjusting the position information of these five objects. For example, the space size information of the indoor living room is adjusted to 7m long x 3.5m wide x 3.5m high, and the position information of the five objects is adjusted to the chair (Chair), sofa (Sofa) and potted plant (Flower) being located side by side in the upper half of the indoor living room, the coffee table (Table) being located in the middle part of the indoor living room, the TV (TV) being located in the lower half of the indoor living room, and the sofa (Sofa), coffee table (Table) and TV (TV) being located side by side in the middle of the indoor living room, the chair (Chair) being located on the left side of the sofa (Sofa), and the potted plant (Flower) being located on the right side of the sofa (Sofa).
[0052] Thus, based on the first interactive content, the intelligent editor adjusts the interactive content and the interactive path with the user in the first interactive scene according to the operation instructions input by the user, so as to create the second interactive content, for example, including: the indoor space size of the indoor living room is 7m long x 3.5m wide x 3.5m high, the fixed objects are the sofa (Sofa), the coffee table (Table) and the TV (TV), the interactive objects are the chair (Chair) and the potted plant (Flower), and the position information of these five objects is that the chair (Chair), the sofa (Sofa) and the potted plant (Flower) are located side by side in the upper half of the indoor living room, the coffee table (Table) is located in the middle part of the indoor living room, the TV (TV) is located in the lower half of the indoor living room, and the sofa (Sofa), the coffee table (Table) and the TV (TV) are located side by side in the middle of the indoor living room, the chair (Chair) is located on the left side of the sofa (Sofa), and the potted plant (Flower) is located on the right side of the sofa (Sofa).
[0053] In addition, based on the second interactive content, the user can also continuously adjust the scene layout, and the intelligent editor will further adjust the interactive content and interactive path according to the instructions input by the user, thereby creating new interactive scenes (such as the third interactive scene and the fourth interactive scene, etc.), until immersive interactive content that highly matches the user's needs is obtained. In this way, it is guaranteed that the user can continuously and autonomously adjust the interactive content created by the intelligent editor according to actual needs without limitation, until immersive interactive content that highly matches the user's needs is obtained.
[0054] Optionally, the operation of collecting various information required in a preset information data set template through interaction between the robot and the user includes: collecting user voice information related to various information required in the preset information data set template through interaction between the robot and the user; and performing semantic understanding on the collected user voice information, and collecting various information required in the preset information data set template based on the results of the semantic understanding.
[0055] Specifically, the robot interacts with the user, and after the intelligent editor collects the user's voice information, it matches it with the various requirements in the preset information data set template, and matches multiple sentences or multiple paragraphs of voice information corresponding to the various information in the information data set template. After that, the intelligent editor semantically understands these voice information through a series of algorithms, parses the voice information into machine-readable valid information, and collects all the information required in the preset information data set template according to the results of semantic understanding. Thus, through the interaction between the robot and the user, the voice information related to the various information required in the information data set template is collected, and the voice information is semantically understood. The intelligent editor can better identify the meaning of the user's voice information and find effective information in complex and non-standard language. In this way, it is possible to collect user behavior information without the need for a command and action. When the user expresses the needs at will, the intelligent editor can still find effective information in the complex and non-standard language, thereby collecting the information data required to create an interactive content corresponding to the user, thereby improving the user's experience.
[0056] Optionally, semantic understanding is performed on the collected user voice information, and various information required in a preset information data set template is collected based on the results of the semantic understanding, including: checking whether the collected user voice information meets the standards; sending the user voice information that meets the standards to a cloud computing center, which converts the user voice information into text information; receiving text information from the cloud computing center; and extracting key information from the text information, and entering the extracted key information into a preset information data set template.
[0057] Specifically, refer to Figure 7 As shown, after the intelligent editor collects the user's voice information, it checks the voice information to determine whether it meets the standards. If the standards are met, the intelligent editor sends the user's voice information to the cloud computing center, and the cloud computing center converts the received voice information into text information, and then sends the text information to the intelligent editor. After receiving the text information, the intelligent editor extracts the key information in the text information and enters the extracted key information into a preset information data set template. Thus, by converting the voice information into text information through the cloud computing center, the efficiency of the intelligent editor in parsing the voice information is improved, and the use cost of the intelligent editor as well as the memory burden and consumption are reduced. In addition, the purpose of efficiently and accurately collecting the information data required to create interactive content corresponding to the user is achieved.
[0058] Optionally, the method further includes: displaying a second interactive scene corresponding to the second interactive content in a preview manner. Figure 6As shown, the terminal device displays the second interactive scene corresponding to the second interactive content in a preview mode, so that the user can browse the second interactive scene, and the user can intuitively judge whether the second interactive content obtained after the second editing fully meets the user's expectations. If it does not fully meet the user's expectations, the user can also enter the corresponding operation instructions in the second interactive scene, so as to adjust the interactive content again according to specific needs, until the immersive interactive content that matches the user's needs is highly or completely matched is obtained. In this way, the user's autonomy in the process of creating immersive interactive content is further improved, and the user's limitations are further reduced, effectively improving the user's experience.
[0059] Optionally, the method also includes: determining, based on the scene layout in the second interactive scene corresponding to the second interactive content, spatial position coordinate information corresponding to each virtual character and / or each object in the second interactive scene through three-dimensional plane image recognition; and updating pre-set rules and constraints based on the determined spatial position coordinate information.
[0060] Specifically, refer to Figure 5 and Figure 6As shown, after the operation instruction input by the user in the first interactive scene, the intelligent editor creates a second interactive content based on the first interactive content, and displays the second interactive scene corresponding to the second interactive content to the user in a preview manner. In this application scenario, the intelligent editor determines the spatial position coordinate information corresponding to each virtual character and / or each object in the second interactive scene according to the scene layout of the second interactive scene through image recognition of the three-dimensional plane, thereby recording the relative rules (Rule) and constraints (Constraint) between all elements, such as the sofa (Sofa), coffee table (Table), TV (TV), chair (Chair) and potted plants (Flower). These five items are all above the ground and are at the same height from the ground. After that, the intelligent editor will re-learn the relative rules and constraints of each virtual character and object in the second scene, so as to continuously optimize and update the rules and constraints of the intelligent editor. For example: before re-learning, the preset rules and constraints are only that the sofa (Sofa), coffee table (Table) and chair (Chair) cannot be stacked or overlapped. Based on the scene layout of the second interactive scene, after relearning the rules and constraints, the rules and constraints known to the intelligent editor become: sofas (Sofa), coffee tables (Table) and chairs (Chair) cannot be stacked or overlapped, and the five items of sofas (Sofa), coffee tables (Table), TVs (TV), chairs (Chair) and potted plants (Flower) are all above the ground and at the same height from the ground. Therefore, when the user uses these items again in the future, the intelligent editor will no longer just display the sofas (Sofa), coffee tables (Table) and chairs (Chair) separately according to the preset rules and constraints, but also place these five items on the ground, and at the same height from the ground. In this way, when the intelligent editor creates immersive interactive content for users in the future, the virtual interactive scene presented to users through preview is more intelligent and detailed, more in line with the real scene, and greatly improves the user experience.
[0061] Thus, according to the first aspect of this embodiment, the intelligent editor deployed on the terminal device collects various information required by the information data set template according to the interactive content between the robot and the user, creates an information data set, and then creates the first interactive content according to the information data set, and displays the first interactive scene in a preview mode. The user interacts with the virtual object in the first interactive scene to create the second interactive content. Thus, in the process of creating the interactive scene, the intelligent editor can independently create according to the user's own ideas, and does not only rely on the set program to collect user behavior information in a command-and-action manner, but collects the information data set used to create immersive interactive content in real time through the interaction between the robot and the user, and then creates the first interactive content corresponding to the user for secondary editing and detail adjustment through the intelligent editor based on the collected information data set, and displays the first interactive scene corresponding to the first interactive content in a preview mode. Thus, the user can enter the corresponding operation instruction in the first interactive scene, and the intelligent editor creates the second interactive content based on the first interactive content according to the operation instruction. It can be seen that the user can continuously adjust the interactive content created by the intelligent editor without limitation and autonomously according to actual needs until an immersive interactive content with a high degree of matching with the user's needs is obtained.
[0062] Therefore, compared with the existing method of collecting user behavior information through a command-and-action method and then creating an interactive content, the method for creating immersive interactive content proposed in this embodiment no longer collects user behavior information through a command-and-action method, but the user informs the robot of information data related to the interactive content to be created according to his expectations, and after the intelligent editor creates an interactive content based on the information data collected by the robot, the user can also independently and continuously adjust the interactive content according to actual needs until an immersive interactive content with a high degree of match with the user's needs is obtained. Therefore, in the process of creating virtual interactive content in this application, the user has high autonomy and low limitations, so that the immersive interactive content created by the intelligent editor has a high degree of match with the user's needs. This solves the technical problem that in the process of creating virtual interactive content in the prior art, the user has high limitations and low autonomy, which leads to the mismatch between the interactive content created by the system and the user's expectations.
[0063] In addition, reference Figure 1 As shown, according to the second aspect of this embodiment, a storage medium is provided, wherein the storage medium includes a stored program, wherein when the program is run, a processor executes any one of the above methods.
[0064] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.
[0065] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0066] Example 2
[0067] Figure 8 The immersive interactive content creation device 800 according to the first aspect of this embodiment is shown, and the device 800 corresponds to the method according to the first aspect of embodiment 1. Figure 8 As shown, the device 800 includes: an information collection module 810, which is used to interact with the user through the robot to collect various information required in the preset information data set template; an information data set creation module 820, which is used to create an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user; a first interactive content creation module 830, which is used to create a first interactive content corresponding to the user based on the information data set, and display a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with the virtual character and / or object in the first interactive scene; an instruction receiving module 840, which is used to receive an operation instruction related to the virtual character and / or object input by the user in the first interactive scene, wherein the operation instruction is a voice instruction and / or a gesture instruction; and a second interactive content creation module 850, which is used to create a second interactive content corresponding to the user based on the first interactive content in response to the operation instruction.
[0068] Optionally, the information data set includes necessary resources for creating the first interactive content and purpose information corresponding to the first interactive content. And the first interactive content creation module 830 includes: a listing submodule, which is used to list all virtual characters and all objects required for interacting with the user according to the pre-set rules and constraints and the necessary resources for creating the first interactive content in the information data set; a series connection submodule, which is used to connect the interactive path of interaction with the user in a linear timeline according to the purpose information corresponding to the first interactive content in the information data set, wherein each interactive node in the interactive path includes the interactive content of the user interacting with the virtual character and / or object; and a construction submodule, which is used to encapsulate each interactive node into an independent module and construct the first interactive content, wherein the user edits the corresponding interactive content based on the independent module.
[0069] Optionally, the second interactive content creation module 850 includes: an adjustment submodule for adjusting, in response to an operation instruction, the interactive content in the first interactive scene for the user to interact with the virtual character and / or object based on the first interactive content; an adjustment submodule for adjusting, in response to an operation instruction, the interactive path for interacting with the user; and a creation submodule for creating the second interactive content based on the adjusted interactive content and the adjusted interactive path.
[0070] Optionally, the information collection module 810 includes: a collection sub-module, which is used to interact with the user through a robot to collect user voice information related to various information required in a preset information data set template; and a collection sub-module, which is used to perform semantic understanding on the collected user voice information, and collect various information required in the preset information data set template based on the results of the semantic understanding.
[0071] Optionally, the collection submodule includes: a verification unit, used to verify whether the collected user voice information meets the standards; a sending unit, used to send the user voice information that meets the standards to the cloud computing center, and the cloud computing center converts the user voice information into text information; a receiving unit, used to receive text information from the cloud computing center; and an extraction unit, used to extract key information from the text information and enter the extracted key information into a preset information data set template.
[0072] Optionally, the device 800 further includes: displaying a second interactive scene corresponding to the second interactive content in a preview manner.
[0073] Optionally, the first interactive content creation module 830 also includes: a determination sub-module, used to determine the spatial position coordinate information corresponding to each virtual character and / or each object in the second interactive scene according to the scene layout in the second interactive scene corresponding to the second interactive content through three-dimensional plane image recognition; and an update sub-module, used to update pre-set rules and constraints according to the determined spatial position coordinate information.
[0074] Thus, according to this embodiment, the intelligent editor deployed on the terminal device collects various information required by the information data set template according to the interactive content between the robot and the user, creates an information data set, and then creates the first interactive content according to the information data set, and displays the first interactive scene in a preview mode. The user interacts with the virtual object in the first interactive scene to create the second interactive content. Thus, in the process of creating the interactive scene, the intelligent editor can independently create according to the user's own ideas, and does not only rely on the set program to collect user behavior information in a command-and-action manner, but collects the information data set used to create immersive interactive content in real time through the interaction between the robot and the user, and then creates the first interactive content corresponding to the user for secondary editing and detail adjustment through the intelligent editor based on the collected information data set, and displays the first interactive scene corresponding to the first interactive content in a preview mode. Thus, the user can enter the corresponding operation instruction in the first interactive scene, and the intelligent editor creates the second interactive content based on the first interactive content according to the operation instruction. It can be seen that the user can continuously adjust the interactive content created by the intelligent editor without limitation and autonomously according to actual needs until an immersive interactive content with a high degree of matching with the user's needs is obtained.
[0075] Therefore, compared with the existing method of collecting user behavior information through a command-and-action method and then creating an interactive content, the method for creating immersive interactive content proposed in this embodiment no longer collects user behavior information through a command-and-action method, but the user informs the robot of information data related to the interactive content to be created according to his expectations, and after the intelligent editor creates an interactive content based on the information data collected by the robot, the user can also independently and continuously adjust the interactive content according to actual needs until an immersive interactive content with a high degree of match with the user's needs is obtained. Therefore, in the process of creating virtual interactive content in this application, the user has high autonomy and low limitations, so that the immersive interactive content created by the intelligent editor has a high degree of match with the user's needs. This solves the technical problem that in the process of creating virtual interactive content in the prior art, the user has high limitations and low autonomy, which leads to the mismatch between the interactive content created by the system and the user's expectations.
[0076] Example 3
[0077] Fig. 9 The immersive interactive content creation device 900 according to the first aspect of this embodiment is shown, and the device 900 corresponds to the method according to the first aspect of embodiment 1. Fig. 9 As shown, the device 900 includes: a processor 910; and a memory 920, which is connected to the processor 910 and is used to provide instructions for the processor 910 to process the following processing steps: collect various information required in a preset information data set template through robot interaction with the user; create an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user; based on the information data set, create first interactive content corresponding to the user, and display a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with a virtual character and / or an object in the first interactive scene; receive an operation instruction related to the virtual character and / or the object input by the user in the first interactive scene, wherein the operation instruction is a voice instruction and / or a gesture instruction; and in response to the operation instruction, create a second interactive content corresponding to the user based on the first interactive content.
[0078] Optionally, the information data set includes necessary resources for creating a first interactive content and purpose information corresponding to the first interactive content, and based on the information data set, the operation of creating the first interactive content corresponding to the user includes: listing all virtual characters and all objects required for interacting with the user according to pre-set rules and constraints and the necessary resources for creating the first interactive content in the information data set; connecting the interactive path for interacting with the user in a linear timeline according to the purpose information corresponding to the first interactive content in the information data set, wherein each interactive node in the interactive path includes interactive content in which the user interacts with the virtual character and / or object; and encapsulating each interactive node into an independent module and constructing the first interactive content, wherein the user edits the corresponding interactive content based on the independent module.
[0079] Optionally, in response to an operation instruction, an operation of creating a second interactive content corresponding to the user based on the first interactive content includes: in response to the operation instruction, based on the first interactive content, adjusting the interactive content in the first interactive scene for the user to interact with the virtual character and / or object; in response to the operation instruction, adjusting the interactive path for interacting with the user; and creating the second interactive content based on the adjusted interactive content and the adjusted interactive path.
[0080] Optionally, the operation of collecting various information required in a preset information data set template through interaction between the robot and the user includes: collecting user voice information related to various information required in the preset information data set template through interaction between the robot and the user; and performing semantic understanding on the collected user voice information, and collecting various information required in the preset information data set template based on the results of the semantic understanding.
[0081] Optionally, semantic understanding is performed on the collected user voice information, and various information required in a preset information data set template is collected based on the results of the semantic understanding, including: checking whether the collected user voice information meets the standards; sending the user voice information that meets the standards to a cloud computing center, which converts the user voice information into text information; receiving text information from the cloud computing center; and extracting key information from the text information, and entering the extracted key information into a preset information data set template.
[0082] Optionally, the memory 920 is further configured to provide the processor 910 with instructions for processing the following processing steps: displaying a second interactive scene corresponding to the second interactive content in a preview manner.
[0083] Optionally, the memory 920 is also used to provide instructions for the processor 910 to process the following processing steps: determining, based on the scene layout in the second interactive scene corresponding to the second interactive content, spatial position coordinate information corresponding to each virtual character and / or each object in the second interactive scene through three-dimensional plane image recognition; and updating pre-set rules and constraints based on the determined spatial position coordinate information.
[0084] Thus, according to this embodiment, the intelligent editor deployed on the terminal device collects various information required by the information data set template according to the interactive content between the robot and the user, creates an information data set, and then creates the first interactive content according to the information data set, and displays the first interactive scene in a preview mode. The user interacts with the virtual object in the first interactive scene to create the second interactive content. Thus, in the process of creating the interactive scene, the intelligent editor can independently create according to the user's own ideas, and does not only rely on the set program to collect user behavior information in a command-and-action manner, but collects the information data set used to create immersive interactive content in real time through the interaction between the robot and the user, and then creates the first interactive content corresponding to the user for secondary editing and detail adjustment through the intelligent editor based on the collected information data set, and displays the first interactive scene corresponding to the first interactive content in a preview mode. Thus, the user can enter the corresponding operation instruction in the first interactive scene, and the intelligent editor creates the second interactive content based on the first interactive content according to the operation instruction. It can be seen that the user can continuously adjust the interactive content created by the intelligent editor without limitation and autonomously according to actual needs until an immersive interactive content with a high degree of matching with the user's needs is obtained.
[0085] Therefore, compared with the existing method of collecting user behavior information through a command-and-action method and then creating an interactive content, the method for creating immersive interactive content proposed in this embodiment no longer collects user behavior information through a command-and-action method, but the user informs the robot of information data related to the interactive content to be created according to his expectations, and after the intelligent editor creates an interactive content based on the information data collected by the robot, the user can also independently and continuously adjust the interactive content according to actual needs until an immersive interactive content with a high degree of match with the user's needs is obtained. Therefore, in the process of creating virtual interactive content in this application, the user has high autonomy and low limitations, so that the immersive interactive content created by the intelligent editor has a high degree of match with the user's needs. This solves the technical problem that in the process of creating virtual interactive content in the prior art, the user has high limitations and low autonomy, which leads to the mismatch between the interactive content created by the system and the user's expectations.
[0086] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0087] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0088] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.
[0089] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0090] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0091] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
[0092] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A method for creating immersive interactive content, applied to a terminal device, wherein an intelligent editor is deployed on the terminal device, characterized in that: include: Through the interaction between the robot and the user, the required information in the preset information data set template is collected; Creating an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user; Based on the information data set, create first interactive content corresponding to the user, and display a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with a virtual character and / or an object in the first interactive scene; receiving an operation instruction related to the virtual character and / or the object input by the user in the first interactive scenario, wherein the operation instruction is a voice instruction and / or a gesture instruction; as well as In response to the operation instruction, creating second interactive content corresponding to the user based on the first interactive content; The information data set includes necessary resources for creating the first interactive content and purpose information corresponding to the first interactive content, and based on the information data set, the operation of creating the first interactive content corresponding to the user includes: Listing all virtual characters and all objects required for interacting with the user according to pre-set rules and constraints and the necessary resources for creating the first interactive content in the information data set; According to the purpose information corresponding to the first interactive content in the information data set, the interactive path of interaction with the user is connected in series in a linear timeline manner, wherein each interactive node in the interactive path includes interactive content of the user interacting with the virtual character and / or object; and Encapsulating each of the interactive nodes into an independent module and constructing the first interactive content, wherein the user edits the corresponding interactive content based on the independent module; In response to the operation instruction, the operation of creating a second interactive content corresponding to the user based on the first interactive content includes: In response to the operation instruction, based on the first interactive content, adjusting the interactive content in the first interactive scene for the user to interact with the virtual character and / or the object; In response to the operation instruction, adjusting an interaction path for interacting with the user; and Creating the second interactive content according to the adjusted interactive content and the adjusted interactive path; The robot interacts with the user to collect the information required in the preset information data set template, including: By interacting with the user through the robot, user voice information related to each item of information required in the preset information data set template is collected; and The collected user voice information is semantically understood, and various information required in the preset information data set template is collected according to the result of the semantic understanding.
2. The method according to claim 1, characterized in that: The operation of semantically understanding the collected user voice information and collecting various information required in the preset information data set template according to the result of the semantic understanding includes: Check whether the collected user voice information meets the standards; Sending user voice information that meets the standards to a cloud computing center, which converts the user voice information into text information; receiving the text information from the cloud computing center; and Extract key information from the text information, and enter the extracted key information into the preset information data set template.
3. The method according to claim 1, characterized in that Also includes: The second interactive scene corresponding to the second interactive content is displayed in a preview manner.
4. The method according to claim 1, characterized in that: Also includes: According to the scene layout in the second interactive scene corresponding to the second interactive content, determining the spatial position coordinate information corresponding to each virtual character and / or each object in the second interactive scene through three-dimensional plane image recognition; as well as The preset rules and constraints are updated according to the determined spatial position coordinate information.
5. A storage medium, characterized in that: The storage medium includes a stored program, wherein when the program is run, the processor executes the method according to any one of claims 1 to 4.
6. An immersive interactive content creation device, applied to a terminal device, wherein an intelligent editor is deployed on the terminal device, characterized in that: include: The information collection module is used to interact with the user through the robot to collect various information required in the preset information data set template; An information data set creation module, used to create an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user; A first interactive content creation module, configured to create first interactive content corresponding to the user based on the information data set, and display a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with a virtual character and / or an object in the first interactive scene; An instruction receiving module, used for receiving an operation instruction related to the virtual character and / or the object input by the user in the first interactive scene, wherein the operation instruction is a voice instruction and / or a gesture instruction; as well as A second interactive content creation module, configured to create, in response to the operation instruction, second interactive content corresponding to the user based on the first interactive content; The information data set includes necessary resources for creating the first interactive content and purpose information corresponding to the first interactive content, and based on the information data set, the operation of creating the first interactive content corresponding to the user includes: Listing all virtual characters and all objects required for interacting with the user according to pre-set rules and constraints and the necessary resources for creating the first interactive content in the information data set; According to the purpose information corresponding to the first interactive content in the information data set, the interactive path of interaction with the user is connected in series in a linear timeline manner, wherein each interactive node in the interactive path includes interactive content of the user interacting with the virtual character and / or object; and Encapsulating each of the interactive nodes into an independent module and constructing the first interactive content, wherein the user edits the corresponding interactive content based on the independent module; In response to the operation instruction, the operation of creating a second interactive content corresponding to the user based on the first interactive content includes: In response to the operation instruction, based on the first interactive content, adjusting the interactive content in the first interactive scene for the user to interact with the virtual character and / or the object; In response to the operation instruction, adjusting an interaction path for interacting with the user; and Creating the second interactive content according to the adjusted interactive content and the adjusted interactive path; The robot interacts with the user to collect the information required in the preset information data set template, including: By interacting with the user through the robot, user voice information related to each item of information required in the preset information data set template is collected; and The collected user voice information is semantically understood, and various information required in the preset information data set template is collected according to the result of the semantic understanding.
7. An immersive interactive content creation device, applied to a terminal device, wherein an intelligent editor is deployed on the terminal device, comprising: processor; as well as A memory, connected to the processor, configured to provide the processor with instructions for processing the following processing steps: Through the interaction between the robot and the user, the required information in the preset information data set template is collected; Creating an information data set corresponding to the user based on the collected information, wherein the information data set is used to create interactive content corresponding to the user; Based on the information data set, create first interactive content corresponding to the user, and display a first interactive scene corresponding to the first interactive content in a preview manner, wherein the user interacts with a virtual character and / or an object in the first interactive scene; receiving an operation instruction related to the virtual character and / or the object input by the user in the first interactive scenario, wherein the operation instruction is a voice instruction and / or a gesture instruction; as well as In response to the operation instruction, creating second interactive content corresponding to the user based on the first interactive content; The information data set includes necessary resources for creating the first interactive content and purpose information corresponding to the first interactive content, and based on the information data set, the operation of creating the first interactive content corresponding to the user includes: Listing all virtual characters and all objects required for interacting with the user according to pre-set rules and constraints and the necessary resources for creating the first interactive content in the information data set; According to the purpose information corresponding to the first interactive content in the information data set, the interactive path of interaction with the user is connected in series in a linear timeline manner, wherein each interactive node in the interactive path includes interactive content of the user interacting with the virtual character and / or object; and Encapsulating each of the interactive nodes into an independent module and constructing the first interactive content, wherein the user edits the corresponding interactive content based on the independent module; In response to the operation instruction, the operation of creating a second interactive content corresponding to the user based on the first interactive content includes: In response to the operation instruction, based on the first interactive content, adjusting the interactive content in the first interactive scene for the user to interact with the virtual character and / or the object; In response to the operation instruction, adjusting an interaction path for interacting with the user; and Creating the second interactive content according to the adjusted interactive content and the adjusted interactive path; The robot interacts with the user to collect the information required in the preset information data set template, including: By interacting with the user through the robot, user voice information related to each item of information required in the preset information data set template is collected; and The collected user voice information is semantically understood, and various information required in the preset information data set template is collected according to the result of the semantic understanding.
