Device for controlling naked-eye 3D scene script based on user responses for interaction and method thereof

Abstract

A device and method for controlling naked-eye 3D scene script interaction based on user reactions. This method determines the emotional state and gaze vector of each user based on their perceptual data of viewing the virtual 3D scene. Then, based on the intersection of the gaze vectors, it selects interactive virtual objects from the virtual 3D objects in the virtual 3D scene. Next, it selects an event script based on the interactive virtual objects and each user's emotional state, and generates virtual scene content corresponding to each display perspective of the device according to the event script. This allows users to interact with interactive virtual objects in the virtual 3D scene from their own player perspective. This technology can dynamically adjust the storyline by integrating the game reactions of multiple players in real time, achieving the technical effect of providing more immersive and differentiated game interactive content.

Claims

1. A method for controlling naked-eye 3D scene script interaction based on user response, applied to a device providing multiple display perspectives, the method comprising at least the following steps: obtaining perceptual data of at least two users viewing a virtual 3D scene; calculating a player gaze vector for each user in the virtual 3D scene based on the perceptual data of each user; determining an intersection position of the player gaze vectors of the at least two users, and determining an interactive virtual object based on the intersection position and the spatial range of all virtual 3D objects in the virtual 3D scene, wherein the interactive virtual object is one of the virtual 3D objects; analyzing the perceptual data of each user to obtain the facial expression of each user, and determining the emotional state of each user using an emotion classification model based on the facial expression of each user; selecting an event script of an interactive event based on the interactive virtual object and the emotional state of each user; The event script generates virtual scene content corresponding to each display viewpoint in the virtual 3D scene; and displays one of the corresponding virtual scene contents in each display viewpoint, so that the at least two users can interact with the interactive virtual object in the virtual 3D scene through their respective player perspectives.

2. The method for controlling naked-eye 3D scene script interaction based on user response as described in claim 1, wherein the step of determining the interactive virtual object by the virtual 3D objects based on the intersection position and the spatial range of the virtual 3D objects in the virtual 3D scene further includes comparing the intersection position and the spatial range of the virtual 3D objects to determine one of the virtual 3D objects associated with the intersection position, and when the intersection position is associated with multiple virtual 3D objects, determining the interactive virtual object based on the plot weight of one of the virtual 3D objects.

3. The method for controlling naked-eye 3D scene script interaction based on user response as described in claim 1, wherein the step of analyzing each piece of sensory data to obtain the facial expression of each user, and using an emotion classification model to determine the emotional state of each user based on the facial expression of each user, further includes analyzing each piece of sensory data to obtain the voice features and gesture features of each user, and using an emotion classification model to determine the emotional state of each user based on the facial expression, voice features, and gesture features of each user.

4. The method for controlling naked-eye 3D scene script interaction based on user response as described in claim 1, wherein after the step of displaying one of the corresponding virtual scene contents at each of the display perspectives, the method further includes the step of adjusting the plot rhythm of the event script when the emotional states of the at least two users meet predetermined conditions.

5. The method for controlling naked-eye 3D scene script interaction based on user response as described in claim 1, wherein the step of selecting the event script of the interactive event from the script database based on the interactive virtual object and the emotional state of each user further includes the step of dividing at least two users into at least two story interaction groups based on the interactive virtual object or the emotional state of each user, and selecting different interactive events for the at least two story interaction groups respectively.

6. A device for controlling naked-eye 3D scene script interaction based on user reactions, the device providing multiple display perspectives, the device comprising at least: a data perception module for acquiring perception data of at least two users viewing a virtual 3D scene; a gaze determination module for calculating a player gaze vector of each user in the virtual 3D scene based on the perception data of each user, and for determining an intersection position of the player gaze vectors of the at least two users, and determining an interactive virtual object based on the intersection position and the spatial range of all virtual 3D objects in the virtual 3D scene, the interactive virtual object being one of the virtual 3D objects; an emotion determination module for analyzing each piece of perception data to acquire the facial expression of each user, and determining the emotional state of each user based on the facial expression of each user using an emotion classification model; and a plot selection module for selecting an event script of an interactive event based on the interactive virtual object and the emotional state of each user. A scene control module is used to generate virtual scene content corresponding to each display perspective in the virtual 3D scene according to the event script; and a scene display module is used to display the virtual scene content using different display perspectives, so that the at least two users can interact with the interactive virtual object in the virtual 3D scene through their respective player perspectives.

7. The device for controlling naked-eye 3D scene script interaction based on user response as described in claim 6, wherein the gaze determination module is further used to determine the interactive virtual object based on the plot weight of one of the virtual 3D objects when determining the multiple associations between the intersection position and the spatial range of the virtual 3D objects.

8. The device for controlling naked-eye 3D scene script interaction based on user response as described in claim 6, wherein the emotion judgment module is further used to analyze each of the perceptual data to obtain the voice features and gesture features of each user, and to use the emotion classification model to judge the emotional state of each user based on the facial expressions, voice features and gesture features of each user.

9. The device for controlling naked-eye 3D scene script interaction based on user response as described in claim 6, wherein the device further includes a script adjustment module for adjusting the plot rhythm of the event script when the emotional states of at least two users meet predetermined conditions.

10. The device for controlling naked-eye 3D scene script interaction based on user response as described in claim 6, wherein the plot selection module is further used to divide at least two users into at least two plot interaction groups based on the interactive virtual object or the emotional state of each user, and to select different interactive events for the at least two plot interaction groups respectively.

Images