Multi-user interaction immersive experience control method and system based on multimedia equipment

Abstract

The embodiment of the invention relates to the technical field of playing interaction, and discloses a multi-user interaction immersive experience control method based on multimedia equipment, which comprises the following steps: acquiring position information of a user detected by a sensor module in an actual physical environment; if the position information is matched with a pre-configured distance detection threshold value, determining that the corresponding user is in an interactive experience area, and sending a particle generation instruction to a graphic engine system to trigger generation of a particle effect; generating a particle display image at a corresponding position of the display module according to the particle generation instruction; and when it is detected that the interaction display image and the particle display image meet a set condition, calling an interaction display animation associated with the interaction display image, and displaying the interaction display animation. According to the multi-user interaction immersive experience control method based on the multimedia equipment, the user can influence the display of the visual effect through the behavior and position change of the user, so that more personalized and diversified experience is obtained.

Description

Technical Field

[0001] The present invention relates to the field of game interaction technology, and in particular to a control method and system for multi-person interactive immersive experience based on multimedia devices. Background Art

[0002] At present, in the current park experience, the traditional virtual scene interaction mode is often limited to static and standardized operations: visitors click on the virtual character icon on the screen to jump to a standardized details page, and then provide corresponding virtual buttons according to the standardized details page to call the corresponding interactive items, but this interactive method lacks deep integration with the real-time status of the virtual character, making the interactive experience of visitors appear monotonous and boring, lacking personalization and immersion. More importantly, this interactive mode ignores the unique personality, emotions and current activity status of each virtual character, resulting in a lack of novelty in the interactive process and difficulty in stimulating visitors' continued interest and desire to explore. Therefore, designing a solution that can enhance the user's interactive experience has become a technical problem that needs to be solved urgently by those skilled in the art. Summary of the invention

[0003] In response to the above-mentioned defects, an embodiment of the present invention discloses a control method for multi-person interactive immersive experience based on multimedia devices, which can achieve a richer interactive experience and enhance user interest in gaming.

[0004] A first aspect of an embodiment of the present invention discloses a control method for a multi-person interactive immersive experience based on a multimedia device, comprising:

[0005] Acquire the location information of the user in the actual physical environment detected by the sensor module, and perform numerical matching according to the location information and a pre-configured distance detection threshold;

[0006] If the position information matches the pre-configured distance detection threshold, it is determined that the corresponding user is in the interactive experience area, and a particle generation instruction is sent to the graphics engine system to trigger the generation of particle effects;

[0007] Generating a particle display image at a corresponding position of a display module according to the particle generation instruction, wherein the particle display image is simulated by a particle system;

[0008] An interactive display image is generated at the display module; the interactive display image moves at the corresponding display module according to a set moving trajectory, and when it is detected that the interactive display image and the particle display image meet set conditions, an interactive display animation associated with the interactive display image is called and displayed.

[0009] As an optional implementation manner, in the first aspect of the embodiment of the present invention, the step of obtaining the position information of the user in the actual physical environment detected by the sensor module includes:

[0010] Acquire location information of all users detected by the sensor module in the actual physical environment, wherein the number of users is multiple;

[0011] Generating a particle display image at a corresponding position of a display module according to the particle generation instruction, wherein the particle display image is simulated by a particle system, comprises:

[0012] A particle display image corresponding to a corresponding user is generated at a corresponding position of the display module according to the particle generation instruction. The particle display image is simulated by a particle system, and the number of the particle display images is the same as the number of users.

[0013] As an optional implementation, in the first aspect of the embodiment of the present invention, the interactive display image has multiple types of pictographic display images, and each type of pictographic display image is associated with a specific interactive display animation, wherein the pictographic display image is an animal pictographic display image, and the interactive display animation is a display animation of the corresponding animal;

[0014] The interactive display image is generated at the display module; the interactive display image moves at the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is retrieved and the interactive display animation is displayed; including:

[0015] Generate a falling object in a corresponding area at the display module according to parameter information configured in the particle system, and assign a pictographic material map to the falling object as an interactive display image, wherein the falling object moves along a moving trajectory from top to bottom;

[0016] In response to the sensing method configured in the particle system, after receiving the superposition signal of the interactive display image and the particle display image, the display animation of the animal associated with the pictographic display image is triggered.

[0017] As an optional implementation manner, in the first aspect of the embodiment of the present invention, the interactive display image is a bubble display image;

[0018] The interactive display image is generated at the display module; the interactive display image moves at the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is called, including:

[0019] constructing a bubble display image according to the graphic engine system, and generating a corresponding bubble display image in the display module;

[0020] Calculating the straight-line detection distance between the particle position and the center position of the bubble, and comparing the straight-line detection distance with the radius of the bubble, if the straight-line detection distance is not greater than the radius of the bubble, determining that a collision event occurs between the particle and the bubble;

[0021] When a collision event is detected for the first time, a timer is started, and in each subsequent time interval, a timer is detected to see whether the time reaches a preset hovering time threshold;

[0022] If the time of the timer reaches the hovering time threshold, the interactive display animation associated with the interactive display image is called.

[0023] As an optional implementation manner, in the first aspect of the embodiment of the present invention, the control method further includes:

[0024] An infrared camera is used to obtain an image containing infrared light source points in real time, wherein the infrared light source points are emitted by a handheld infrared device of a corresponding interactive user;

[0025] Identifying an image containing infrared light source points by an image processing algorithm to identify infrared light points in the image, wherein the image processing algorithm includes a threshold segmentation algorithm or an edge detection algorithm;

[0026] Position matching is performed based on the detected coordinates of the infrared light spot and the coordinates of the bubble. If the two match, the bubble display animation associated with the bubble display image is called.

[0027] As an optional implementation, in the first aspect of the embodiment of the present invention, after performing position matching according to the detected coordinates of the infrared light spot and the coordinates of the bubble, and calling the bubble display animation associated with the bubble display image if the two match, it also includes:

[0028] When it is detected that the number of bubble display images touched exceeds a preset value, a scene switching instruction is triggered to perform a switching operation on the current display scene at the display module.

[0029] As an optional implementation manner, in the first aspect of the embodiment of the present invention, the step of obtaining the position information of the user in the actual physical environment detected by the sensor module includes:

[0030] Acquire the first position information of the user in the first position area detected by the radar sensor, and acquire the second position information of the user in the second position area detected by the kinect body sensor;

[0031] Generating a particle display image at a corresponding position of a display module according to the particle generation instruction includes:

[0032] Particle display points are generated at a first display area of ​​a display module according to the particle generation instruction, and particle display dot matrix is ​​generated at a second display area of ​​the display module according to the particle generation instruction.

[0033] A second aspect of an embodiment of the present invention discloses a control system for multi-person interactive immersive experience based on a multimedia device, comprising:

[0034] Acquisition module: used to acquire the position information of the user in the actual physical environment detected by the sensor module, and perform numerical matching according to the position information and a pre-configured distance detection threshold;

[0035] Detection module: used for determining that the corresponding user is in the interactive experience area if the position information matches a pre-configured distance detection threshold, and sending a particle generation instruction to the graphics engine system to trigger the generation of particle effects;

[0036] A generation module: used for generating a particle display image at a corresponding position of the display module according to the particle generation instruction, wherein the particle display image is simulated by a particle system;

[0037] Display module: used to generate an interactive display image at the display module; the interactive display image moves in the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is called up and the interactive display animation is displayed.

[0038] The third aspect of an embodiment of the present invention discloses an electronic device, comprising: a memory storing executable program code; a processor coupled to the memory; the processor calls the executable program code stored in the memory to execute the control method for multi-person interactive immersive experience based on a multimedia device disclosed in the first aspect of the embodiment of the present invention.

[0039] A fourth aspect of an embodiment of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the control method for a multi-person interactive immersive experience based on a multimedia device disclosed in the first aspect of an embodiment of the present invention.

[0040] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0041] The control method for multi-person interactive immersive experience based on multimedia devices in the embodiment of the present invention introduces particle effects and interactive display animations, so that the interactive immersive experience space is no longer a static, single display space, but becomes an interactive environment full of changes, challenges and fun. Users can influence the display of visual effects through their own behavior and position changes, thereby obtaining a more personalized and diversified experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0043] Figure 1 It is a flow chart of a control method for multi-person interactive immersive experience based on multimedia devices disclosed in an embodiment of the present invention;

[0044] Figure 2 It is a schematic diagram of the pictographic character display animation process disclosed in an embodiment of the present invention;

[0045] Figure 3 It is a schematic diagram of the bubble display process disclosed in an embodiment of the present invention;

[0046] Figure 4 It is a schematic diagram of the infrared and bubble interaction process disclosed in an embodiment of the present invention;

[0047] Figure 5 It is a schematic diagram of pictographic character display disclosed in an embodiment of the present invention;

[0048] Figure 6 is a bubble display schematic diagram disclosed in an embodiment of the present invention;

[0049] Figure 7 is a schematic diagram of the somatosensory detection display disclosed in an embodiment of the present invention;

[0050] Figure 8 It is a structural schematic diagram of a control system for multi-person interactive immersive experience based on multimedia devices provided by an embodiment of the present invention;

[0051] Fig. 9 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0053] It should be noted that the terms "first", "second", "third", "fourth", etc. in the specification and claims of the present invention are used to distinguish different objects rather than to describe a specific order. The terms "including" and "having" in the embodiments of the present invention and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0054] At present, in the current park play experience, the traditional virtual scene interaction mode is often limited to static and standardized operations: visitors click on the virtual character icon on the screen to jump to a standardized details page, and then provide corresponding virtual buttons according to the standardized details page to call the corresponding interactive items, but this interactive method lacks deep integration with the real-time status of the virtual character, making the interactive experience of visitors monotonous and boring, lacking personalization and immersion. More importantly, this interactive mode ignores the unique personality, emotions and current activity status of each virtual character, resulting in a lack of novelty in the interactive process and difficulty in stimulating visitors' continued interest and desire to explore. Based on this, the embodiment of the present invention discloses a control method, system, electronic device and storage medium for a multi-person interactive immersive experience based on a multimedia device, which introduces particle effects and interactive display animations, and the interactive immersive experience space is no longer a static, single display space, but becomes an interactive environment full of changes, challenges and fun. Users can affect the display of visual effects through their own behavior and position changes, thereby obtaining a more personalized and diversified experience.

[0055] Embodiment 1

[0056] See also Figure 1 , Figure 1It is a flow chart of a control method for a multi-person interactive immersive experience based on multimedia devices disclosed in an embodiment of the present invention. Among them, the execution subject of the method described in the embodiment of the present invention is an execution subject composed of software and / or hardware, and the execution subject can receive relevant information by wired or / and wireless means, and can send certain instructions. Of course, it can also have certain processing functions and storage functions. The execution subject can control multiple devices, such as a remote physical server or cloud server and related software, or it can be a local host or server and related software that performs related operations on a device placed somewhere. In some scenarios, multiple storage devices can also be controlled, and the storage devices can be placed in the same place or different places as the devices. For example Figure 1 As shown, the control method for multi-person interactive immersive experience based on multimedia devices includes the following steps:

[0057] S101: Acquire location information of a user in an actual physical environment detected by a sensor module, and perform numerical matching according to the location information and a pre-configured distance detection threshold;

[0058] S102: If the position information matches the pre-configured distance detection threshold, it is determined that the corresponding user is in the interactive experience area, and a particle generation instruction is sent to the graphics engine system to trigger the generation of particle effects;

[0059] S103: generating a particle display image at a corresponding position of a display module according to the particle generation instruction, wherein the particle display image is simulated by a particle system;

[0060] S104: generating an interactive display image at the display module; the interactive display image moves at the corresponding display module according to a set moving trajectory, and when it is detected that the interactive display image and the particle display image meet set conditions, calling an interactive display animation associated with the interactive display image, and displaying the interactive display animation.

[0061] The embodiment of the present invention detects the user's position information in the actual physical environment in real time through the sensor module, and matches it with the preset distance detection threshold, so as to accurately determine whether the user has entered the preset interactive experience area. This precise recognition mechanism ensures that the triggering timing of the interactive experience is accurate and provides users with instant feedback and immersion.

[0062] Once the user is determined to be in the interactive experience area, the graphics engine system will receive the particle generation instruction, thereby generating a particle display image at the corresponding position of the display module. The particle system creates dynamic and realistic visual effects for users by simulating the particle behavior in natural or virtual environments (such as drifting, gathering, explosion, etc.), enhancing the realism and interactivity of the environment.

[0063] The interactive display images move on the display module according to the set movement trajectory. When these images and the particle display images meet specific conditions (such as touching, crossing, approaching, etc.), the associated interactive display animation will be triggered. This combination not only enriches the interactive form, but also further enhances the user's sense of participation and immersion through dynamic visual changes.

[0064] More preferably, the step of obtaining the position information of the user in the actual physical environment detected by the sensor module includes:

[0065] Acquire location information of all users detected by the sensor module in the actual physical environment, wherein the number of users is multiple;

[0066] Generating a particle display image at a corresponding position of a display module according to the particle generation instruction, wherein the particle display image is simulated by a particle system, comprises:

[0067] A particle display image corresponding to a corresponding user is generated at a corresponding position of the display module according to the particle generation instruction. The particle display image is simulated by a particle system, and the number of the particle display images is the same as the number of users.

[0068] The solution of the embodiment of the present invention obtains the position information of all users (i.e., multiple users) detected by the sensor module in the actual physical environment, and the system can simultaneously track and identify the actions and positions of multiple users. This means that the experience space is no longer exclusive to a single user, but can support multiple people to participate at the same time, jointly create and enjoy interactive experiences. This multi-user support function greatly broadens the application scenarios and audience range of interactive experiences.

[0069] According to the particle generation instructions, a corresponding particle display image is generated for each user at the corresponding position of the display module, and the number of particle display images is the same as the number of users. This design allows each user to have his or her own unique particle effect, increasing the degree of personalization of the experience. The particle effects between users are independent of each other but may be intertwined, creating an interactive atmosphere of both competition and cooperation.

[0070] Since each user has his or her own particle display image, the movement and change of these images on the display module can become a medium for interaction between users. For example, a user's action or position change can affect other users' particle effects, or specific interactions can occur between different users' particle effects. This design promotes communication and collaboration between users and enhances the social nature of the experience.

[0071] While supporting multiple users, the system can also assign corresponding particle display images to each user, which means that the entire experience space is fully utilized and the interaction density is improved. Users can experience richer and denser interactive content in a limited space, further enhancing their sense of immersion and participation.

[0072] The design also has certain scalability and customizability. The system can adjust the types, styles and parameters of particle effects according to actual needs to meet the needs of different user groups and scenarios. At the same time, different interaction rules and reward mechanisms can be set for different users or user groups to increase the diversity and attractiveness of the experience.

[0073] More preferably, the interactive display image has multiple types of pictographic display images, and each type of pictographic display image is associated with a specific interactive display animation, wherein the pictographic display image is an animal pictographic display image, and the interactive display animation is a display animation of the corresponding animal;

[0074] like Figure 2 As shown, the interactive display image is generated at the display module; the interactive display image moves in the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is called and the interactive display animation is displayed; including:

[0075] S1041: generating a falling object in a corresponding area of ​​the display module according to parameter information configured in the particle system, and assigning a pictographic material map to the falling object as an interactive display image, wherein the falling object moves along a moving trajectory from top to bottom;

[0076] S1042: In response to the sensing method configured in the particle system, after receiving the superposition signal of the interactive display image and the particle display image, triggering the display animation of the animal associated with the pictographic display image.

[0077] like Figure 5 As shown in the figure, it is a schematic diagram of the interactive effect of the corresponding pictograms; specifically, when the experiencer approaches the wall, particles appear on the wall at the corresponding position. When the particles overlap and interact with the falling pictograms, the corresponding animals jump out of the pictograms. The visual effect is achieved by connecting to the particle engine in the program according to the touch points identified by the radar scan, setting the shader for the data, and processing and converting it into particle visual effects. The particle visual effect can track the moving position of the character in real time.

[0078] The interactive element method in the embodiment of the present invention mainly uses the particle system in the program to drop objects in the corresponding area, and assign material maps to the objects (pictograms are used as maps in this interactive solution), and sets the sensing method of the particle system. When receiving the superimposed signal, the pictogram material triggers the subsequent animation to achieve the effect change.

[0079] The embodiment of the present invention designs the interactive display image as a variety of pictographic display images, especially taking animal pictographic characters as an example, and this design gives the interactive elements a deeper cultural connotation and visual appeal. Each pictographic character represents a specific animal, so that users can feel the charm of traditional culture when participating in the interaction, and also increase the fun and educational significance of the interaction.

[0080] Each type of pictographic display image is associated with a specific interactive display animation. This design achieves a natural transition from static images to dynamic animations. When the interactive display image and the particle display image meet the set conditions, the corresponding animal display animation is triggered. This instant feedback mechanism enhances the user's sense of participation and immersion. The interactive display image moves on the display module according to the set moving trajectory. This dynamic effect makes the entire interactive process more vivid and interesting. In particular, when the falling object moves from top to bottom, the user needs to predict and react to its movement path, which increases the challenge and fun of the interaction.

[0081] Through the induction method configured in the particle system, when the interactive display image is superimposed with the particle display image, the display animation of the animal associated with it will be triggered. This induction trigger mechanism makes the interaction process more natural and smooth, and also improves the response speed and accuracy of the system. The design cleverly combines traditional cultural elements (such as pictograms) with modern scientific and technological means (such as particle systems and animation technology) to create a new interactive experience. This fusion not only demonstrates the charm of technology, but also promotes the value of traditional culture, providing users with a richer cultural experience and aesthetic enjoyment.

[0082] More preferably, the interactive display image is a bubble display image;

[0083] like Figure 3 As shown, the interactive display image is generated at the display module; the interactive display image moves at the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is called, including:

[0084] S104a: constructing a bubble display image according to the graphic engine system, and generating a corresponding bubble display image in the display module;

[0085] S104b: calculating the straight line detection distance between the particle position and the center position of the bubble, and comparing the straight line detection distance with the radius of the bubble. If the straight line detection distance is not greater than the radius of the bubble, it is determined that a collision event occurs between the particle and the bubble.

[0086] S104c: when a collision event is detected for the first time, a timer is started, and in each subsequent time interval, a timer is detected to determine whether the time reaches a preset hovering time threshold;

[0087] S104d: If the time of the timer reaches the hovering time threshold, the interactive display animation associated with the interactive display image is called.

[0088] like Figure 6 As shown in the figure, it is a bubble interactive display effect diagram. The infrared sensor and radar are used in combination to convert data in the interactive engine, converting the desktop simulation data into three-dimensional data, and performing collision processing in three-dimensional space. After the collision is triggered, the bubble material changes with animation.

[0089] The embodiment of the present invention designs the interactive display image as a bubble display image, which is not only visually novel and unique, but also more naturally and harmoniously combined with the particle display image. As a light and floating element, bubbles can create a relaxed and pleasant interactive atmosphere and enhance the user's sense of participation and immersion.

[0090] By calculating the straight-line detection distance between the particle position and the center position of the bubble and comparing it with the radius of the bubble, the system can accurately determine whether the particle and the bubble collide. This collision detection mechanism not only improves the accuracy of the interaction, but also provides users with instant feedback, increasing the fun and challenge of the interaction.

[0091] When a collision event is detected for the first time, a timer is started, and in each subsequent time interval, the timer is checked to see if it reaches the preset hovering time threshold. This design ensures that the bubble does not disappear or trigger animation immediately after a collision, but remains in a hovering state for a period of time, giving users more time to observe and react. At the same time, the setting of the hovering time also increases the uncertainty and surprise of the interaction.

[0092] When the timer reaches the hovering time threshold, the system will call the interactive display animation associated with the bubble display image. These animations can be special effects related to the shape or color of the bubble, or storylines or game elements related to the content represented by the bubble. Through the display of these animations, users can get more visual enjoyment and interactive experience.

[0093] Overall, this design not only enriches the content and form of the interactive immersive experience by introducing bubble display images and collision detection mechanisms, but also improves the fun and interactivity of the user experience. Users can feel more fun and challenges in their interaction with the bubbles, and thus participate in the experience more devotedly.

[0094] like Figure 4 As shown, more preferably, the control method further includes:

[0095] S105: acquiring an image including an infrared light source point in real time through an infrared camera, wherein the infrared light source point is emitted by a handheld infrared device of a corresponding interactive user;

[0096] S106: identifying the image containing the infrared light source point by using an image processing algorithm to identify the infrared light point in the image, wherein the image processing algorithm includes a threshold segmentation algorithm or an edge detection algorithm;

[0097] S107: Performing position matching according to the detected coordinates of the infrared light spot and the coordinates of the bubble, and if the two match, calling the bubble display animation associated with the bubble display image.

[0098] The solution of the embodiment of the present invention combines radar and infrared camera for interaction. When the user approaches the wall, particles appear at the corresponding position on the wall. When the particles overlap and interact with the bubbles, they hover for a while and then the bubbles burst. The user can use a magic wand prop with built-in infrared to point to the location of the bubbles on the wall and the bubbles will burst.

[0099] The embodiment of the present invention uses an infrared camera to obtain images containing infrared light source points in real time, and these infrared light source points are emitted by infrared devices held by interactive users. This method can accurately track the user's position and movement, and provide accurate data support for subsequent interactive operations.

[0100] Using image processing algorithms such as threshold segmentation algorithms or edge detection algorithms to identify images containing infrared light source points can quickly and accurately separate infrared light points from complex backgrounds. This efficient image processing capability ensures that the system responds instantly to user actions, improving the smoothness of interaction and user experience.

[0101] The position matching is performed based on the detected infrared light spot coordinates and the bubble coordinates. When the two match, the system can automatically call the bubble display animation associated with the bubble display image. This position matching mechanism not only enables accurate interaction between users and interactive elements, but also enables personalized display of interactive content based on the user's actual position and action, enhancing the fun and personalized experience of interaction.

[0102] Through the combination of infrared cameras and image processing algorithms, the system can capture user movements in real time and convert them into changes in interactive elements. This instant feedback mechanism enables users to participate in the interaction more immersively, enhancing their sense of immersion and participation.

[0103] More preferably, after performing position matching according to the detected coordinates of the infrared light spot and the coordinates of the bubble, and calling the bubble display animation associated with the bubble display image if the two match, the method further includes:

[0104] When it is detected that the number of bubble display images touched exceeds a preset value, a scene switching instruction is triggered to perform a switching operation on the current display scene at the display module.

[0105] On the basis of the original, a scene switching mechanism is added, so that the interactive experience is no longer limited to operations within a single scene. When it is detected that the number of images displayed by the touch bubble exceeds the preset value, the system automatically triggers the generation of a scene switching instruction to switch the current display scene at the display module. This design makes the interactive process more colorful, and users can experience different feelings and challenges brought by different scenes.

[0106] By presetting the value of touching bubbles as the trigger condition for scene switching, the system can dynamically adjust the difficulty and fun of the interaction according to the user's interaction speed and accuracy. When the user can quickly and accurately touch a sufficient number of bubbles, the system will reward the user by switching to a new scene, giving the user a sense of accomplishment and motivation to continue exploring. Conversely, if the user's progress is slow, the system can also maintain the current scene, giving the user more opportunities to practice and familiarize themselves.

[0107] The scene switching mechanism increases the diversity and freshness of the interactive experience, making users more willing to participate in the interaction for a long time. Each new scene may bring new challenges and surprises, thus attracting users to continue to explore and try. This design helps to improve user stickiness and promote continuous interaction between users and the system.

[0108] The scene switching mechanism makes the interaction process more flexible and changeable. The system can flexibly adjust the interaction process and scene layout according to the user's actual interaction situation and needs. This flexibility helps to meet the personalized needs of different users and improve the quality of the overall interaction experience.

[0109] More preferably, the step of obtaining the position information of the user in the actual physical environment detected by the sensor module includes:

[0110] Acquire the first position information of the user in the first position area detected by the radar sensor, and acquire the second position information of the user in the second position area detected by the kinect body sensor;

[0111] Generating a particle display image at a corresponding position of a display module according to the particle generation instruction includes:

[0112] Particle display points are generated at a first display area of ​​a display module according to the particle generation instruction, and particle display dot matrix is ​​generated at a second display area of ​​the display module according to the particle generation instruction.

[0113] like Figure 7 As shown, it is a somatosensory detection display interactive diagram. The solution of the embodiment of the present invention combines radar and kinect somatosensor for interaction. Radar: When the experiencer approaches the wall, particles appear on the wall at the corresponding position. When the particles overlap and interact with the falling pictograms, the animals corresponding to the pictograms change and jump out of them. Kinect somatosensor: When the experiencer approaches the somatosensor recognition area, the image of the person appears on the wall in the form of particles. Visual effect implementation method: The portrait pattern recognized by the kinect somatosensor is connected to the particle system in the interactive engine, converted into dot matrix particles as particle emitters according to the recognized image, and given the corresponding luminous material.

[0114] By writing a program to read radar data, the distance and position between the experiencer and the wall are analyzed. When the experiencer approaches the wall, a particle effect is generated at the position detected by the radar, which is implemented using Unity's particle system. The corresponding relationship between pictograms and animals is designed. When the particles overlap with the pictograms, the animation of the animal jumping out is triggered.

[0115] Kinect somatosensory interaction, using Kinect SDK to obtain human body images or skeleton data. Convert human body images into dot matrix particles, implement them through Unity's Shader and particle system, and give them luminous materials to enhance the visual effect. Merge the particle images generated by Kinect with the particle effects triggered by radar to ensure that the two are visually coordinated.

[0116] When the particle effect is generated at the position detected by the radar, particles of various colors and shapes can be designed to increase the visual layering. When the particles overlap with the falling pictograms, the pictograms are gradually transformed into the corresponding animal images through animation effects, accompanied by sound effects and light and shadow changes, making the moment when the animals jump out more shocking and interesting. When Kinect recognizes that the experiencer has entered the recognition area, its outline or image is projected onto the wall in the form of dot matrix particles. These particles can be integrated with the particles generated by the radar to form an interactive scene where people dance with pictograms, animals and other elements. At the same time, the realism and immersion of the visual effects can be enhanced by adjusting parameters such as the transparency, speed and distribution density of the particles.

[0117] In addition to the above methods, the solution of the embodiment of the present invention can also design multiple levels of interactive links, so that the experiencer can gradually deepen the experience. For example, in the early stage, it is just a simple interaction between particles and pictograms. As the experiencer further explores and changes his actions, more complex interactive effects and animation scenes are gradually unlocked. Set tasks and challenges, such as requiring the experiencer to complete specific actions or trigger specific interactive effects within a specified time, to increase the fun and challenge of the interaction.

[0118] The control method for multi-person interactive immersive experience based on multimedia devices in the embodiment of the present invention introduces particle effects and interactive display animations, so that the interactive immersive experience space is no longer a static, single display space, but becomes an interactive environment full of changes, challenges and fun. Users can influence the display of visual effects through their own behavior and position changes, thereby obtaining a more personalized and diversified experience.

[0119] Embodiment 2

[0120] See also Figure 8 , Figure 8 Schematic diagram of the structure of the control system for multi-person interactive immersive experience based on multimedia devices disclosed in the embodiment of the present invention. Figure 8 As shown, the control system for multi-person interactive immersive experience based on multimedia devices may include:

[0121] Acquisition module 21: used to acquire the position information of the user in the actual physical environment detected by the sensor module, and perform numerical matching according to the position information and a pre-configured distance detection threshold;

[0122] Detection module 22: for determining that the corresponding user is in the interactive experience area if the position information matches a pre-configured distance detection threshold, and sending a particle generation instruction to the graphics engine system to trigger the generation of particle effects;

[0123] Generating module 23: used to generate a particle display image at a corresponding position of the display module according to the particle generating instruction, wherein the particle display image is simulated by a particle system;

[0124] Display module 24: used to generate an interactive display image at the display module; the interactive display image moves in the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is called and the interactive display animation is displayed.

[0125] The control method for multi-person interactive immersive experience based on multimedia devices in the embodiment of the present invention introduces particle effects and interactive display animations, so that the interactive immersive experience space is no longer a static, single display space, but becomes an interactive environment full of changes, challenges and fun. Users can influence the display of visual effects through their own behavior and position changes, thereby obtaining a more personalized and diversified experience.

[0126] Embodiment 3

[0127] See also Fig. 9 , Fig. 9 Schematic diagram of the structure of an electronic device disclosed in an embodiment of the present invention. The electronic device may be a computer, a server, etc. Of course, in certain circumstances, it may also be a smart device such as a mobile phone, a tablet computer, a monitoring terminal, and an image acquisition device with processing functions. Fig. 9 As shown, the electronic device may include:

[0128] A memory 510 storing executable program codes;

[0129] a processor 520 coupled to the memory 510;

[0130] The processor 520 calls the executable program code stored in the memory 510 to execute part or all of the steps in the control method for multi-person interactive immersive experience based on multimedia devices in the first embodiment.

[0131] An embodiment of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute part or all of the steps in the method for controlling a multi-person interactive immersive experience based on a multimedia device in Embodiment 1.

[0132] An embodiment of the present invention further discloses a computer program product, wherein when the computer program product runs on a computer, the computer executes part or all of the steps in the control method for multi-person interactive immersive experience based on multimedia devices in embodiment one.

[0133] An embodiment of the present invention further discloses an application publishing platform, wherein the application publishing platform is used to publish a computer program product, wherein when the computer program product runs on a computer, the computer executes some or all of the steps in the control method for multi-person interactive immersive experience based on multimedia devices in embodiment one.

[0134] In various embodiments of the present invention, it should be understood that the size of the serial numbers of the processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0135] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place or distributed over multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0136] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0137] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to perform some or all of the steps of the method described in each embodiment of the present invention.

[0138] In the embodiments provided by the present invention, it should be understood that "B corresponding to A" means that B is associated with A, and B can be determined according to A. However, it should also be understood that determining B according to A does not mean determining B only according to A, and B can also be determined according to A and / or other information.

[0139] A person of ordinary skill in the art can understand that some or all of the steps in the various methods of the embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0140] The above describes in detail the control method, system, electronic device and storage medium for a multi-person interactive immersive experience based on a multimedia device disclosed in the embodiments of the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the ideas of the present invention, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A control method for multi-person interactive immersive experience based on multimedia devices, characterized in that: include: Acquire the location information of the user in the actual physical environment detected by the sensor module, and perform numerical matching according to the location information and a pre-configured distance detection threshold; If the position information matches the pre-configured distance detection threshold, it is determined that the corresponding user is in the interactive experience area, and a particle generation instruction is sent to the graphics engine system to trigger the generation of particle effects; Generating a particle display image at a corresponding position of a display module according to the particle generation instruction, wherein the particle display image is simulated by a particle system; An interactive display image is generated at the display module; the interactive display image moves at the corresponding display module according to a set moving trajectory, and when it is detected that the interactive display image and the particle display image meet set conditions, an interactive display animation associated with the interactive display image is called and displayed.

2. The control method for multi-person interactive immersive experience based on multimedia devices according to claim 1, characterized in that: The obtaining of the position information of the user in the actual physical environment detected by the sensor module includes: Acquire location information of all users detected by the sensor module in the actual physical environment, wherein the number of users is multiple; Generating a particle display image at a corresponding position of a display module according to the particle generation instruction, wherein the particle display image is simulated by a particle system, comprises: A particle display image corresponding to a corresponding user is generated at a corresponding position of the display module according to the particle generation instruction. The particle display image is simulated by a particle system, and the number of the particle display images is the same as the number of users.

3. The control method for multi-person interactive immersive experience based on multimedia devices according to claim 1, characterized in that: The interactive display image has multiple types of pictographic display images, and each type of pictographic display image is associated with a specific interactive display animation, wherein the pictographic display image is an animal pictographic display image, and the interactive display animation is a display animation of the corresponding animal; The interactive display image is generated at the display module; the interactive display image moves at the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is retrieved and the interactive display animation is displayed; including: Generate a falling object in a corresponding area at the display module according to parameter information configured in the particle system, and assign a pictographic material map to the falling object as an interactive display image, wherein the falling object moves along a moving trajectory from top to bottom; In response to the sensing method configured in the particle system, after receiving the superposition signal of the interactive display image and the particle display image, the display animation of the animal associated with the pictographic display image is triggered.

4. The control method for multi-person interactive immersive experience based on multimedia devices according to claim 1, characterized in that: The interactive display image is a bubble display image; The interactive display image is generated at the display module; the interactive display image moves at the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is called, including: constructing a bubble display image according to the graphic engine system, and generating a corresponding bubble display image in the display module; Calculating the straight-line detection distance between the particle position and the center position of the bubble, and comparing the straight-line detection distance with the radius of the bubble, if the straight-line detection distance is not greater than the radius of the bubble, determining that a collision event occurs between the particle and the bubble; When a collision event is detected for the first time, a timer is started, and in each subsequent time interval, a timer is detected to see whether the time reaches a preset hovering time threshold; If the time of the timer reaches the hovering time threshold, the interactive display animation associated with the interactive display image is called.

5. The control method for multi-person interactive immersive experience based on multimedia devices according to claim 4, characterized in that: The control method further includes: An infrared camera is used to obtain an image containing infrared light source points in real time, wherein the infrared light source points are emitted by a handheld infrared device of a corresponding interactive user; Identifying an image containing infrared light source points by an image processing algorithm to identify infrared light points in the image, wherein the image processing algorithm includes a threshold segmentation algorithm or an edge detection algorithm; Position matching is performed based on the detected coordinates of the infrared light spot and the coordinates of the bubble. If the two match, the bubble display animation associated with the bubble display image is called.

6. The control method for multi-person interactive immersive experience based on multimedia devices according to claim 1, characterized in that: After performing position matching according to the detected coordinates of the infrared light spot and the coordinates of the bubble, and calling the bubble display animation associated with the bubble display image if the two match, the method further includes: When it is detected that the number of bubble display images touched exceeds a preset value, a scene switching instruction is triggered to perform a switching operation on the current display scene at the display module.

7. The control method for multi-person interactive immersive experience based on multimedia devices according to claim 1, characterized in that: The obtaining of the position information of the user in the actual physical environment detected by the sensor module includes: Acquire the first position information of the user in the first position area detected by the radar sensor, and acquire the second position information of the user in the second position area detected by the kinect body sensor; Generating a particle display image at a corresponding position of a display module according to the particle generation instruction includes: Particle display points are generated at a first display area of ​​a display module according to the particle generation instruction, and particle display dot matrix is ​​generated at a second display area of ​​the display module according to the particle generation instruction.

8. A control system for multi-person interactive immersive experience based on multimedia devices, characterized in that: include: Acquisition module: used to acquire the position information of the user in the actual physical environment detected by the sensor module, and perform numerical matching according to the position information and a pre-configured distance detection threshold; Detection module: used for determining that the corresponding user is in the interactive experience area if the position information matches a pre-configured distance detection threshold, and sending a particle generation instruction to the graphics engine system to trigger the generation of particle effects; A generation module: used for generating a particle display image at a corresponding position of the display module according to the particle generation instruction, wherein the particle display image is simulated by a particle system; Display module: used to generate an interactive display image at the display module; the interactive display image moves in the corresponding display module according to the set movement trajectory, and when it is detected that the interactive display image and the particle display image meet the set conditions, the interactive display animation associated with the interactive display image is called up and the interactive display animation is displayed.

9. An electronic device, characterized in that: include: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the control method for multi-person interactive immersive experience based on a multimedia device as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program enables a computer to execute the control method for a multi-person interactive immersive experience based on a multimedia device as described in any one of claims 1 to 7.

Images