Intelligent interactive media display method and system

Abstract

The invention discloses an intelligent interactive media display method and system. The method comprises the following steps that the environment where audiences are located is sensed in real time through the sensor technology; superposing the virtual content in the real world seen by the audience by using a mixed reality technology; capturing body actions and postures of audiences in real time by using a biological recognition technology or a posture recognition sensor; customizing display content according to historical behaviors of audiences and real-time feedback by using a machine learning algorithm and a personalized recommendation system; and according to the data analysis result, adjusting the display content and the interaction design so as to optimize the user experience and meet the display target and demand. The present invention uses a mixed reality engine, fuses virtual content with the real world, including augmented reality virtual objects, information tags or interactive interface elements, which allows content to be adjusted in real time in response to audience position changes and actions, enhancing audience's sense of participation and interactivity.

Description

Technical Field

[0001] The present invention relates to the field of multimedia technology, and in particular to an intelligent interactive media display method and system. Background Art

[0002] Intelligent interactive media presentation is an emerging field that combines artificial intelligence and user interaction technology. It aims to enable media content to interact with users in a more natural and intelligent way through natural language processing and semantic understanding technology. This technology is not limited to the presentation of text or static information, but also includes multimedia content in the form of audio, video and their combination.

[0003] Current media presentation technology mainly relies on pre-set scripts or simple question-and-answer interactions. However, it relies on static content presentation and pre-written interaction scripts, cannot be flexibly adjusted according to the user's specific needs and context, and has limitations in understanding the semantics and intent of user input, resulting in interactions that are not smart and natural enough. At the same time, due to technical limitations, users often feel the incoherence of information presentation and the discontinuity of interactive experience when interacting with existing media presentation systems. Summary of the invention

[0004] The purpose of the present invention is to provide an intelligent interactive media display method and system to solve the problems raised in the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] An intelligent interactive media display method comprises the following steps:

[0007] Step S1, environmental perception, uses sensor technology to perceive the audience's environment in real time, including spatial layout, light conditions and audience position, and analyzes the current audience scene based on environmental perception data to determine the optimal layout and form of the display content;

[0008] Step S2, content generation, based on the results of scene analysis, using mixed reality technology to overlay virtual content on the real world seen by the audience, the virtual content includes virtual objects, information tags or interactive interface elements of augmented reality, and is adjusted in real time to respond to the position changes and movements of the audience, while interactive elements are designed to enhance the audience's sense of participation and interactivity;

[0009] Step S3, body perception, using biometric technology or gesture recognition sensors to capture the audience's body movements and postures in real time, and adjusting the display and interaction of virtual content according to the body perception data, such as selecting and dragging virtual objects through gestures, or turning the head to browse different perspectives;

[0010] Step S4: Personalized adjustment: using machine learning algorithms and personalized recommendation systems to customize display content based on audience historical behaviors and real-time feedback, and continuously optimizing display content and interactive design through real-time data analysis of audience interactive behaviors and feedback;

[0011] Step S5, data analysis, collects and analyzes the audience's interaction data, participation, and satisfaction evaluation, and adjusts the display content and interaction design based on the data analysis results to optimize the user experience and meet the display goals and needs.

[0012] Furthermore, in step S1, the sensor technology includes but is not limited to infrared sensors, cameras, light sensors and position trackers.

[0013] Furthermore, in step S2, mixed reality technology includes but is not limited to augmented reality, virtual reality and mixed reality technology.

[0014] Furthermore, in step S3, biometric recognition technology includes but is not limited to facial recognition, fingerprint recognition and iris recognition, and gesture recognition sensors include but are not limited to accelerometers, gyroscopes and depth cameras.

[0015] Furthermore, in step S4, the machine learning algorithm includes but is not limited to deep learning, reinforcement learning and recommendation system algorithm.

[0016] Furthermore, in step S5, the data analysis method includes but is not limited to statistical analysis, data mining and user behavior analysis.

[0017] An intelligent interactive media display system, comprising

[0018] The environment perception system includes a sensor network and a data processing module. The sensor network is used to perceive the environment of the audience in real time. The data processing module is used to process the data collected by the sensor to perform environment analysis and scene recognition.

[0019] A mixed reality system, comprising a content creation tool and a mixed reality engine, wherein the content creation tool is used to design and generate virtual content, and the mixed reality engine is used to merge the virtual content with the real world and to render and display it in real time;

[0020] a body sensing system including a biometric device and a gesture recognition sensor, wherein the biometric device is used to capture the biometric characteristics of the audience, the gesture recognition sensor is used to capture the body movements and gestures of the audience, and an interaction design module is used to design an interaction method based on the body sensing data;

[0021] A personalization system, including a machine learning platform and a data analysis platform. The machine learning platform is used to train personalized recommendation models and optimization algorithms, and the data analysis platform is used to collect and analyze audience interaction data for real-time optimization and feedback.

[0022] The effect evaluation system includes a data collection tool and an effect evaluation module. The data collection tool is used to collect audience interaction data, participation and satisfaction evaluation. The effect evaluation module is used to perform quantitative analysis and evaluation of the display effect based on the collected data.

[0023] The interface control system includes a user interface and a control module, which is used to provide an intuitive and easy-to-use interface for administrators to set display content and parameters, as well as to monitor and manage the operating status of the entire display system in real time;

[0024] The network communication module, including the network infrastructure and cloud service platform, is used to ensure unimpeded data transmission and communication between various parts of the system, as well as to support remote management and data storage.

[0025] Furthermore, the mixed reality engine supports the integrated application of augmented reality, virtual reality and mixed reality technologies.

[0026] Furthermore, the machine learning platform supports the application of deep learning, reinforcement learning and recommendation system algorithms.

[0027] Furthermore, the data analysis platform supports the application of statistical analysis, data mining and user behavior analysis methods.

[0028] Compared with the prior art, the present invention has the following beneficial effects:

[0029] 1. The present invention uses a mixed reality engine to integrate virtual content with the real world, including virtual objects, information tags or interactive interface elements of augmented reality. This technology allows the content to be adjusted in real time to respond to changes in the viewer's position and movements, thereby enhancing the viewer's sense of participation and interactivity.

[0030] 2. The present invention uses biometric technology and gesture recognition sensors to capture the audience's body movements and postures in real time, and adjusts the display and interaction methods of virtual content based on these data. This personalized interactive design can enhance the user's sense of participation and experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 A schematic diagram of a flow chart of an intelligent interactive media display method of the present invention;

[0032] Figure 2 A schematic diagram of an intelligent interactive media display system of the present invention;

[0033] Figure 3A schematic diagram of an environment perception system of an intelligent interactive media display system of the present invention;

[0034] Figure 4 A schematic diagram of a mixed reality system of an intelligent interactive media display system of the present invention;

[0035] Figure 5 A schematic diagram of a body sensing system of an intelligent interactive media display system of the present invention;

[0036] Figure 6 A schematic diagram of a personalized system of an intelligent interactive media display system of the present invention;

[0037] Figure 7 A schematic diagram of an effect evaluation system of an intelligent interactive media display system of the present invention;

[0038] Figure 8 A schematic diagram of an interface control system of an intelligent interactive media display system of the present invention;

[0039] Fig. 9 The present invention is a schematic diagram of a network communication module of an intelligent interactive media display system. DETAILED DESCRIPTION

[0040] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0041] See also Figure 1 , the present invention provides a technical solution:

[0042] An intelligent interactive media display method comprises the following steps:

[0043] Step S1, environmental perception, uses sensor technology to perceive the audience's environment in real time, including spatial layout, light conditions and audience position, and analyzes the current audience scene based on environmental perception data to determine the optimal layout and form of the display content;

[0044] Preferably, sensor technology includes but is not limited to infrared sensors, cameras, light sensors, and position trackers.

[0045] Furthermore, the sensor data fusion function expression is as follows:

[0046] [E=f_{sensor}(S_{layout},L_{light},P_{position})]

[0047] Among them, (S_{layout}) represents the spatial layout data, (L_{light}) represents the light condition data, and (P_{position}) represents the audience position data.

[0048] In this step, the sensor data (S_{layout}) (spatial layout), (L_{light}) (lighting conditions), and (P_{position}) (viewer position) are fused into a comprehensive environmental perception data (E).

[0049] Step S2, content generation, based on the results of scene analysis, using mixed reality technology to overlay virtual content on the real world seen by the audience, the virtual content includes virtual objects, information tags or interactive interface elements of augmented reality, and is adjusted in real time to respond to the position changes and movements of the audience, while interactive elements are designed to enhance the audience's sense of participation and interactivity;

[0050] Preferably, mixed reality technology includes but is not limited to augmented reality, virtual reality and mixed reality technology.

[0051] Furthermore, the virtual content overlay function expression is as follows:

[0052] [V_{overlay}=f_{overlay}(E,R_{real})]

[0053] Among them, (R_{real}) represents the audience perspective data in the real world.

[0054] In this step, the function (f_{overlay}) combines the environmental perception data (E) and the audience perspective data in the real world (R_{real}) to generate virtual content (V_{overlay}).

[0055] Step S3, body perception, using biometric technology or gesture recognition sensors to capture the audience's body movements and postures in real time, and adjusting the display and interaction of virtual content according to the body perception data, such as selecting and dragging virtual objects through gestures, or turning the head to browse different perspectives;

[0056] Preferably, biometric recognition technology includes but is not limited to facial recognition, fingerprint recognition and iris recognition, and gesture recognition sensors include but are not limited to accelerometers, gyroscopes and depth cameras.

[0057] Furthermore, the gesture recognition function expression is as follows:

[0058] [M_{pose}=f_{pose}(B_{biometric},S_{sensor})]

[0059] Among them, (B_{biometric}) represents biometric data, including but not limited to facial recognition and fingerprint recognition, and (S_{sensor}) represents gesture recognition sensor data, including but not limited to accelerometer and gyroscope.

[0060] In this step, the function (f_{pose}) uses the biometric data (B_{biometric}) and the pose recognition sensor data (S_{sensor}) to identify the audience's body movements and postures and generate pose information (M_{pose}).

[0061] Step S4: Personalized adjustment: using machine learning algorithms and personalized recommendation systems to customize display content based on audience historical behaviors and real-time feedback, and continuously optimizing display content and interactive design through real-time data analysis of audience interactive behaviors and feedback;

[0062] Preferably, machine learning algorithms include but are not limited to deep learning, reinforcement learning, and recommendation system algorithms.

[0063] Furthermore, the machine learning personalized recommendation function expression is as follows:

[0064] [P_{personalized}=f_{ML}(H_{history},F_{feedback})]

[0065] Among them, (H_{history}) represents the audience's historical behavior data, and (F_{feedback}) represents the real-time feedback data.

[0066] In this step, the function (f_{ML}) uses the audience's historical behavior data (H_{history}) and real-time feedback data (F_{feedback}) to apply machine learning algorithms to generate personalized recommendation content (P_{personalized}).

[0067] Step S5, data analysis, collecting and analyzing audience interaction data, participation, and satisfaction evaluation, and adjusting display content and interactive design based on data analysis results to optimize user experience and meet display goals and needs;

[0068] Preferably, data analysis methods include but are not limited to statistical analysis, data mining and user behavior analysis.

[0069] Furthermore, the user engagement evaluation function expression is as follows:

[0070] [D_{analysis}=f_{analysis}(I_{interaction},S_{satisfaction})]

[0071] Among them, (I_{interaction}) represents audience interaction data, and (S_{satisfaction}) represents satisfaction evaluation data.

[0072] In this step, the function (f_{analysis}) uses the audience's interaction data (I_{interaction}) and satisfaction evaluation data (S_{satisfaction}) to perform data analysis and evaluate the audience's engagement (D_{analysis}).

[0073] like Figure 2-9 As shown, an intelligent interactive media display system includes

[0074] The environment perception system includes a sensor network and a data processing module. The sensor network is used to perceive the environment of the audience in real time. The data processing module is used to process the data collected by the sensor to perform environment analysis and scene recognition.

[0075] A mixed reality system, comprising a content creation tool and a mixed reality engine, wherein the content creation tool is used to design and generate virtual content, and the mixed reality engine is used to merge the virtual content with the real world and to render and display it in real time;

[0076] Preferably, the mixed reality engine supports the integrated application of augmented reality, virtual reality and mixed reality technologies.

[0077] a body sensing system including a biometric device and a gesture recognition sensor, wherein the biometric device is used to capture the biometric characteristics of the audience, the gesture recognition sensor is used to capture the body movements and gestures of the audience, and an interaction design module is used to design an interaction method based on the body sensing data;

[0078] A personalization system, including a machine learning platform and a data analysis platform. The machine learning platform is used to train personalized recommendation models and optimization algorithms, and the data analysis platform is used to collect and analyze audience interaction data for real-time optimization and feedback.

[0079] Preferably, the machine learning platform supports the application of deep learning, reinforcement learning and recommendation system algorithms.

[0080] Furthermore, preferably, the data analysis platform supports the application of statistical analysis, data mining and user behavior analysis methods.

[0081] The effect evaluation system includes a data collection tool and an effect evaluation module. The data collection tool is used to collect audience interaction data, participation and satisfaction evaluation. The effect evaluation module is used to perform quantitative analysis and evaluation of the display effect based on the collected data.

[0082] The interface control system includes a user interface and a control module, which is used to provide an intuitive and easy-to-use interface for administrators to set display content and parameters, as well as to monitor and manage the operating status of the entire display system in real time;

[0083] The network communication module, including the network infrastructure and cloud service platform, is used to ensure unimpeded data transmission and communication between various parts of the system, as well as to support remote management and data storage.

[0084] The specific implementation process based on the above intelligent interactive media display system is as follows:

[0085] Install and configure multiple sensors, such as cameras, sound sensors, and temperature sensors, to cover the entire display area and collect sensor data in real time, including crowd density, ambient light, and sound level;

[0086] Transmit sensor data to the data processing module and use machine learning algorithms or rule engines to perform data analysis and environmental scene recognition, such as detecting the location of people, the direction of movement, and evaluating the impact of ambient light on the display content;

[0087] Use content creation tools to create and edit virtual content, including but not limited to 3D models and special effects animations, import the designed virtual content into the mixed reality engine, use the mixed reality engine to merge the virtual content with the real scenes in the sensor data, and render the virtual content in real time to ensure interaction and viewing effects with the real world;

[0088] Configure biometric devices, including but not limited to facial recognition or fingerprint recognition systems, to identify the identity of the audience, use gesture recognition sensors to capture the audience's body movements and gestures, design interaction methods and trigger conditions based on gestures and biometric data, and enable the audience to interact with virtual content, such as triggering specific scenes or animations through gestures or body movements.

[0089] Collect audience's historical behavior data, feedback and preference information, use machine learning platform to train personalized recommendation model, generate personalized content recommendation or optimize interactive response based on audience data, collect audience's interaction data, engagement and satisfaction evaluation, use data analysis platform to conduct statistical analysis, data mining and user behavior analysis on the collected data, and evaluate the quality of display effect and system performance based on the analysis results.

[0090] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0091] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. An intelligent interactive media display method, characterized in that: The following steps are involved: Step S1, environmental perception, uses sensor technology to perceive the audience's environment in real time, including spatial layout, light conditions and audience position, and analyzes the current audience scene based on environmental perception data to determine the optimal layout and form of the display content; Step S2, content generation, based on the results of scene analysis, using mixed reality technology to overlay virtual content on the real world seen by the audience, the virtual content includes virtual objects, information tags or interactive interface elements of augmented reality, and is adjusted in real time to respond to the position changes and movements of the audience, while interactive elements are designed to enhance the audience's sense of participation and interactivity; Step S3, body perception, using biometric technology or gesture recognition sensors to capture the audience's body movements and postures in real time, and adjusting the display and interaction of virtual content according to the body perception data, such as selecting and dragging virtual objects through gestures, or turning the head to browse different perspectives; Step S4: Personalized adjustment: using machine learning algorithms and personalized recommendation systems to customize display content based on audience historical behaviors and real-time feedback, and continuously optimizing display content and interactive design through real-time data analysis of audience interactive behaviors and feedback; Step S5, data analysis, collects and analyzes the audience's interaction data, participation, and satisfaction evaluation, and adjusts the display content and interaction design based on the data analysis results to optimize the user experience and meet the display goals and needs.

2. The intelligent interactive media display method according to claim 1, characterized in that: In step S1, the sensor technology includes but is not limited to infrared sensors, cameras, light sensors and position trackers.

3. The intelligent interactive media display method according to claim 1, characterized in that: In step S2, mixed reality technology includes but is not limited to augmented reality, virtual reality and mixed reality technology.

4. The intelligent interactive media display method according to claim 1, characterized in that: In step S3, the biometric recognition technology includes but is not limited to facial recognition, fingerprint recognition and iris recognition, and the gesture recognition sensor includes but is not limited to an accelerometer, a gyroscope and a depth camera.

5. The intelligent interactive media display method according to claim 1, characterized in that: In step S4, the machine learning algorithm includes but is not limited to deep learning, reinforcement learning and recommendation system algorithm.

6. The intelligent interactive media display method according to claim 1, characterized in that: In step S5, the data analysis method includes but is not limited to statistical analysis, data mining and user behavior analysis.

7. An intelligent interactive media display system according to any one of claims 1 to 6, characterized in that: include The environment perception system includes a sensor network and a data processing module. The sensor network is used to perceive the environment of the audience in real time. The data processing module is used to process the data collected by the sensor to perform environment analysis and scene recognition. A mixed reality system, comprising a content creation tool and a mixed reality engine, wherein the content creation tool is used to design and generate virtual content, and the mixed reality engine is used to merge the virtual content with the real world and to render and display it in real time; a body sensing system including a biometric device and a gesture recognition sensor, wherein the biometric device is used to capture the biometric characteristics of the audience, the gesture recognition sensor is used to capture the body movements and gestures of the audience, and an interaction design module is used to design an interaction method based on the body sensing data; A personalization system, including a machine learning platform and a data analysis platform. The machine learning platform is used to train personalized recommendation models and optimization algorithms, and the data analysis platform is used to collect and analyze audience interaction data for real-time optimization and feedback. The effect evaluation system includes a data collection tool and an effect evaluation module. The data collection tool is used to collect audience interaction data, participation and satisfaction evaluation. The effect evaluation module is used to perform quantitative analysis and evaluation of the display effect based on the collected data. The interface control system includes a user interface and a control module, which is used to provide an intuitive and easy-to-use interface for administrators to set display content and parameters, as well as to monitor and manage the operating status of the entire display system in real time; The network communication module, including the network infrastructure and cloud service platform, is used to ensure unimpeded data transmission and communication between various parts of the system, as well as to support remote management and data storage.

8. The intelligent interactive media display system according to claim 7, characterized in that: The mixed reality engine supports the integrated application of augmented reality, virtual reality and mixed reality technologies.

9. The intelligent interactive media display system according to claim 7, characterized in that: The machine learning platform supports the application of deep learning, reinforcement learning, and recommendation system algorithms.

10. The intelligent interactive media display system according to claim 7, characterized in that: The data analysis platform supports the application of statistical analysis, data mining and user behavior analysis methods.

Images