Infrared induction intelligent interactive projection large screen and ground screen holographic device

Abstract

The invention provides an infrared induction intelligent interactive projection large screen and ground screen holographic device, and relates to the technical field of intelligent display interaction. The equipment is composed of a large projection screen, a ground screen, an infrared induction device, a data processing host, a feature extraction and intention recognition module, an environment perception and adaptive adjustment module and an intelligent feedback and multi-mode interaction fusion module, and the large projection screen is used for displaying holographic images and has the functions of high brightness, wide color gamut and touch control; the ground screen is made of a transparent holographic imaging material, can synchronously display interaction information and has a touch sensing function, and the infrared sensing device captures three-dimensional action information of a user through an emitter and a receiver which are arranged in a matrix mode. The problems that a traditional display device is poor in interaction experience and single in display effect are solved, natural and smooth long-distance human body action interaction and immersive visual experience are achieved, and the system is suitable for many fields such as science and technology exhibition, commercial exhibition and intelligent education.

Description

Technical Field

[0001] This invention relates to the field of intelligent display and interactive technology, specifically to infrared sensing intelligent interactive projection screens and floor holographic devices. Background Technology

[0002] In existing technologies, traditional projection display devices and floor screens typically operate as independent units, resulting in poor interactivity between them. Taking a common projector and floor projection device as an example, the projector is primarily responsible for projecting images or video content onto the screen, while the floor screen is usually used to display auxiliary information or static patterns related to the projected content. This separate structure and working principle means that users need to operate different devices separately when interacting with the projection system, making it difficult to achieve a seamless interactive experience.

[0003] Currently, projection equipment and floor-mounted display devices on the market have certain limitations in terms of interactive functions and display effects. On the one hand, the interaction methods of traditional projection equipment are relatively simple, usually relying on manual touch screen or remote control operation. This method cannot meet the interactive needs of users in long-distance or non-contact scenarios. On the other hand, although floor-mounted display devices can enhance the visual effect of the display to a certain extent, their displayed content often lacks close synchronization and interactivity with the large projection screen, resulting in an overall display effect that is not coherent and vivid. In addition, existing projection and floor-mounted devices are not adaptable enough to environmental changes. The display effect is greatly reduced under different lighting conditions, and they cannot automatically adjust their brightness and color performance according to the intensity of ambient light, affecting the user experience. Moreover, the devices do not understand the user's intentions accurately enough, making it difficult to implement complex interactive logic, which limits the application scope of the devices in intelligent interactive scenarios. Summary of the Invention

[0004] (a) Technical problems to be solved

[0005] To address the shortcomings of existing technologies, this invention provides an infrared sensing intelligent interactive projection screen and floor holographic device, which solves the problems mentioned in the background technology.

[0006] (II) Technical Solution

[0007] To achieve the above objectives, the present invention provides the following technical solution: an infrared-sensing intelligent interactive projection screen and floor screen holographic device, comprising a projection screen, a floor screen, an infrared sensing device, a data processing host, a feature extraction and intent recognition module, an environmental perception and adaptive adjustment module, and an intelligent feedback and multimodal interaction fusion module. The projection screen is characterized in that it displays holographic images, has a first display area and a first touch function, and can adjust the displayed content in real time according to the user's touch operation and interaction commands; the projection screen also has an adaptive display mode switching function, which can automatically switch display modes according to ambient light and user interaction preferences.

[0008] The ground screen is used to synchronously display interactive information and holographic effects related to the projection screen. It has a second display area and a second touch function, which can respond to the user's touch operation and provide feedback on interactive information. The ground screen also has a dynamic display effect adjustment function, which can adjust the display effect in real time according to the user's action characteristics and environmental information.

[0009] The infrared sensing device includes multiple infrared transmitters and infrared receivers for capturing user motion information in three-dimensional space. The infrared sensing device can sense the speed, force, direction and position of the user's motion in real time and convert the motion information into electrical signals. The infrared sensing device also has an adaptive calibration function, which can automatically adjust the sensing parameters according to environmental changes.

[0010] The data processing host is connected to the projection screen, the floor screen and the infrared sensing device respectively. It is used to receive and process the electrical signals transmitted by the infrared sensing device, analyze the user's intention and generate corresponding control commands to control the display content and display effect of the projection screen and the floor screen. The data processing host also has an intelligent learning function, which can continuously optimize the analysis algorithm and response strategy according to the user's interactive behavior.

[0011] The feature extraction and intent recognition module is used to extract feature parameters from the action information and identify the user's interaction intent by combining the user's interaction history and environmental information. The feature extraction and intent recognition module can also adjust the personalized intent recognition and response strategy according to the different user's operating habits and preferences.

[0012] The environmental perception and adaptive adjustment module is used to perceive environmental information around the device in real time, including ambient light, ambient noise, temperature, humidity, etc., and automatically adjust the display parameters of the projection screen and the ground screen, as well as the working parameters of the infrared sensing device, according to the environmental information to ensure the best display effect and interactive experience of the device in different environments.

[0013] The intelligent feedback and multimodal interaction fusion module is used to generate corresponding intelligent feedback based on the user's interaction behavior and environmental information, including visual feedback, auditory feedback, tactile feedback, etc., and to integrate infrared sensing interaction with other interaction methods (such as voice interaction, gesture interaction, touch interaction, etc.) to achieve natural and smooth multimodal interaction. The intelligent feedback and multimodal interaction fusion module also has a real-time feedback strategy adjustment function, which can adjust the feedback method and intensity in real time according to the user's reaction and environmental changes.

[0014] Preferably, the projection screen adopts ultra-high-definition resolution projection technology, with a brightness set to 3000-4500 lumens, a color gamut coverage of 90%-95% NTSC, and supports multi-touch interaction. Its display screen can be dynamically adjusted according to the user's actions and environmental information, such as automatically switching display modes, automatically adjusting the screen layout and content presentation, etc., to adapt to different interaction scenarios and user needs.

[0015] Preferably, the floor screen is made of transparent holographic imaging material with a display viewing angle of 160° and a light transmittance of 80%. It can synchronously and interactively display the content of the projection screen and has a touch sensing function to respond to the user's touch action. The floor screen can also adjust the display effect in real time according to the user's action characteristics and environmental information, such as increasing the display brightness and contrast when the user approaches and reducing energy consumption while maintaining a basic display state when the user moves away, thus achieving a balance between intelligent energy saving and display optimization.

[0016] Preferably, the infrared sensing devices are arranged in a matrix, with an adjustable sensing distance of 0.5m-5m and a sensing accuracy of ≤±2mm. They are used to capture the user's movement trajectory in three-dimensional space and transmit the movement data in real time. At the same time, the infrared sensing devices have the ability to identify and track multiple users, and can simultaneously track the movements of at least 10 independent users, distinguish and mark the movements of different users, and realize multi-user collaborative interaction and personalized response.

[0017] Preferably, the data processing host has a built-in high-performance processor and graphics processing chip with a processing latency of ≤30ms. It has powerful real-time data processing and screen rendering capabilities, and can simultaneously handle interactive information from multiple users and rendering tasks of complex scenes, ensuring the smoothness and synchronization of screen interaction. The data processing host also has fault diagnosis and self-repair functions, and can monitor the device's operating status in real time, promptly detect and handle faults, and ensure the stable operation of the device.

[0018] Preferably, the feature extraction and intent recognition module adopts deep learning algorithms and big data analysis technology, which can extract key features and mine potential intents from user interaction data. Its intent recognition accuracy is ≥90% and the response speed is ≤100ms. The feature extraction and intent recognition module also has the ability to learn and continuously optimize itself, and can continuously accumulate experience as the device is used to improve the accuracy and efficiency of intent recognition.

[0019] Preferably, the environmental perception and adaptive adjustment module includes multiple high-precision sensors that can perceive environmental information around the device in real time and automatically adjust the display parameters of the projection screen and the floor screen, as well as the working parameters of the infrared sensing device, according to a preset environmental model and adaptive algorithm. Its environmental adaptability covers a variety of complex indoor and outdoor environmental conditions, ensuring the best display effect and interactive experience of the device in different environments. The environmental perception and adaptive adjustment module also has an environmental prediction function, which can adjust the device parameters in advance according to the trend of environmental changes, providing users with detailed environmental adaptation strategies and parameter adjustment basis.

[0020] Preferably, the intelligent feedback and multimodal interaction fusion module can generate rich intelligent feedback based on the user's interactive behavior and environmental information, including but not limited to changes in light and shadow, animation effects, holographic effects, voice prompts, sound effects, background music, vibration, airflow, etc. Its feedback method and intensity can be adjusted in real time according to the user's reaction and environmental changes to enhance the user's immersion and interactive experience. The intelligent feedback and multimodal interaction fusion module also has the function of linkage with other intelligent devices, which can realize multi-device collaborative interaction and feedback, further expanding the application scenarios and interaction methods of the devices.

[0021] (III) Beneficial Effects

[0022] This invention provides an infrared sensing intelligent interactive projection screen and floor screen holographic device, which has the following beneficial effects:

[0023] 1. This invention achieves natural and smooth long-distance human body movement interaction through infrared sensing technology. Users can accurately control the content of the projection screen and the ground screen through gestures and body movements within a certain distance without touching the device.

[0024] 2. This projection screen and floor screen utilize holographic display technology, enabling close synchronization and interactive display. The projection screen displays the main holographic image, while the floor screen synchronously presents relevant interactive information and extended holographic effects. Together, they create a coherent and vivid visual experience for the user. Compared to traditional single-screen display devices, this multi-screen interactive holographic display method significantly enhances the three-dimensionality, immersion, and appeal of the displayed content.

[0025] 3. This device integrates environmental sensing and adaptive adjustment functions. By sensing ambient light, noise, and other information in real time, it automatically adjusts the display parameters of the projection screen and floor screen, as well as the operating parameters of the infrared sensor. Compared with existing devices with fixed display parameters, this device can maintain optimal display effects and interactive performance under different environmental conditions. Attached Figure Description

[0026] Figure 1 This is a schematic diagram of the structure of the present invention;

[0027] Figure 2 This is a schematic diagram of the process of the present invention. Detailed Implementation

[0028] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0029] Example 1:

[0030] like Figure 1-2 As shown, this embodiment of the invention provides an infrared-sensing intelligent interactive projection screen and floor screen holographic device, including a projection screen, a floor screen, an infrared sensing device, a data processing host, a feature extraction and intent recognition module, an environmental perception and adaptive adjustment module, and an intelligent feedback and multimodal interaction fusion module.

[0031] The installation method for this device is as follows:

[0032] S1. Select an ultra-high-definition projection screen of suitable size and resolution, and fix it on the wall or a dedicated bracket in the display area, ensuring that it is horizontal and stable. Adjust the vertical and horizontal angles of the projection screen so that the projected image can accurately cover the predetermined area, while ensuring that the image is clear and distortion-free. Connect the power cord and data transmission cable, turn on the projection screen, and adjust the basic display parameters through the built-in menu. Set the initial brightness to 3000 lumens and the color gamut coverage to 90% NTSC to meet the needs of a typical display environment. Further fine-tuning can be performed according to the actual usage scenario.

[0033] S2. On the ground of the display area, lay a transparent holographic imaging material floor screen according to the design dimensions, ensuring that its surface is flat, free of bubbles and scratches, and that there are no gaps between adjacent splices, in order to achieve the best holographic display effect. The installation frame of the floor screen must have sufficient strength and stability to withstand a certain amount of stepping pressure without deformation. The power and data interfaces of the floor screen are connected to the main control system. Initially test its display function to enable it to have basic image display capabilities. The initial display viewing angle is set to 160° and the light transmittance is set to 80% to ensure that the image is clearly visible when viewing the floor screen from different angles, and does not affect the light penetration of the space below the ground.

[0034] S3. Install multiple infrared transmitters and receivers in a matrix layout in front of the projection screen and around the floor screen to form an infrared sensing device. Determine the spacing between the transmitters and receivers according to the size of the display area and the expected sensing range. Generally, the horizontal and vertical spacing is set to 0.5-1 meters. Connect the infrared sensing device to the signal input port of the data processing host and set the basic sensing parameters. Set the initial sensing distance to 2 meters and adjust the sensing accuracy to within ±2mm to ensure that the user's subtle movements in three-dimensional space can be accurately captured, laying the foundation for subsequent complex interactive functions.

[0035] S4. Place the data processing host in the control cabinet or a relatively concealed location in the display area, ensuring good heat dissipation and a stable power supply. Connect the data transmission lines of the projection screen, floor screen, and infrared sensor to the corresponding interfaces of the data processing host. Configure communication through a dedicated data transmission protocol to ensure stable, fast, and error-free data transmission between each device and the host. Install and configure a high-performance processor and graphics processing chip inside the data processing host, and optimize the operating system and related drivers to enable it to efficiently handle interactive information from multiple users and rendering tasks of complex scenes. The initial processing latency should be controlled within 30ms to ensure a smooth interactive experience.

[0036] S5. Integrate a feature extraction and intent recognition module into the data processing host. This module uses a combination of deep learning algorithms and big data analysis technology to preprocess the collected user action data, extract key feature parameters, and build a user interaction behavior feature library. At the same time, combined with the user's interaction history data and environmental information, it uses machine learning models to identify and predict the user's interaction intent. The initial intent recognition accuracy can reach more than 85%, and the response speed is controlled within 100ms. By continuously optimizing the algorithm and updating the feature library, the adaptability to different user operating habits and preferences is improved, realizing personalized intent recognition and accurate response.

[0037] S6. Install multiple high-precision environmental sensors around the display area and at key locations on the equipment to form an environmental perception and adaptive adjustment module. Connect these sensors to the data processing host and use dedicated environmental perception software to monitor and analyze the collected environmental data in real time. Based on the preset environmental model and adaptive algorithm, automatically adjust the display parameters of the projection screen and the floor screen as well as the working parameters of the infrared sensing device, so that the equipment can always maintain the best display effect and interactive performance under different environmental conditions.

[0038] S8. Integrate an intelligent feedback and multimodal interaction fusion module (labeled 8) into the data processing host. This module can generate various forms of intelligent feedback based on user interaction behavior and environmental information, and perform deep fusion. Through reasonable interaction logic and information fusion strategy, it can achieve natural and smooth multimodal interaction. In addition, this module also has a real-time feedback strategy adjustment function, which can dynamically adjust the feedback method and intensity according to the user's immediate reaction and environmental changes to meet the needs and preferences of different users.

[0039] After completing the hardware assembly and basic debugging of the above parts, the entire system is tested and debugged to ensure that the devices work together normally and that all functional indicators meet the expected requirements, thus completing the installation and debugging of the device.

[0040] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. Infrared sensing intelligent interactive projection screen and floor holographic device, including: The projection screen, floor screen, infrared sensing device, data processing host, feature extraction and intent recognition module, environmental perception and adaptive adjustment module, and intelligent feedback and multimodal interaction fusion module are characterized in that: the projection screen is used to display holographic images, has a first display area and a first touch function, and can adjust the display content in real time according to the user's touch operation and interaction command; The ground screen is used to synchronously display interactive information and holographic effects related to the projection screen. It has a second display area and a second touch function, and can respond to the user's touch operation and provide feedback on interactive information. The infrared sensing device includes multiple infrared transmitters and infrared receivers, used to capture the user's motion information in three-dimensional space; The data processing host is connected to the projection screen, the floor screen and the infrared sensing device respectively. It is used to receive and process the electrical signals transmitted by the infrared sensing device, analyze the user's intention and generate corresponding control commands to control the display content and display effect of the projection screen and the floor screen. The feature extraction and intent recognition module is used to extract feature parameters from the action information and identify the user's interaction intent by combining the user's interaction history and environmental information. The environmental perception and adaptive adjustment module is used to perceive the environmental information around the device in real time, and automatically adjust the display parameters of the projection screen and the ground screen, as well as the working parameters of the infrared sensing device, according to the environmental information. The intelligent feedback and multimodal interaction fusion module is used to generate corresponding intelligent feedback based on the user's interaction behavior and environmental information, and to integrate infrared sensing interaction with other interaction methods to achieve natural and smooth multimodal interaction.

2. The infrared sensing intelligent interactive projection screen and floor screen holographic device according to claim 1, characterized in that, The projection screen has a brightness of 3000-4500 lumens, a color gamut coverage of 90%-95% NTSC, supports multi-touch interaction, and its display can be dynamically adjusted according to the user's actions and environmental information.

3. The infrared sensing intelligent interactive projection screen and floor holographic device according to claim 1, characterized in that, The floor screen is made of transparent holographic imaging material with a 160° viewing angle and 80% light transmittance. It also has a touch-sensing function, which can respond to the user's touch action. The floor screen can also adjust the display effect in real time according to the user's action characteristics and environmental information.

4. The infrared sensing intelligent interactive projection screen and floor holographic device according to claim 1, characterized in that, The infrared sensing devices are arranged in a matrix, with an adjustable sensing distance of 0.5m-5m and a sensing accuracy of ≤±2mm. They are used to capture the user's movement trajectory in three-dimensional space and transmit the movement data in real time. At the same time, the infrared sensing devices have the ability to identify and track multiple users, and can simultaneously track the movements of at least 10 independent users and distinguish and mark the movements of different users.

5. The infrared sensing intelligent interactive projection screen and floor screen holographic device according to claim 1, characterized in that, The data processing host has a built-in high-performance processor and graphics processing chip, which can simultaneously handle interactive information from multiple users and rendering tasks of complex scenes, ensuring the smoothness and synchronization of screen interaction.

6. The infrared sensing intelligent interactive projection screen and floor screen holographic device according to claim 1, characterized in that, The feature extraction and intent recognition module uses deep learning algorithms and big data analysis technology to extract key features and uncover potential intents from user interaction data.

7. The infrared sensing intelligent interactive projection screen and floor screen holographic device according to claim 1, characterized in that, The environmental perception and adaptive adjustment module includes multiple high-precision sensors that can perceive environmental information around the device in real time. Based on a preset environmental model and adaptive algorithm, it automatically adjusts the display parameters of the projection screen and the floor screen, as well as the operating parameters of the infrared sensing device. The environmental perception and adaptive adjustment module also has an environmental prediction function, which can adjust the device parameters in advance according to the trend of environmental changes, providing users with detailed environmental adaptation strategies and parameter adjustment basis.

8. The infrared sensing intelligent interactive projection screen and floor holographic device according to claim 1, characterized in that, The intelligent feedback and multimodal interaction fusion module can generate rich intelligent feedback based on the user's interaction behavior and environmental information. Its feedback method and intensity can be adjusted in real time according to the user's reaction and environmental changes.

Images