Human motion capture interactive light and shadow system based on Internet of Things
Through the Internet of Things-based human motion capture interactive light and shadow system, combined with Kinect and IoT technology, the existing system has solved the problem of insufficient accuracy, real-time and adaptability, and achieved efficient and accurate human motion capture and diversified interactions. Effects enhance user experience and system scalability.
Patent Information
- Application Number
- CN202410969561.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-26
AI Technical Summary
The existing human motion capture system has shortcomings in accuracy, real-time and adaptability, resulting in large errors in captured motion data, affecting user interaction experience, and limited adaptability and flexibility, limiting the application scope and ability of the system. Extensibility.
Adopt the interactive light and shadow system of human motion capture based on the Internet of Things, combining Kinect, interactive sensors, projection devices, ESP32 chips and interactive systems, and capture and analyze human motion in real time through the Internet of Things technology, transmit data and interact light and shadow to achieve personalized interaction Experience and diverse motion capture effects.
It realizes efficient and accurate human motion capture and real-time interactive feedback, enhances the user's immersion and interactive experience, supports collaborative interaction among multiple people, and has a flexible and scalable system architecture to adapt to different scenarios and needs.
Smart Images

Figure HDA0004952754600000011 
Figure HDA0004952754600000021 
Figure HDA0004952754600000031
Abstract
Description
Technical Field
[0001] The present invention relates to the field of human motion capture, and in particular to an interactive light and shadow system for human motion capture based on the Internet of Things. Background Art
[0002] The existing technology relies on sensors to capture human movements, but the sensors are not accurate enough. When obtaining human data, the existing systems often use cameras, motion recognition and other sensors. The accuracy of the sensors may not be high enough, which may lead to certain errors in the captured motion data, affecting the system's accurate perception and feedback of user movements. The real-time performance is insufficient. Some human motion capture systems are insufficient in real time, that is, the system has a high delay in perception and feedback of user movements, which may reduce the user's interactive experience, especially for related applications with high requirements for time and motion accuracy. At the same time, their adaptability and flexibility are poor: some human motion capture systems have limited adaptability and flexibility and can only support specific types of movements or specific scenarios. For other types of movements or more complex scenarios, the system may not be able to meet the needs, limiting the application scope and scalability of the system.
[0003] Therefore, it is necessary to propose an interactive light and shadow system for human motion capture based on the Internet of Things to solve the above problems. Summary of the invention
[0004] The main purpose of the present invention is to provide a human motion capture interactive light and shadow system based on the Internet of Things, which can effectively solve the problems in the background technology.
[0005] To achieve the above object, the technical solution adopted by the present invention is:
[0006] The invention discloses an interactive light and shadow system for capturing human motion based on the Internet of Things, comprising a somatosensory device module, a sensor module, a power module, an Internet of Things module, a server and a light and shadow interactive device, wherein the light and shadow interactive device comprises a kinect, an interactive sensor, a projection device, a light and shadow device, a chip ESP32, an interactive system and a power module, wherein the input ends of the interactive device are electrically connected, the input ends of the interactive sensor and the projection device are connected to the server by signals through the Internet of Things, the input ends of the light and shadow device are connected to the server by signals through the Internet of Things, the output ends are output by receiving scheme instructions, the output ends of the scheme instructions are located at an interactive position, the limb data of tourists are captured by kinect for collection, and the collected images are input into the server, and relevant instructions are issued from the server to the light and shadow device and the projection device, the sensor module is used to transmit the acquired data to the interactive system and the data processing module through the Internet of Things technology, and the interactive system and the data processing module are used to analyze and process the sensor data to determine the behavior, intention and demand of tourists.
[0007] Preferably, the interactive system includes a feedback module, the output end of the feedback module is connected to the input end signal of the server through the Internet of Things, and the output end of the feedback module is electrically connected to the input end of the data processing module, so as to provide a personalized interactive experience in combination with preset interactive devices and interactive content.
[0008] Preferably, the interactive device includes but is not limited to a touch screen, a projection device, a sound device, and corresponding interactive content, including but not limited to audio, video, and games, so that visitors can interact with the system through the interactive device and the presentation of interactive content, and enjoy the interactive experience with the environment, landscape, and other visitors.
[0009] Preferably, the power module is used to first step down the external 12V input voltage to 5V to meet the use of the external interface, and then step down the 5V voltage to 3.3V to meet the use of the chip ESP32 itself.
[0010] Preferably, the Internet of Things module is used to achieve interconnection between various components of the system. The Internet of Things module is based on the connection between sensors and controllers, and is used to obtain environmental data of the light and shadow system in real time, perform data processing and control instruction transmission.
[0011] Beneficial Effects
[0012] Compared with the prior art, the present invention provides a human motion capture interactive light and shadow system based on the Internet of Things, which has the following beneficial effects:
[0013] 1. The human motion capture interactive light and shadow system based on the Internet of Things can accurately and efficiently capture the user's human motion, and has the ability to analyze, identify and process the captured motion data. It can interact with other terminals through the Internet of Things technology, and can combine the data with light and shadow, and project it to the relevant interactive area in real time, so that users can intuitively feel the impact of their movements on light and shadow. The system uses the Internet of Things technology to combine sensors, cameras, cloud computing and other technologies, and can achieve interaction and entertainment experience with users by capturing human motion and generating corresponding light and shadow effects in real time.
[0014] 2. This interactive light and shadow system for human motion capture based on the Internet of Things, Microsoft Kinect is a well-known human motion capture technology that combines an infrared transmitter and an infrared camera to capture the user's movements in real time and convert them into digital signals or virtual models. The technology obtains the user's skeletal information through a depth sensor, and then analyzes and tracks the movements through image processing and pattern recognition algorithms. In addition, by connecting to a TV or computer, the system can render and project the user's motion images in real time.
[0015] 3. The human motion capture interactive light and shadow system based on the Internet of Things, the Internet of Things technology is used to realize the connection and data transmission between multiple devices. Based on this technology, the human motion capture interactive light and shadow system can transmit the motion data to the cloud or other devices for processing and analysis. At the same time, the Internet of Things technology can also realize the interconnection of the system with other devices or terminals, such as control and interaction through mobile applications.
[0016] 4. The human motion capture interactive light and shadow system based on the Internet of Things can use sensor technology to obtain data after capturing human motion. It can be connected to various sensor devices using the Internet of Things technology. These sensor devices can use corresponding actions as trigger points to trigger corresponding light and shadow effects, and can achieve real-time interactive feedback. For example, in scenes such as stage performances and virtual reality games, the movements of characters can trigger corresponding light and shadow changes, enhancing the audience's sense of immersion and interactive experience.
[0017] 5. The human motion capture interactive light and shadow system based on the Internet of Things can perceive the user's movements and postures in real time through sensors and network connections, quickly transmit data to the back-end for processing, and provide real-time feedback to the user, which allows users to immediately see their movements in the virtual environment, enhancing the real-time and immersive nature of the interactive experience. The human motion capture system based on the Internet of Things can support multiple people to perform motion capture and interaction at the same time, realizing a multi-person collaborative interaction scenario.
[0018] 6. The human motion capture interactive light and shadow system based on the Internet of Things can be designed as a flexible and scalable system architecture, supporting the access of multiple sensor devices and the customization of light and shadow effects. Through flexible configuration and combination, it can adapt to different scenarios and needs and create a variety of human motion capture interactive light and shadow effects. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 is a system block diagram of the present invention;
[0020] Figure 2 It is a system block diagram of the main control chip of the present invention;
[0021] Figure 3 is a software diagram of the present invention;
[0022] Figure 4 is a remote interaction schematic diagram of the present invention;
[0023] Figure 5 It is the interactive light and shadow page diagram of the present invention;
[0024] Figure 6 It is a power module diagram of the present invention;
[0025] Figure 7 It is a power module diagram of the present invention;
[0026] Figure 8 It is a module diagram of the somatosensory device of the present invention. DETAILED DESCRIPTION
[0027] In order to make the technical means, creative features, objectives and effects achieved by the present invention easy to understand, the present invention is further explained below in conjunction with specific implementation methods.
[0028] like Figure 1-Figure 8As shown, a human motion capture interactive light and shadow system based on the Internet of Things includes a somatosensory device module, a sensor module, a power module, an Internet of Things module, a server and a light and shadow interactive device. The light and shadow interactive device includes kinect, an interactive sensor, a projection device, a light and shadow device, a chip ESP32, an interactive system, and a power module. The input ends of the interactive devices are electrically connected, the input ends of the interactive sensor and the projection device are connected to the server by signals through the Internet of Things, the input ends of the light and shadow device are connected to the server by signals through the Internet of Things, the output ends are output by receiving program instructions, and the output ends of the program instructions are located at the interactive position. The limb data of the tourists is captured by kinect for collection, and the collected images are input into the server. When the relevant instructions are issued from the server to the light and shadow device and the projection device, the sensor module is used to transmit the acquired data to the interactive system and the data processing module through the Internet of Things technology. The interactive system and the data processing module are used to analyze and process the sensor data. Determine the behavior, intention and demand of tourists. The interactive system includes a feedback module. The output end of the feedback module is connected to the input end signal of the server through the Internet of Things. The output end of the feedback module is electrically connected to the input end of the data processing module, which is used to combine preset interactive devices and interactive content to provide personalized interactive experience. The interactive devices include but are not limited to touch screens, projection devices, sound devices, and corresponding interactive content, including but not limited to audio, video, and games. Through the presentation of interactive devices and interactive content, tourists can interact with the system and enjoy the interactive experience with the environment, landscape and other tourists. The power module is used to first reduce the external 12V input voltage to 5V to meet the use of the external interface, and then reduce the 5V voltage to 3.3V to meet the use of the chip ESP32 itself. The Internet of Things module is used to realize the interconnection between the various components of the system. The Internet of Things module is based on the connection between sensors and controllers, and is used to obtain the environmental data of the light and shadow system in real time, and to process data and transmit control instructions.
[0029] It should be noted that the present invention is a human motion capture interactive light and shadow system based on the Internet of Things. When using the data processing module, it is necessary to initialize each module first, which includes configuring communication parameters to ensure smooth communication between the system and other devices. At the same time, it is necessary to configure sensor parameters according to different environments and application requirements to adapt to various situations. In addition, it is also necessary to initialize the hardware device, allocate necessary resources to it and set the initial state. After the initialization is completed, the system will check the wireless status to determine whether a wireless connection is required. If the wireless status is good and the connection is successful, the system will upload the status information to the PC and start the preset device. In the interactive platform, special effects can be made in advance, and the audio and video signals are converted into digital signals through the data processing module. These digital signals are processed by the operation The processing module and the data calculation module perform corresponding processing and calculation, and then the data storage device can perform backup storage. Through the data output module, the digital signal can be transmitted, and the processor can control the interactive system to send corresponding instructions to tourists to achieve interactive effects. At the same time, the Kinect sensor can be used to collect and read the data of tourists' body movements. The read body movement information is converted into recognizable signals through the ESP32 module and uploaded to the server for further processing and analysis. When the server receives specific instructions, it will send these instructions to the interactive device and the light and shadow device. The interactive device will perform corresponding actions or operations according to the instructions, such as displaying special effects, playing audio, etc. The light and shadow device will adjust the light and shadow effects according to the instructions to achieve the expected visual effect.
[0030] like Figure 4As shown, the interactive schematic diagram includes two parts: a switch light and shadow system and an interactive light and shadow system. The switch light and shadow system mainly includes a human body capture module, an interactive light and shadow module, a somatosensory device module and an interactive device module. The interactive light and shadow system mainly includes an LED brightness module, a human body distance module, a temperature module and a humidity module. By using this system and method, it is possible to increase light and shadow effects and interactive experience in the schematic diagram scene, enhance visual effects and user participation, and the human body capture module is used to capture the movement and posture information of the human body in the scene; the interactive light and shadow module controls the brightness, color and direction of the light source, as well as the shape and position of the shadow according to the information obtained by the human body capture module, so as to achieve adjustment and interaction of light and shadow effects. Feedback, somatosensory device module: used to perceive the contact, pressure, weight and other information of objects in the scene, or perceive parameters such as temperature and humidity of the environment; interactive device module: used for interactive input and output between users and the system, including input devices such as buttons, touch screens, sound sensors, and output devices such as speakers and projectors; LED brightness module: controls the brightness of LED lights to adjust the light source; human distance module: senses the distance between the human body and the system, and triggers specific light and shadow effects or interactive behaviors according to set rules; temperature module: perceives the temperature parameters of the environment, and adjusts the light and shadow effects or interactive behaviors according to the temperature value; humidity module: perceives the humidity parameters of the environment, and adjusts the light and shadow effects or interactive behaviors according to the humidity value.
[0031] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.
Claims
1. A human motion capture interactive light and shadow system based on the Internet of Things, comprising a somatosensory device module, a sensor module, a power module, an Internet of Things module, a server and a light and shadow interactive device, characterized in that: The light and shadow interactive device includes kinect, interactive sensor, projection device, light and shadow device, chip ESP32, interactive system, power module, the input ends of the interactive device are electrically connected, the input ends of the interactive sensor and the projection device are connected to the server by signal through the Internet of Things, the input end of the light and shadow device is connected to the server by signal through the Internet of Things, the output end is output by receiving a program instruction, the output end of the program instruction is located at the interactive position, the body data of the tourists is captured by kinect for collection, and the collected images are input into the server, and the relevant instructions are issued from the server to the light and shadow device and the projection device. The sensor module is used to transmit the acquired data to the interactive system and the data processing module through the Internet of Things technology, and the interactive system and the data processing module are used to analyze and process the sensor data to determine the behavior, intention and needs of the tourists.
2. The human motion capture interactive light and shadow system based on the Internet of Things according to claim 1, characterized in that: The interactive system includes a feedback module, the output end of the feedback module is connected to the input end signal of the server through the Internet of Things, and the output end of the feedback module is electrically connected to the input end of the data processing module, so as to provide a personalized interactive experience in combination with preset interactive devices and interactive content.
3. The human motion capture interactive light and shadow system based on the Internet of Things according to claim 2, characterized in that: The interactive devices include but are not limited to touch screens, projection devices, sound devices, and corresponding interactive content, including but not limited to audio, video, and games. Through the presentation of interactive devices and interactive content, visitors can interact with the system and enjoy the interactive experience with the environment, landscape, and other visitors.
4. The human motion capture interactive light and shadow system based on the Internet of Things according to claim 1, characterized in that: The power module is used to first step down the external 12V input voltage to 5V to meet the use of the external interface, and then step down the 5V voltage to 3.3V to meet the use of the chip ESP32 itself.
5. The human motion capture interactive light and shadow system based on the Internet of Things according to claim 1, characterized in that: The Internet of Things module is used to realize the interconnection between the components of the system. The IoT module is based on the connection between sensors and controllers to obtain the environmental data of the light and shadow system in real time. Perform data processing and control instruction transmission.
