A three-dimensional electronic sandbox based on gesture recognition

Through a three-dimensional electronic sandbox based on gesture recognition, the terrain lifting and display control system is combined with gesture interaction to solve the problems of insufficient projection range and authenticity in existing technologies, realize three-dimensional terrain simulation and rich interactive experience, and improve the user's operating efficiency and immersion.

CN120388506BActive Publication Date: 2025-09-16BEIJING AOTEWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510875645.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-06-27
Publication Date
2025-09-16
Estimated Expiration
2045-06-27

AI Technical Summary

Technical Problem

The existing 3D electronic sandbox has problems such as limited projection range, insufficient scene realism and insufficient interactive experience, and is unable to fully display terrain details and achieve 3D interaction.

Method used

A three-dimensional electronic sandbox based on gesture recognition is used. Through the terrain lifting control system, display control system and gesture interaction system, combined with a high-resolution infrared camera and LED infrared light source, hand movements are captured to generate 3D gesture data, and the lifting and lighting effects of the LED display blocks are controlled to achieve three-dimensional terrain simulation and interaction.

Benefits of technology

It provides more realistic terrain simulation and rich interactive experience. Users can quickly complete complex commands through simple gestures, improving work efficiency and user experience. It supports multiple gestures and enhances user immersion and interactivity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120388506B_ABST
    Figure CN120388506B_ABST
Patent Text Reader

Abstract

The present invention discloses a three-dimensional electronic sandbox based on gesture recognition. The gesture interaction system of the present invention allows users to quickly complete complex command operations through simple gestures without having to find and click buttons or menus on the screen. The efficient interaction method can greatly improve the user's work efficiency and usage experience. The gesture interaction system supports a variety of gestures, including clicking, sliding, pinching, rotating and other rich gestures, providing users with more diversified operation methods, thereby meeting the needs of users in different scenarios and obtaining a better interactive experience in conjunction with the three-dimensional electronic sandbox. The terrain lifting control system and the display control system provide the sandbox with a more realistic terrain simulation. By controlling the lifting and lowering through the motor, the three-dimensional electronic sandbox can more accurately simulate the changes in terrain and topography, and display terrain changes, geographic information, etc. in real time, with a vivid display effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of new generation information technology, and in particular to a three-dimensional electronic sandbox based on gesture recognition. Background Art

[0002] As an important part of the modern geographic information display and decision support system, the 3D electronic sand table integrates a number of high-tech technologies such as advanced 3D modeling, geographic data transmission, virtual simulation, gesture interaction, multimedia display and system integration, providing an intuitive and highly interactive information display platform for urban planning, military exercises, education and training, disaster simulation and other fields.

[0003] However, the existing three-dimensional electronic sandbox has the following shortcomings: 1. Due to the limitation of screen size or projection range, it is impossible to fully display all details, making it difficult for users to observe and grasp the relationship between the whole and the part, which only affects the comprehensiveness and accuracy of the information. 2. The constructed scene lacks authenticity and is basically limited to flat display images, which cannot form a three-dimensional sense of layering, affecting the user's understanding and judgment of the displayed content. 3. The interactive experience is limited. Traditional electronic sandboxes mainly use flat touch interaction technology. Users cannot control the sandbox based on three-dimensional gestures to obtain a more realistic and rich interactive experience. Based on the above shortcomings, there is an urgent need for a more reasonable three-dimensional electronic sandbox to meet the needs of existing technologies. Summary of the Invention

[0004] In view of the shortcomings of the above-mentioned technologies, such as the limited projection range of the three-dimensional sand table, insufficient scene authenticity and three-dimensional sense, inability to interact with the electronic sand table, and inability to control the display function of the electronic sand table, the present invention provides a three-dimensional electronic sand table based on gesture recognition.

[0005] To achieve the above object, the present invention provides a three-dimensional electronic sandbox based on gesture recognition, comprising:

[0006] The terrain lifting control system is used to simulate the changes in terrain and build a three-dimensional model of the corresponding terrain according to the parameters transmitted by the terrain data processing system;

[0007] Display control system, used to simulate texture, color, light and shadow characteristics corresponding to the terrain;

[0008] A gesture interaction system, which uses gesture sensors to capture and track a person's hands, extracts hand feature information, and converts it into control instructions for 3D gesture data, and uses the 3D gesture data to control the terrain lifting control system and the display control system;

[0009] A terrain data processing system is used to obtain terrain data and process, convert and map it into lifting control parameters and corresponding texture feature parameters of a three-dimensional electronic sand table;

[0010] The main control system is used to receive and analyze 3D gesture data to identify control instructions of the 3D gesture data, and regulate the terrain lifting control system and the display control system according to the control instructions and parameters of the terrain data processing system.

[0011] As an improved solution of the present invention, the gesture sensor includes at least two high-resolution infrared cameras and at least three LED infrared light sources. The LED infrared light sources are used to emit infrared rays toward the hand. The infrared cameras receive reflected light from the hand and acquire an image of the hand. 3D gesture data is generated based on the hand's position, gesture, and movement to establish a hand model.

[0012] As an improved solution of the present invention, the hand feature information includes the hand's motion trajectory, motion speed and motion posture. The motion trajectory is generated by establishing a spatial coordinate system based on the position of the hand in the spatial coordinate system; the motion speed is obtained through the hand's motion stroke and motion time; and the motion posture is judged based on the position of the hand's finger endpoints.

[0013] As an improved solution of the present invention, a frame object and ID library are established. The frame object is the target object in a frame image currently within the visual range of the gesture sensor. The ID library stores the IDs associated with the target objects, including hands, fingers, objects with endpoints, and gestures. The gesture recognition system matches the collected gestures based on the information in the ID library to generate corresponding control instructions.

[0014] As an improvement to the present invention, a frame motion is established. The frame motion is the movement change of displacement, rotation, scale, and shape of the target object. The corresponding control instruction is obtained according to the movement trend of the frame motion combined with the frame object and ID library.

[0015] As an improved solution of the present invention, the display control system includes a matrix display screen composed of multiple independent LED display blocks, and the terrain lifting control system includes a drive motor for controlling the lifting of the LED display blocks. The LED display blocks use different colors and tones to represent different heights and terrain features. The brightness and contrast of the LED display blocks are adjusted to simulate real light and shadow effects, and the drive motor adjusts the height of the LED display blocks.

[0016] As an improved solution of the present invention, the lifting height range of the LED display block includes 0-250 mm, wherein 0 mm and 250 mm are the lowest point and the highest point of the LED display block respectively.

[0017] As an improved solution of the present invention, the terrain data processing system transmits data through a network protocol and converts and maps parameter data of the terrain and topography according to a dedicated data module.

[0018] As an improved solution of the present invention, the main control system includes a gesture recognition processing chip and a terrain data processing chip. The gesture recognition processing chip analyzes the hand feature information and converts gesture movements into gesture control instructions to regulate the display control system and the terrain lifting control system; the terrain data processing chip receives the lifting control parameters and texture feature parameters transmitted by the terrain data processing system and converts them into terrain control instructions to regulate the display control system and the terrain lifting control system.

[0019] The present invention also provides a three-dimensional electronic sandbox control method based on gesture recognition, comprising the following steps:

[0020] S1, obtaining topographic data, constructing a 3D model that matches the topographic data on a 3D electronic sand table, and generating texture, color, and light and shadow features corresponding to the topographic data on the 3D model;

[0021] S2, based on the gesture sensor, collects 3D gesture data in real time and converts the 3D gesture data into corresponding control instructions through the main control chip;

[0022] S3, according to the control instruction, the main control chip controls the three-dimensional electronic sand table to transform into the terrain corresponding to the control instruction.

[0023] The beneficial effects of the present invention are: compared with the existing technology, the present invention provides a three-dimensional electronic sand table based on gesture recognition. The gesture interaction system of the present invention allows users to quickly complete complex command operations through simple gestures without having to find and click buttons or menus on the screen. The efficient interaction method can greatly improve the user's work efficiency and usage experience. The gesture interaction system supports a variety of gestures, including clicking, sliding, pinching, rotating and other rich gestures, providing users with more diversified operation methods, thereby meeting the needs of users in different scenarios, and cooperating with the three-dimensional electronic sand table to obtain a better interactive experience. The terrain lifting control system and the display control system provide the sand table with a more realistic terrain simulation. By controlling the lifting and lowering through the motor, the three-dimensional electronic sand table can more accurately simulate the changes in terrain and topography, and display terrain changes, geographic information, etc. in real time, and the display effect is vivid and vivid. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a functional connection diagram of the modules of the present invention;

[0025] Figure 2 This is a schematic diagram of the three-dimensional electronic sandbox of the present invention;

[0026] Figure 3 Schematic diagram of the three-dimensional electronic sandbox and gesture interaction platform of the present invention.

[0027] The main component symbols are described as follows:

[0028] 1. 3D electronic sandbox; 2. Gesture interaction platform. DETAILED DESCRIPTION

[0029] In order to more clearly illustrate the present invention, the present invention will be further described below with reference to the accompanying drawings.

[0030] In the following description, example details are provided to provide a deeper understanding of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. It should be understood that the specific embodiments are only used to illustrate the present invention and are not intended to limit the present invention.

[0031] It should be understood that when the terms "comprise" and / or "include" are used in this specification, they indicate the presence of the stated features, integers, steps, operations, elements or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components or combinations thereof.

[0032] See also Figure 1 The present invention provides a three-dimensional electronic sandbox based on gesture recognition, comprising:

[0033] The terrain elevation control system is used to simulate changes in terrain and topography. Based on the parameters transmitted by the terrain data processing system, it constructs and simulates the corresponding terrain and topography. The terrain and topography mainly refer to landform features in the real world, such as mountains, basins, oceans, deserts, hills, plateaus, glaciers, etc., to achieve a degree of matching with the real world.

[0034] The display control system is used to create light and shadow effects corresponding to the actual terrain and improve the simulation effect; the display control system is mainly used to reflect the texture characteristics of the terrain, use different colors or tones to represent different heights or terrain features, use dark colors to represent low terrain, and use light colors to represent high terrain. The three-dimensional sense of the terrain display is increased by switching between dark and light colors. At the same time, virtual light sources and shadow effects are added to the terrain model to simulate sunlight, so as to achieve an effect closer to the real-world landscape. This is achieved by adjusting the brightness and contrast, and the terrain features can also be made more prominent. At the same time, geological textures and maps are applied to the terrain model to simulate different surface features, such as mountains, forests, waters, etc., and the display content is dynamically displayed, such as flowing water, moving clouds, pouring waterfalls, swaying flowers and trees, etc., thereby increasing the richness of the terrain display and bringing real 3D visual effects to users to a great extent, helping users to more easily understand the displayed content.

[0035] The gesture interaction system uses gesture sensors to capture and track a person's hands, extracts hand feature information, and converts it into 3D gesture data control instructions, which are transmitted to the terrain data processing system. The 3D gesture data is used to control the terrain lifting control system and the display control system. The gesture interaction system can detect and track hands, fingers and finger-like tools and obtain their position, gestures and movements in real time. The gesture interaction system can operate with high precision and high tracking frame rate, and combine software to analyze objects within the visible range of the gesture sensor. Among them, the hand feature information mainly includes hand images, video recordings and three-dimensional models built based on infrared rays.

[0036] A terrain data processing system is used to process, convert, and map real-world terrain data into lift control parameters for a three-dimensional electronic sand table, receive and parse 3D gesture data, and identify control instructions for the 3D gesture data. The terrain data referred to in the present invention is primarily based on data sources such as geographic information system databases, satellite remote sensing, and lidar scanning. The system parses control instructions generated by the gesture interaction system and outputs control instructions to regulate the terrain lift control system and display control system. The system also performs processing on the acquired terrain data, including noise removal, terrain curve smoothing, and data conversion into appropriate units such as centimeters or millimeters. The system then generates a resolution and size matching the display control system based on the terrain data, matching the lift operation.

[0037] The main control system is used to receive and parse 3D gesture data to identify the control instructions of the 3D gesture data, and regulate the terrain lifting control system and display control system according to the control instructions and the parameters of the terrain data processing system. The main control system judges the gesture operation based on the continuity and stability of the gesture. If the gesture movement remains continuous and stable, the main control system will recognize it as a valid control instruction and adjust the lifting and display of the three-dimensional electronic sand table accordingly. For example, when the user swipes upward with a stable gesture, the system may interpret it as a request to lift a part of the terrain in the electronic sand table; on the contrary, a downward swipe gesture is interpreted as a request to lower the terrain.

[0038] Among them, the 3D gesture data control instructions generated by the gesture interaction system can adjust and control the terrain lifting control system and the display control system, and are converted by the terrain data processing system to control various terrain changes on the three-dimensional electronic sand table, such as zooming in, changing the terrain, and controlling the pause playback of the display control system screen.

[0039] In this embodiment, the gesture sensor includes at least two high-resolution infrared cameras and at least three LED infrared light sources. The LED infrared light source is used to emit infrared rays to the hand. The infrared camera receives the reflected light from the hand and obtains an image of the hand. The two infrared cameras extract information including the three-dimensional position to perform gesture analysis and judgment, generate 3D gesture data based on the hand position, gesture and movement, and establish a hand model. The capture area formed by the two infrared cameras is in an inverted pyramid shape, covering a range of 25-600mm in front of the device. The LED infrared light source is mainly used to enhance the hand reflection signal and reduce ambient light interference. The infrared camera captures the reflected light spot through the infrared light reflected by the hand to form a high-contrast hand image, and then combines the machine learning algorithm to recognize the gesture, convert it into 3D gesture data, and send it to the terrain data processing system to realize non-contact operation of the terrain lifting control system and display control system. Figure 3As shown, in actual operation, gesture operations are completed on the gesture interaction platform 2. The gesture sensor is arranged on the inner ring surface of the gesture interaction platform 2, and the user's hand movements are confined to the gesture interaction platform 2, which can form more accurate, clear and fast gesture recognition. According to the situation, at least two or more infrared cameras can be arranged on the upper and lower inner ring surfaces of the gesture interaction platform 2 to capture the hand 360° without blind spots. The LED infrared light source provides reflected light and lighting effects for the infrared camera. It can be used to construct an infrared hand model based on the reflected light and form a hand image. Specifically, at least three LED infrared light sources can be set in the upper, lower, left and right directions of the inner ring surface of the gesture interaction platform to meet the conditions for the infrared camera to capture the hand. Furthermore, the inner ring surface of the gesture interaction platform can be a touch screen. The user can also interact with the three-dimensional electronic sandbox through touch operation, switch between different real scenes, add dynamic effects, adjust the picture presented by the display control system, and other functions, providing users with diverse control methods and flexible adjustment operations.

[0040] In this embodiment, the hand feature information includes the motion trajectory, motion speed and motion posture of the hand. The motion trajectory is generated according to the position of the hand in the spatial coordinate system by establishing a spatial coordinate system; the motion speed is obtained by the motion stroke and motion time of the hand; the motion posture is judged based on the position of the finger endpoints of the hand; wherein, the motion speed is measured by a speed sensor, and the motion time.

[0041] The present invention defines the object to be tracked by the gesture sensor by setting a frame object and establishing an ID library. The frame object refers to the target in a frame image currently within the visual range of the gesture sensor, and the ID library stores the ID associated with the target object. The ID library stores information about hands, fingers, objects with endpoints, and gestures. The gesture recognition system matches the collected gestures with the information in the ID library to generate corresponding control instructions. The gesture information stored in the ID library includes various interactive actions that can be made by the hands, such as flipping, pinching, stretching, clicking, rotating, etc. Each action corresponds to the control of the electronic stereo. The functions in the sandbox include controlling the display control system of the sandbox to pause the playback screen, selecting and enlarging the content displayed by the display control system, controlling the terrain lifting system to change the current terrain to other features, such as mountains, basins, etc., and controlling the color, brightness and other parameters displayed by the display control system; when the gesture recognition system collects and matches an object that is not in the library, it is regarded as an undefined object. An undefined object does not contain any valid tracking data, and will not cause the gesture sensor to track the object, simplifying a large number of null pointer detections, that is, eliminating the detection of undefined gestures, and reducing the invalid work of the gesture sensor.

[0042] The present invention calls the movement of frame objects frame motion. Frame motion refers to the displacement, rotation, scale, shape, and other movement changes that occur to a target in a frame image within the current visual range of the gesture sensor. For example, if both hands appear simultaneously in the field of view of the gesture sensor and then move to the left side of the field of view, a displacement change occurs. The motion result is obtained based on the target's motion trend, combined with the corresponding gesture information in the frame object and ID library. The main control board then converts the motion result into control instructions and parameters for adjusting the display control system and the terrain lifting control system.

[0043] Regarding the detection index of frame motion, the present invention collects the properties of the target to reflect its physical characteristics:

[0044] Palm coordinates, in the sensor's coordinate system, the coordinates of the palm center are measured in millimeters. According to the coordinates of the palm center movement, that is, the stroke, it is converted into the amplitude of adjusting the three-dimensional electronic sandbox.

[0045] The palm speed is 50mm / s, which is converted into the amplitude adjustment of the three-dimensional electronic sandbox according to the movement speed.

[0046] The palm normal direction is the perpendicular vector to the plane formed by the palm. The vector direction points to the inside of the palm. Parameters such as the height of a three-dimensional electronic sandbox can be adjusted according to the vector direction.

[0047] Direction: The vector from the center of the palm to the finger determines the direction of movement of the palm, and then forms the direction of adjustment, such as moving left to adjust the display screen of the three-dimensional model and other operations.

[0048] The sphere and its radius are designed to fit the inner curved surface of the palm. When the shape of the hand changes, the radius of the sphere changes accordingly. The size change of the radius of the sphere can be used to control the zooming in and out of a 3D electronic sandbox.

[0049] In this embodiment, the display control system includes a matrix stereoscopic display device composed of multiple independent LED display blocks and a driving motor that independently controls the lifting of an LED display block. The driving motor is a servo motor to ensure that the adjustment accuracy of the LED display block can reach 1mm. The LED display block uses different colors and tones to represent different heights and terrain features. By adjusting the brightness and contrast of the LED display block to simulate real light and shadow effects, the driving motor adjusts the height of the LED display block; wherein, the LED display block is a display block with five sides consisting of four cylindrical surfaces and one top surface, and all of them have display functions. The simulation degree of the three-dimensional electronic sandbox can be further improved through the five display surfaces, so that users can see more three-dimensional and real scenes, and can also observe details at different angles, providing a larger display screen, and users can easily observe the relationship between the part and the whole, which is very useful for information. The acquisition is more comprehensive and accurate, and each LED display block adjusts its own height through a motor. The adjustment accuracy of the motor is ±1mm, and the adjustment range is 0mm-250mm. 0mm and 250mm are the height differences between the lowest point and the highest point respectively. When all LED display blocks are at the lowest point of 0mm, they can be used as flat display screens. The height adjustment of the motor can make the LED display blocks flexibly switch between stereo display devices and flat display screens; the motor is controlled by the main control system, and the main control system parameters control the motor to raise and lower the height of the LED display blocks; among them, the display control system also includes power amplifier equipment for audio playback corresponding to the LED display blocks, such as speakers, loudspeakers and other power amplifier equipment, which can play special effects sounds that match the scene, such as wind sounds, water sounds and other sound effects, thereby increasing the use experience of the stereo electronic sandbox and allowing users to have an immersive feeling.

[0050] In this embodiment, the terrain data processing system transmits data through a network protocol and converts and maps parameter data of terrain and topography based on a dedicated data module. Specifically, it mainly relies on the geographic information system and transmits and obtains data through network protocols such as HTTP and FTP. In this way, it can ensure that the terrain data processing system can update geographic information in real time or near real time when switching between different terrains, supporting the rapid construction and dynamic adjustment of complex scenes.

[0051] In this embodiment, the main control system includes a gesture recognition processing chip and a terrain data processing chip. The gesture recognition processing chip analyzes hand feature information, converts gesture movements into gesture control instructions, and regulates the display control system and the terrain lifting control system. The terrain data processing chip receives the lifting control parameters and texture feature parameters transmitted by the terrain data processing system and converts them into terrain control instructions to regulate the display control system and the terrain lifting control system. Since the engineering processing volume of gesture operation processing and terrain data processing is relatively large, two independent processing chips are provided to analyze and process different targets respectively, thereby improving the real-time control rate of the three-dimensional electronic sand table and ensuring that users can experience low-latency, high-synchronization operation of the three-dimensional electronic sand table.

[0052] The present invention also provides a three-dimensional electronic sandbox control method based on gesture recognition, comprising the following steps:

[0053] S1, obtaining topographic data, constructing a 3D model that matches the topographic data on a 3D electronic sand table, and generating texture, color, and light and shadow features corresponding to the topographic data on the 3D model;

[0054] S2, based on the gesture sensor, collects 3D gesture data in real time and converts the 3D gesture data into corresponding control instructions through the main control chip;

[0055] S3, according to the control instruction, the main control chip controls the three-dimensional electronic sand table to transform into the terrain corresponding to the control instruction.

[0056] The working principle of the present invention is:

[0057] Initialization: When the system starts the control program, it is first initialized, including setting initial parameters and connecting to related hardware components, such as micro-lifting motors, LED screens, etc.; importing terrain data, which comes from geographic information databases, elevation data, user input, etc. The data exists in digital maps, elevation models or other formats, and then processing and analyzing the imported terrain data to match the resolution and size of the LED screen of the terrain lifting control module and match the motor lifting operation; initializing the LED screen and setting display parameters to ensure that the initial terrain or landscape is displayed at the beginning; enabling the user interface to allow users to interact with the electronic sandbox, which can be achieved through a touch screen, physical buttons or other input devices; according to the guide The system interacts with the user through the terrain data input, controls the micro motor to perform lifting and lowering movements to simulate changes in terrain. The motor movement is controlled according to the user's instructions or the regulation of the main control system, and displays the simulated terrain on the LED screen, including color, shadow, texture, etc., to increase the three-dimensionality and realism of the terrain. If new terrain data is available (for example, the user selects a different area or switches to a different data source), the terrain data is updated and re-simulated and displayed; feedback information is provided, such as displaying the current altitude, terrain features or other useful information on the LED display block to help users understand the simulation results; user operations and simulation data are recorded for subsequent analysis or playback, or user-defined terrain data can be saved for later use.

[0058] The advantages of the present invention are:

[0059] 1) The gesture interaction system of this invention introduces a novel interaction method that can increase user interest and participation, providing a more immersive experience. It does not require users to wear additional equipment, making the gesture interaction system more convenient and easy to use, allowing users to interact with the 3D sandbox through gestures anytime, anywhere.

[0060] 2) The terrain lift control system and display control system jointly construct a three-dimensional terrain model that can match the terrain and topography of the real world. Through precise data collection and analysis, the complex terrain features in the real world are accurately presented in three-dimensional form.

[0061] The above disclosures are only several specific embodiments of the present invention, but the present invention is not limited thereto. Any changes that can be conceived by those skilled in the art should fall within the scope of protection of the present invention.

Claims

1. A three-dimensional electronic sandbox based on gesture recognition, characterized in that: include: The terrain lifting control system is used to simulate the changes in terrain and build a three-dimensional model of the corresponding terrain according to the parameters transmitted by the terrain data processing system; Display control system, used to simulate texture, color, light and shadow characteristics corresponding to the terrain; A gesture interaction system, which uses gesture sensors to capture and track a person's hands, extracts hand feature information, and converts it into control instructions for 3D gesture data, and uses the 3D gesture data to control the terrain lifting control system and the display control system; A terrain data processing system is used to obtain terrain data and process, convert and map it into lifting control parameters and corresponding texture feature parameters of a three-dimensional electronic sand table; a main control system for receiving and parsing 3D gesture data to identify control instructions of the 3D gesture data, and regulating the terrain lifting control system and the display control system according to the control instructions and parameters of the terrain data processing system; The gesture sensor includes at least two high-resolution infrared cameras and at least three LED infrared light sources. The LED infrared light sources are used to emit infrared light toward the hand. The infrared camera receives reflected light from the hand and acquires an image of the hand. 3D gesture data is generated based on the hand's position, gesture, and movement, and a hand model is established. The capture area formed by the two infrared cameras is in the shape of an inverted pyramid, covering a range of 25-600mm in front of the device. The LED infrared light sources are mainly used to enhance the hand reflection signal and reduce ambient light interference. The infrared camera captures the reflected light spot through the infrared light reflected by the hand, forming a high-contrast hand image. The hand gesture is then identified using a machine learning algorithm, converted into 3D gesture data, and sent to the terrain data processing system. The hand feature information includes the hand's motion trajectory, motion speed and motion posture. The motion trajectory is generated by establishing a spatial coordinate system based on the position of the hand in the spatial coordinate system; the motion speed is obtained through the hand's motion stroke and motion time; and the motion posture is judged based on the position of the hand's finger endpoints.

2. The three-dimensional electronic sandbox based on gesture recognition according to claim 1, characterized in that: A frame object and ID library are established. The frame object is the target object in a frame image currently within the visual range of the gesture sensor. The ID library stores the IDs associated with the target objects, including hands, fingers, objects with endpoints, and gestures. The gesture interaction system matches the collected gestures based on the information in the ID library to generate corresponding control instructions.

3. The three-dimensional electronic sandbox based on gesture recognition according to claim 2, characterized in that: Establish frame motion, which is the displacement, rotation, scale, and shape changes of the target object. According to the motion trend of the frame motion, the corresponding control instructions are obtained in combination with the frame object and ID library.

4. The three-dimensional electronic sandbox based on gesture recognition according to claim 1, characterized in that: The display control system includes a matrix display screen composed of multiple independent LED display blocks, and the terrain lifting control system includes a drive motor for controlling the lifting of the LED display blocks. The LED display blocks use different colors and tones to represent different heights and terrain features. The brightness and contrast of the LED display blocks are adjusted to simulate real light and shadow effects. The drive motor adjusts the height of the LED display blocks.

5. The three-dimensional electronic sandbox based on gesture recognition according to claim 4, characterized in that: The lifting height range of the LED display block includes 0-250 mm, wherein 0 mm and 250 mm are the lowest point and the highest point of the LED display block respectively.

6. The three-dimensional electronic sandbox based on gesture recognition according to claim 1, characterized in that: The terrain data processing system transmits data via a network protocol and converts and maps parameter data of terrain and topography according to a dedicated data module.

7. The three-dimensional electronic sandbox based on gesture recognition according to claim 1, characterized in that: The main control system includes a gesture recognition processing chip and a terrain data processing chip. The gesture recognition processing chip analyzes the hand feature information, converts gesture movements into gesture control instructions, and regulates the display control system and the terrain lifting control system. The terrain data processing chip receives the lifting control parameters and texture feature parameters transmitted by the terrain data processing system, converts them into terrain control instructions, and regulates the display control system and the terrain lifting control system.

Citation Information

Patent Citations

  • Electronic sand table system and method

    CN103473981A

  • Electron sand table operation panel

    CN205487097U