System, method and device for realizing 3D gesture operation of central control screen based on double ToF sensors, processor and medium

Abstract

The invention relates to a system for realizing center control screen 3D gesture operation processing based on double ToF sensors, and the system comprises a center control screen, the center control screen comprises an SoC and two ToF sensors, the SoC serves as a main control chip of the center control screen, the center control screen is used for carrying out the centralized control of other devices of a smart home, the two ToF sensors are asymmetrically disposed around the center control screen, and the SoC serves as a main control chip of the center control screen. The two ToF sensors are connected with the SoC through an I2C communication interface, and the ToF sensors receive distance data of obstacles in front of the ToF sensors in real time and feed back the distance data to the SoC. The invention also relates to a method and a device for realizing the 3D gesture operation processing of the central control screen based on the double ToF sensor, a processor and a readable storage medium thereof. By adopting the system, the method, the device, the processor and the computer readable storage medium for realizing the 3D gesture operation processing of the central control screen based on the double ToF sensors, the existing intelligent central control products can be controlled and upgraded, and the operability and the experience value of the products are improved. Simplified cost reduction can be carried out on a camera or other high-cost 3D gesture control schemes, and the market competitiveness of products is improved.

Description

Technical Field

[0001] The present invention relates to the field of non-contact control of intelligent central control and smart home, and particularly to the field of smart home and hotel intelligent control products. Specifically, it refers to a system, method, device, processor, and computer-readable storage medium for realizing 3D gesture operation processing of a central control screen based on dual ToF sensors. Background Art

[0002] Currently, 3D gesture recognition is mainly used in the human-computer interaction interfaces of scenarios such as smart home, intelligent driving, and intelligent industry, as a non-contact interaction method. However, the technologies for realizing 3D control are basically completed by using image recognition technology or an induction array (an array with the number of sensors greater than or equal to 3), with relatively high complexity and cost. There is also a part that only achieves partial gesture recognition in the planar dimension, with limited operation range. Currently, there is no technology that has advantages in both operation comprehensiveness and cost performance applied to human-computer interaction interfaces such as smart home. Summary of the Invention

[0003] The purpose of the present invention is to overcome the above-mentioned disadvantages of the prior art, and provide a system, method, device, processor, and computer-readable storage medium for realizing 3D gesture operation processing of a central control screen based on dual ToF sensors, which has a simple structure, strong market competitiveness, and a relatively wide range of applications.

[0004] In order to achieve the above purpose, the system, method, device, processor, and computer-readable storage medium for realizing 3D gesture operation processing of a central control screen based on dual ToF sensors of the present invention are as follows: The system for realizing 3D gesture operation processing of a central control screen based on dual ToF sensors is mainly characterized in that the system includes a central control screen, the central control screen includes an SoC and two ToF sensors, the SoC serves as the main control chip of the central control screen, the central control screen is used for centralized control of other devices in the smart home, the two ToF sensors are placed around the central control screen in an asymmetric manner, the two ToF sensors are connected to the SoC through an I2C communication interface, the ToF sensors receive the distance data of obstacles in front of the ToF sensors in real time and feedback it to the SoC, and the system judges the gesture actions, corresponds to control instructions according to the mapping table, and the SoC completes the issuance of control instructions.

[0005] Preferably, the ToF sensor includes an infrared light emitting tube and a receiving tube. If the emitted infrared light encounters an obstacle, it is reflected back, and the distance of the obstacle is calculated by counting the time difference from the emission of infrared light to the reception.

[0006] Preferably, the central control screen includes multiple pages and multi-level pages. The main interface is selected by a left-right swipe gesture, and the next-level interface is entered by two repeated proximity gestures.

[0007] Preferably, when the system plays music, songs are switched by a left-right swipe gesture, and the volume is adjusted by a proximity gesture.

[0008] Preferably, the I2C communication interface and bus are a bidirectional two-wire synchronous serial bus.

[0009] The method for implementing 3D gesture operation processing of the central control screen based on dual ToF sensors using the above system is mainly characterized in that the method includes the following steps: (1) The distances D1 and D2 of the obstacles in front of the two ToF sensors are obtained in real time, and the time information T1 and T2 of being blocked are also obtained in real time; (2) Determine whether it is a waving gesture or a pinching gesture based on the existence time of the obstacle. If it is a waving gesture, continue to step (3); if it is a pinching gesture, continue to step (5); (3) Determine whether it is a valid wave on a plane by the distance difference between D1 and D2. If so, continue to step (4); (4) Distinguish the gesture waving direction by judging the time difference of occlusion of the two sensors, and identify whether it is an upward swipe operation, a downward swipe operation, a left swipe operation or a right swipe operation; (5) Judge whether the gesture is a far gesture, a near gesture or a stable gesture according to the changes in D1 and D2.

[0010] Preferably, step (2) is specifically: Judge whether the existence time of the data of D1 and D2 is less than 0.5 s. If so, it is a waving gesture, and continue to step (3); otherwise, the palm has been in front of the device, and continue to step (5).

[0011] Preferably, step (3) is specifically: Judge whether the absolute value of the distance difference between D1 and D2 is less than or equal to 50 mm. If so, the palm waves in the xy plane and there is no z-axis movement trajectory, and continue to step (4).

[0012] Preferably, step (4) specifically includes the following steps: (4.1) Judge whether the absolute value of the distance difference between T1 and T2 is less than or equal to 0.15 s. If so, continue to step (4.2); otherwise, continue to step (4.3); (4.2) Determine whether the distance difference between T1 and T2 is less than or equal to 0.15 s and greater than 0. If so, it is an operation of swiping right; otherwise, it is an operation of swiping left. (4.3) Determine whether the distance difference between T1 and T2 is greater than 0.15 s. If so, it is an operation of swiping down; otherwise, it is an operation of swiping up.

[0013] Preferably, the step (5) specifically includes the following steps: (5.1) Capture the change data of D1 and D2; (5.2) Determine whether the values of D1 and D2 become larger. If so, it is a gesture of moving away; otherwise, continue to step (5.3); (5.3) Determine whether the values of D1 and D2 become smaller. If so, it is a gesture of approaching; determine whether the change value of D1 and D2 is less than 5 mm. If so, it is a stable gesture.

[0014] The device for implementing 3D gesture operation processing of the central control screen based on dual ToF sensors is mainly characterized in that the device includes: A processor configured to execute computer-executable instructions; A memory storing one or more computer-executable instructions, and when the computer-executable instructions are executed by the processor, each step of the method for implementing 3D gesture operation processing of the central control screen based on dual ToF sensors as described above is realized.

[0015] The processor for implementing 3D gesture operation processing of the central control screen based on dual ToF sensors is mainly characterized in that the processor is configured to execute computer-executable instructions, and when the computer-executable instructions are executed by the processor, each step of the method for implementing 3D gesture operation processing of the central control screen based on dual ToF sensors as described above is realized.

[0016] The computer-readable storage medium is mainly characterized in that a computer program is stored thereon, and the computer program can be executed by a processor to realize each step of the method for implementing 3D gesture operation processing of the central control screen based on dual ToF sensors as described above.

[0017] The system, method, device, processor and computer-readable storage medium for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention can achieve non-contact control of the content of the central control screen only through a low-cost dual ToF sensor solution, and can complete controls such as volume adjustment, page flipping, item selection, screen zooming, scene switching, shutdown, etc. This invention can upgrade the control of existing intelligent central control products, send commands when it is inconvenient to directly operate the touch screen, improve the operability and experience value of the products. It can simplify the cost reduction for existing 3D gesture control solutions using cameras or other high-cost methods, and enhance the market competitiveness of the products. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a control block diagram of the system for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention.

[0019] Figure 2a It is a schematic diagram of a conventional symmetric layout of the prior art.

[0020] Figure 2b It is a schematic diagram of an asymmetric layout of the system for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention.

[0021] Figure 3 It is a schematic diagram for explaining the spatial coordinates of the central control screen of the system for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention.

[0022] Figure 4 Figure a is a schematic diagram of a horizontal waving gesture from top to bottom of the system for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention.

[0023] Figure 4 Figure b is a schematic diagram of a horizontal waving gesture from bottom to top of the system for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention.

[0024] Figure 4 Figure c is a schematic diagram of a horizontal waving gesture from left to right of the system for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention.

[0025] Figure 4 Figure d is a schematic diagram of a horizontal waving gesture from right to left of the system for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention.

[0026] Figure 5 Figure a is a schematic diagram of a vertical waving gesture from right to left of the system for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor of the present invention.

[0027] Figure 5 Figure b is a schematic diagram of a vertical waving gesture from left to right of the system for realizing 3D gesture operation processing of the central control screen based on a dual ToF sensor according to the present invention.

[0028] Figure 6 Figure is a schematic diagram of the hardware structure of the system for realizing 3D gesture operation processing of the central control screen based on a dual ToF sensor according to the present invention.

[0029] Figure 7 Figure is a combined control logic flow chart of the dual ToF sensors for the method of realizing 3D gesture operation processing of the central control screen based on a dual ToF sensor according to the present invention.

[0030] Reference numerals: 1 First ToF Sensor 2 Second ToF Sensor 3 Central control screen 4 Screen panel opening Embodiment

[0031] In order to more clearly describe the technical content of the present invention, the following will be further described in conjunction with specific embodiments.

[0032] The system for realizing 3D gesture operation processing of the central control screen based on a dual ToF sensor according to the present invention includes a central control screen, the central control screen includes an SoC and two ToF sensors, the SoC serves as the main control chip of the central control screen, the central control screen is used for centralized control of other smart home devices, the two ToF sensors are placed around the central control screen in an asymmetric manner, the two ToF sensors are connected to the SoC through an I2C communication interface, the ToF sensors receive the distance data of obstacles in front of the ToF sensors in real time and feedback it to the SoC, and the system judges the gesture actions, corresponds to control instructions according to the mapping table, and the SoC completes the issuance of control instructions.

[0033] As a preferred embodiment of the present invention, the ToF sensor includes an infrared light emitting tube and a receiving tube. If the emitted infrared light encounters an obstacle, it is reflected back, and the distance of the obstacle is calculated by counting the time difference from the emission of the infrared light to the reception.

[0034] As a preferred embodiment of the present invention, the central control screen includes multiple pages and multi-level pages. The main interface is selected by a left-right sliding gesture, and the next-level interface is entered by two repeated approaching gestures.

[0035] As a preferred embodiment of the present invention, when the system plays music, it switches between songs through a left - right sliding gesture and adjusts the volume through a proximity gesture.

[0036] As a preferred embodiment of the present invention, the I2C communication interface and bus are a bidirectional two - wire synchronous serial bus.

[0037] The method for realizing 3D gesture operation processing of the central control screen based on dual ToF sensors by using the above - mentioned system of the present invention includes the following steps: (1) Real - time obtain the distances D1 and D2 of the obstacles in front of the two ToF sensors, and also real - time obtain the time information T1 and T2 when being blocked. (2) Judge whether it is a waving gesture or a pinching gesture according to the existence time of the obstacle. If it is a waving gesture, continue to step (3); if it is a pinching gesture, continue to step (5). (3) Judge whether it is a valid wave in a plane according to the distance difference between D1 and D2. If so, continue to step (4). (4) Distinguish the gesture waving direction by judging the time difference when the two sensors are blocked, and identify whether it is an upward - sliding operation, a downward - sliding operation, a left - sliding operation or a right - sliding operation. (5) Judge whether the gesture is a moving - away gesture, a moving - closer gesture or a stable gesture according to the changes of D1 and D2.

[0038] As a preferred embodiment of the present invention, step (2) is specifically as follows: Judge whether the existence time of the data of D1 and D2 is less than 0.5 s. If so, it is a waving gesture, and continue to step (3); otherwise, the palm has been in front of the device, and continue to step (5).

[0039] As a preferred embodiment of the present invention, step (3) is specifically as follows: Judge whether the absolute value of the distance difference between D1 and D2 is less than or equal to 50 mm. If so, the palm waves in the xy plane and has no z - axis movement trajectory, and continue to step (4).

[0040] As a preferred embodiment of the present invention, step (4) specifically includes the following steps: (4.1) Judge whether the absolute value of the distance difference between T1 and T2 is less than or equal to 0.15 s. If so, continue to step (4.2); otherwise, continue to step (4.3). (4.2) Judge whether the distance difference between T1 and T2 is less than or equal to 0.15 s and greater than 0. If so, it is a right - sliding operation; otherwise, it is a left - sliding operation. (4.3) Determine whether the distance difference between T1 and T2 is greater than 0.15 s. If so, it is an operation of swiping downwards; otherwise, it is an operation of swiping upwards.

[0041] As a preferred embodiment of the present invention, the step (5) specifically includes the following steps: (5.1) Capture the change data of D1 and D2; (5.2) Determine whether the values of D1 and D2 become larger. If so, it is a gesture of moving away; otherwise, continue with step (5.3); (5.3) Determine whether the values of D1 and D2 become smaller. If so, it is a gesture of approaching; determine whether the change value of D1 and D2 is less than 5 mm. If so, it is a stable gesture.

[0042] The device for implementing 3D gesture operation processing of a central control screen based on dual ToF sensors according to the present invention, wherein the device includes: A processor configured to execute computer-executable instructions; A memory storing one or more computer-executable instructions, and when the computer-executable instructions are executed by the processor, each step of the method for implementing 3D gesture operation processing of a central control screen based on dual ToF sensors as described above is realized.

[0043] The processor for implementing 3D gesture operation processing of a central control screen based on dual ToF sensors according to the present invention, wherein the processor is configured to execute computer-executable instructions, and when the computer-executable instructions are executed by the processor, each step of the method for implementing 3D gesture operation processing of a central control screen based on dual ToF sensors as described above is realized.

[0044] The computer-readable storage medium according to the present invention, on which a computer program is stored, and the computer program can be executed by a processor to realize each step of the method for implementing 3D gesture operation processing of a central control screen based on dual ToF sensors as described above.

[0045] In a specific embodiment of the present invention, the present invention is a 3D gesture operation method based on dual ToF sensors. Two ToF sensors are placed around the central control screen in an asymmetric manner. The sensor can obtain the distance of the occluding object in front of it in real time. The distance data of the obstacles in front of the two sensors are received in real time through the I2C communication interface and fed back to the SoC. The system judges the gesture action, and then corresponds to the control instruction according to the established mapping table. The SoC completes the issuance of the control instruction. For details of the block diagram, see Figure 1 .

[0046] When the hand slides in the space parallel to the central control screen, each sensor can sense the distance of the hand in front. Because they are placed asymmetrically, as shown in Figure 2, the order and time of the palm passing through the two sensors are different, so the direction of the gesture sliding can be determined. Different sliding directions can control the page flipping up and down and left and right. Because the sensor can also test the distance information of obstacles, when the hand moves in the space perpendicular to the screen (Z axis), the sensor can sense whether the hand is far away or close, and this data can be used to control the volume of playback. Through the combination of multiple gestures, you can also achieve a variety of operation methods such as item selection, selection, and cancellation. For details on spatial coordinates, see Figure 3 .

[0047] Products on the market have two proximity sensors placed symmetrically on both sides of the central control screen, but they cannot judge the movement in the y-axis direction, because both the top-down and bottom-up gestures block the two proximity sensors at the same time, so the direction cannot be judged. Moreover, simple proximity sensors are difficult to measure the distance, so the data on the Z axis will be missing, and the information of approaching and moving away cannot be received.

[0048] When the sensor transmits data to the SoC, the corresponding control operation is completed according to the combined event of the sensor being blocked. The interface of the central control screen is generally composed of multiple pages and multi-level pages. You can first select the main interface by sliding left and right, and then enter the next level interface by repeated approach gestures twice; when playing music, you can easily switch between songs by sliding left and right, and you can also adjust the volume by approaching gestures (the volume is reduced when approaching, and the volume is increased when moving away); you can also perform more complex and diverse operations through a combination of horizontal and vertical gestures. For schematic diagrams, please refer to the attached figure description. Figure 4 and Figure 5 .

[0049] The smart central control screen is an intelligent control device that integrates various functions such as touch control, network access, device control, cloud control, etc., and can centrally control other devices and various scenarios in the smart home.

[0050] The ToF sensor has an infrared light transmitting tube and a receiving tube. The emitted infrared light will be reflected back when encountering an obstruction. The distance of the obstruction is calculated by counting the time difference from the emission of the infrared light to the reception. It is an accurate distance test sensor.

[0051] The proximity sensing sensor on the market determines whether there is an obstruction by sensing the intensity of the infrared signal through a receiving tube, and cannot accurately test the distance of the obstruction.

[0052] The 3D gesture control refers to operating a device remotely through gestures without touching the operating object, and it can perform three-dimensional control.

[0053] The SoC is an integrated circuit with a dedicated target, which contains a complete system and all the content of the embedded software.

[0054] The I2C communication is a simple, two-way, two-wire synchronous serial bus. It only requires two wires to transmit information between devices connected to the bus.

[0055] As Figure 4 shown in the operation method of horizontal waving, it can be seen that when waving the hand in four directions through the screen, the order and interval of occlusion of sensor1 (upper sensor) and sensor2 (lower sensor) are different, and the waving method can be clearly distinguished.

[0056] Gesture of waving the hand from top to bottom Gesture of waving the hand from bottom to top Gesture of waving the hand from left to right Gesture of waving the hand from right to left 1 precedes 2 2 precedes 1 1 precedes 2 2 precedes 1 The interval between 1 and 2 is long The interval between 2 and 1 is long The interval between 1 and 2 is short The interval between 2 and 1 is short As Figure 5 shown in the operation method of vertical waving, the size of the 86 central control screen is only 86mm×86mm, and the palm can basically cover the positions of the two sensors. Pushing the palm forward and backward can feedback the distance, so as to perform corresponding operation instructions. Even if it is a large screen or the palm is not large enough, the approach or departure of the palm can be judged by one sensor.

[0057] At the hardware level, two ToF sensors need to be placed asymmetrically around the central control screen to complete the circuit design and structural design. As Figure 6 shown, establish communication with the SoC through I2C to ensure its normal operation.

[0058] The ToF sensor calculates the distance based on the time of light traveling back and forth on the reflection path. The distance of the conventional gesture operation from the central control screen is about 20cm. The sensor only needs 1.3ns to judge whether there is an occluder. Therefore, it can track objects moving very fast, such as the movement of waving the palm. Generally, the time for waving across the screen is about 0.3s.

[0059] First, the distance to the occlusion in front of the two sensors and the information about the occlusion time can be obtained in real time. By judging the existence time of the occlusion, it can be determined whether it is a waving gesture or a pinching gesture (generally, the waving time of the hand is 0.3 s). If it is a waving gesture, the measured distance difference between D1 and D2 is used to determine whether the waving is effective in a plane (to avoid interference from some accidental waves). Then, by judging the difference in the occlusion time of the two sensors, the waving direction of the gesture can be distinguished. At this time, the asymmetric layout plays a key role. If it is found that the data of D1 and D2 continuously exist for more than 0.5 s, it means that the palm has been in front of the device, and then the change of D1 and D2 is used to judge whether the gesture is moving away or approaching. The detailed flow chart is as shown in Figure 7 。

[0060] For the specific implementation solution of this embodiment, reference can be made to the relevant descriptions in the above embodiments, which will not be elaborated here.

[0061] It can be understood that the same or similar parts in the above embodiments can be referred to each other, and the content not detailed in some embodiments can be referred to the same or similar content in other embodiments.

[0062] It should be noted that in the description of the present invention, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, the meaning of "a plurality of" refers to at least two.

[0063] Any process or method description shown in the flowchart or described in other ways herein can be understood as representing a module, segment, or part of code including one or more executable instructions for implementing a specific logical function or process. The scope of the preferred embodiments of the present invention includes additional implementations, where the functions can be executed in a substantially simultaneous manner or in the reverse order according to the functions involved, rather than in the order shown or discussed, which should be understood by those skilled in the technical field to which the embodiments of the present invention belong.

[0064] It should be understood that each part of the present invention can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution device. For example, if implemented by hardware, as in another embodiment, any one or a combination of the following well-known technologies in the art can be used: discrete logic circuits with logic gate circuits for implementing logical functions on data signals, application-specific integrated circuits with appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0065] Those of ordinary skill in the art can understand that all or part of the steps carried out in implementing the method of the above embodiments can be completed by instructing relevant hardware through a program, and the corresponding program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.

[0066] In addition, in each embodiment of the present invention, the functional units can be integrated into a processing module, or each unit can exist physically alone, or two or more units can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0067] The above-mentioned storage medium can be a read-only memory, a magnetic disk or an optical disc, etc.

[0068] In the description of this specification, the descriptions with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. mean that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in a suitable manner in any one or more embodiments or examples.

[0069] By adopting the system, method, device, processor and computer-readable storage medium of the present invention for realizing 3D gesture operation processing of the central control screen based on a dual ToF sensor, non-contact control of the content of the central control screen can be realized only through a low-cost dual ToF sensor solution, and controls such as volume adjustment, page turning, item selection, screen zooming, switching scenes, and shutting down can be completed. The present invention can upgrade the control of existing intelligent central control products, send instructions when it is inconvenient to directly operate the touch screen, and improve the operability and experience value of the products. For existing 3D gesture control solutions using cameras or other high-cost ones, cost reduction can be achieved by streamlining, thereby enhancing the market competitiveness of the products.

[0070] In this specification, the present invention has been described with reference to its specific embodiments. However, it is obvious that various modifications and transformations can still be made without departing from the spirit and scope of the present invention. Therefore, the specification and drawings should be regarded as illustrative rather than restrictive.

Claims

1. A system for realizing 3D gesture operation processing of a central control screen based on dual ToF sensors, characterized in that, The described system includes a central control screen, and the central control screen includes an SoC and two ToF sensors. The SoC serves as the main control chip of the central control screen. The central control screen is used for centralized control of other smart home devices. The two ToF sensors are placed around the central control screen in an asymmetric manner. The two ToF sensors are connected to the SoC through an I2C communication interface. The ToF sensor receives the distance data of the obstacle in front of the ToF sensor in real time and feeds it back to the SoC. The system judges the gesture actions, corresponds to control instructions according to the mapping table, and the SoC completes the issuance of control instructions.

2. The system for realizing 3D gesture operation processing of the center control screen based on dual ToF sensors according to claim 1, characterized in that, The described ToF sensor includes an infrared light emitting tube and a receiving tube. If the emitted infrared light encounters an obstacle, it is reflected back, and the distance of the obstacle is calculated by counting the time difference from emitting the infrared light to receiving it.

3. The system for realizing 3D gesture operation processing of the central control screen based on dual ToF sensors according to claim 1, wherein The described central control screen includes multiple pages and multi-level pages. The main interface is selected through a left-right swipe gesture, and the next-level interface is entered through two repeated approaching gestures.

4. The system for realizing 3D gesture operation processing of the central control screen based on dual ToF sensors according to claim 1, wherein, When the system is playing music, it switches between songs through a left-right swipe gesture and adjusts the volume through an approaching gesture.

5. The system for realizing 3D gesture operation processing of a central control screen based on a dual ToF sensor according to claim 1, characterized in that The described I2C communication interface and bus are a two-way two-wire synchronous serial bus.

6. A method for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor by using the system described in claim 1, characterized in that, The described method includes the following steps: (1) Obtain the distances D1 and D2 of the obstacles in front of the two ToF sensors in real time, and also obtain the time information T1 and T2 when being blocked in real time; (2) Judge whether it is a waving gesture or a pinching gesture based on the existence time of the obstacle. If it is a waving gesture, continue to step (3); if it is a pinching gesture, continue to step (5); (3) Judge whether it is a valid wave on a plane by the distance difference between D1 and D2. If so, continue to step (4); (4) Distinguish the waving direction of the gesture by judging the time difference of being blocked by the two sensors, and identify whether it is an upward swipe operation, a downward swipe operation, a left swipe operation or a right swipe operation; (5) Judge whether the gesture is a far gesture, a near gesture or a stable gesture according to the changes of D1 and D2.

7. The method for implementing 3D gesture operation processing of the central control screen based on dual ToF sensors according to claim 1, wherein The specific content of the described step (2) is: Judge whether the existence time of the data of D1 and D2 is less than 0.5s. If so, it is a waving gesture, and continue to step (3); otherwise, the palm has been in front of the device, and continue to step (5).

8. The method for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor according to claim 1, wherein, The specific content of the described step (3) is: Judge whether the absolute value of the distance difference between D1 and D2 is less than or equal to 50mm. If so, the palm waves in the xy plane and there is no z-axis movement trajectory, and continue to step (4).

9. The method for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor according to claim 1, characterized in that, The specific content of the described step (4) includes the following steps: (4.1) Judge whether the absolute value of the distance difference between T1 and T2 is less than or equal to 0.15s. If so, continue to step (4.2); otherwise, continue to step (4.3); (4.2) Judge whether the distance difference between T1 and T2 is less than or equal to 0.15s and greater than 0. If so, it is a right swipe operation; otherwise, it is a left swipe operation; (4.3) Determine whether the distance difference between T1 and T2 is greater than 0.15 s. If so, it is an operation of sliding down; otherwise, it is an operation of sliding up.

10. The method for implementing 3D gesture operation processing of the central control screen based on a dual ToF sensor according to claim 1, wherein, The specific steps of step (5) are as follows: (5.1) Capture the change data of D1 and D2; (5.2) Determine whether the values of D1 and D2 become larger. If so, it is a gesture of moving away; otherwise, proceed to step (5.3); (5.3) Determine whether the values of D1 and D2 become smaller. If so, it is a gesture of approaching; determine whether the change value of D1 and D2 is less than 5 mm. If so, it is a stable gesture.

11. An apparatus for implementing 3D gesture operation processing of a central control screen based on dual ToF sensors, characterized in that, The device includes: A processor configured to execute computer-executable instructions; A memory storing one or more computer-executable instructions, and when the computer-executable instructions are executed by the processor, each step of the method for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor as described in any one of claims 6 to 10 is realized.

12. A processor for implementing 3D gesture operation processing of a central control screen based on dual ToF sensors, characterized in that, The processor is configured to execute computer-executable instructions, and when the computer-executable instructions are executed by the processor, each step of the method for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor as described in any one of claims 6 to 10 is realized.

13. A computer-readable storage medium, characterized in that, A computer program is stored thereon, and the computer program can be executed by the processor to realize each step of the method for implementing 3D gesture operation processing of a central control screen based on a dual ToF sensor as described in any one of claims 6 to 10.

Images