Gesture control method and device for storage device, medium and equipment

Abstract

The invention provides a gesture control method and device for a storage device, a medium and equipment. The gesture control method comprises the following steps: acquiring hand data of a person in a vehicle; based on the palm space position and the target space area, a target storage device of the person in the vehicle is determined; based on the palm space position and the finger space position, a control instruction of the target storage device is determined; based on the control instruction of the target storage device, controlling the target storage device to execute a corresponding action; the target storage device to be controlled by the person in the vehicle is determined according to the space area where the palm space position of the person in the vehicle is located, and the control instruction is determined according to the position information of the palm and fingers of the person in the vehicle so as to control the target storage device to be opened or closed. Therefore, people in the vehicle can simply open or close the target storage device through gestures without touching the target storage device, the difficulty of opening or closing the storage device by the people in the vehicle is reduced, and the safety interaction satisfaction degree in the vehicle driving process is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of opening and closing of a storage device built into a vehicle, and in particular to a method, device, medium and equipment for gesture control of a storage device. Background Art

[0002] With the continuous development of science and technology, the functions of automobiles are becoming more and more abundant, gradually transforming from traditional means of transportation to intelligent means of travel. In the field of intelligent automobiles, technologies such as artificial intelligence and intelligent interaction have gradually matured, providing vehicles with a more convenient, safe and comfortable travel experience. The built-in device in the car needs to be manually operated when opening and locking. Each time it is opened, a person needs to manually pull the buckle on the built-in device in the car, and when closing it, a person also needs to manually push the built-in device in the car back to its original position. In this way, manual operation is required every time the built-in device in the car is opened and closed. During the driving process of the vehicle, manually opening and closing the built-in device in the car will affect driving, especially when the driver opens and closes the built-in device in the car, there are certain safety hazards, especially when the built-in device in the car is far away from the driver, the driver needs to adjust the posture to open and close. Therefore, a method for conveniently opening and closing the built-in device in the car without affecting driving is needed. Summary of the invention

[0003] In order to solve the above technical problems, this solution is proposed. The embodiments of this solution provide a gesture control method, device, medium and equipment for a storage device.

[0004] According to one aspect of the present solution, a gesture control method for a storage device is provided, comprising: acquiring hand data of a person in a vehicle; wherein the hand data comprises a palm space position and a finger space position; based on the palm space position and the target space area, determining a target storage device of the person in the vehicle; wherein each in-vehicle storage device corresponds to one target space area; based on the palm space position and the finger space position, determining a control instruction for the target storage device; and based on the control instruction for the target storage device, controlling the target storage device to perform a corresponding action.

[0005] In one embodiment, determining the target storage device of the occupant based on the palm space position and the target space area includes: calculating the center point position of the palm of the occupant based on the palm space position; if the center point position of the palm of the occupant is within the target space area, determining that the in-vehicle storage device corresponding to the target space area is the target storage device.

[0006] In one embodiment, determining the control instruction of the target placement device based on the palm space position and the finger space position includes: calculating the angle between the palm and the fingers of the person in the vehicle based on the palm space position and the finger space position; if the angle between the palm and the fingers of the person in the vehicle is greater than a preset first angle threshold, determining that the control instruction of the target placement device is not to move.

[0007] In one embodiment, determining the control instruction of the target placement device based on the palm space position and the finger space position includes: if the angle between the palm and the finger of the person in the vehicle is less than or equal to the first angle threshold, calculating the duration during which the angle between the palm and the finger of the person in the vehicle is less than or equal to the first angle threshold; if the duration is less than a preset time threshold, determining that the control instruction of the target placement device is not to move.

[0008] In one embodiment, determining the control instruction of the target placement device based on the palm space position and the finger space position includes: calculating the displacement of the fingertips of the person in the vehicle starting from an initial moment based on the palm space position and the finger space position; wherein the initial moment indicates the moment when the duration reaches the time threshold; if the displacement is less than a preset distance threshold, determining that the control instruction of the target placement device is not to move.

[0009] In one embodiment, determining the control instruction of the target placement device based on the palm spatial position and the finger spatial position includes: calculating the finger movement speed of the occupant based on the displacement and the corresponding movement time; if the finger movement speed of the occupant is less than a preset speed threshold, determining the control instruction of the target placement device as no movement.

[0010] In one embodiment, determining the control instruction of the target placement device based on the palm space position and the finger space position includes: calculating the hand normal vector of the occupant based on the palm space position and the finger space position; wherein the hand normal vector of the occupant represents a normal vector perpendicular to the plane where the hand of the occupant is located; calculating the angle between the hand normal vector of the occupant and the vertical direction; if the angle between the hand normal vector of the occupant and the vertical direction is greater than a preset second angle threshold, determining that the control instruction of the target placement device is not to move.

[0011] According to another aspect of the present solution, a gesture control device for a storage device is provided, comprising: a collection module, used to obtain hand data of a person in a vehicle; wherein the hand data comprises a palm space position and a finger space position; a determination module, used to determine a target storage device of the person in the vehicle based on the palm space position and the target space area; wherein each in-vehicle storage device corresponds to one target space area; an identification module, used to determine a control instruction of the target storage device based on the palm space position and the finger space position; and a control module, used to control the target storage device to perform a corresponding action based on the control instruction of the target storage device.

[0012] According to another aspect of the present solution, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is used to execute any of the above-mentioned methods.

[0013] According to another aspect of the present solution, an electronic device is provided, comprising: a processor; a memory for storing instructions executable by the processor; and the processor is used to execute any of the above-described methods.

[0014] The present solution provides a method, device, medium and equipment for gesture control of a storage device, which obtains hand data of a person in a vehicle, wherein the hand data includes a palm space position and a finger space position; based on the palm space position and the target space area, determines a target storage device of the person in the vehicle; wherein each in-vehicle storage device corresponds to a target space area; based on the palm space position and the finger space position, determines a control instruction of the target storage device; based on the control instruction of the target storage device, controls the target storage device to perform a corresponding action; that is, the target storage device to be controlled by the person in the vehicle is determined according to the space area where the palm space position of the person in the vehicle is located, and the control instruction is determined according to the position information of the palm and the finger of the person in the vehicle to control the opening or closing of the target storage device, so that the person in the vehicle can simply open or close the target storage device through gestures without touching the target storage device, which not only reduces the difficulty of opening or closing the storage device for the person in the vehicle, but also improves the safety of the vehicle during driving and the interaction satisfaction of the person in the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other purposes, features and advantages of the present solution will become more apparent by describing the embodiments of the present solution in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present solution and constitute a part of the specification. Together with the embodiments of the present solution, they are used to explain the present solution and do not constitute a limitation on the present solution. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0016] Figure 1It is a flowchart of a storage device gesture control method provided by an exemplary embodiment of the present invention.

[0017] Figure 2a It is a schematic diagram of the structure for calculating the angle between the palm and the fingers provided by an exemplary embodiment of the present invention.

[0018] Figure 2b It is a structural schematic diagram of calculating the angle between the palm and the fingers provided by another exemplary embodiment of the present invention.

[0019] Figure 3 It is a schematic diagram of the structure for calculating the hand normal vector and the vertical angle provided by an exemplary embodiment of the present scheme.

[0020] Figure 4 It is a structural schematic diagram of a gesture control device for a storage device provided in an exemplary embodiment of the present invention.

[0021] Figure 5 It is a structural diagram of an electronic device provided by an exemplary embodiment of this scheme. DETAILED DESCRIPTION

[0022] Below, the exemplary embodiments according to the present solution will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present solution, rather than all the embodiments of the present solution, and it should be understood that the present solution is not limited to the exemplary embodiments described here.

[0023] Figure 1 FIG. 1 is a flow chart of a method for controlling a storage device by gestures according to an exemplary embodiment of the present invention. Figure 1 As shown, the gesture control method of the storage device includes the following steps: Step 110: Acquire hand data of the person in the vehicle.

[0024] The hand data includes the palm spatial position and the finger spatial position. In this solution, a binocular camera with high resolution and wide viewing angle can be installed at a suitable position in the cockpit, such as above the dashboard or near the rearview mirror inside the car, to capture the hand data of the occupants (such as the three-dimensional image data of the palms and fingers of the occupants), wherein the present solution covers the gesture operation area of ​​the occupants through the binocular camera or other devices that can capture three-dimensional image data, so as to capture the palm spatial position and finger spatial position of the occupants in real time. Preferably, the present solution can use an image processing unit (including a processor and corresponding software) to process the three-dimensional image data, extract the key points of the palms and fingers of the occupants (such as the center point of the palm and the fingertips), and use the key points as the representation analysis to obtain the palm spatial position and finger spatial position.

[0025] Step 120: Determine the target storage device of the occupant based on the palm spatial position and the target spatial area.

[0026] Each in-vehicle storage device corresponds to a target space area. After analyzing and obtaining the palm space position of the occupant, based on the palm space position of the occupant and the set target space area, for example, it is determined whether the palm space position of the occupant is within the set target space area, so as to determine the target storage device to be controlled by the occupant. It should be understood that the in-vehicle storage device involved in this solution can be one or more, and the in-vehicle storage device to be controlled can be determined according to the palm position of the occupant, so as to realize the control of multiple in-vehicle storage devices. For example, the target space area corresponding to each built-in vehicle storage device can be set to a specific area in front of the built-in vehicle storage device. For example, the built-in vehicle storage device on the left side of the driver. Since the built-in vehicle storage device is usually only opened by the driver, the target space area of ​​the built-in vehicle storage device can be set to an area directly in front of the built-in vehicle storage device that is easily reached by the driver's left hand. Another example is the built-in vehicle storage device (glove box) directly in front of the co-pilot. Since both the driver and the co-pilot passenger will open the built-in vehicle storage device, the target space area of ​​the built-in vehicle storage device can be set to an area that is easily reached by both the driver and the co-pilot passenger (such as the area between the driver and the co-pilot passenger).

[0027] In one embodiment, the specific implementation method of the above step 120 can be: based on the palm space position, calculate the center point position of the palm of the person in the car; if the center point position of the palm of the person in the car is located in the target space area, then determine that the in-vehicle storage device corresponding to the target space area is the target storage device.

[0028] After obtaining the spatial position of the palm (the spatial position of the palm boundary points), this solution calculates the position of the palm center point based on the spatial position of the palm boundary points, that is, the palm center point represents the palm to simplify the calculation difficulty. If the palm center point of the occupant's palm is located in the target spatial area corresponding to one of the built-in storage devices, then the control object of the occupant is determined to be the built-in storage device, that is, the target storage device. Specifically, the coordinates of the palm center point of the occupant's palm (based on the vehicle center console, and a three-dimensional coordinate system defined by the spatial range of length, width, and height is established according to the vehicle coordinate system) are recorded as ( x,y,z ),like x min ≤ x ≤ x max , y min ≤ y ≤ y max , z min ≤z ≤ z max , then it is determined that the center point of the palm of the person in the car is located in the target space area, where x min , x max , y min , y max , z min , z max They are the boundary points of the target space area in three dimensions in the vehicle coordinate system.

[0029] Step 130: Determine a control instruction for the target placement device based on the palm spatial position and the finger spatial position.

[0030] After determining the target storage device of the occupant, this solution determines the control instructions of the occupant based on the palm space position and finger space position of the occupant (the palm space position and finger space position at multiple moments are the palm movements and finger movements), for example, triggering the action of the target storage device according to the palm space position and finger space position of the occupant, and determining the opening or closing action of the target storage device in combination with the palm movement and finger movement of the occupant.

[0031] In one embodiment, the specific implementation method of the above step 130 may be: based on the palm space position and the finger space position, calculate the angle between the palm and the fingers of the person in the vehicle; if the angle between the palm and the fingers of the person in the vehicle is greater than a preset first angle threshold, determine that the control instruction of the target placement device is not to move.

[0032] In order to avoid misoperation by the occupants, this solution calculates the angle between the palm and fingers of the occupants after determining the target storage device of the occupants to determine whether the palm and fingers are aligned, so as to avoid misoperation caused by actions such as raising the hands of the occupants in the car. If the angle between the palm and fingers of the occupants is greater than the preset first angle threshold, the control instruction of the target storage device will not be triggered, that is, if the angle between the palm and fingers is large, the storage device control will not be triggered. For example, if the angle between the palm and fingers is greater than 10 degrees, the storage device control will not be triggered. Among them, this solution can use a key point detection algorithm (such as the OpenPose algorithm, etc.) to extract the key point coordinates of the palm and fingers of the occupants: the center point of the wrist (denoted as E), the center point of the palm (denoted as W), and the center point of the middle finger tip (denoted as P), where the three-dimensional coordinates (three-dimensional coordinates in the vehicle coordinate system) of the center point of the wrist, the center point of the palm, and the center point of the middle finger tip are respectively E =( Ex , Ey , Ez )、 W =( Wx , Wy , W )、 P =( Px , Py , Pz ). Then the palm vector of the person in the car is V 手掌 =( Wx-Ex , Wy-Ey , Wz- Ez ), the finger vector is V 手指 =( Px-Wx , Py-Wy , Pz-Wz ),like Figure 2a and Figure 2b As shown, the angle between the palm and fingers The calculation formula can be: ; in, is the dot product of the finger vector and the palm vector, are the modulus lengths of the finger vector and the palm vector respectively.

[0033] In one embodiment, the specific implementation method of the above step 130 may be: if the angle between the palm and fingers of the person in the vehicle is less than or equal to a first angle threshold, then the duration of the angle between the palm and fingers of the person in the vehicle is less than or equal to the first angle threshold is calculated; if the duration is less than a preset time threshold, then the control instruction of the target placement device is determined to be no movement.

[0034] This scheme determines that the angle between the palm and fingers of the person in the car is less than or equal to the first angle threshold, which means that the person in the car needs to perform gesture control on the target placement device. At this time, in order to avoid the erroneous operation caused by the instantaneous state of the person in the car satisfying the small angle between the palm and fingers during the hand movement, this scheme further calculates the duration of the angle between the palm and fingers of the person in the car being less than or equal to the first angle threshold when the angle between the palm and fingers of the person in the car is less than or equal to the first angle threshold. If the duration is short (for example, shorter than 2 seconds), it is determined that the person in the car just made a mistake and the control instruction of the target placement device is not triggered.

[0035] In one embodiment, the specific implementation method of the above step 130 may be: based on the palm space position and the finger space position, calculate the displacement of the fingertip (for example, the middle fingertip) of the person in the vehicle starting from the initial moment; wherein the initial moment indicates the moment when the duration reaches the time threshold; if the displacement is less than the preset distance threshold, determine that the control instruction of the target placement device is no movement.

[0036] If the person in the car triggers the control instruction of the target storage device, the displacement of the fingertip (such as the middle fingertip) of the person in the car from the initial moment is calculated. If the displacement is small, the target storage device is controlled not to move. That is, when the duration for which the person in the car continues to maintain the angle between the palm and the finger less than or equal to the first angle threshold reaches the time threshold, the displacement of the fingertip of the person in the car is calculated. If the displacement is small, the target storage device is controlled not to move temporarily. Since the person in the car is not so accurate in calculating the specific starting moment (that is, the initial moment) of the fingertip movement, the person in the car usually continues for a longer time to ensure that the control program of the target storage device is entered. During the continuous process, if there is a slight movement of the fingertip of the person in the car, it may cause misoperation. Therefore, this solution calculates the displacement of the fingertip of the person in the car from the initial moment. If the displacement is small, it is determined to be a misoperation and waits for further action by the person in the car. Among them, the displacement of the fingertip of the person in the car from the initial moment L The calculation formula is: ; in, They are the fingertip coordinates of the people in the car at the initial moment and the current moment respectively.

[0037] In one embodiment, the specific implementation method of the above step 130 may be: based on the displacement and the corresponding movement time, the finger movement speed of the occupant of the vehicle is calculated; if the finger movement speed of the occupant of the vehicle is less than a preset speed threshold, the control instruction of the target placement device is determined to be no movement.

[0038] This scheme calculates the displacement of the fingertips of the people in the car from the initial moment L Then, based on the displacement and the corresponding motion time T , calculate the finger movement speed of the person in the car, where the finger movement speed of the person in the car V=L / T If the finger movement speed of the person in the car is less than the speed threshold, the target storage device is controlled not to move to avoid misoperation.

[0039] In one embodiment, the specific implementation method of the above step 130 may be: based on the palm space position and the finger space position, calculate the hand normal vector of the person in the vehicle; wherein the hand normal vector of the person in the vehicle represents the normal vector perpendicular to the plane where the hand of the person in the vehicle is located; calculate the angle between the hand normal vector of the person in the vehicle and the vertical direction; if the angle between the hand normal vector of the person in the vehicle and the vertical direction is greater than a preset second angle threshold, determine that the control instruction of the target placement device is not to move.

[0040] This solution can also determine whether the palm and fingers are aligned horizontally by calculating the hand normal vector and comparing the deviation of the hand normal vector relative to the vertical direction. If the angle between the hand normal vector and the vertical direction is greater than a second angle threshold (e.g., 10 degrees), it means that the palm and fingers are not aligned horizontally, and the target placement device is controlled not to move. For example, this solution can form a feature point set { P 1. P 2. ... P n}, all feature points are used to fit the hand plane (including palm and fingers), and the hand normal vector of the hand plane is calculated by the least squares method n , calculate the hand normal vector and vertical direction (vehicle coordinate system z The angle between the axis direction α (like Figure 3 ), where the angle between the hand normal vector and the vertical direction (reference vector) is α The calculation formula is: ; in, n ref is the reference vector in the vertical direction.

[0041] Step 140: Based on the control instruction of the target storage device, control the target storage device to perform a corresponding action.

[0042] After determining the control instructions of the occupant to the target storage device, the target storage device is controlled to perform corresponding actions according to the control instructions. For example, a drive motor and a corresponding controller are set at each in-vehicle storage device. After the storage device gesture control device sends the control instruction to the controller of the target storage device, the controller of the target storage device controls the drive motor of the target storage device to operate to realize actions such as opening or closing the target storage device.

[0043] Optionally, after recognizing a control command from a person in the vehicle (such as turning on a target storage device, etc.), this solution can display the control command and the status information of the corresponding target storage device to the person in the vehicle, such as controlling the icon of the corresponding target storage device to be highlighted, or controlling the status light of the corresponding target storage device (indicating whether it is on or off) to be constantly on or flashing to indicate that the target storage device is in the process of being in action.

[0044] The scheme provides a gesture control method for a storage device, which obtains hand data of a person in a vehicle, wherein the hand data includes a palm space position and a finger space position; based on the palm space position and the target space area, determines a target storage device of the person in the vehicle; wherein each in-vehicle storage device corresponds to a target space area; based on the palm space position and the finger space position, determines a control instruction for the target storage device; based on the control instruction for the target storage device, controls the target storage device to perform a corresponding action; that is, the target storage device to be controlled by the person in the vehicle is determined according to the space area where the palm space position of the person in the vehicle is located, and the control instruction is determined according to the position information of the palm and the finger of the person in the vehicle to control the opening or closing of the target storage device, so that the person in the vehicle can simply open or close the target storage device through gestures without touching the target storage device, which not only reduces the difficulty of opening or closing the storage device for the person in the vehicle, but also improves the safety of the vehicle during driving and the interaction satisfaction of the person in the vehicle.

[0045] In one embodiment, if the center point of the palm of the person in the vehicle is located within the target space area, the angle between the palm and the finger is less than or equal to the first angle threshold for a duration greater than the time threshold, the displacement of the fingertip from the initial moment is greater than the distance threshold, and the finger movement speed is greater than the speed threshold, then the target placement device corresponding to the target space area is controlled to move.

[0046] In one embodiment, the movement direction of the target storage device is determined based on the movement direction of the fingertip of the vehicle occupant in the vertical direction from the initial moment. The movement direction of the target storage device is determined by calculating the movement direction of the fingertip of the vehicle occupant in the vertical direction from the initial moment, that is, determining whether the target storage device performs an opening or closing movement, wherein the fingertip of the vehicle occupant in the vertical direction (vertically upward) from the initial moment is the movement direction of the fingertip of the vehicle occupant in the vertical direction (vertically upward) from the initial moment. z Vertical displacement in the positive direction of the axis ,like >0, it is determined that the fingertip of the person in the car is moving in the vertical direction upward from the initial moment (corresponding to closing the target storage device). =0, it is determined that the movement direction of the fingertip of the person in the car in the vertical direction from the initial moment is directionless (the corresponding target placement device does not move). <0, it is determined that the movement direction of the fingertip of the occupant in the vertical direction from the initial moment is downward (corresponding to opening the target storage device).

[0047] Figure 4 Schematic diagram of the structure of the gesture control device for the storage device provided by the exemplary embodiment of the present invention. Figure 4 As shown, the storage device gesture control device 40 includes: a collection module 41, used to obtain hand data of the person in the vehicle; wherein the hand data includes the palm space position and the finger space position; a determination module 42, used to determine the target storage device of the person in the vehicle based on the palm space position and the target space area; wherein each in-vehicle storage device corresponds to a target space area; an identification module 43, used to determine the control instruction of the target storage device based on the palm space position and the finger space position; a control module 44, used to control the target storage device to perform a corresponding action based on the control instruction of the target storage device.

[0048] The present solution provides a gesture control device for an in-vehicle storage device, which acquires hand data of a person in the vehicle through a collection module 41; wherein the hand data includes a palm spatial position and a finger spatial position; a determination module 42 determines a target storage device of the person in the vehicle based on the palm spatial position and the target spatial area; wherein each in-vehicle storage device corresponds to a target spatial area; an identification module 43 determines a control instruction of the target storage device based on the palm spatial position and the finger spatial position; and a control module 44 controls the target storage device to perform a corresponding action based on the control instruction of the target storage device; that is, the target storage device to be controlled by the person in the vehicle is determined according to the spatial area where the palm spatial position of the person in the vehicle is located, and the control instruction is determined according to the position information of the palm and the finger of the person in the vehicle to control the opening or closing of the target storage device, so that the person in the vehicle can simply open or close the target storage device through gestures without touching the target storage device, which not only reduces the difficulty of opening or closing the storage device for the person in the vehicle, but also improves the safety of the vehicle during driving and the interaction satisfaction of the person in the vehicle.

[0049] In one embodiment, the above-mentioned determination module 42 can be further configured to: calculate the center point position of the palm of the person in the car based on the palm space position; if the center point position of the palm of the person in the car is located in the target space area, then determine that the in-vehicle storage device corresponding to the target space area is the target storage device.

[0050] In one embodiment, the above-mentioned recognition module 43 can be further configured to: calculate the angle between the palm and fingers of the person in the vehicle based on the palm space position and the finger space position; if the angle between the palm and fingers of the person in the vehicle is greater than a preset first angle threshold, determine that the control instruction of the target placement device is not to move.

[0051] In one embodiment, the above-mentioned identification module 43 can be further configured as follows: if the angle between the palm and fingers of the person in the vehicle is less than or equal to a first angle threshold, then the duration of the angle between the palm and fingers of the person in the vehicle is less than or equal to the first angle threshold is calculated; if the duration is less than a preset time threshold, then the control instruction of the target placement device is determined to be no movement.

[0052] In one embodiment, the above-mentioned identification module 43 can be further configured as: based on the palm space position and the finger space position, calculating the displacement of the fingertips of the person in the vehicle starting from the initial moment; wherein the initial moment indicates the moment when the duration reaches the time threshold; if the displacement is less than the preset distance threshold, then determining that the control instruction of the target placement device is no movement.

[0053] In one embodiment, the above-mentioned identification module 43 can be further configured to: calculate the finger movement speed of the person in the car based on the displacement and the corresponding movement time; if the finger movement speed of the person in the car is less than a preset speed threshold, determine that the control instruction of the target placement device is not to move.

[0054] In one embodiment, the above-mentioned recognition module 43 can be further configured as follows: based on the palm space position and the finger space position, calculating the hand normal vector of the person in the vehicle; wherein the hand normal vector of the person in the vehicle represents the normal vector perpendicular to the plane where the hand of the person in the vehicle is located; calculating the angle between the hand normal vector of the person in the vehicle and the vertical direction; if the angle between the hand normal vector of the person in the vehicle and the vertical direction is greater than a preset second angle threshold, determining that the control instruction of the target placement device is not to move.

[0055] In one embodiment, the above-mentioned identification module 43 can be further configured as follows: if the center point of the palm of the person in the vehicle is located in the target space area, the angle between the palm and the finger is less than or equal to the first angle threshold and the duration is greater than the time threshold, the displacement of the fingertip from the initial moment is greater than the distance threshold, and the finger movement speed is greater than the speed threshold, then the target placement device corresponding to the target space area is controlled to move.

[0056] In one embodiment, the identification module 43 may be further configured to determine the movement direction of the target storage device based on the movement direction of the fingertips of the person in the vehicle in the vertical direction from the initial moment.

[0057] Below, reference Figure 5 The electronic device according to the embodiment of the present solution is described. The electronic device may be any one or both of the first device and the second device, or a stand-alone device independent of them, and the stand-alone device may communicate with the first device and the second device to receive the collected input signals from them.

[0058] Figure 5 A block diagram of an electronic device according to an embodiment of the present solution is shown.

[0059] like Figure 5 As shown, the electronic device 10 includes one or more processors 11 and a memory 12 .

[0060] The processor 11 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

[0061] The memory 12 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 11 may run the program instructions to implement the methods of the various embodiments of the present solution described above and / or other desired functions. Various contents such as input signals, signal components, noise components, etc. may also be stored in the computer-readable storage medium.

[0062] In one example, the electronic device 10 may further include: an input device 13 and an output device 14 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0063] When the electronic device is a stand-alone device, the input device 13 may be a communication network connector, which is used to receive the collected input signals from the first device and the second device.

[0064] In addition, the input device 13 may also include, for example, a keyboard, a mouse, and the like.

[0065] The output device 14 can output various information to the outside, including the determined distance information, direction information, etc. The output device 14 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0066] Of course, to simplify, Figure 5 Only some of the components related to the present solution in the electronic device 10 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, the electronic device 10 may further include any other appropriate components according to specific application conditions.

[0067] In addition to the above-mentioned methods and devices, an embodiment of the present scheme may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the method according to various embodiments of the present scheme described in the above-mentioned "Exemplary Method" section of this specification.

[0068] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the embodiments of the present solution, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user computing device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0069] In addition, an embodiment of the present solution may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the steps of the method according to various embodiments of the present solution described in the above "Exemplary Method" section of this specification.

[0070] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0071] The basic principle of the present solution is described above in conjunction with specific embodiments. However, it should be pointed out that the advantages, strengths, effects, etc. mentioned in the present solution are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required for each embodiment of the present solution. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation. The above details do not limit the present solution to the requirement of adopting the above specific details to be implemented.

[0072] The block diagrams of the devices, apparatuses, equipment, and systems involved in this solution are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The word "such as" used here refers to the phrase "such as but not limited to", and can be used interchangeably with it.

[0073] It should also be noted that in the apparatus, device and method of the present invention, each component or each step can be decomposed and / or reassembled, and such decomposition and / or reassembly should be regarded as an equivalent of the present invention.

[0074] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present solution. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present solution. Therefore, the present solution is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0075] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present solution to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A gesture control method for a storage device, characterized in that: include: Acquire hand data of a person in the vehicle; wherein the hand data includes a palm space position and a finger space position; Based on the palm space position and the target space area, determine the target storage device of the person in the vehicle; wherein each in-vehicle storage device corresponds to one target space area; Determining a control instruction of the target placement device based on the palm spatial position and the finger spatial position; Based on the control instruction of the target placement device, the target placement device is controlled to perform a corresponding action.

2. The method for controlling a storage device by gesture according to claim 1, characterized in that: The determining of the target placement device of the occupant based on the palm space position and the target space area includes: Based on the palm spatial position, calculating the palm center point position of the person in the vehicle; If the center point of the palm of the person in the vehicle is located within the target space area, the in-vehicle storage device corresponding to the target space area is determined to be the target storage device.

3. The gesture control method of a storage device according to claim 1, characterized in that: The determining the control instruction of the target placement device based on the palm space position and the finger space position includes: Calculating the angle between the palm and the fingers of the person in the vehicle based on the palm spatial position and the finger spatial position; If the angle between the palm and fingers of the person in the vehicle is greater than a preset first angle threshold, it is determined that the control instruction of the target storage device is not to move.

4. The method for controlling a storage device by gesture according to claim 3, characterized in that: The determining the control instruction of the target placement device based on the palm space position and the finger space position includes: If the angle between the palm and the finger of the occupant is less than or equal to the first angle threshold, calculating the duration of time during which the angle between the palm and the finger of the occupant is less than or equal to the first angle threshold; If the duration is less than a preset time threshold, it is determined that the control instruction of the target placement device is no movement.

5. The method for controlling a storage device by gesture according to claim 4, characterized in that: The determining the control instruction of the target placement device based on the palm space position and the finger space position includes: Based on the palm spatial position and the finger spatial position, calculating the displacement of the fingertips of the occupant from an initial moment; wherein the initial moment indicates the moment when the duration reaches the time threshold; If the displacement is less than a preset distance threshold, it is determined that the control instruction of the target placement device is not to move.

6. The method for controlling a storage device by gesture according to claim 5, characterized in that: The determining the control instruction of the target placement device based on the palm space position and the finger space position includes: Calculating the finger movement speed of the person in the vehicle based on the displacement and the corresponding movement time; If the finger movement speed of the person in the vehicle is less than a preset speed threshold, it is determined that the control instruction of the target placement device is not to move.

7. The method for controlling a storage device by gesture according to claim 1, characterized in that: The determining the control instruction of the target placement device based on the palm space position and the finger space position includes: Based on the palm spatial position and the finger spatial position, a hand normal vector of the occupant of the vehicle is calculated; wherein the hand normal vector of the occupant of the vehicle represents a normal vector perpendicular to the plane where the hand of the occupant of the vehicle is located; Calculating the angle between the hand normal vector of the person in the vehicle and the vertical direction; If the angle between the hand normal vector of the occupant and the vertical direction is greater than a preset second angle threshold, it is determined that the control instruction of the target placement device is not to move.

8. A gesture control device for a storage device, characterized in that: include: A collection module, used to obtain hand data of the person in the vehicle; wherein the hand data includes the spatial position of the palm and the spatial position of the fingers; A determination module, used to determine the target storage device of the occupant based on the palm spatial position and the target spatial area; wherein each in-vehicle storage device corresponds to one target spatial area; an identification module, configured to determine a control instruction of the target placement device based on the palm spatial position and the finger spatial position; The control module is used to control the target placement device to perform a corresponding action based on the control instruction of the target placement device.

9. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and the computer program is used to execute the method according to any one of claims 1 to 7.

10. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is used to execute the method described in any one of claims 1 to 7.

Images