An air conditioner control method, system, electronic device and vehicle
By using image acquisition equipment and air conditioning vent data to determine user intent, intelligent control of air conditioning vents is achieved, solving the problems of inconvenience and safety risks associated with controlling concealed air conditioners and improving user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2022-04-29
- Publication Date
- 2026-05-01
AI Technical Summary
In existing technologies, the control of concealed air conditioning vents requires users to operate on the central control screen, resulting in a poor user experience and safety risks. Furthermore, traditional gesture control requires users to memorize fixed gestures and area operations.
The system acquires user gesture images and air conditioning airflow data through image acquisition devices, determines whether the user intends to control the air conditioning, and sends control commands to the air conditioning control system based on the gesture control images to control the air conditioning airflow.
It eliminates the need for users to memorize gestures and fixed area operations, improving user experience and enhancing security and convenience.
Smart Images

Figure CN117011928B_ABST
Abstract
Description
[Technical Field]
[0001] This invention relates to the field of intelligent control technology, specifically to an air conditioning control method, system, electronic device, and vehicle. [Background Technology]
[0002] Currently, more and more vehicles are adopting concealed air vents for their air conditioning systems. Drivers and passengers can no longer control the airflow direction by moving the vents; they must now adjust the airflow direction via the central control screen. This is very inconvenient for both drivers and passengers. Furthermore, moving the vents requires users to operate the system from a considerable distance while driving, which also poses safety risks.
[0003] In related technologies, users can control air conditioning direction or temperature via gestures. However, this requires users to perform gesture control operations within a fixed area, where they can be drivers or passengers. This not only requires users to memorize gestures but also to reach their hands into the fixed area, thus reducing the user experience. [Summary of the Invention]
[0004] In view of this, the present invention provides an air conditioning control method, system, electronic device, and vehicle for improving user experience.
[0005] A first aspect provides an air conditioning control method, the method being applied to an electronic device, the method comprising:
[0006] Based on the user's gesture image obtained from the image acquisition device and the air conditioning output data obtained from the air conditioning control system, it is determined whether the user has the intention to control the air conditioning.
[0007] If it is determined that the user intends to control the air conditioner, at least one gesture control image of the user performing gesture control is acquired from the image acquisition device;
[0008] The air conditioning control system sends control commands to the air conditioning control system based on the at least one gesture control image, so that the air conditioning control system can control the airflow of the air conditioner according to the control commands.
[0009] In one possible implementation, determining whether the user intends to control the air conditioning based on the user's gesture image acquired from the image acquisition device and the air conditioning venting data acquired from the air conditioning control system includes:
[0010] Based on the user's gesture image, generate the position coordinates of the user's hand in the established spatial coordinate system;
[0011] Based on the air conditioner air outlet data, generate the air outlet spatial path of the air conditioner in the spatial coordinate system;
[0012] Based on the coordinates of the user's hand and the air outlet path, determine whether the user's hand is located on the air outlet path of the air conditioner;
[0013] If it is determined that the user's hand is located in the air outlet path of the air conditioner, then it is determined that the user has the intention to control the air conditioner.
[0014] If it is determined that the user's hand is not located in the air outlet path of the air conditioner, then it is determined that the user does not intend to control the air conditioner.
[0015] In one possible implementation, determining whether the user's hand is located in the air outlet path of the air conditioner includes:
[0016] In the spatial coordinate system, a sphere is generated with the position coordinates as the center and a first set value as the radius;
[0017] In the spatial coordinate system, the air outlet space region where the air outlet space path is located is generated according to the air outlet space path;
[0018] Determine whether there is an overlapping area between the sphere and the air outlet space area;
[0019] If it is determined that there is an overlapping area between the sphere and the air outlet space, then it is determined that the user's hand is located on the air outlet path of the air conditioner;
[0020] If it is determined that there is no overlap between the sphere and the air outlet space area, then the position coordinates are determined to be not located on the air outlet space path.
[0021] In one possible implementation, after determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes:
[0022] By establishing a hand model, the hand's grip posture and / or grip orientation are generated based on the user's gesture image;
[0023] Determine whether the grip posture is the set grip posture and determine whether the grip orientation is the set grip orientation;
[0024] If it is determined that the grip posture is the set grip posture and the grip direction is the set grip direction, then the step of determining that the user has the intention to control the air conditioner is executed;
[0025] If it is determined that the grip posture is not the set grip posture and / or the grip orientation is not the set grip orientation, then the step of determining that the user does not have the intention to control the air conditioning is executed.
[0026] In one possible implementation, after determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes:
[0027] Two infrared images of a hand are acquired from an infrared camera at set time intervals;
[0028] Based on two infrared images of the hand captured by the infrared camera, the first and second temperatures of the user's hand are identified.
[0029] Determine whether the absolute value of the difference between the first temperature and the second temperature is greater than the temperature change threshold.
[0030] If it is determined that the absolute value of the difference is greater than the temperature change threshold, the step of determining that the user has the intention to control the air conditioner is executed.
[0031] If it is determined that the absolute value of the difference is less than or equal to the temperature change threshold, the step of determining that the user does not have the intention to control the air conditioner is executed.
[0032] In one possible implementation, after determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes:
[0033] The overlap time between the user's hand and the air outlet path of the air conditioner is calculated based on at least one user gesture image acquired from the image acquisition device.
[0034] Determine whether the overlap time is greater than a time threshold;
[0035] If it is determined that the overlap time is greater than the time threshold, the step of determining that the user has the intention to control the air conditioner is executed.
[0036] If it is determined that the overlap time is less than or equal to the time threshold, the step of determining that the user does not have the intention to control the air conditioner is executed.
[0037] In one possible implementation, after determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes:
[0038] Determine whether the air outlet of the air conditioner and the position coordinates of the user's hand are both within the user's line of sight;
[0039] If it is determined that the air outlet and its location coordinates are both within the user's line of sight, then proceed with the step of determining that the user has the intention to control the air conditioner.
[0040] If it is determined that the air outlet and / or its location coordinates are not within the user's line of sight, then proceed with the step of determining that the user does not intend to control the air conditioner.
[0041] In one possible implementation, after determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes:
[0042] Determine whether the coordinates of the air conditioner's air outlet and the user's hand are both located in the direction the user is looking at.
[0043] If it is determined that the air outlet and its location coordinates are both located in the direction the user is looking, then proceed with the step of determining that the user has the intention to control the air conditioner.
[0044] If it is determined that the air outlet and / or location coordinates of the air conditioner are not located in the direction the user is looking, then the step of determining that the user does not have the intention to control the air conditioner is executed.
[0045] In one possible implementation, the method further includes:
[0046] The speed of the user's hand movement is calculated based on multiple gesture control images acquired from the image acquisition device;
[0047] Determine whether the speed of the hand movement is less than a speed threshold;
[0048] If it is determined that the speed of the hand movement is less than the speed threshold, then the step of sending a control command to the air conditioning control system based on the at least one gesture control image is executed;
[0049] If it is determined that the speed of the hand movement is greater than or equal to the speed threshold, the air conditioning control operation is exited.
[0050] In one possible implementation, the method further includes:
[0051] The acceleration of the user's hand movement is calculated based on multiple gesture control images acquired from the image acquisition device.
[0052] Determine whether the acceleration of the hand movement is less than an acceleration threshold;
[0053] If it is determined that the acceleration of the hand movement is less than the acceleration threshold, then the step of sending a control command to the air conditioning control system based on the at least one gesture control image is executed.
[0054] If it is determined that the acceleration of the hand movement is greater than or equal to the acceleration threshold, the air conditioning control operation is exited.
[0055] In one possible implementation, the method further includes:
[0056] The speed of the user's hand movement is calculated based on multiple gesture control images acquired from the image acquisition device;
[0057] The airflow direction movement speed of the air outlet is calculated based on the speed of the air outlet obtained from the air conditioning control system.
[0058] Determine whether the difference between the speed of the hand movement and the speed of the wind movement is less than a speed difference threshold;
[0059] If it is determined that the difference between the speed of the hand movement and the speed of the wind movement is less than the speed difference threshold, then the step of sending a control command to the air conditioning control system based on the at least one gesture control image is executed.
[0060] If it is determined that the difference between the speed of the hand movement and the speed of the wind movement is greater than or equal to the speed difference threshold, then the air conditioning control operation is exited.
[0061] In one possible implementation, the method further includes:
[0062] Based on multiple gesture control images acquired from the image acquisition device, the position coordinates of the hand corresponding to each gesture control image are generated in the established spatial coordinate system.
[0063] Based on multiple air outlet data obtained from the air conditioning control system, multiple air outlet spatial paths are generated for the air conditioning outlet in the spatial coordinate system.
[0064] Based on each location coordinate and the corresponding air outlet path, determine whether the user's hand is always on the corresponding air outlet path within a set time period;
[0065] If it is determined that the user's hand is located on the corresponding air outlet path within a set time period, then the step of sending a control command to the air conditioning control system based on the at least one gesture control image is executed.
[0066] If it is determined that the user's hand is not located on the corresponding air outlet path at least once within the set time period, the air conditioning control operation is exited.
[0067] In one possible implementation, the method further includes:
[0068] If a stop operation action is recognized from the gesture control image, the air conditioning control operation is exited.
[0069] In one possible implementation, the stopping action includes a hand retraction action, a fist clenching action, a hand downward movement, or a hand returning to the steering wheel.
[0070] In one possible implementation, the method further includes:
[0071] Based on the gesture control image acquired from the image acquisition device, the position coordinates of the user's hand are generated in the established spatial coordinate system;
[0072] Determine whether the air outlet of the air conditioner and the position coordinates of the user's hand are both within the user's line of sight;
[0073] If it is determined that the air outlet of the air conditioner and the location coordinates are both within the user's line of sight, then the step of determining that the user has the intention to control the air conditioner is executed.
[0074] If it is determined that the air outlet of the air conditioner and / or the location coordinates are not within the user's line of sight, then the air conditioner control operation is exited.
[0075] In one possible implementation, the method further includes:
[0076] Based on the gesture control image acquired from the image acquisition device, the position coordinates of the user's hand are generated in the established spatial coordinate system;
[0077] Determine whether the coordinates of the air conditioner's air outlet and the user's hand are both located in the direction the user is looking at.
[0078] If it is determined that the air outlet of the air conditioner and the location coordinates are both located in the direction of the user's head gaze, then the step of determining that the user has the intention to control the air conditioner is executed.
[0079] If it is determined that the air outlet of the air conditioner and / or the location coordinates are not located in the direction of the user's head gaze, the air conditioner control operation is exited.
[0080] In one possible implementation, after determining that the user intends to control the air conditioning, the process further includes:
[0081] A trigger success command is sent to the feedback device, so that the feedback device outputs trigger success feedback according to the trigger success command.
[0082] In one possible implementation, after sending the control command to the air conditioning control system based on the at least one gesture control image, the method further includes:
[0083] An adjustment result instruction is sent to the feedback device so that the feedback device outputs adjustment result feedback according to the adjustment result instruction.
[0084] In one possible implementation, after exiting the air conditioning control operation, the method further includes:
[0085] Send an exit operation command to the feedback device so that the feedback device outputs exit operation feedback according to the exit operation command.
[0086] In one possible implementation, the air conditioning outlet data includes information about the air conditioning outlet and airflow direction data.
[0087] The second aspect provides an air conditioning control system, including: electronic equipment, image acquisition equipment and air conditioning control system;
[0088] The electronic device is configured to determine whether a user has the intention to control the air conditioning based on a user gesture image acquired from the image acquisition device and air conditioning airflow data acquired from the air conditioning control system; if it is determined that the user has the intention to control the air conditioning, it acquires at least one gesture control image from the image acquisition device when the user performs gesture control; and sends a control command to the air conditioning control system based on the at least one gesture control image.
[0089] The air conditioning control system is used to control the air output of the air conditioner according to the control command.
[0090] The third aspect provides a vehicle that includes the air conditioning control system of the second aspect.
[0091] A fourth aspect provides an electronic device comprising: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the electronic device, cause the electronic device to perform the air conditioning control method of the first aspect or any possible implementation thereof.
[0092] The fifth aspect provides a computer-readable storage medium including a stored program, wherein, when the program is executed, it controls an electronic device in which the computer-readable storage medium is located to perform the first aspect or any possible air conditioning control method of the first aspect.
[0093] In the technical solution provided by this invention, the electronic device determines whether the user has the intention to control the air conditioner based on the user's gesture image obtained from the image acquisition device and the air conditioner air outlet data obtained from the air conditioner control system. If the user is determined to have the intention to control the air conditioner, the electronic device sends a control command to the air conditioner control system based on at least one gesture control image when the user performs gesture control. The air conditioner control system controls the air outlet of the air conditioner according to the control command. In this invention, the electronic device can control the air outlet of the air conditioner through the user's gesture control image after determining that the user has the intention to control the air conditioner, without requiring the user to memorize the gesture action or reach their hand to a fixed area, thereby improving the user experience. [Attached Image Description]
[0094] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0095] Figure 1 These are schematic diagrams of the air conditioning control system in some embodiments;
[0096] Figure 2 These are flowcharts of air conditioning control methods in some embodiments;
[0097] Figure 3 These are schematic diagrams of air conditioning control methods in some embodiments;
[0098] Figure 4 These are flowcharts of methods for determining air conditioning control intent in some embodiments;
[0099] Figure 5 These are schematic diagrams of an electronic device provided in some embodiments.
Detailed Implementation Methods
[0100] To better understand the technical solution of the present invention, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
[0101] It should be understood that the described embodiments are merely some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without inventive effort are within the scope of protection of the present invention.
[0102] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms “a,” “the,” and “the” as used in the embodiments of this invention and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.
[0103] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.
[0104] Figure 1 These are schematic diagrams of the air conditioning control system in some embodiments, such as... Figure 1 As shown, the system includes: electronic device 100, image acquisition device 200, and air conditioning control system 300.
[0105] Electronic device 100 includes, but is not limited to, carrying Alternatively, it can be a device with another operating system. The electronic device 100 may be a device with a touchscreen or a device without a touchscreen. In some embodiments, when the air conditioning control system is applied to a vehicle's smart cockpit, the electronic device 100 may be the vehicle's central control system. In other embodiments, when the air conditioning control system is applied to an aircraft, the electronic device 100 may be the aircraft's control system. In other embodiments, when the air conditioning control system is applied to a smart home system, the electronic device 100 may include, but is not limited to, a whole-house smart panel, a smart speaker, a smart air conditioner, or a mobile terminal, such as, but not limited to, a mobile phone, tablet computer, or laptop computer. In this embodiment of the invention, the application of an air conditioning control system to a vehicle's smart cockpit is described as an example.
[0106] The image acquisition device 200 may include a camera, such as an RGB camera, an infrared camera, or a depth camera. Multiple image acquisition devices 200 can be installed in the vehicle's smart cockpit as needed. These devices can be used to acquire images of the user in the smart cockpit; for example, user images may include user gesture images, user head images, etc.
[0107] The air conditioning control system 300 can be used to control the air outlet direction, air outlet speed, and air outlet temperature of the air conditioner 400. The air conditioner 400 may include a concealed air outlet type air conditioner, an electrically driven paddle-type air conditioner, or a handheld air conditioner. The vehicle in this embodiment of the invention may use a concealed air outlet type air conditioner.
[0108] In some embodiments, the system may further include an eye tracker 500. The eye tracker 500 can detect the user's eyes to obtain the user's field of vision.
[0109] In some embodiments, the system may further include a feedback device 600. The feedback device 600 may include at least one of the following: ambient lighting, a fragrance diffuser, an in-vehicle projector, an external projector, a screen, a seat, a seatbelt, a speaker, and an ultrasonic haptic feedback device. The screen may be a display screen for a separate device or a display screen for a central control system.
[0110] In some embodiments, the image acquisition device 200, the air conditioning control system 300, the eye tracker 500, and the feedback device 600 can be connected to the electronic device 100 via wired or wireless communication. The wireless communication methods include, but are not limited to, Wi-Fi or Bluetooth.
[0111] This invention also provides a vehicle that includes the aforementioned air conditioning control system.
[0112] To address the issue of reduced user experience in air conditioning control processes in related technologies, based on... Figure 1 The air conditioning control system shown in this invention provides an air conditioning control method, system, electronic device, and vehicle. In some embodiments, the electronic device determines whether the user intends to control the air conditioning based on a user gesture image acquired from an image acquisition device and air conditioning airflow data acquired from the air conditioning control system. If the user is determined to have the intention to control the air conditioning, the electronic device sends a control command to the air conditioning control system based on at least one gesture control image when the user performs the gesture control. The air conditioning control system then controls the airflow of the air conditioning system according to the control command. In this invention, the electronic device can control the airflow of the air conditioning system through the user's gesture control image after determining that the user has the intention to control the air conditioning, without requiring the user to memorize the gesture or extend their hand to a fixed area, thereby improving the user experience.
[0113] For example, Figure 2 These are flowcharts of air conditioning control methods in some embodiments, such as... Figure 2 As shown, the method includes:
[0114] Step 102: The electronic device determines whether the user has the intention to control the air conditioner based on the user's gesture image obtained from the image acquisition device and the air conditioner air output data obtained from the air conditioner control system. If yes, proceed to step 104; otherwise, proceed to step 102.
[0115] For example, Figure 3 These are schematic diagrams of air conditioning control methods in some embodiments. Figure 3 The user is located in the vehicle's intelligent cockpit. The user can be a driver, passenger, or robot. The vehicle's air conditioning system (400) features concealed air vents, with the steering wheel positioned in front of these vents. Figure 1 As shown, the image acquisition device 200 can capture user gesture images and send them to the electronic device 100. In this case, the image acquisition device 200 can be an RGB camera. For example... Figure 1 As shown, the air conditioning control system 300 can detect the air conditioning air outlet data of the air conditioner 400 and send the air conditioning air outlet data to the electronic device 100. The air conditioning air outlet data may include information about the air outlet of the air conditioner 400 and airflow direction data. Specifically, if the air outlet of the air conditioner 400 is a fixed air outlet, the air outlet information includes the position and orientation of the air outlet; if the air outlet of the air conditioner 400 is a non-fixed air outlet, the air outlet information includes the real-time position and real-time orientation of the air outlet. For example, a non-fixed air outlet may include a movable air outlet or an air outlet with a movable built-in fan.
[0116] If the electronic device determines that the user has the intention to control the air conditioner, it means that the user can control the air conditioner's airflow through gestures, and then continues to control the airflow of the air conditioner through the user's gesture control image; if it determines that the user does not have the intention to control the air conditioner, it means that the user cannot control the airflow of the air conditioner through gestures, and then executes step 102 to continue monitoring whether the user has the intention to control the air conditioner.
[0117] Step 104: The electronic device acquires at least one gesture control image from the image acquisition device when the user performs gesture control.
[0118] like Figure 3 As shown, when the electronic device determines that the user intends to control the air conditioner, the user's hand is positioned in front of the air outlet of the air conditioner 400. At this time, the user can perform gesture control to control the airflow of the air conditioner 400. Figure 1 As shown, the image acquisition device 200 acquires at least one gesture control image when the user performs gesture control and sends the at least one gesture control image to the electronic device 100. Alternatively, the image acquisition device can continuously acquire multiple gesture control images when the user performs gesture control.
[0119] Step 106: The electronic device sends a control command to the air conditioning control system based on at least one gesture control image.
[0120] In this embodiment of the invention, the control instructions may include gesture behavior information and air conditioning control information. The electronic device can obtain the user's gesture behavior information based on at least one gesture control image; specifically, the electronic device can obtain the user's gesture behavior information based on multiple gesture control images. The gesture behavior information may include at least one of the following: hand movement direction, movement speed, displacement, relative displacement, acceleration, speed change over a certain time period, gesture, palm opening and closing, distance the arm extends and retracts, and arm opening / closing degree. The movement direction can be any direction in space, and the movement speed can be the movement speed in any direction in space. The air conditioning control information can be used to instruct the air conditioning control system 300 to control the air conditioner 400's airflow. The air conditioning control information can be set in correspondence with the gesture behavior information, and may include at least one of the following: airflow direction, airflow temperature, air volume, humidity, air purification, fragrance, and blowing mode of the air conditioner 400. The gesture may include five fingers together, a clenched fist, or an OK gesture, etc.
[0121] As an optional solution, control commands are used to control the airflow direction of the air conditioner 400 to follow the direction of the user's hand movement. For example... Figure 1 and Figure 3As shown, for example, if a user's hand 'a' moves to the left at a certain speed near the air outlet of the air conditioner 400, the electronic device 100 obtains the user's gesture behavior information based on at least one gesture control image of the user's hand 'a' moving to the left. This gesture behavior information may include the direction and speed of the user's hand 'a' moving to the left. The corresponding air conditioning control information may include the air outlet direction of the air conditioner 400. This control command instructs the air conditioning control system 300 to control the air outlet direction of the air conditioner 400 to move to the left at the specified speed, thus enabling the air outlet direction of the air conditioner 400 to follow the direction of the user's hand 'a'. As another example, if a user's hand 'b' moves to the right at a certain speed near the air outlet of the air conditioner 400, the electronic device 100 obtains the user's gesture behavior information based on at least one gesture control image of the user's hand 'b' moving to the right. This gesture behavior information may include the direction and speed of the user's hand 'b' moving to the right. The corresponding air conditioning control information may include the air outlet direction of the air conditioner 400. The control command is used to instruct the air conditioning control system 300 to control the air conditioner 400 to move to the right at the specified rightward moving speed, thereby enabling the air conditioner 400 to move in the direction of the user's hand b.
[0122] As an alternative, control commands are used to control the airflow of the air conditioner 400. The gesture behavior information includes the acceleration of hand movement, and the corresponding air conditioning control information includes the airflow of the air conditioner 400. The control command instructs the air conditioning control system 300 to control the airflow of the air conditioner 400 according to the acceleration, thereby enabling the airflow of the air conditioner 400 to change in accordance with the acceleration of the user's hand movement.
[0123] In practical applications, different gesture behavior information can correspond to different air conditioning control information. After obtaining the user's gesture behavior information based on at least one gesture control image, the electronic device can obtain the corresponding air conditioning control information based on the gesture behavior information. For example, if the gesture behavior information includes the direction of movement and relative position, the air conditioning control information corresponding to the gesture behavior information may include temperature; or, for example, if the gesture behavior information includes the opening and closing of the palm, the air conditioning control information corresponding to the gesture behavior information may include the air blowing mode, and so on.
[0124] Step 108: The air conditioning control system controls the airflow of the air conditioner according to the control command.
[0125] As an alternative, such as Figure 1 and Figure 3As shown, for example, if a control command instructs the air conditioner 400 to move its air outlet direction to the left at the specified leftward moving speed, the air conditioning control system 300 controls the air conditioner 400 to move its air outlet direction to the left at the specified leftward moving speed according to the control command. As another example, if a control command instructs the air conditioner 400 to move its air outlet direction to the right, the air conditioning control system 300 controls the air conditioner 400 to move its air outlet direction to the right at the specified rightward moving speed according to the control command.
[0126] As an alternative, if the control command is used to instruct the air volume of the air conditioner 400, the air conditioning control system 300 controls the air volume of the air conditioner according to the acceleration. Different acceleration values can correspond to different air volumes. For example, the greater the acceleration, the greater the air volume; conversely, the smaller the acceleration, the smaller the air volume.
[0127] To more accurately determine whether a user intends to control the air conditioner, this invention provides a method for determining such intentions. For example, Figure 4 These are flowcharts of methods for determining air conditioning control intent in some embodiments, such as... Figure 4 As shown, the method includes:
[0128] Step 202: The electronic device generates the position coordinates of the user's hand in the established spatial coordinate system based on the user's gesture image.
[0129] For example, an electronic device can establish a spatial coordinate system, such as a spatial rectangular coordinate system. The electronic device can then obtain the position coordinates of the user's hand in the user's gesture image in the spatial rectangular coordinate system. For example, the position coordinates can be (q1, w1, e1).
[0130] Step 204: The electronic device generates the air outlet spatial path of the air conditioner in the spatial coordinate system based on the air conditioner air outlet data.
[0131] For example, air conditioner air outlet data may include information about the air outlet and air direction data. Then, electronic devices can obtain the air outlet spatial path of the air outlet in a spatial rectangular coordinate system. For example, the air outlet spatial path k = x1 + y1 + z1.
[0132] Step 206: The electronic device determines whether the user's hand is located on the air outlet path of the air conditioner based on the hand's position coordinates and the air outlet space path. If yes, proceed to step 208; otherwise, proceed to step 210.
[0133] Step 208: The electronic device determines that the user intends to control the air conditioning.
[0134] Step 210: The electronic device determines that the user does not have the intention to control the air conditioner.
[0135] To more accurately determine whether the location coordinates are located on the air outlet path, this embodiment of the invention provides a method for determining whether a user's hand is located on the air outlet path of the air conditioner. For example, step 206 may specifically include:
[0136] Step 2062: In the spatial coordinate system, the electronic device generates a sphere with its position coordinates as the center and a first set value as the radius.
[0137] In this embodiment of the invention, the first set value can be the radius of the user's palm. Then the electronic device generates a sphere with the radius of the palm as the radius. For example, the radius of the palm is 10cm.
[0138] Step 2064: In the spatial coordinate system, the electronic device generates the air outlet space area where the air outlet space path is located based on the air outlet space path.
[0139] As an alternative, if the air outlet of the air conditioner is a point-shaped air outlet, then the air outlet space area is a cone with the point-shaped air outlet as the vertex and the air outlet space path as the center line, and the base radius of the cone is a second set value.
[0140] As another option, if the air conditioner's air outlet is a linear air outlet, then the air outlet space is a cuboid extending from the linear air outlet in the spatial coordinate system, and the air outlet space path is an axis of symmetry of the cuboid.
[0141] Step 2066: The electronic device determines whether there is an overlapping area between the sphere and the air outlet space area. If yes, proceed to step 2068; otherwise, proceed to step 2070.
[0142] Specifically, the electronic device determines whether there is an overlapping area between the sphere and the cone, or whether there is an overlapping area between the sphere and the air outlet space. As an optional solution, if the electronic device determines in step 2066 that there is an overlapping area between the sphere and the cone, it can also perform the following steps: The electronic device calculates the ratio of the cross-sectional area of the overlapping area to the interface area of the palm, and determines whether this ratio is greater than a set ratio threshold. If the ratio is greater than the set ratio threshold, step 2068 is executed; if the ratio is less than or equal to the set ratio threshold, step 2070 is executed. For example, the set ratio threshold is 30%.
[0143] Step 2068: The electronic device determines that the user's hand is located in the air outlet path of the air conditioner.
[0144] Step 2070: The electronic device determines that the user's hand is not located in the air outlet path of the air conditioner.
[0145] To avoid misjudging whether a user intends to control the air conditioner, embodiments of the present invention provide a method for preventing misjudgment of a user's intention to control the air conditioner.
[0146] As an optional solution, the user's intention to control the air conditioner can be further determined by the hand's grip posture and / or grip direction. That is, after determining that the user's hand is in the airflow path of the air conditioner, the electronic device can further assist in determining whether the user has the intention to control the air conditioner by observing the hand's grip posture and / or grip direction, thereby avoiding misjudgment of whether the user has the intention to control the air conditioner. Specifically, after step 2068, the method further includes:
[0147] Step 3012: The electronic device generates the hand holding posture and grip orientation based on the user's gesture image by establishing a hand model.
[0148] Electronic devices can input user gesture images to create a hand model, identify key hand nodes, and then output the hand's grip posture and grip orientation.
[0149] Step 3014: The electronic device determines whether the grip posture is the set grip posture and whether the grip orientation is the set grip orientation. If yes, proceed to step 208; otherwise, proceed to step 210.
[0150] If the electronic device determines that the grip posture is the set grip posture and the grip orientation is the set grip orientation, it executes step 208; if the electronic device determines that the grip posture is not the set grip posture and the grip orientation is not the predetermined grip orientation, it executes step 210.
[0151] like Figure 3 As shown, for example, setting the grip posture may include having all five fingers together, and setting the grip orientation may include the palm facing the air conditioner. If the electronic device determines that the grip posture is having all five fingers together and that the grip orientation is the palm facing the air conditioner, then it executes step 208, which determines that the user has the intention to control the air conditioner. If the electronic device determines that the grip posture is not having all five fingers together and / or that the grip orientation is not the palm facing the air conditioner, then it executes step 210, which determines that the user does not have the intention to control the air conditioner.
[0152] In this embodiment of the invention, in the technical solutions of steps 3012 and 3014, if the electronic device determines that the user's hand is located on the air outlet path of the air conditioner, it cannot directly determine that the user has the intention to control the air conditioner. Instead, it needs to further determine whether the user has the intention to control the air conditioner based on the grip posture and grip direction. Only when the electronic device determines that the user's hand is located on the air outlet path of the air conditioner, and determines that the grip posture and grip direction are the set grip posture and grip direction, can it be determined that the user has the intention to control the air conditioner. This avoids the problem of misjudgment when determining that the user has the intention to control the air conditioner solely based on the user's hand being located on the air outlet path of the air conditioner, and further improves the accuracy of determining whether the user has the intention to control the air conditioner.
[0153] Optionally, in step 3012, the electronic device can also generate a hand grip posture based on the user's gesture image using the established hand model. Then, in step 3014, the electronic device determines whether the grip posture is a set grip posture. If it is determined to be a set grip posture, the step of determining the user's intention to control the air conditioner in step 208 is executed; if it is determined that the grip posture is not a set grip posture, the step of determining the user's intention not to control the air conditioner in step 210 is executed. In this scheme, the electronic device only uses the hand grip posture as an auxiliary means to determine whether the user has the intention to control the air conditioner. That is, if the electronic device determines that the user's hand is located on the air conditioner's air outlet path, it cannot directly determine that the user has the intention to control the air conditioner, but needs to further determine whether the user has the intention to control it through the grip posture. Only when the electronic device determines that the user's hand is in the air outlet path of the air conditioner and judges that the holding posture is the set holding posture can it determine that the user has the intention to control the air conditioner. This avoids the problem of misjudgment when determining that the user has the intention to control the air conditioner simply by the fact that the user's hand is in the air outlet path of the air conditioner, and further improves the accuracy of determining whether the user has the intention to control the air conditioner.
[0154] Optionally, in step 3022, the electronic device can also generate the hand's grip orientation based on the user's gesture image using the established hand model. Then, in step 3034, the electronic device determines whether the grip orientation is the set grip orientation. If it is determined to be the set grip orientation, the step 208, determining that the user has the intention to control the air conditioner, is executed; if it is determined that the grip orientation is not the set grip orientation, the step 210, determining that the user does not have the intention to control the air conditioner, is executed. In this scheme, the electronic device only uses the hand's grip orientation as an auxiliary means to determine whether the user has the intention to control the air conditioner. That is, if the electronic device determines that the user's hand is located on the air conditioner's air outlet path, it cannot directly determine that the user has the intention to control the air conditioner; instead, it needs to further determine whether the user has the intention to control the air conditioner based on the grip orientation. Only when the electronic device determines that the user's hand is in the air outlet path of the air conditioner and judges that the grip direction is the set grip direction can it determine that the user has the intention to control the air conditioner. This avoids the problem of misjudgment when determining that the user has the intention to control the air conditioner simply by the fact that the user's hand is in the air outlet path of the air conditioner, and further improves the accuracy of determining whether the user has the intention to control the air conditioner.
[0155] It should be noted that in practical applications, the grip posture can include, but is not limited to, using five fingers together, and other grip postures can also be used, such as making a fist, making an OK gesture, etc., which will not be listed here; the grip direction can include, but is not limited to, the palm facing the direction of the air conditioner, and the back of the palm facing the direction of the air conditioner can also be used.
[0156] As an alternative, the temperature of the user's hand can be used to further determine whether the user intends to control the air conditioner. That is, after the electronic device determines that the user's hand is in the airflow path of the air conditioner, it can further use the temperature of the hand to assist in determining whether the user intends to control the air conditioner, thereby avoiding misjudgments. Specifically, after step 2068, the method further includes:
[0157] Step 3022: The electronic device acquires two infrared images of the hand from the infrared camera at set time intervals.
[0158] In this embodiment of the invention, when a user's hand is positioned in the airflow path of an air conditioner, the temperature of the user's hand will change rapidly due to the influence of the airflow. For example, the hand temperature will rise when the air conditioner is blowing hot air and fall when it is blowing cold air. An infrared camera can capture images of the user in real time. The electronic device can sequentially acquire two infrared images of the user's hand from the infrared camera at set time intervals when the user's hand is positioned in the airflow path of the air conditioner, for example, a time interval of 3 seconds.
[0159] Step 3024: The electronic device identifies the first and second temperatures of the user's hand based on the two infrared images of the hand acquired by the infrared camera.
[0160] When a user's hand temperature varies, the infrared image of the hand displays different colors. Therefore, electronic devices can identify the user's hand temperature based on the color of the infrared image. Thus, the electronic device identifies a first temperature of the user's hand based on one infrared image and a second temperature based on another infrared image.
[0161] Step 3026: The electronic device determines whether the absolute value of the difference between the first temperature and the second temperature is greater than the temperature change threshold. If yes, proceed to step 208; otherwise, proceed to step 210.
[0162] If the absolute value of the difference between the first temperature and the second temperature is greater than the temperature change threshold, it indicates a significant temperature change in the hand, such as a large decrease or increase in hand temperature. This further indicates that the user's hand is located in the air outlet path of the air conditioner, thus confirming the user's intention to control the air conditioner, and step 208 can be executed. If the absolute value of the difference between the first temperature and the second temperature is less than or equal to the temperature change threshold, it indicates a small temperature change in the hand, such as a small decrease or increase in hand temperature. Therefore, it can be confirmed that the user does not intend to control the air conditioner, and step 210 can be executed. For example, the temperature change threshold is 2°C.
[0163] In this embodiment of the invention, in the technical solutions of steps 3022 to 3026, if the electronic device determines that the user's hand is located on the air outlet path of the air conditioner, it cannot directly determine that the user has the intention to control the air conditioner. Instead, it needs to further determine whether the user has the intention to control the air conditioner based on the temperature of the hand. Only when the electronic device determines that the user's hand is located on the air outlet path of the air conditioner, and determines that the absolute value of the difference between the first temperature and the second temperature of the hand is greater than the temperature change threshold, can it be determined that the user has the intention to control the air conditioner. This avoids the problem of misjudgment when determining that the user has the intention to control the air conditioner solely based on whether the user's hand is located on the air outlet path of the air conditioner, and further improves the accuracy of determining whether the user has the intention to control the air conditioner.
[0164] As an alternative, the overlap time between the user's hand and the airflow path of the air conditioner can be used to further determine whether the user intends to control the air conditioner. That is, after determining that the user's hand is on the airflow path of the air conditioner, the electronic device can further use the overlap time between the user's hand and the airflow path to assist in determining whether the user intends to control the air conditioner, thereby avoiding misjudgment of whether the user intends to control the air conditioner. Specifically, after step 2068, the method further includes:
[0165] Step 3032: The electronic device calculates the overlap time between the user's hand and the air outlet path of the air conditioner based on at least one user gesture image obtained from the image acquisition device.
[0166] Specifically, the electronic device starts timing when it determines that the hand is on the air outlet path based on the user's gesture image, and ends timing when it determines that the hand is no longer on the air outlet path based on the user's gesture image, in order to obtain the overlap time. The specific method by which the electronic device determines that the hand is on the air outlet path or determines that the hand is no longer on the air outlet path based on at least one user gesture image can be found in the description of steps 2062 to 2070 above, and will not be repeated here.
[0167] Step 3034: The electronic device determines whether the overlap time is greater than the time threshold. If yes, proceed to step 208; otherwise, proceed to step 210.
[0168] If the electronic device determines that the overlap time is greater than the time threshold, it indicates that the hand has remained on the air conditioner's air outlet path for a certain period of time, further confirming that the user intends to control the air conditioner, and step 208 can be executed; if the electronic device determines that the overlap time is less than or equal to the time threshold, it indicates that the hand has remained on the air conditioner's air outlet path for a short time, suggesting that the hand may have simply passed quickly through the air conditioner's air outlet path, determining that the user does not intend to control the air conditioner, and step 210 can be executed. For example, the time threshold is 1 second.
[0169] In this embodiment of the invention, in the technical solutions of steps 3032 and 3034, if the electronic device determines that the user's hand is located on the air outlet path of the air conditioner, it cannot directly determine that the user has the intention to control the air conditioner. Instead, it needs to further determine whether the user has the intention to control the air conditioner by measuring the overlap time between the user's hand and the air outlet path. Only when the electronic device determines that the user's hand is located on the air outlet path of the air conditioner and determines that the overlap time is greater than a time threshold can it determine that the user has the intention to control the air conditioner. This avoids the problem of misjudgment when determining that the user has the intention to control the air conditioner solely by measuring the user's hand on the air outlet path, and further improves the accuracy of determining whether the user has the intention to control the air conditioner.
[0170] As an alternative, the relationship between the hand's position coordinates and the user's line of sight can be used to further determine whether the user intends to control the air conditioner. That is, after determining that the user's hand is on the air conditioner's airflow path, the electronic device can further use the relationship between the hand's position coordinates and the user's line of sight to assist in determining whether the user intends to control the air conditioner, thereby avoiding misjudgments. Specifically, after step 2068, the method further includes:
[0171] The electronic device determines whether the user's hand position coordinates are within the user's line of sight. If yes, it proceeds to step 208; otherwise, it proceeds to step 210.
[0172] In this embodiment of the invention, the eye tracker detects the user's eyes to obtain the user's gaze, and the electronic device obtains the user's gaze from the eye tracker.
[0173] In this embodiment of the invention, if the electronic device determines that the position coordinates are within the user's line of sight, it indicates that the user is paying attention to the hand's action of adjusting the air conditioner and the user has the awareness to control the air conditioner, and step 208 can be executed; if the electronic device determines that the position coordinates are not within the user's line of sight, it indicates that the user is not paying attention to the hand's action of adjusting the air conditioner and the user does not have the awareness to control the air conditioner, and step 210 can be executed.
[0174] As an alternative, the relationship between the air conditioner's air outlet, the hand's position coordinates, and the user's line of sight can be used to further determine whether the user intends to control the air conditioner. That is, after determining that the user's hand is on the air conditioner's air outlet path, the electronic device can further use the relationship between the air conditioner's air outlet, the hand's position coordinates, and the user's line of sight to assist in determining whether the user intends to control the air conditioner, thereby avoiding misjudgments. Specifically, after step 2068, the method further includes:
[0175] The electronic device determines whether the air outlet of the air conditioner and the position coordinates of the user's hand are both within the user's line of sight. If yes, it proceeds to step 208; otherwise, it proceeds to step 210.
[0176] In this embodiment of the invention, if the electronic device determines that the air outlet and its location coordinates are both within the user's line of sight, it indicates that the user is paying attention to the hand movements used to control the air conditioner and that the user is aware of controlling the air conditioner, and step 208 can be executed; if the electronic device determines that the air outlet and / or its location coordinates are not within the user's line of sight, it indicates that the user is not paying attention to the hand movements used to control the air conditioner and that the user is not aware of controlling the air conditioner, and step 210 can be executed.
[0177] As an alternative, the relationship between the hand's position coordinates and the user's head gaze direction can be used to further determine whether the user intends to control the air conditioner. That is, after determining that the user's hand is on the air conditioner's airflow path, the electronic device can further use the relationship between the hand's position coordinates and the user's head gaze direction to assist in determining whether the user intends to control the air conditioner, thereby avoiding misjudgments. Specifically, after step 2068, the method further includes:
[0178] The electronic device determines whether the position coordinates of the user's hand are located in the direction of the user's head gaze. If yes, it proceeds to step 208; otherwise, it proceeds to step 210.
[0179] In this embodiment of the invention, if the electronic device determines that the position coordinates are located in the direction of the user's head gaze, it indicates that the user is paying attention to the action of adjusting the air conditioner with their hands, and the user has the awareness to control the air conditioner, and step 208 can be executed; if the electronic device determines that the position coordinates are not located in the direction of the user's head gaze, it indicates that the user is not paying attention to the action of adjusting the air conditioner with their hands, and the user does not have the awareness to control the air conditioner, and step 210 can be executed.
[0180] In this embodiment of the invention, the image acquisition device acquires a user's head image and sends the user's head image to an electronic device. For example, the image acquisition device can be an RGB camera. The electronic device generates the user's head gaze direction based on the user's head image using a built head model. Specifically, the electronic device inputs the user's head image into the head model to output the user's head gaze direction.
[0181] As an alternative, the relationship between the air conditioner's air outlet, the hand's position coordinates, and the user's head gaze direction can be used to further determine whether the user intends to control the air conditioner. That is, after determining that the user's hand is on the air conditioner's air outlet path, the electronic device can further use the relationship between the air conditioner's air outlet, the hand's position coordinates, and the user's head gaze direction to assist in determining whether the user intends to control the air conditioner, thereby avoiding misjudgments. Specifically, after step 2068, the method further includes:
[0182] The electronic device determines whether the position coordinates of the air conditioner's air outlet and the user's hand are both located in the direction of the user's head gaze. If yes, it proceeds to step 208; otherwise, it proceeds to step 210.
[0183] In this embodiment of the invention, if the electronic device determines that the air outlet of the air conditioner and the position coordinates of the user's hand are both located in the direction of the user's head gaze, it indicates that the user is paying attention to the action of controlling the air conditioner with their hand and that the user has the awareness to control the air conditioner, and step 208 can be executed; if the electronic device determines that the position coordinates of the air outlet of the air conditioner and / or the user's hand are not located in the direction of the user's head gaze, it indicates that the user is not paying attention to the action of controlling the air conditioner with their hand and that the user does not have the awareness to control the air conditioner, and step 210 can be executed.
[0184] In this embodiment of the invention, if the electronic device determines that the user's hand is located on the air outlet path of the air conditioner, it cannot directly determine that the user intends to control the air conditioner. Instead, it needs to further determine whether the user intends to control the air conditioner by considering the relationship between the hand's position coordinates and the user's line of sight. Only when the electronic device determines that the user's hand is located on the air outlet path of the air conditioner and determines that the position coordinates of the user's hand are within the user's line of sight can it determine that the user intends to control the air conditioner. This avoids the problem of misjudgment that occurs when determining that the user intends to control the air conditioner solely based on whether the user's hand is located on the air outlet path, and further improves the accuracy of determining whether the user intends to control the air conditioner.
[0185] In order to determine whether a user has a continuous intention to control the air conditioner or an intention to exit air conditioner control during the user's gesture control process, this embodiment of the invention provides a method for determining whether a user has a continuous intention to control the air conditioner during the air conditioner control process.
[0186] As an alternative approach, the speed of hand movement can be used to determine whether the user has a sustained intention to control the air conditioning or intends to exit control. Specifically, the method further includes:
[0187] Step 1062: The electronic device calculates the speed of the user's hand movement based on multiple gesture control images acquired from the image acquisition device.
[0188] When a user controls the air conditioner's airflow using gestures, their hand typically needs to move slowly to ensure the airflow direction follows the hand's movement. Therefore, the electronic device needs to calculate the hand movement speed from multiple gesture control images when the user performs gesture control.
[0189] During the user's hand movement, the image acquisition device captures gesture control images in real time and sends multiple captured gesture control images to the electronic device. The electronic device identifies the hand's displacement from the multiple gesture control images and records the time of displacement. By removing bits and using the time of displacement, the speed of hand movement is derived, where the hand displacement represents the change in hand position.
[0190] Step 1064: The electronic device determines whether the speed of the hand movement is less than the speed threshold. If yes, proceed to step 106; otherwise, proceed to step 1066.
[0191] If the electronic device determines that the hand movement speed is less than a speed threshold, indicating that the user has a continuous intention to control the air conditioner, it can proceed to step 106 to continue controlling the air conditioner through the user's gestures. If the electronic device determines that the hand movement speed is greater than or equal to a speed threshold, indicating that the user has an intention to exit air conditioner control, it can proceed to step 1066. For example, the speed threshold is 5 cm / s.
[0192] Step 1066: Exit the air conditioning control operation of the electronic device.
[0193] As an alternative approach, the acceleration of hand movements can be used to determine whether the user has a sustained intention to control the air conditioning or intends to exit air conditioning control. Specifically, the method further includes:
[0194] Step 1072: The electronic device calculates the acceleration of the user's hand movement based on multiple gesture control images acquired from the image acquisition device.
[0195] When a user controls the air conditioner's airflow using gestures, their hand typically needs to move at a constant speed to ensure the airflow direction follows the hand's movement. Therefore, the electronic device needs to calculate the acceleration of the hand movement from multiple gesture control images.
[0196] During the user's hand movement, the image acquisition device captures gesture control images in real time and sends multiple captured gesture control images to the electronic device. The electronic device identifies the hand displacement from the multiple gesture control images and records the time of displacement. It then removes the bits and uses the time of displacement to derive the hand movement speed. Based on the speeds of the two hand movements, the electronic device calculates the speed change and divides the speed change by the time taken to obtain the hand movement acceleration.
[0197] Step 1074: The electronic device determines whether the acceleration of the hand movement is less than the acceleration threshold. If yes, proceed to step 106; otherwise, proceed to step 1076.
[0198] If the electronic device determines that the acceleration of the hand movement is less than the acceleration threshold, indicating that the user has a continuous intention to control the air conditioner, it can proceed to step 106 to continue controlling the air conditioner through the user's gestures. If the electronic device determines that the acceleration of the hand movement is greater than or equal to the acceleration threshold, indicating that the user has an intention to exit air conditioner control, it can proceed to step 1066. For example, the acceleration threshold is 0.3 m / s². 2 .
[0199] Step 1076: Exit the air conditioning control operation of the electronic device.
[0200] As an alternative approach, the speed of hand movement and the speed of airflow movement can be used to determine whether the user has a sustained intention to control the air conditioning or intends to exit control. Specifically, the method further includes:
[0201] Step 1082: The electronic device calculates the speed of the user's hand movement based on multiple gesture control images acquired from the image acquisition device.
[0202] When a user controls the air conditioner's airflow using gestures, their hand typically moves slowly. The user adapts to the changing airflow direction and speed to ensure the airflow follows the hand's movement. Therefore, the electronic device needs to calculate the hand's movement speed from multiple gesture control images.
[0203] For the calculation method of hand movement speed, please refer to step 1062, which will not be repeated here.
[0204] Step 1084: The electronic device calculates the airflow direction movement speed of the air conditioner based on the speed of the air outlet obtained from the air conditioner control system.
[0205] If the air conditioner's air outlet is a parallel moving outlet, and the speed of the air outlet is the speed at which the air outlet moves parallel, then the electronic equipment will determine the speed at which the air outlet moves parallel as the speed of the airflow direction.
[0206] If the air conditioner's air outlet is a rotating outlet, and the speed of the air outlet is the angular velocity of its rotation, then the electronic device can generate the airflow direction speed based on the angular velocity of the air outlet's rotation and the distance between the hand and the air outlet. Specifically, the electronic device calculates the airflow direction speed using the formula v = w * r, where v is the airflow direction speed, w is the angular velocity of the air outlet's rotation, and r is the distance between the hand and the air outlet. The airflow direction speed is the linear velocity of the airflow. Step 1086: The electronic device determines whether the difference between the hand's movement speed and the airflow direction speed is less than a speed difference threshold. If yes, proceed to step 106; otherwise, proceed to step 1088.
[0207] If the electronic device determines that the difference between the speed of the hand movement and the speed of the airflow movement is less than a speed difference threshold, indicating that the user has a continuous intention to control the air conditioner, then it can execute step 106 to continue controlling the air conditioner through the user's gestures. If the electronic device determines that the difference between the speed of the hand movement and the speed of the airflow movement is greater than or equal to a speed difference threshold, indicating that the user has an intention to exit air conditioner control, then it can execute step 1066. For example, the speed difference threshold is 1 cm / s.
[0208] Step 1088: Exit the air conditioning control operation of the electronic device.
[0209] As an alternative approach, the user's intention to continuously control the air conditioning or to exit air conditioning control can be determined by the hand's position coordinates and the airflow path. Specifically, the method further includes:
[0210] Step 1092: The electronic device generates the position coordinates of the hand corresponding to each gesture control image in the established spatial coordinate system based on the multiple gesture control images acquired from the image acquisition device.
[0211] Step 1094: The electronic device generates multiple air outlet spatial paths for the air conditioning outlets in the spatial coordinate system based on multiple air conditioning outlet data obtained from the air conditioning control system.
[0212] Step 1096: The electronic device determines whether the user's hand is located on the corresponding air outlet path within a set time period based on each location coordinate and the corresponding air outlet space path. If yes, proceed to step 106; otherwise, proceed to step 1098.
[0213] If the electronic device determines that the user's hand is consistently positioned on the corresponding air outlet path within a set time period, indicating a continuous overlap between the user's hand and the air conditioner's air outlet path during that period, and that the user has a sustained intention to control the air conditioner, then step 106 can be executed to continue controlling the air conditioner via the user's gestures. If it determines that the user's hand is not positioned on the corresponding air outlet path at least once within the set time period, indicating a lack of continuous overlap between the user's hand and the corresponding air outlet path during that period, and that the user intends to exit air conditioner control, then step 1098 can be executed. For example, the set time period is 2 seconds. A detailed description of step 1096 can be found in steps 2062 to 2070, and will not be repeated here.
[0214] Step 1098: Exit the air conditioning control operation of the electronic device.
[0215] As an alternative, the user's intention to exit air conditioning control can be determined by a stop operation gesture. Specifically, the method further includes: if the electronic device recognizes a stop operation gesture from the gesture control image, it exits the air conditioning control operation. For example, the stop operation gesture includes a hand retraction gesture, a fist clenching gesture, a hand downward gesture, or a hand returning to the steering wheel gesture. Alternatively, the stop operation gesture can be a rapid operation gesture, which can include operation gestures with a speed greater than a set speed threshold. For example, rapid operation gestures include a rapid hand retraction gesture, a rapid fist clenching gesture, a rapid hand downward gesture, or a rapid hand returning to the steering wheel gesture, and the set speed threshold can be 0.5 m / s.
[0216] When a user controls the air conditioner using gestures, if the electronic device recognizes a stop operation action from the gesture control image, indicating that the user intends to exit the air conditioner, it will directly exit the air conditioner control operation; if the electronic device does not recognize a stop operation action from the gesture control image, it can execute step 106 and continue to control the air conditioner using the user's gestures.
[0217] As an alternative approach, the user's intention to continuously control the air conditioner or to disengage from it can be determined by the coordinates of their hand, the air vents of the air conditioner, and their line of sight. Specifically, the method further includes:
[0218] Step 2002: The electronic device generates the position coordinates of the user's hand in the established spatial coordinate system based on the gesture control image obtained from the image acquisition device.
[0219] Step 2004: The electronic device determines whether the air outlet of the air conditioner and the position coordinates of the user's hand are both within the user's line of sight. If yes, proceed to step 106; otherwise, proceed to step 2006.
[0220] If the electronic device determines that the air conditioner's air outlet and location coordinates are both within the user's line of sight, indicating that the user has a continuous intention to control the air conditioner, then it can proceed to step 106 to continue controlling the air conditioner through the user's gestures. If the electronic device determines that the location coordinates and / or the air conditioner's air outlet are not within the user's line of sight, indicating that the user has an intention to exit air conditioner control, then it can proceed to step 2006.
[0221] Step 2006: Exit the air conditioning control operation of the electronic device.
[0222] As an alternative approach, the user's intention to continuously control the air conditioner or to disengage from it can be determined by the coordinates of their hand position, the air vent of the air conditioner, and the direction of their gaze. Specifically, the method further includes:
[0223] Step 2102: The electronic device generates the position coordinates of the user's hand in the established spatial coordinate system based on the gesture control image obtained from the image acquisition device.
[0224] Step 2104: The electronic device determines whether the position coordinates of the air conditioner's air outlet and the user's hand are both located in the direction of the user's head gaze. If yes, proceed to step 106; otherwise, proceed to step 2106.
[0225] If the electronic device determines that the air conditioner's vent and location coordinates are both in the user's head-gazing direction, indicating that the user has a continuous intention to control the air conditioner, then it can execute step 106 to continue controlling the air conditioner through the user's gestures. If the electronic device determines that the location coordinates and / or the air conditioner's vent are not in the user's head-gazing direction, indicating that the user has an intention to exit air conditioner control, then it executes step 2106.
[0226] Step 2106: Exit the air conditioning control operation of the electronic device.
[0227] In this embodiment of the invention, the user can feel the airflow of the air conditioner through their own touch, thereby naturally activating the control function of the air conditioner's airflow. Then, the airflow of the air conditioner can move with the movement of the user's hand, and the air conditioner control process can be naturally ended when the user intends to exit the air conditioner operation.
[0228] In order to promptly notify users that the function of controlling the air conditioner via gestures has been successfully triggered, this embodiment of the invention provides a method for outputting successful trigger feedback through a feedback device.
[0229] As an alternative, after determining that the user intends to control the air conditioner, the method further includes: the electronic device sending a trigger success command to the feedback device, so that the feedback device outputs trigger success feedback according to the trigger success command.
[0230] In this embodiment of the invention, when the feedback device is a functional light, the successful trigger feedback is that the functional light illuminates. For example, functional lights include interior ambient lights, other vehicle lights, environmental lights, or smart streetlights. When the feedback device is a fragrance diffuser, the successful trigger feedback is that the fragrance diffuser emits a fragrance. When the feedback device is an in-vehicle projector, the successful trigger feedback is that the in-vehicle projection is successful. When the feedback device is an external projector, the successful trigger feedback is that the external projection is successful. When the feedback device is a screen, the successful trigger feedback is that the displayed image is successful. When the feedback device is a seat, the successful trigger feedback is that the seat vibrates. When the feedback device is a seatbelt, the successful trigger feedback is that the seatbelt vibrates. When the feedback device is a speaker, the successful trigger feedback is that sound is emitted. When the feedback device is an ultrasonic tactile feedback device, the successful trigger feedback is ultrasonic air-to-ground feedback. When the feedback device is an electromagnetic wave generator, a current human body sensing device, an implanted artificial organ, or an implanted microelectronic bio-device, the successful trigger feedback is inductive feedback. When the feedback device is a brain-computer interface device, the successful trigger feedback is a signal sent to the brain indicating successful triggering, so that the brain generates an image of successful triggering information based on the signal.
[0231] As an alternative, when the feedback device is a non-invasive wearable device, the successful feedback is triggered by a function possessed by that non-invasive wearable device. Non-invasive wearable devices include smartwatches, smart bracelets, smart rings, VR haptic gloves, smart glasses, smart headphones, or smart neckbands, etc. For example, when the feedback device is a smartwatch, the successful feedback is triggered by displaying an image.
[0232] As an alternative, when the feedback device is an invasive wearable device, the successful feedback is triggered by a function possessed by that invasive wearable device. Invasive wearable devices include implanted smart earrings, implanted nose rings, or implanted bracelets, etc. For example, when the feedback device is an implanted earring, the successful feedback is vibration feedback.
[0233] As an alternative, after determining that the user intends to control the air conditioner, the method further includes: the electronic device sending a trigger success command to the air conditioner control system, so that the air conditioner control system instructs the air conditioner to output trigger success feedback according to the trigger success command. For example, trigger success feedback includes feedback on changes in airflow or changes in airflow density. In order to promptly inform the user of the real-time adjustment results of the air conditioner, embodiments of the present invention provide a method for outputting adjustment result feedback through a feedback device.
[0234] As an optional approach, after step 106, the method further includes: the electronic device sending an adjustment result instruction to the feedback device, so that the feedback device outputs adjustment result feedback according to the adjustment result instruction.
[0235] In this embodiment of the invention, when the feedback device is a functional light, the adjustment result feedback is that the functional light emits light. For example, functional lights include interior ambient lights, other vehicle lights, ambient lights, or smart streetlights. When the feedback device is a fragrance diffuser, the adjustment result feedback is that the fragrance diffuser emits a fragrance. When the feedback device is an in-vehicle projector, the adjustment result feedback is that the in-vehicle projection is projected. When the feedback device is an external projector, the adjustment result feedback is that the external projection is projected. When the feedback device is a screen, the adjustment result feedback is that the display image is shown. When the feedback device is a seat, the adjustment result feedback is that the seat vibrates. When the feedback device is a seatbelt, the adjustment result feedback is that the seatbelt vibrates. When the feedback device is a speaker, the adjustment result feedback is that sound is emitted. When the feedback device is an ultrasonic tactile feedback device, the adjustment result feedback is ultrasonic air-to-air feedback. When the feedback device is an electromagnetic wave generator, a current human body sensing device, an implanted artificial organ, or an implanted microelectronic bio-device, the adjustment result feedback is inductive feedback. When the feedback device is a brain-computer interface device, the adjustment result feedback is a signal indicating successful triggering sent to the brain, so that the brain generates an image of successful triggering information based on the signal.
[0236] As an alternative, when the feedback device is a non-invasive wearable device, the adjustment result feedback is the feedback provided by the functions of that non-invasive wearable device. Non-invasive wearable devices include smartwatches, smart bracelets, smart rings, VR haptic gloves, smart glasses, smart headphones, or smart neckbands, etc. For example, when the feedback device is a smartwatch, the adjustment result feedback is the displayed image feedback.
[0237] As an alternative, when the feedback device is an invasive wearable device, the adjustment result feedback is the feedback of the functions provided by that invasive wearable device. Invasive wearable devices include implanted smart earrings, implanted nose rings, or implanted bracelets, etc. For example, when the feedback device is an implanted earring, the adjustment result feedback is vibration feedback.
[0238] As an alternative, after step 106, the method further includes: the electronic device sending an adjustment result command to the air conditioning control system, so that the air conditioning control system instructs the air conditioner to output adjustment result feedback according to the adjustment result command. For example, the adjustment result feedback includes feedback on changes in airflow or changes in airflow mist size.
[0239] In order to promptly notify users to exit the air conditioning operation, this embodiment of the invention provides a method for outputting exit operation feedback through a feedback device.
[0240] As an optional solution, after exiting the air conditioning control operation, the electronic device also sends an exit operation command to the feedback device, so that the feedback device outputs exit operation feedback according to the exit operation command.
[0241] In this embodiment of the invention, when the feedback device is an ambient light, the exit operation feedback is that the ambient light illuminates; when the feedback device is a fragrance diffuser, the exit operation feedback is that the fragrance diffuser emits a fragrance; when the feedback device is an in-vehicle projector, the exit operation feedback is that the in-vehicle projection occurs; when the feedback device is an external projector, the exit operation feedback is that the external projection occurs; when the feedback device is a screen, the exit operation feedback is that the displayed image occurs; when the feedback device is a seat, the exit operation feedback is that the seat vibrates; when the feedback device is a seatbelt, the exit operation feedback is that the seatbelt vibrates; when the feedback device is a speaker, the exit operation feedback is that sound is emitted; when the feedback device is an ultrasonic tactile feedback device, the exit operation feedback is ultrasonic air-sensitive feedback.
[0242] As an alternative, after exiting the air conditioning control operation, the process also includes: the electronic device sending an exit operation command to the air conditioning control system, so that the air conditioning control system instructs the air conditioner to output exit operation feedback according to the exit operation command. For example, exit operation feedback may include feedback on changes in airflow or changes in airflow volume.
[0243] In this embodiment of the invention, during the process of controlling the air conditioner, feedback can be provided on the successful triggering of the air conditioner control intention, the adjustment result of the air conditioner control, and the exit operation of exiting the air conditioner control through a multimodal feedback method.
[0244] This invention provides a computer-readable storage medium including a stored program, wherein the program, when running, controls the electronic device containing the computer-readable storage medium to execute the aforementioned air conditioning control method.
[0245] This invention provides an electronic device. The electronic device includes: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the device, enable the device to perform the various steps in the above-described air conditioning control method embodiments.
[0246] Figure 5 These are schematic diagrams of an electronic device provided in some embodiments, such as... Figure 5 As shown, the electronic device 100 includes a processor 11, a memory 12, and a computer program 13 stored in the memory 12 and executable on the processor 11. When the computer program 13 is executed by the processor 11, it implements the air conditioning control method in the embodiment. To avoid repetition, it will not be described in detail here.
[0247] Electronic device 100 includes, but is not limited to, a processor 11 and a memory 12. Those skilled in the art will understand that... Figure 5 This is merely an example of electronic device 100 and does not constitute a limitation on electronic device 100. It may include more or fewer components than shown, or combine certain components, or different components. For example, a server may also include input / output devices, network access devices, buses, etc.
[0248] The processor 11 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.
[0249] The memory 12 can be an internal storage unit of the electronic device 100, such as a hard disk or RAM of the electronic device 100. The memory 12 can also be an external storage device of the electronic device 100, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, or FlashCard. Furthermore, the memory 12 can include both internal and external storage units of the electronic device 100. The memory 12 is used to store computer programs and other programs and data required by the electronic device 100. The memory 12 can also be used to temporarily store data that has been output or will be output.
[0250] In this embodiment of the invention, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, the simultaneous existence of A and B, or the existence of B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0251] Those skilled in the art will recognize that the units and algorithm steps described in the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of electronic hardware and software. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.
[0252] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0253] In the several embodiments provided by this invention, any function, if implemented as a software functional unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0254] The above description is merely a specific embodiment of the present invention. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this invention should be included within the protection scope of this invention. The protection scope of this invention should be determined by the scope of the claims.
Claims
1. An air conditioning control method, characterized in that, The method is applied to an electronic device, and the method includes: Based on the user's gesture image obtained from the image acquisition device and the air conditioning output data obtained from the air conditioning control system, it is determined whether the user has the intention to control the air conditioning. If it is determined that the user intends to control the air conditioner, at least one gesture control image of the user performing gesture control is acquired from the image acquisition device; The air conditioning control system sends control commands to the air conditioning control system based on the at least one gesture control image, so that the air conditioning control system can control the air outlet of the air conditioner according to the control commands; The step of determining whether a user intends to control the air conditioning based on a user gesture image acquired from an image acquisition device and air conditioning airflow data acquired from the air conditioning control system includes: Based on the user's gesture image, generate the position coordinates of the user's hand in the established spatial coordinate system; Based on the air conditioning outlet data, generate the air outlet spatial path of the air conditioning outlet in the spatial coordinate system; Based on the coordinates of the user's hand and the air outlet path, determine whether the user's hand is located on the air outlet path of the air conditioner; If it is determined that the user's hand is located in the air outlet path of the air conditioner, then it is determined that the user has the intention to control the air conditioner. If it is determined that the user's hand is not located in the air outlet path of the air conditioner, then it is determined that the user does not intend to control the air conditioner.
2. The method according to claim 1, characterized in that, The step of determining whether the user's hand is located in the air outlet path of the air conditioner includes: In the spatial coordinate system, a sphere is generated with the position coordinates as the center and a first set value as the radius; In the spatial coordinate system, the air outlet space region where the air outlet space path is located is generated according to the air outlet space path; Determine whether there is an overlapping area between the sphere and the air outlet space area; If it is determined that there is an overlapping area between the sphere and the air outlet space, then it is determined that the user's hand is located on the air outlet path of the air conditioner; If it is determined that there is no overlap between the sphere and the air outlet space area, then it is determined that the user's hand is not located on the air outlet space path.
3. The method according to claim 1, characterized in that, After determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes: By establishing a hand model, the hand's grip posture and / or grip orientation are generated based on the user's gesture image; Determine whether the grip posture is the set grip posture and determine whether the grip orientation is the set grip orientation; If it is determined that the grip posture is the set grip posture and the grip direction is the set grip direction, then the step of determining that the user has the intention to control the air conditioner is executed; If it is determined that the grip posture is not the set grip posture and / or the grip orientation is not the set grip orientation, then the step of determining that the user does not have the intention to control the air conditioning is executed.
4. The method according to claim 1, characterized in that, After determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes: Two infrared images of a hand are acquired from an infrared camera at set time intervals; Based on two infrared images of the hand captured by the infrared camera, the first and second temperatures of the user's hand are identified. Determine whether the absolute value of the difference between the first temperature and the second temperature is greater than the temperature change threshold. If it is determined that the absolute value of the difference is greater than the temperature change threshold, the step of determining that the user has the intention to control the air conditioner is executed. If it is determined that the absolute value of the difference is less than or equal to the temperature change threshold, the step of determining that the user does not have the intention to control the air conditioner is executed.
5. The method according to claim 1, characterized in that, After determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes: The overlap time between the user's hand and the air outlet path of the air conditioner is calculated based on at least one user gesture image acquired from the image acquisition device. Determine whether the overlap time is greater than a time threshold; If it is determined that the overlap time is greater than the time threshold, the step of determining that the user has the intention to control the air conditioner is executed. If it is determined that the overlap time is less than or equal to the time threshold, the step of determining that the user does not have the intention to control the air conditioner is executed.
6. The method according to claim 1, characterized in that, After determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes: Determine whether the air outlet of the air conditioner and the position coordinates of the user's hand are both within the user's line of sight; If it is determined that the air outlet and its location coordinates are both within the user's line of sight, then proceed with the step of determining that the user has the intention to control the air conditioner. If it is determined that the air outlet and / or its location coordinates are not within the user's line of sight, then proceed with the step of determining that the user does not intend to control the air conditioner.
7. The method according to claim 1, characterized in that, After determining that the user's hand is located in the air outlet path of the air conditioner, the method further includes: Determine whether the coordinates of the air conditioner's air outlet and the user's hand are both located in the direction the user is looking at. If it is determined that the air outlet and its location coordinates are both located in the direction the user is looking, then proceed with the step of determining that the user has the intention to control the air conditioner. If it is determined that the air outlet and / or location coordinates of the air conditioner are not located in the direction the user is looking, then the step of determining that the user does not have the intention to control the air conditioner is executed.
8. The method according to claim 1, characterized in that, The method further includes: The speed of the user's hand movement is calculated based on multiple gesture control images acquired from the image acquisition device; Determine whether the speed of the hand movement is less than a speed threshold; If it is determined that the speed of the hand movement is less than the speed threshold, then the step of sending a control command to the air conditioning control system based on the at least one gesture control image is executed; If it is determined that the speed of the hand movement is greater than or equal to the speed threshold, the air conditioning control operation is exited.
9. The method according to claim 1, characterized in that, The method further includes: The acceleration of the user's hand movement is calculated based on multiple gesture control images acquired from the image acquisition device. Determine whether the acceleration of the hand movement is less than an acceleration threshold; If it is determined that the acceleration of the hand movement is less than the acceleration threshold, then the step of sending a control command to the air conditioning control system based on the at least one gesture control image is executed. If it is determined that the acceleration of the hand movement is greater than or equal to the acceleration threshold, the air conditioning control operation is exited.
10. The method according to claim 1, characterized in that, The method further includes: The speed of the user's hand movement is calculated based on multiple gesture control images acquired from the image acquisition device; The airflow direction movement speed of the air outlet is calculated based on the speed of the air outlet obtained from the air conditioning control system. Determine whether the difference between the speed of the hand movement and the speed of the wind movement is less than a speed difference threshold; If it is determined that the difference between the speed of the hand movement and the speed of the wind movement is less than the speed difference threshold, then the step of sending a control command to the air conditioning control system based on the at least one gesture control image is executed. If it is determined that the difference between the speed of the hand movement and the speed of the wind movement is greater than or equal to the speed difference threshold, then the air conditioning control operation is exited.
11. The method according to claim 1, characterized in that, The method further includes: Based on multiple gesture control images acquired from the image acquisition device, the position coordinates of the hand corresponding to each gesture control image are generated in the established spatial coordinate system. Based on multiple air outlet data obtained from the air conditioning control system, multiple air outlet spatial paths are generated in the spatial coordinate system. Based on each location coordinate and the corresponding air outlet path, determine whether the user's hand is always on the corresponding air outlet path within a set time period; If it is determined that the user's hand is located on the corresponding air outlet path within a set time period, then the step of sending a control command to the air conditioning control system based on the at least one gesture control image is executed. If it is determined that the user's hand is not located on the corresponding air outlet path at least once within the set time period, the air conditioning control operation is exited.
12. The method according to claim 1, characterized in that, The method further includes: If a stop operation action is recognized from the gesture control image, the air conditioning control operation is exited.
13. The method according to claim 12, characterized in that, The stopping actions include retracting the hand, clenching a fist, lowering the hand, or placing the hand back on the steering wheel.
14. The method according to claim 1, characterized in that, The method further includes: Based on the gesture control image acquired from the image acquisition device, the position coordinates of the user's hand are generated in the established spatial coordinate system; Determine whether the air outlet of the air conditioner and the position coordinates of the user's hand are both within the user's line of sight; If it is determined that the air outlet of the air conditioner and the location coordinates are both within the user's line of sight, then the step of determining that the user has the intention to control the air conditioner is executed. If it is determined that the air outlet of the air conditioner and / or the location coordinates are not within the user's line of sight, then the air conditioner control operation is exited.
15. The method according to claim 1, characterized in that, The method further includes: Based on the gesture control image acquired from the image acquisition device, the position coordinates of the user's hand are generated in the established spatial coordinate system; Determine whether the coordinates of the air conditioner's air outlet and the user's hand are both located in the direction the user is looking at. If it is determined that the air outlet of the air conditioner and the location coordinates are both located in the direction of the user's head gaze, then the step of determining that the user has the intention to control the air conditioner is executed. If it is determined that the air outlet of the air conditioner and / or the location coordinates are not located in the direction of the user's head gaze, the air conditioner control operation is exited.
16. The method according to any one of claims 1 to 15, characterized in that, After determining that the user intends to control the air conditioning, the process also includes: A trigger success command is sent to the feedback device, so that the feedback device outputs trigger success feedback according to the trigger success command.
17. The method according to any one of claims 1 to 15, characterized in that, After sending control commands to the air conditioning control system based on the at least one gesture control image, the method further includes: An adjustment result instruction is sent to the feedback device so that the feedback device outputs adjustment result feedback according to the adjustment result instruction.
18. The method according to any one of claims 8 to 15, characterized in that, After exiting the air conditioning control operation, the following is also included: Send an exit operation command to the feedback device so that the feedback device outputs exit operation feedback according to the exit operation command.
19. The method according to any one of claims 1 to 15, characterized in that, The air conditioning outlet data includes information about the air conditioning outlet and airflow direction.
20. An air conditioning control system, characterized in that, include: Electronic equipment, image acquisition equipment, and air conditioning control systems; The electronic device is used to determine whether the user has the intention to control the air conditioner based on the user gesture image obtained from the image acquisition device and the air conditioner air output data obtained from the air conditioner control system. If it is determined that the user intends to control the air conditioner, at least one gesture control image of the user performing gesture control is acquired from the image acquisition device; The control command is sent to the air conditioning control system based on the at least one gesture control image; The air conditioning control system is used to control the air output of the air conditioner according to the control command; The electronic device is specifically used to generate the position coordinates of the user's hand in an established spatial coordinate system based on the user's gesture image; generate the air outlet spatial path of the air conditioner in the spatial coordinate system based on the air conditioner's air outlet data; determine whether the user's hand is located on the air outlet path of the air conditioner based on the position coordinates of the user's hand and the air outlet spatial path; if it is determined that the user's hand is located on the air outlet path of the air conditioner, then it is determined that the user has the intention to control the air conditioner. If it is determined that the user's hand is not located in the air outlet path of the air conditioner, then it is determined that the user does not intend to control the air conditioner.
21. A vehicle, characterized in that, include: The air conditioning control system according to claim 20.
22. An electronic device, characterized in that, include: One or more processors; Memory; And one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs including instructions that, when executed by the electronic device, cause the electronic device to perform the air conditioning control method according to any one of claims 1 to 19.
23. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein, when the program is executed, it controls the electronic device in which the computer-readable storage medium is located to perform the air conditioning control method according to any one of claims 1 to 19.
Citation Information
Patent Citations
Gesture identification apparatus, communication device and vehicle
CN107797651A
3D interaction method and device, computer equipment and storage medium
CN108052202A
Gesture recognition system and car
CN206258820U