A method, device, terminal equipment and storage medium for adjusting air conditioner in vehicle

Abstract

The present application is applicable to the field of air-conditioning control technology, and provides a method, apparatus, terminal device and storage medium for adjusting the in-vehicle air-conditioning. The method includes: obtaining a first in-vehicle image in which a first gesture is present, and then determining the target air-conditioning that needs to be adjusted according to the position of the first gesture in the first in-vehicle image, and sending the air-conditioning adjustment strategy corresponding to the first gesture to the target air-conditioning. The present application uses gesture detection to adjust the air-conditioning. The user only needs to make the corresponding gesture without searching for buttons, which makes the adjustment of the air-conditioning more convenient and can also increase the intelligence level of the vehicle. In addition, the present application can also determine the in-vehicle air-conditioning that needs to be adjusted according to the position of the first gesture in the first in-vehicle image, and only adjust the in-vehicle air-conditioning that needs to be adjusted, while other air-conditioning are not adjusted. The zoned adjustment of the air-conditioning is achieved through gesture recognition, which improves the intelligence level of the vehicle.

Description

Technical Field

[0001] The present application belongs to the technical field of air conditioning control, and in particular, relates to a method, device, terminal equipment and storage medium for regulating in-vehicle air conditioning. Background Art

[0002] With the development of automobiles, in-car air conditioning has become one of the indispensable equipment in automobiles.

[0003] At present, due to the low level of intelligence of vehicles, the air conditioning in the car is mostly adjusted by physical buttons or touch buttons. When the driver uses physical buttons or touch buttons to adjust the air conditioning while driving, the driver needs to shift his eyes to determine the location of the physical buttons or touch buttons, which makes the air conditioning adjustment inconvenient. Summary of the invention

[0004] The embodiments of the present application provide a method, apparatus, terminal device and storage medium for adjusting the in-vehicle air conditioner, which can solve the problem of inconvenient adjustment of the in-vehicle air conditioner due to the low level of intelligence of the vehicle.

[0005] In a first aspect, an embodiment of the present application provides a method for adjusting an in-vehicle air conditioner, comprising:

[0006] Acquire a first in-vehicle image of a vehicle, wherein the vehicle is provided with at least two in-vehicle air conditioners, and a first gesture for adjusting the in-vehicle air conditioners exists in the first in-vehicle image;

[0007] Determining a target air conditioner in the vehicle based on a position of the first gesture in the first in-vehicle image, wherein the target air conditioner is an in-vehicle air conditioner that needs to be adjusted;

[0008] The target air conditioner is controlled to perform an action based on the air conditioner adjustment strategy corresponding to the first gesture.

[0009] In a second aspect, an embodiment of the present application provides a regulating device for an in-vehicle air conditioner, comprising:

[0010] An image acquisition module, configured to acquire a first in-vehicle image of a vehicle, wherein the vehicle is provided with at least two in-vehicle air conditioners, and a first gesture for adjusting the in-vehicle air conditioners is present in the first in-vehicle image;

[0011] a target determination module, configured to determine a target air conditioner in the vehicle based on a position of the first gesture in the first in-vehicle image, wherein the target air conditioner is an in-vehicle air conditioner that needs to be adjusted;

[0012] The strategy sending module is used to control the target air conditioner to perform an action based on the air conditioner adjustment strategy corresponding to the first gesture.

[0013] In a third aspect, an embodiment of the present application provides a vehicle, including: an image acquisition module, a central processing unit, an air conditioning adjustment module, and an edge computing module;

[0014] An image acquisition module is used to acquire a first in-vehicle image and send the first in-vehicle image to an edge computing module;

[0015] an edge computing module, detecting whether the first in-vehicle image includes a first gesture, and sending a gesture type of the first gesture to a central processor when the first in-vehicle image includes the first gesture;

[0016] A central processing unit, for executing the method for adjusting the in-vehicle air conditioner according to the first aspect;

[0017] The air conditioning adjustment module controls the air conditioning in the vehicle to operate according to the air conditioning control strategy corresponding to the first gesture sent by the central processing unit.

[0018] In this embodiment, the vehicle further comprises a voice module;

[0019] The voice module broadcasts the air conditioning control strategy corresponding to the first gesture.

[0020] In a possible implementation manner of the second aspect, the method further includes:

[0021] An image acquisition module acquires a second in-vehicle image and sends the first in-vehicle image to an edge computing module;

[0022] an edge computing module, detecting whether the second in-vehicle image includes a second gesture, and sending a gesture type of the second gesture to a central processor when the second in-vehicle image includes the second gesture;

[0023] The central processing unit, after receiving the gesture type of the second gesture, sends a wake-up instruction to the air conditioning adjustment module;

[0024] The air conditioning adjustment module receives the wake-up command sent by the central processing unit and controls the air conditioning in the vehicle to enter the wake-up state.

[0025] In a fourth aspect, an embodiment of the present application provides a terminal device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for adjusting the in-vehicle air conditioner described in any one of the first aspects above is implemented.

[0026] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for adjusting the in-vehicle air conditioner described in any one of the first aspects above is implemented.

[0027] In a sixth aspect, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute the method for adjusting the in-vehicle air conditioner as described in any one of the above-mentioned first aspects.

[0028] Compared with the prior art, the beneficial effect of the first aspect embodiment of the present application is as follows: the present application first obtains a first in-car image with a first gesture, and then determines the target air conditioner that needs to be adjusted according to the position of the first gesture in the first in-car image, and controls the target air conditioner to perform actions based on the air conditioner adjustment strategy corresponding to the first gesture. The present application uses gesture detection to adjust the air conditioner. The user only needs to make the corresponding gesture without searching for buttons. The user's line of sight does not need to be diverted while driving, making the adjustment of the air conditioner more convenient and increasing the intelligence of the vehicle. In addition, the present application can also determine the in-car air conditioner that needs to be adjusted according to the position of the first gesture in the first in-car image, and only adjust the in-car air conditioner that needs to be adjusted, while other air conditioners are not adjusted. The zoning adjustment of the air conditioner is achieved through gesture recognition, which improves the intelligence of the vehicle.

[0029] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0031] Figure 1 is a flow chart of a method for adjusting the in-vehicle air conditioner provided by an embodiment of the present application;

[0032] Figure 2 is a structural schematic diagram of image partitioning provided by an embodiment of the present application;

[0033] Figure 3 is a flowchart of a method for determining a target air conditioner provided in an embodiment of the present application;

[0034] Figure 4 This is a flowchart of a method for waking up the in-vehicle air conditioner provided in an embodiment of the present application. Figure 1 ;

[0035] Figure 5 This is a flowchart of a method for waking up the in-vehicle air conditioner provided in an embodiment of the present application. Figure 2 ;

[0036] Figure 6This is a flowchart of a method for waking up the in-vehicle air conditioner provided in an embodiment of the present application. Figure 3 ;

[0037] Figure 7 is a flow chart of a method for adjusting the in-vehicle air conditioner provided by another embodiment of the present application;

[0038] Figure 8 is a structural schematic diagram of a vehicle provided by an embodiment of the present application;

[0039] Fig. 9 It is a structural schematic diagram of a regulating device for an in-vehicle air conditioner provided in one embodiment of the present application;

[0040] Fig.10 It is a structural diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0041] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0042] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0043] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0044] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0045] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.

[0046] At present, in addition to button adjustment, voice adjustment can also be used to adjust the air conditioner in the car. By collecting the user's voice information, determining the air conditioning adjustment strategy corresponding to the voice information, and executing the air conditioning adjustment strategy, the purpose of adjusting the air conditioner is achieved.

[0047] However, the current recognition rate of voice information processing is low, and the accuracy of dialect recognition is low, resulting in slow adjustment or incorrect adjustment when using voice to adjust the air conditioner, resulting in a poor user experience.

[0048] Based on the above reasons, the present application proposes a method for adjusting the air conditioner in a car, which adjusts the air conditioner through gestures. The user no longer needs to lower his head to find the button to adjust the air conditioner, and the phenomenon of poor air conditioning adjustment effect caused by the disadvantages of voice processing is avoided.

[0049] In addition, the present application can also identify the position of the gesture to determine the in-vehicle air conditioner that needs to be adjusted, and complete the air conditioner zone adjustment through gestures, thus achieving the effect of air conditioner zone adjustment through gestures.

[0050] Figure 1 The schematic flow chart of the method for adjusting the in-vehicle air conditioner provided by the present application is shown, and the method can be implemented in the central processor in the vehicle. Figure 1 , the method is described in detail as follows:

[0051] S101, acquiring a first in-vehicle image of a vehicle, wherein the first in-vehicle image contains a first gesture for adjusting an in-vehicle air conditioner, and the vehicle is provided with at least two of the in-vehicle air conditioners.

[0052] In this embodiment, the image acquisition device installed on the inner wall of the vehicle is used to acquire images inside the vehicle. The image acquisition device may be a high-dynamic image acquisition device; wherein the high-dynamic image acquisition device is an image acquisition device with a dynamic range greater than 120DB, for example, a camera with a dynamic range greater than 120DB. The high-dynamic image acquisition device can cope with situations where the light is strong or weak.

[0053] After the image acquisition device captures the in-vehicle image, in order to determine whether the captured in-vehicle image includes the first gesture for adjusting the air conditioner, the image acquisition device can first identify the captured in-vehicle image to determine whether the captured in-vehicle image includes the first gesture for adjusting the air conditioner; if the first gesture exists in the captured in-vehicle image, the in-vehicle image is recorded as the first in-vehicle image, and the first in-vehicle image and the gesture type of the first gesture are sent to the central processor.

[0054] Alternatively, after the image acquisition device acquires the in-vehicle image, the acquired in-vehicle image is sent to the central processing unit, and the central processing unit recognizes the in-vehicle image; if the first gesture exists in the in-vehicle image, the in-vehicle image is recorded as the first in-vehicle image; if the first gesture does not exist in the in-vehicle image, the in-vehicle image is discarded.

[0055] In addition, the method for determining whether the first gesture exists in the collected in-vehicle image may further include: inputting the collected in-vehicle image into a discriminant model to determine whether the first gesture exists in the collected in-vehicle image. The discriminant model may be a model such as yoloV5, MobileDets, PP-PicoDet, NanoDet, fastrcnn or rcnn. The above discriminant models need to be trained before use to obtain a trained discriminant model.

[0056] In this embodiment, the first gesture may come from a user at any position in the vehicle, for example, a user at the main driving position, a user at the co-pilot position, or a user at the back seat. The first gesture may be a palm-up gesture, a palm-down gesture, an index finger-up gesture, or an index finger-down gesture, etc.

[0057] In this embodiment, the air conditioning in the vehicle is zoned. For example, three air conditioners are arranged in the vehicle and the three air conditioners can be adjusted individually. The three air conditioners are the main driver's air conditioner, the co-driver's air conditioner and the rear seat air conditioner.

[0058] Each in-car air conditioner can be set with a unique identification code.

[0059] S102: Determine a target air conditioner in the vehicle based on the position of the first gesture in the first in-vehicle image, wherein the target air conditioner is the in-vehicle air conditioner that needs to be adjusted.

[0060] In this embodiment, a standard in-vehicle image of the vehicle interior is collected in advance, the standard in-vehicle image is divided into N areas, and the in-vehicle air conditioner corresponding to each area is set. After obtaining the first in-vehicle image, the first in-vehicle image is divided into N areas according to the division form of the standard in-vehicle image, the area where the first gesture is located is determined, and the in-vehicle air conditioner corresponding to the area where the first gesture is located is used as the target air conditioner.

[0061] If the same first gesture exists in at least two areas of the first in-vehicle image, that is, a first gesture is distributed in at least two areas, the area of ​​the first gesture included in each area is found, and the area with the largest area including the first gesture is taken as the area where the first gesture is located.

[0062] As an example, the interior image of the car is divided into three regions, such as Figure 2 As shown, area A corresponds to the main driver's air conditioner, area B corresponds to the co-driver's air conditioner, and area C corresponds to the rear air conditioner. If the first gesture is in area A, the target air conditioner is determined to be the main driver's air conditioner. If the first gesture is in area C, the target air conditioner is determined to be the rear air conditioner.

[0063] Optionally, based on the positions of the in-vehicle air conditioners in the vehicle, each in-vehicle air conditioner is mapped on the first in-vehicle image, and the position of each in-vehicle air conditioner on the first in-vehicle image is determined. The position of the in-vehicle air conditioner closest to the position of the first gesture is determined in the first in-vehicle image, and the in-vehicle air conditioner closest to the position of the first gesture in the first in-vehicle image is the target air conditioner.

[0064] S103: Control the target air conditioner to perform an action based on the air conditioner adjustment strategy corresponding to the first gesture.

[0065] Specifically, the air conditioning adjustment strategy corresponding to the first gesture is sent to the target air conditioning, wherein the air conditioning adjustment strategy is used to instruct the target air conditioning to perform an action according to the air conditioning adjustment strategy. After receiving the air conditioning adjustment strategy, the target air conditioning executes the air conditioning adjustment strategy.

[0066] In this embodiment, air conditioning adjustment strategies corresponding to different gestures are preset. The air conditioning adjustment strategy corresponding to the first gesture is searched. The air conditioning adjustment strategy may include temperature adjustment, air volume adjustment, and wind direction adjustment.

[0067] For example, if the first gesture is a palm-up gesture, the air conditioning adjustment strategy corresponding to the first gesture is to increase the temperature by a preset first temperature, for example, one degree. If the first gesture is a palm-down gesture, the air conditioning adjustment strategy corresponding to the first gesture is to decrease the temperature by a preset second temperature, for example, one degree. The preset first temperature and the preset second temperature are the same or different.

[0068] In this embodiment, after the air conditioning adjustment strategy corresponding to the first gesture is determined, the air conditioning adjustment strategy may be voice broadcasted so that the user can determine whether the air conditioning adjustment strategy corresponding to the first gesture is correct.

[0069] In addition, the air conditioning adjustment strategy corresponding to the first gesture may be preset by the user.

[0070] Specifically, the user selects a first gesture and an air conditioning adjustment strategy corresponding to the first gesture through a human-computer interaction interface. After the vehicle detects the first gesture and the corresponding air conditioning adjustment strategy selected by the user, the vehicle associates and stores the first gesture and the corresponding air conditioning adjustment strategy.

[0071] In the embodiment of the present application, the first in-car image with the first gesture is first obtained, and then the target air conditioner to be adjusted is determined according to the position of the first gesture in the first in-car image, and the air conditioner adjustment strategy corresponding to the first gesture is sent to the target air conditioner. The present application uses gesture detection to adjust the air conditioner. The user only needs to make the corresponding gesture without searching for buttons, which makes the adjustment of the air conditioner more convenient and can also increase the intelligence of the vehicle. In addition, the present application can also determine the in-car air conditioner to be adjusted according to the position of the first gesture in the first in-car image, and only adjust the in-car air conditioner to be adjusted, while other air conditioners are not adjusted. The zoning adjustment of the air conditioner is realized through gesture recognition, which improves the intelligence of the vehicle. At the same time, it also enables users at various positions to independently adjust the air conditioner, so that the user's car experience is better. Finally, the in-car image of the present application does not need to be uploaded to the server or other equipment outside the car. The detection and positioning of the air conditioner can be completed in the car, so as to avoid the leakage of the in-car image and enhance the user's sense of security.

[0072] like Figure 3 As shown, in a possible implementation manner, the implementation process of step S102 may include:

[0073] S1021: Determine a position of the first gesture in the vehicle based on the position of the first gesture in the first in-vehicle image.

[0074] In this embodiment, the position of the first gesture in the first in-vehicle image is mapped in the vehicle to obtain the position of the first gesture in the vehicle.

[0075] Alternatively, the image position relationship between the first gesture and the in-vehicle reference object (the main driver's seat back, the co-driver's seat back, etc.) is determined in the first in-vehicle image, and the in-vehicle reference object exists in the first in-vehicle image. Based on the image position relationship between the first gesture and the in-vehicle reference object, the actual position relationship between the first gesture and the in-vehicle reference object in the vehicle is obtained. Based on the actual position relationship between the first gesture and the in-vehicle reference object, the position of the first gesture in the vehicle is obtained. Both the image position relationship and the actual position relationship may include distance and / or orientation, etc.

[0076] As the distance, in the first in-vehicle image, if the image position relationship between the first gesture and the in-vehicle reference object (the in-vehicle reference object is the main driver's seat back) includes: the first gesture is on the right side of the in-vehicle reference object. According to the image position relationship, it can be determined that the first gesture is an action made by the co-pilot, that is, the first gesture is at the co-pilot position in the vehicle.

[0077] S1022: Determine a target air conditioner in the vehicle based on the position of the first gesture in the vehicle.

[0078] Specifically, the in-vehicle air conditioner closest to the position of the first gesture in the vehicle is searched, and the in-vehicle air conditioner closest to the position of the first gesture in the vehicle is used as the target air conditioner.

[0079] The distance between each in-vehicle air conditioner and the position of the first gesture is calculated, and the in-vehicle air conditioner closest to the position of the first gesture is selected as the target air conditioner.

[0080] In the embodiment of the present application, the target air conditioner is determined according to the position of the first gesture in the vehicle, so that the target air conditioner can be determined accurately, simply, and quickly.

[0081] In a possible implementation, in order to determine that the first gesture detected is a gesture made when the user needs to adjust the air conditioner, the user wakes up the air conditioner before adjusting the air conditioner, and then makes the first gesture after waking up the air conditioner to achieve the effect of adjusting the air conditioner. By increasing the wake-up of the air conditioner, the situation of incorrect adjustment of the air conditioner due to false detection is prevented.

[0082] like Figure 4 As shown, specifically, before step S101, the above method may further include an operation of waking up the air conditioner. Specifically, the method of waking up the air conditioner includes:

[0083] S201, acquiring a second in-vehicle image of the vehicle, wherein the second in-vehicle image contains a second gesture for waking up the in-vehicle air conditioner.

[0084] In this embodiment, after acquiring the in-vehicle image, firstly detect whether the second gesture exists in the acquired in-vehicle image, and if the second gesture exists in the acquired in-vehicle image, then record the acquired in-vehicle image as the second in-vehicle image. If the second gesture does not exist in the acquired in-vehicle image, then discard the in-vehicle image and continue to acquire in-vehicle images.

[0085] Specifically, the method for detecting whether the second gesture exists in the in-vehicle image is the same as the method for detecting whether the first gesture exists in the in-vehicle image. Please refer to the above method for detecting the first gesture, which will not be described in detail here.

[0086] In this embodiment, the second gesture is a gesture different from the first gesture. For example, the second gesture may be a fist gesture, or a gesture with the index finger and the middle finger pointing upward.

[0087] S202, sending a wake-up instruction to each of the in-vehicle air conditioners, wherein the wake-up instruction is used to instruct each of the in-vehicle air conditioners to enter a wake-up state.

[0088] In this embodiment, if the second gesture is detected, all the air conditioners in the vehicle need to be awakened to facilitate users at various positions in the vehicle to adjust each air conditioner.

[0089] When the air conditioner in the vehicle is in the awake state, the air conditioner can be adjusted. If the air conditioner in the vehicle is in the non-awakened state, even if the first gesture is detected, the air conditioner cannot be adjusted, that is, the air conditioner will not operate.

[0090] When waking up the air conditioner in the car, a voice announcement can also be made to remind the user that the air conditioner in the car has been woken up.

[0091] In the embodiment of the present application, the vehicle air conditioner is awakened by the second gesture. After the vehicle air conditioner is awakened and the first gesture is detected, the vehicle air conditioner can be adjusted, thereby preventing false detection and allowing the vehicle air conditioner to be adjusted more accurately.

[0092] In a possible implementation, if the first gesture is detected within a preset time after the vehicle wake-up time, the first gesture is a valid gesture, and only valid gestures can adjust the air conditioner in the vehicle. Each time the air conditioner is adjusted, if the time for the user to issue the first gesture times out, the air conditioner will not be operated. Therefore, before determining whether the air conditioner in the vehicle is adjusted, it is also necessary to determine whether the detected first gesture has timed out. If it is determined that the first gesture has not timed out, the air conditioner in the vehicle is adjusted.

[0093] Specifically, after step S101, the method may further include:

[0094] Calculate the time difference between the acquisition time of the first in-vehicle image and the acquisition time of the second in-vehicle image, and determine that the time difference is less than or equal to a preset value.

[0095] In this embodiment, if it is determined that the time difference is less than or equal to the preset value, the first in-vehicle image is determined to be a valid image, that is, the first gesture in the first in-vehicle image is a valid gesture, and the actions of step S102 and step S103 can be continued. The preset value can be set as needed, for example, the preset value can be set to 10 seconds, 15 seconds or 20 seconds, etc.

[0096] If it is determined that the time difference is greater than the preset value, it is determined that the first in-car image has timed out and the first in-car image is an invalid image, that is, the first gesture in the first in-car image is an invalid gesture, and the first in-car image is discarded, and the actions of step S102 and step S103 are not performed, and the in-car air conditioner is not adjusted.

[0097] For example, if the preset value is 10 seconds. The second in-car image is collected at 3:12:10. If the first in-car image is collected at 3:12:15, 15 seconds - 10 seconds = 5 seconds < the preset value 10 seconds; then the first in-car image is a valid image. If the first in-car image is collected at 3:12:25, 25-10 = 15 seconds > the preset value; the first in-car image is a timed-out image, and the first in-car image is an invalid image.

[0098] When it is determined that the time difference is greater than the preset value, the current air conditioning adjustment operation is terminated, and detection continues to be performed to determine whether the acquired in-vehicle image includes the second gesture.

[0099] Specifically, after determining that the first in-vehicle image has timed out, the method may further include:

[0100] A third in-vehicle image of the vehicle is acquired.

[0101] It is determined whether the second gesture exists in the third in-vehicle image.

[0102] If the second gesture exists in the third in-vehicle image, a wake-up instruction is sent to each of the in-vehicle air conditioners.

[0103] After the in-vehicle air conditioner is in an awake state, acquiring a fourth in-vehicle image of the vehicle;

[0104] If the first gesture exists in the fourth in-vehicle image and the fourth in-vehicle image is a valid image, the position of the first gesture in the vehicle is determined based on the position of the first gesture in the fourth in-vehicle image.

[0105] The in-vehicle air conditioner that needs to be adjusted is determined based on the position of the first gesture in the vehicle.

[0106] The air conditioning adjustment strategy corresponding to the first gesture is sent to the in-vehicle air conditioning that needs to be adjusted.

[0107] In a possible implementation, after the second gesture is detected, it is not necessary to wake up all the in-vehicle air conditioners, but only the in-vehicle air conditioners that need to be woken up according to the second gesture.

[0108] like Figure 5 Specifically, before step S101, the method may further include:

[0109] S301, acquiring a third in-vehicle image of the vehicle, wherein the third in-vehicle image contains a second gesture for waking up the in-vehicle air conditioner.

[0110] In this embodiment, the method for determining the third in-vehicle image is the same as the method for determining the first in-vehicle image described above. Please refer to the description of step S101 above, which will not be repeated here.

[0111] S302: Determine an in-vehicle air conditioner that needs to be awakened based on the position of the second gesture in the third in-vehicle image.

[0112] Specifically, the method for determining the in-vehicle air conditioner that needs to be awakened in this step is the same as the method for determining the target air conditioner mentioned above. Please refer to the method for determining the target air conditioner mentioned above, and no further details will be given here.

[0113] S303: Send a wake-up instruction to the in-vehicle air conditioner that needs to be awakened, wherein the wake-up instruction is used to instruct the in-vehicle air conditioner that needs to be awakened to enter an awake state.

[0114] Accordingly, before step S103, the method further includes:

[0115] It is determined that the in-vehicle air conditioner that needs to be awakened is the same as the target air conditioner.

[0116] The air conditioning adjustment strategy corresponding to the first gesture may be sent to the target air conditioner only when it is determined that the in-vehicle air conditioner to be awakened is the same as the target air conditioner.

[0117] If it is determined that the in-vehicle air conditioner to be awakened is not the same as the target air conditioner, step S103 is not executed.

[0118] In the embodiment of the present application, the in-vehicle air conditioner is woken up in a targeted manner through the second gesture, so that the adjustment of the in-vehicle air conditioner can be more accurate.

[0119] like Figure 6 As shown, in a possible implementation, the above method may further include:

[0120] S11, obtaining an in-vehicle image captured by an image acquisition device.

[0121] S12, determining whether a second gesture exists in the in-vehicle image captured by the image capture device.

[0122] S13, if the second gesture exists in the in-vehicle image captured by the image capture device, each in-vehicle air conditioner is awakened, and a voice prompt is given that the air conditioner has been awakened, and the air conditioner can be adjusted.

[0123] If the second gesture does not exist in the in-vehicle image captured by the image acquisition device, step S11 is executed to continue acquiring the in-vehicle image captured by the image acquisition device.

[0124] like Figure 7 As shown, S14, after the air conditioner in the vehicle is awakened, continue to obtain the image in the vehicle captured by the image acquisition device.

[0125] S15, determining whether the in-vehicle image captured by the image capturing device contains a first gesture.

[0126] S16, if the in-vehicle image captured by the image acquisition device contains the first gesture, determine the position of the first gesture in the vehicle according to the position of the first gesture in the in-vehicle image. If the in-vehicle image captured by the image acquisition device does not contain the first gesture, execute step S14.

[0127] S17, determining the in-vehicle air conditioner closest to the position of the first gesture, and recording the in-vehicle air conditioner closest to the first gesture as the target air conditioner.

[0128] S18, determining the action type of the first gesture.

[0129] S19: If the gesture type of the first gesture is a palm-upward action, determine that the air conditioning adjustment strategy is to increase the temperature by 1 degree.

[0130] S20: If the gesture type of the first gesture is a palm-down action, determine that the air conditioning adjustment strategy is to lower the temperature by 1 degree.

[0131] S21, sending the air conditioning control strategy or the calculated adjusted air conditioning temperature value to the target air conditioning.

[0132] It should be noted that, when executing step S20 and step S21, an operation of voice broadcasting the air conditioning adjustment strategy may also be performed so that the user can understand the content of the air conditioning adjustment strategy.

[0133] When executing step S15, the time difference between the acquisition time of the in-vehicle image and the time when the second gesture is detected can also be calculated. If the time difference is less than or equal to a preset value, it is determined whether the in-vehicle image acquired by the image acquisition device contains the first gesture. If the time difference is greater than the preset value, step S11 is executed.

[0134] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0135] Figure 8 A schematic diagram of the structure of a vehicle provided by the present application is shown. The vehicle includes an image acquisition module 10, a central processing unit 20, an air conditioning adjustment module 40 and an edge computing module 30;

[0136] The image acquisition module 10 acquires a first in-vehicle image and sends the first in-vehicle image to the edge computing module.

[0137] The edge computing module 30 detects whether the first in-vehicle image includes the first gesture, and when the first in-vehicle image includes the first gesture, sends the gesture type of the first gesture to the central processor.

[0138] The central processing unit 20 executes the in-vehicle air conditioning adjustment method described in the first aspect.

[0139] The air conditioning adjustment module 40 controls the air conditioning in the vehicle to operate according to the air conditioning control strategy corresponding to the first gesture sent by the central processing unit.

[0140] In this embodiment, the image acquisition module 10 can also be used to acquire a second in-vehicle image. The edge computing module 30 is also used to detect whether a second gesture exists in the second in-vehicle image.

[0141] The edge computing module 30 stores the discrimination model.

[0142] In this embodiment, the vehicle further includes a voice module 50. The voice module 50 broadcasts the air conditioning control strategy corresponding to the first gesture. The voice module 50 is also used to broadcast wake-up information.

[0143] Corresponding to the method for adjusting the in-vehicle air conditioner described in the above embodiment, Fig. 9 A structural block diagram of an in-vehicle air conditioning regulating device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0144] Reference Fig. 9 The device 400 may include: an image acquisition module 410, a target determination module 420 and a strategy sending module 430.

[0145] The image acquisition module 410 is used to acquire a first in-vehicle image of the vehicle, wherein the first in-vehicle image contains a first gesture for adjusting an in-vehicle air conditioner, and the vehicle is provided with at least two in-vehicle air conditioners;

[0146] a target determination module 420, configured to determine a target air conditioner in the vehicle based on the position of the first gesture in the first in-vehicle image, wherein the target air conditioner is an in-vehicle air conditioner that needs to be adjusted;

[0147] The strategy sending module 430 is used to control the target air conditioner to perform an action based on the air conditioner adjustment strategy corresponding to the first gesture.

[0148] In a possible implementation, the target determination module 420 may be specifically used to:

[0149] Determining a position of the first gesture in the vehicle based on a position of the first gesture in the first in-vehicle image;

[0150] A target air conditioner in the vehicle is determined based on a position of the first gesture in the vehicle.

[0151] In a possible implementation, the target determination module 420 may be specifically used to:

[0152] Finding the in-vehicle air conditioner in the vehicle that is closest to the position of the first gesture;

[0153] The in-vehicle air conditioner closest to the position of the first gesture in the vehicle is used as the target air conditioner.

[0154] In a possible implementation, the image acquisition module 410 is also connected to:

[0155] An image acquisition module, used for acquiring a second in-vehicle image of the vehicle, wherein the second in-vehicle image contains a second gesture for waking up the in-vehicle air conditioner;

[0156] The first instruction sending module is used to send a wake-up instruction to each of the in-vehicle air conditioners, wherein the wake-up instruction is used to instruct each of the in-vehicle air conditioners to enter a wake-up state.

[0157] In a possible implementation, the image acquisition module 410 is also connected to:

[0158] a calculation module, used to calculate a time difference between a capture time of the first in-vehicle image and a capture time of the second in-vehicle image;

[0159] The first result determination module is used to determine whether the time difference is less than or equal to a preset value.

[0160] In a possible implementation, the computing module is also connected to:

[0161] A second result determination module, used to determine that the time difference is greater than the preset value;

[0162] An image processing module is used to discard the first in-vehicle image.

[0163] In a possible implementation, the image acquisition module 410 is also connected to:

[0164] an image determination module, configured to obtain a third in-vehicle image of the vehicle, wherein the third in-vehicle image contains a second gesture for waking up the in-vehicle air conditioner;

[0165] an air conditioning determination module, configured to determine an in-vehicle air conditioning that needs to be awakened based on a position of the second gesture in the third in-vehicle image;

[0166] A second instruction sending module is used to send a wake-up instruction to the in-vehicle air conditioner that needs to be awakened, wherein the wake-up instruction is used to instruct the in-vehicle air conditioner that needs to be awakened to enter a wake-up state;

[0167] Correspondingly, the strategy sending module 430 is also connected to:

[0168] The comparison module is used to determine whether the in-vehicle air conditioner to be awakened is the same as the target air conditioner.

[0169] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0170] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0171] The present application also provides a terminal device, see Fig.10 The terminal device 500 may include: at least one processor 510, a memory 520, and a computer program stored in the memory 520 and executable on the at least one processor 510. When the processor 510 executes the computer program, the steps in any of the above-mentioned method embodiments are implemented, for example Figure 1 Steps S101 to S103 in the illustrated embodiment. Alternatively, when the processor 510 executes the computer program, the functions of each module / unit in the above-mentioned device embodiments are implemented, for example Fig. 9 The functions of the image acquisition module 410 to the policy sending module 430 are shown.

[0172] Exemplarily, the computer program may be divided into one or more modules / units, one or more modules / units are stored in the memory 520, and executed by the processor 510 to complete the present application. The one or more modules / units may be a series of computer program segments capable of completing specific functions, and the program segments are used to describe the execution process of the computer program in the terminal device 500.

[0173] Those skilled in the art will understand that Fig.10It is only an example of a terminal device and does not constitute a limitation on the terminal device. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components, such as input and output devices, network access devices, buses, etc.

[0174] The processor 510 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0175] The memory 520 may be an internal storage unit of the terminal device, or an external storage device of the terminal device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. The memory 520 is used to store the computer program and other programs and data required by the terminal device. The memory 520 may also be used to temporarily store data that has been output or is to be output.

[0176] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0177] The method for adjusting the in-vehicle air conditioner provided in the embodiment of the present application can be applied to terminal devices such as computers, tablet computers, laptop computers, netbooks, personal digital assistants (PDAs), etc. The embodiment of the present application does not impose any restrictions on the specific type of terminal devices.

[0178] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0179] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0180] In the embodiments provided in the present application, it should be understood that the disclosed terminal equipment, devices and methods can be implemented in other ways. For example, the terminal equipment embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0181] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0182] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0183] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by one or more processors, the steps of each of the above-mentioned method embodiments can be implemented.

[0184] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by one or more processors, the steps of each of the above-mentioned method embodiments can be implemented.

[0185] Similarly, as a computer program product, when the computer program product runs on a terminal device, the terminal device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0186] The computer program includes computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer readable media do not include electric carrier signals and telecommunication signals.

[0187] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for adjusting an in-vehicle air conditioner, characterized in that: include: Acquire a first in-vehicle image of a vehicle, wherein the vehicle is provided with at least two in-vehicle air conditioners, and a first gesture for adjusting the in-vehicle air conditioners exists in the first in-vehicle image; Determining a target air conditioner in the vehicle based on a position of the first gesture in the first in-vehicle image, wherein the target air conditioner is an in-vehicle air conditioner that needs to be adjusted; Controlling the target air conditioner to perform an action based on the air conditioner adjustment strategy corresponding to the first gesture; The determining a target air conditioner in the vehicle based on the position of the first gesture in the first in-vehicle image includes: Determining a position of the first gesture in the vehicle based on a position of the first gesture in the first in-vehicle image; Finding the in-vehicle air conditioner in the vehicle that is closest to the position of the first gesture; The in-vehicle air conditioner closest to the position of the first gesture in the vehicle is used as the target air conditioner.

2. The method for adjusting the in-vehicle air conditioner according to claim 1, characterized in that: Before acquiring the first in-vehicle image of the vehicle, the method further includes: Acquire a second in-vehicle image of the vehicle, wherein the second in-vehicle image contains a second gesture for waking up the in-vehicle air conditioner; A wake-up instruction is sent to each of the in-vehicle air conditioners, wherein the wake-up instruction is used to instruct each of the in-vehicle air conditioners to enter a wake-up state.

3. The method for adjusting the in-vehicle air conditioner according to claim 2, characterized in that: After acquiring the first in-vehicle image of the vehicle, the method further includes: Calculating a time difference between a capture time of the first in-vehicle image and a capture time of the second in-vehicle image; It is determined that the time difference is less than or equal to a preset value.

4. The method for adjusting the in-vehicle air conditioner according to claim 3, characterized in that: After calculating the time difference between the acquisition time of the first in-vehicle image and the acquisition time of the second in-vehicle image, the method further includes: Determining that the time difference is greater than the preset value; The first in-vehicle image is discarded.

5. The method for adjusting the in-vehicle air conditioner according to claim 1, characterized in that: Before acquiring the first in-vehicle image of the vehicle, the method further includes: Acquire a third in-vehicle image of the vehicle, wherein the third in-vehicle image contains a second gesture for waking up the in-vehicle air conditioner; Determining an in-vehicle air conditioner that needs to be awakened based on a position of the second gesture in the third in-vehicle image; Sending a wake-up instruction to the in-vehicle air conditioner that needs to be awakened, wherein the wake-up instruction is used to instruct the in-vehicle air conditioner that needs to be awakened to enter an awake state; Accordingly, before controlling the target air conditioner to perform an action based on the air conditioner adjustment strategy corresponding to the first gesture, the method further includes: It is determined that the in-vehicle air conditioner that needs to be awakened is the same as the target air conditioner.

6. A regulating device for an in-vehicle air conditioner, characterized in that: include: An image acquisition module, configured to acquire a first in-vehicle image of a vehicle, wherein the vehicle is provided with at least two in-vehicle air conditioners, and a first gesture for adjusting the in-vehicle air conditioners is present in the first in-vehicle image; a target determination module, configured to determine a target air conditioner in the vehicle based on a position of the first gesture in the first in-vehicle image, wherein the target air conditioner is an in-vehicle air conditioner that needs to be adjusted; A strategy sending module, used to control the target air conditioner to perform an action based on the air conditioner adjustment strategy corresponding to the first gesture; The Targeting Module is also used to: Determining a position of the first gesture in the vehicle based on a position of the first gesture in the first in-vehicle image; Finding the in-vehicle air conditioner in the vehicle that is closest to the position of the first gesture; The in-vehicle air conditioner closest to the position of the first gesture in the vehicle is used as the target air conditioner.

7. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method for adjusting the in-vehicle air conditioner according to any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method for adjusting the in-vehicle air conditioner according to any one of claims 1 to 5 is implemented.

Images