Air conditioner control method and device, air conditioner and storage medium

By conducting background analysis and object detection on the image information of the air conditioner, and using the object projection curve to process the occlusion situation, the adhesion and occlusion problems of the air conditioner during image recognition are solved, the recognition accuracy and control accuracy are improved, and the user is improved Experience.

CN119042767AActive Publication Date: 2024-11-29TCL AIR CONDITIONER ZHONGSHAN CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411338019.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-24
Publication Date
2024-11-29
Estimated Expiration
2044-09-24

AI Technical Summary

Technical Problem

During image recognition, existing air conditioners are prone to loss or misidentification of targets caused by image information sticking or being blocked, resulting in poor recognition accuracy and inability to accurately perform personalized control.

Method used

By obtaining the initial image information of the air conditioner operating area, conducting background analysis and object detection, using historical foreground masks and preset background detection thresholds for background modeling and segmentation, morphological processing and occlusion detection are performed based on the object projection curve, and identifying the target object Information and adjust the operating parameters of the air conditioner.

Benefits of technology

It improves the accuracy of the recognition of target objects, enhances the accuracy and personalized control capabilities of air conditioning control, and improves the user's air conditioning experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119042767A_ABST
    Figure CN119042767A_ABST
Patent Text Reader

Abstract

The invention provides an air conditioner control method and device, an air conditioner and a storage medium, and the air conditioner control method comprises the steps that an air conditioner control request is responded, and initial image information in an air conditioner operation area is obtained; performing background analysis on the initial image information, and determining foreground object information of the initial image information; performing image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information; and object state information corresponding to the target object information is recognized, and air conditioner operation parameters corresponding to the air conditioner operation area are adjusted according to the object state information. According to the technical scheme, the air conditioner can be accurately used for recognizing the target object with adhesion or shielding in the operation scene, the recognition accuracy of the target object is improved, then the control accuracy of executing personalized air conditioner control according to the target recognition result is improved, and the air conditioner use experience of a user is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of air conditioning control, and in particular to an air conditioning control method, device, air conditioner and storage medium. Background Art

[0002] At present, with the rapid development of air conditioners and image recognition technology, more and more air conditioner devices are equipped with object recognition functions, and use object recognition to detect object information in the working environment during operation for more intelligent control. However, when performing object recognition, existing air conditioner devices are prone to abnormal situations such as target loss or misidentification caused by image information adhesion or occlusion, resulting in poor object recognition accuracy and the inability to perform corresponding operations more accurately. Summary of the invention

[0003] The embodiments of the present application provide an air conditioning control method, device, air conditioner and storage medium, aiming to solve the technical problem in the prior art that when performing image recognition, smart devices such as air conditioners have abnormal situations such as target loss or misidentification caused by image information adhesion or occlusion, resulting in poor recognition accuracy.

[0004] In one aspect, an embodiment of the present application provides an air conditioning control method, the air conditioning control method comprising the following steps:

[0005] In response to an air conditioning control request, initial image information in an air conditioning operation area is obtained;

[0006] Performing background analysis on the initial image information to determine foreground object information of the initial image information;

[0007] Performing image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information;

[0008] The object state information corresponding to the target object information is identified, and the air-conditioning operation parameters corresponding to the air-conditioning operation area are adjusted according to the object state information.

[0009] In a possible implementation of the present application, performing background analysis on the initial image information to determine foreground object information of the initial image information includes:

[0010] Performing background modeling on the initial image information using the historical foreground mask to obtain target background image information of the initial image information;

[0011] Segmenting the target foreground image information in the initial image information according to the initial image information and the target background image information;

[0012] The target foreground image information is subjected to object detection using a preset object detection model to determine foreground object information of the initial image information.

[0013] In a possible implementation of the present application, the using of the historical foreground mask to perform background modeling on the initial image information to obtain the target background image information of the initial image information includes:

[0014] Accessing an air conditioning image database to obtain a historical foreground mask of the air conditioning operation area;

[0015] Performing background modeling on the initial image information according to a preset background recognition model to obtain initial background image information;

[0016] The initial background image information is updated according to the historical foreground mask and a preset background detection threshold to obtain target background image information.

[0017] In a possible implementation of the present application, the updating of the initial background image information according to the historical foreground mask and a preset background detection threshold to obtain the target background image information includes:

[0018] Obtaining mask pixels in the historical foreground mask;

[0019] If the mask pixel value of the mask pixel point is less than the background detection threshold, the mask pixel point is determined to be a background pixel point;

[0020] If the mask pixel value of the mask pixel is greater than the background detection threshold, the mask pixel is determined to be a foreground pixel;

[0021] The initial background image information is updated according to the background pixel points and the foreground pixel points to obtain target background image information.

[0022] In a possible implementation of the present application, performing image processing on the foreground object information according to the object projection curve associated with the foreground object information to obtain target object information includes:

[0023] Performing morphological processing on the foreground object information to obtain an object feature image of the foreground object information;

[0024] Performing projection processing based on feature pixel values ​​in the object feature image to obtain an object projection curve of the foreground object information;

[0025] Occlusion detection is performed on the foreground object information based on the object projection curve to determine target object information in the foreground object information.

[0026] In a possible implementation of the present application, performing projection processing based on feature pixel values ​​in the object feature image to obtain an object projection curve of the foreground object information includes:

[0027] Acquire characteristic pixel values ​​in the object characteristic image, wherein the characteristic pixel values ​​include horizontal characteristic pixel values ​​and vertical characteristic pixel values;

[0028] Pixel projection is performed according to the horizontal characteristic pixel value and the lateral characteristic pixel value to obtain an object projection curve of the foreground object information.

[0029] In a possible implementation of the present application, performing occlusion detection on the foreground object information based on the object projection curve to determine target object information in the foreground object information includes:

[0030] Perform boundary point detection based on the object projection curve to obtain target boundary points of the object projection curve, wherein the target boundary points include peak boundary points and trough boundary points;

[0031] Performing occlusion detection on the foreground object information according to the peak boundary point and the trough boundary point to determine object occlusion information in the foreground object information;

[0032] The foreground object information is segmented according to the object occlusion information to obtain target object information in the foreground object information.

[0033] In a possible implementation of the present application, the identifying the object state information corresponding to the target object information, and adjusting the air conditioning operation parameters corresponding to the air conditioning operation area according to the object state information, includes:

[0034] Performing status detection on the target object information to obtain object status information corresponding to the target object information;

[0035] Accessing an air conditioning operation database to obtain an air conditioning correction parameter associated with the object state information in the air conditioning operation database;

[0036] The air conditioning operation parameters corresponding to the air conditioning operation area are adjusted according to the air conditioning correction parameters to obtain an air conditioning correction result.

[0037] On the other hand, the present application provides an air conditioning control device, the air conditioning control device comprising:

[0038] An image acquisition module is configured to respond to an air conditioning control request and acquire initial image information in an air conditioning operation area;

[0039] An image segmentation module is configured to perform background analysis on the initial image information to determine foreground object information of the initial image information;

[0040] An image processing module is configured to perform image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information;

[0041] The air conditioning control module is configured to identify object status information corresponding to the target object information, and adjust the air conditioning operation parameters corresponding to the air conditioning operation area according to the object status information.

[0042] On the other hand, the present application also provides an air conditioner, the air conditioner comprising:

[0043] one or more processors;

[0044] Memory; and

[0045] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the air conditioning control method.

[0046] On the other hand, the present application also provides a computer-readable storage medium on which a computer program is stored, and the computer program is loaded by a processor to execute the steps in the air conditioning control method.

[0047] In the present application, by responding to the air conditioning control request, the initial image information in the air conditioning operation area is obtained; the background analysis is performed on the initial image information to determine the foreground object information of the initial image information; the foreground object information is image processed according to the object projection curve associated with the foreground object information to obtain the target object information; the object state information corresponding to the target object information is identified, and the air conditioning operation parameters corresponding to the air conditioning operation area are adjusted according to the object state information. When the air conditioner collects the image information in the air conditioning operation area, it can extract the foreground object information containing the user object in the image information, and also use the object projection curve associated with the foreground object information to determine whether the foreground image information has adhesion or occlusion, and perform image processing on the foreground object information to obtain the separated target object information, and the air conditioner is parameter corrected according to the object state information of the target object information. In the case of object adhesion or occlusion, the air conditioner can be used to accurately identify the target object with adhesion or occlusion in the operation scene, improve the recognition accuracy of the target object, and then improve the control accuracy of the personalized air conditioning control based on the target recognition result, and improve the user's air conditioning experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0049] Figure 1 A schematic diagram of a scenario of an air conditioning control method according to an embodiment of the present application;

[0050] Figure 2 A flowchart of an embodiment of an air conditioning control method in an embodiment of the present application;

[0051] Figure 3 A schematic diagram of an embodiment of an object feature image generated by morphologically processing the adhesion foreground object information in the air conditioning control method provided in the embodiment of the present application;

[0052] Figure 4 A schematic diagram of a flow chart of an embodiment of determining target background image information in the air conditioning control method provided in an embodiment of the present application;

[0053] Figure 5 A flowchart of an embodiment of performing occlusion detection in the air conditioning control method provided in an embodiment of the present application;

[0054] Figure 6 A schematic diagram of the structure of an embodiment of an air conditioning control device provided in an embodiment of the present application;

[0055] Figure 7 A schematic structural diagram of an embodiment of an air conditioner provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0057] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, which are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0058] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as being preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to implement and use the invention. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the invention can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the invention with unnecessary details. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in this application.

[0059] At present, with the rapid development of air conditioners and image recognition technology, more and more air conditioner devices are equipped with object recognition functions, and use object recognition to detect object information in the working environment during operation for more intelligent control. However, when performing object recognition, existing air conditioner devices are prone to abnormal situations such as target loss or misidentification caused by image information adhesion or occlusion, resulting in poor object recognition accuracy and the inability to perform corresponding operations more accurately.

[0060] Based on this, the present application proposes an air conditioning control method, device, equipment and computer-readable storage medium to solve the technical problem in the prior art that when performing image recognition, smart devices such as air conditioners have abnormal situations such as target loss or misidentification caused by image information adhesion or occlusion, resulting in poor recognition accuracy.

[0061] The air conditioning control method in the embodiment of the present invention is applied to an air conditioning control device, which is arranged in an air conditioner. The air conditioner is provided with one or more processors, a memory, and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the air conditioning control method; wherein the air conditioner can be an intelligent terminal, such as a mobile phone, a tablet computer, a network device, and a smart computer; optionally, the air conditioner can also be a server, or a service cluster composed of multiple servers.

[0062] like Figure 1 As shown, Figure 1 This is a scene diagram of the air-conditioning control method of an embodiment of the present application. The air-conditioning control scene in the embodiment of the present invention includes an air conditioner 100 (an air-conditioning control device is integrated in the air conditioner 100), and a computer-readable storage medium corresponding to the air-conditioning control method is running in the air conditioner 100 to execute the steps of the air-conditioning control method.

[0063] Understandably, Figure 1 The air conditioner in the air conditioning control method scenario shown, or the devices included in the air conditioner, does not constitute a limitation on the embodiments of the present invention, that is, the number of air conditioner devices and types of devices included in the air conditioning control method scenario, or the number of devices and types of devices included in each device, do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be regarded as equivalent replacements or derivatives of the technical solution claimed to be protected in the embodiments of the present invention.

[0064] The air conditioner 100 in the embodiment of the present invention is mainly used to: respond to an air conditioning control request and obtain initial image information in the air conditioning operation area;

[0065] Performing background analysis on the initial image information to determine foreground object information of the initial image information;

[0066] Performing image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information;

[0067] The object state information corresponding to the target object information is identified, and the air-conditioning operation parameters corresponding to the air-conditioning operation area are adjusted according to the object state information.

[0068] The air conditioner 100 in the embodiment of the present invention can be an independent air conditioner, such as various intelligent air conditioners such as a mobile air conditioner, a window air conditioner, a wall air conditioner and a cabinet air conditioner, or it can be an air conditioner control network or air conditioner control cluster composed of multiple air conditioners.

[0069] The embodiments of the present application provide an air conditioning control method, apparatus, device, and computer-readable storage medium, which are described in detail below.

[0070] It can be understood by those skilled in the art that Figure 1 The application environment shown in is only one of the application scenarios related to the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer air conditioners, or air conditioner control network connections, are shown, for example Figure 1 Only one air conditioner is shown in the figure. It can be understood that the scenario of the air conditioning control method can also include one or more air conditioners, which is not specifically limited here. The air conditioner 100 can also include a memory for storing image data and other data.

[0071] It should be noted that Figure 1 The scene diagram of the air-conditioning control method shown is only an example. The scene of the air-conditioning control method described in the embodiment of the present invention is to more clearly illustrate the technical solution of the embodiment of the present invention, and does not constitute a limitation on the technical solution provided by the embodiment of the present invention.

[0072] Based on the scenario of the above air-conditioning control method, various embodiments of the air-conditioning control method disclosed in the present invention are proposed.

[0073] like Figure 2 As shown, Figure 2 This is a flow chart of an embodiment of an air conditioning control method in an embodiment of the present application. The air conditioning control method includes the following steps 201 to 204:

[0074] 201. Respond to an air conditioning control request and obtain initial image information in an air conditioning operation area;

[0075] The air conditioning control method in this embodiment is applied to air conditioners, and the type and number of air conditioners are not specifically limited. That is, the air conditioner can be any one of various types of intelligent air conditioners such as one or more mobile air conditioners, window air conditioners, wall-mounted air conditioners and cabinet air conditioners.

[0076] Specifically, during operation, the air conditioner can respond to an air conditioner control request, wherein the air conditioner control request is a control event that drives the air conditioner to collect target object information in the air conditioner operation area and uses the target object information to perform personalized air conditioner control. The triggering method of the air conditioner control request is not specifically limited here, that is, the triggering method of the air conditioner control request can be actively triggered by the user, for example, the user actively triggers the air conditioner control request by clicking the air conditioner control panel or the air conditioner control button in the remote control connected to the air conditioner. Optionally, in other embodiments, the air conditioner control request can also be actively triggered by the air conditioner, for example, a portrait control process is set in the air conditioner, and when the target user object is detected in the air conditioner operation area, the air conditioner control request is actively triggered.

[0077] Specifically, when the air conditioner obtains the air conditioning control request, it also collects the initial image information in the air conditioning operation area associated with the air conditioner. Among them, the air conditioning operation area is the air conditioning working area that represents the air conditioning of the air conditioner for air and temperature regulation. The initial image information is the image information obtained by the air conditioner using a preset image acquisition module to shoot the air conditioning operation area, which may contain target object information such as user objects. Among them, the preset image acquisition module can be an optical camera module such as an infrared acquisition module and a depth camera module. For example, in a specific embodiment, the air conditioner can collect the initial image information in the air conditioning operation area through an infrared image module that is set on the air conditioner or separated from the air conditioner and is in the air conditioning operation area. Optionally, in other embodiments, the image acquisition module can also be set in other smart home appliances in the air conditioning operation area, and the air conditioner is connected to the smart home appliance by communication to obtain the initial image information of the air conditioning operation area.

[0078] Specifically, after acquiring the initial image information in the air-conditioning operation area, the air conditioner also performs image processing on the initial image information to determine the user object appearing in the air-conditioning operation area, and in subsequent steps, the air conditioner is personalized controlled through the object state information of the user object.

[0079] 202. Perform background analysis on the initial image information to determine foreground object information of the initial image information;

[0080] Specifically, after acquiring the initial image information of the air-conditioning operating area, the air conditioner performs background analysis on the initial image information to determine the foreground image information in the initial image information, so that subsequent steps can determine the target object information in the initial image information that represents the user or other specific objects that can indicate the air conditioner to adjust the operating status based on the foreground image information.

[0081] Specifically, a preset background recognition model is also pre-set in the air conditioner, and after obtaining the initial image information, the background model is performed on the initial image information according to the background recognition model, so as to obtain the initial background image information corresponding to the initial image information. The preset background recognition model can be a neural network model that performs background modeling on the initial image information using median filtering.

[0082] Specifically, the air conditioner can use the background recognition model to perform noise removal and other operations on the initial image information, and then use the median filtering algorithm to perform background modeling on the initial image information. That is, the background recognition model obtains filtered image information by replacing each pixel value in the initial image information with the median of the pixel values ​​in the neighborhood, and obtains the initial background image information of the initial image information by taking the median of the sequence pixels of each pixel in the filtered image information as the median.

[0083] Specifically, after the air conditioner obtains the initial background image information of the initial image information, since the air conditioner operation area is coordinated as a user's home scene and other places, which is greatly affected by environmental factors such as lighting, the air conditioner also uses the historical foreground mask to perform background update on the initial background image information of the initial image information, thereby obtaining the target background image information of the initial image. The historical foreground mask is a foreground mask image that represents the foreground information of the historical image information, obtained by background segmentation based on historical image information of a preset time length before the initial image information. The preset time length can be a custom time length of the previous frame or several previous frames.

[0084] Specifically, the air conditioner accesses the air conditioning image database pre-set to store image information of the air conditioning operation area at different time nodes in the air conditioner, and obtains the historical foreground mask associated with the initial image information in the air conditioning operation area, and determines the background area to be updated in the initial background image information according to the historical foreground mask and the preset background detection threshold, and updates the background area to be updated in the initial background image information to obtain the target background image information. The background detection threshold is the pixel value threshold information corresponding to the air conditioning operation area, which is used to detect whether the image is a background image.

[0085] Specifically, after determining the target background image information in the initial image information, the air conditioner also segments the target foreground information in the initial image information according to the initial image information and the target background image information, that is, after determining the target background image information, the air conditioner also uses the target background image information to perform image segmentation on the initial image information, thereby extracting the target foreground image information in the initial image information. That is, the air conditioner subtracts the initial image information and the target foreground image information pixel by pixel to obtain the difference image information, and performs threshold segmentation on the difference image information using the foreground detection threshold to obtain the foreground image information corresponding to the difference image information.

[0086] Specifically, after determining the target foreground image information in the initial image information, the air conditioner also uses a preset object detection model to perform object detection on the target foreground image information, thereby determining the foreground object information contained in the target foreground image information. The foreground object information is object image information representing the user or other object objects present in the initial image information.

[0087] 203. Perform image processing on the foreground object information according to the object projection curve associated with the foreground object information to obtain target object information;

[0088] Specifically, after determining the foreground object information in the initial image information, the air conditioner further performs image processing on the foreground object information according to the object projection curve associated with the foreground object information to obtain the target object information.

[0089] Specifically, since the initial image information captured in the air-conditioning operation area may contain multiple user objects that are stuck together or a specific user may be blocked by another user, or a specific user may be blocked by furniture and other objects, resulting in target loss or target recognition errors, the air conditioner further performs morphological processing on each foreground object information after obtaining the foreground image information corresponding to the initial image information, and generates object feature images of each foreground object information that may be stuck together or blocked in the initial image information.

[0090] That is, the air conditioner selects and processes each foreground object information, and generates a geometric feature image that can cover the foreground object information, wherein the geometric feature image can be a rectangle or other geometric feature shapes. Figure 3 As shown, Figure 3 This is a schematic diagram of an embodiment of an object feature image generated by morphologically processing the adhesion foreground object information in the air conditioning control method provided in the embodiment of the present application. Figure 3 As shown, the Figure 3 A frame of foreground image information containing a foreground object information combination with an adhesion situation is shown in the figure. The air conditioner performs morphological processing on the foreground object information combination with an adhesion situation, and generates an object feature image representing the foreground object information as a combination of two partially overlapping rectangular features. In a specific embodiment, the morphological processing method can be to perform mask processing on the foreground object information, and determine the mask frame diagram corresponding to the foreground object information as the object feature image of the foreground object information.

[0091] Specifically, after the air conditioner obtains the object feature image of the foreground object information, it also performs projection processing based on the feature pixel value in the object feature image to obtain the object projection curve of the foreground object information. That is, after the air conditioner obtains each object feature image, it also obtains the feature pixel value in the object feature image, wherein the feature pixel value includes a horizontal feature pixel value and a vertical feature pixel value, wherein the horizontal feature pixel value is a pixel value in the horizontal direction of the object feature image. The vertical feature pixel value is a pixel value in the vertical direction of the object feature image.

[0092] Specifically, after acquiring the characteristic pixel values ​​of the object characteristic image, the air conditioner sums the horizontal characteristic pixel values ​​in the horizontal direction to obtain the horizontal pixel total value, and sums the vertical characteristic pixel values ​​in the vertical direction to obtain the vertical pixel total value, and projects the horizontal pixel total value and the vertical pixel total value in the horizontal direction and the vertical direction respectively to obtain the object projection curve of the foreground object information, wherein the object projection curve includes a horizontal projection curve and a vertical projection curve, wherein the horizontal projection curve is a pixel projection curve obtained by projecting in the horizontal direction, and the vertical projection curve is a pixel projection curve obtained by projecting in the vertical direction.

[0093] Specifically, after obtaining the object projection curve of the foreground object information, the air conditioner also performs occlusion detection on the foreground object information according to the object projection curve to determine whether the foreground object information is blocked or adhered, and identifies the target object information to guide the air conditioner to perform operation control.

[0094] 204. Identify object status information corresponding to the target object information, and adjust air-conditioning operation parameters corresponding to the air-conditioning operation area according to the object status information.

[0095] Specifically, after determining the target object information in the foreground object information, the air conditioner also identifies the object state information corresponding to the target object information, and adjusts the air conditioning operation parameters corresponding to the air conditioning operation area according to the object state information. The target object information is object image information representing the user object or other objects that can affect the operation state of the air conditioner.

[0096] Specifically, after determining the target object information, the air conditioner can further perform object recognition on the target object information, thereby determining the object state information of the target object information, wherein the object state information may be state parameter information characterizing the attributes, posture and other states of the target object. For example, the object state information may include object identity information, object posture information and object physiological state information.

[0097] For example, after determining the target object information, the air conditioner can also identify the target object information to determine the object identity information of the target object. The air conditioner can then read the air conditioning correction parameters corresponding to the object identity information and adjust the operating parameters of the air conditioner according to the air conditioning correction parameters to guide the air conditioner to perform personalized operation according to the object identity information.

[0098] For another example, after determining the target object information, the air conditioner can also perform posture recognition on the target object information to determine the object posture information of the target object, thereby judging the current behavior state of the target object, and selecting an appropriate air conditioning correction parameter according to the behavior state to adjust the operating parameters of the air conditioner to guide the air conditioner to perform personalized operation according to the object posture information. In a specific embodiment, the object posture information can be posture information that can characterize user behavior activities, such as sitting posture information, exercise posture information, and sleeping posture information.

[0099] In this embodiment, the air conditioner obtains the initial image information in the air conditioner operation area by responding to the air conditioner control request; performs background analysis on the initial image information to determine the foreground object information of the initial image information; performs image processing on the foreground object information according to the object projection curve associated with the foreground object information to obtain the target object information; identifies the object state information corresponding to the target object information, and adjusts the air conditioner operation parameters corresponding to the air conditioner operation area according to the object state information. When the air conditioner collects the image information in the air conditioner operation area, it can extract the foreground object information containing the user object in the image information, and also use the object projection curve associated with the foreground object information to determine whether the foreground image information has adhesion or occlusion, and perform image processing on the foreground object information to obtain separated target object information, and perform parameter correction on the air conditioner according to the object state information of the target object information. In this way, when the object is adhered or blocked, the air conditioner can be used to accurately identify the target object with adhesion or occlusion in the operation scene, improve the recognition accuracy of the target object, and then improve the control accuracy of the personalized air conditioner control based on the target recognition result, and improve the user's air conditioner use experience.

[0100] like Figure 4 As shown, Figure 4 This is a flow chart of an embodiment of determining target background image information in the air conditioning control method provided in the embodiment of the present application. Specifically, in this embodiment, the air conditioning control method further includes steps 301 to 304:

[0101] 301. Obtain mask pixels in the historical foreground mask;

[0102] 302. If the mask pixel value of the mask pixel is less than the background detection threshold, determine that the mask pixel is a background pixel;

[0103] 303. If the mask pixel value of the mask pixel is greater than the background detection threshold, determine that the mask pixel is a foreground pixel;

[0104] 304. Update the initial background image information according to the background pixels and the foreground pixels to obtain target background image information.

[0105] Based on the above embodiments, in this embodiment, the air conditioner can obtain the historical foreground mask corresponding to the initial image information, and determine the background area to be updated in the initial background image information based on the historical foreground mask and the preset background detection threshold, and update the background area to be updated in the initial background image information to obtain the target background image information.

[0106] Specifically, after obtaining the historical foreground mask, the air conditioner uses the historical foreground mask as a priori indication and obtains the mask pixels in the historical foreground mask, and compares the mask pixels with the background detection threshold to determine the background area to be updated in the initial background image information.

[0107] Optionally, if the mask pixel value of the mask pixel point in the historical foreground mask is less than the background detection threshold, the air conditioner determines that the mask pixel point is a background pixel point.

[0108] Optionally, if the mask pixel value of the mask pixel point in the historical foreground mask is greater than the background detection threshold, the air conditioner determines that the mask pixel point is a foreground pixel point.

[0109] Specifically, after the air conditioner obtains the background pixel points in the historical foreground mask, it determines the background update area through the background pixel points, and updates the corresponding pixel points in the initial background image information according to the background update area to obtain the target background image information, wherein the pixel update formula is as follows:

[0110]

[0111] Among them, P t (x, y) is the pixel value of the point (x, y) in the initial background image information; P t+1 (x, y) is the pixel value of the point (x, y) in the target background image information; I t (x, y) is the pixel value of the point (x, y) in the historical foreground image information; Mask(x, y) is the pixel value of the point (x, y) in the historical foreground mask; α is a weight between 0 and 1.

[0112] Specifically, after determining the target foreground image information in the initial image information, the air conditioner also uses a preset object detection model to perform object detection on the target foreground image information, thereby determining the foreground object information contained in the target foreground image information. The foreground object information is object image information representing the user or other object objects present in the initial image information.

[0113] In this embodiment, the air conditioner obtains the mask pixel point in the historical foreground mask; if the mask pixel value of the mask pixel point is less than the background detection threshold, the mask pixel point is determined to be a background pixel point; if the mask pixel value of the mask pixel point is greater than the background detection threshold, the mask pixel point is determined to be a foreground pixel point; the initial background image information is updated according to the background pixel point and the foreground pixel point to obtain the target background image information. In this way, the initial background image information is updated according to the historical foreground image and the historical foreground mask to obtain the target background image information, so as to reduce the interference of the subsequent object recognition caused by the change of environmental factors and improve the recognition accuracy.

[0114] like Figure 5 As shown, Figure 5 This is a flow chart of an embodiment of performing occlusion detection in the air conditioning control method provided in the embodiment of the present application. Specifically, in this embodiment, the air conditioning control method further includes steps 401 to 403:

[0115] 401. Perform boundary point detection based on the object projection curve to obtain target boundary points of the object projection curve, where the target boundary points include peak boundary points and trough boundary points;

[0116] 402. Perform occlusion detection on the foreground object information according to the wave peak boundary point and the wave valley boundary point to determine object occlusion information in the foreground object information;

[0117] 403. Perform object segmentation on the foreground object information according to the object occlusion information to obtain target object information in the foreground object information.

[0118] Based on the above embodiments, in this embodiment, after the air conditioner obtains the object projection curve of the foreground object information, it also performs occlusion detection on the foreground object information according to the object projection curve to determine whether the foreground object information is blocked or adhered, and identifies the target object information to guide the air conditioner to perform operation control.

[0119] Specifically, the air conditioner performs boundary point detection on the object projection curve to obtain the target boundary point of the object projection curve. That is, the air conditioner performs boundary point search on the peak and its neighborhood in the object projection curve, that is, calculates the first-order derivative within the peak and its neighborhood interval in the object projection curve, obtains the first step function associated with the object projection curve, and obtains the jump discontinuity point of the step function to determine the peak boundary point in the direction corresponding to the peak.

[0120] Specifically, the air conditioner also searches for boundary points of the trough and its neighborhood in the object projection curve, that is, calculates the first-order derivative within the trough and its neighborhood interval in the object projection curve, obtains the second step function associated with the object projection curve, and obtains the jump discontinuity points of the step function to determine the trough boundary points in the direction corresponding to the trough.

[0121] Specifically, after acquiring the peak boundary point and the trough boundary point, the air conditioner determines the peak boundary point and the trough boundary point as the target boundary point of the object projection curve.

[0122] Specifically, after obtaining the target boundary points of the projection curve of each object, the air conditioner also performs occlusion detection on the foreground object information based on the peak boundary points and the trough boundary points in the target boundary points, that is, the air conditioner determines the target boundary area of ​​each object projection curve based on the peak boundary points and the trough boundary points, and determines whether a peak or a trough appears in the target boundary area based on the peak boundary points and the trough boundary points. If a peak appears in the target boundary area, it means that the foreground object information is occluded in the corresponding direction of the object projection curve, resulting in overlapping of the target boundary areas; if a trough appears in the target boundary area, it means that the target boundary area is not occluded and there is no overlapping of the target boundary areas, so as to generate object occlusion information in the foreground object information.

[0123] Specifically, after determining the object occlusion information, the air conditioner performs object segmentation on the foreground object information according to the object occlusion information, thereby obtaining target object information in the foreground object information that can guide the operation of the air conditioner.

[0124] In this embodiment, the air conditioner performs boundary point detection based on the object projection curve to obtain target boundary points of the object projection curve, wherein the target boundary points include peak boundary points and trough boundary points; performs occlusion detection on the foreground object information according to the peak boundary points and the trough boundary points to determine the object occlusion information in the foreground object information; performs object segmentation on the foreground object information according to the object occlusion information to obtain the target object information in the foreground object information. The projection curve is used to perform occlusion detection and segmentation on the object image, and then, in the case of object adhesion or occlusion, the air conditioner can be used to accurately identify the target object with adhesion or occlusion in the running scene, thereby improving the accuracy of object recognition.

[0125] In order to better implement the air conditioning control method in the embodiment of the present application, based on the air conditioning control method, an air conditioning control device is also provided in the embodiment of the present application, such as Figure 6 As shown, Figure 6 The structure diagram of the air conditioning control device provided in the embodiment of the present application is as follows. Specifically, the air conditioning control device 500 includes:

[0126] The image acquisition module 501 is configured to respond to the air conditioning control request and acquire the initial image information in the air conditioning operation area;

[0127] An image segmentation module 502 is configured to perform background analysis on the initial image information to determine foreground object information of the initial image information;

[0128] An image processing module 503 is configured to perform image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information;

[0129] The air conditioning control module 504 is configured to identify the object state information corresponding to the target object information, and adjust the air conditioning operation parameters corresponding to the air conditioning operation area according to the object state information.

[0130] In a possible implementation of this embodiment, the air conditioning control device performs background analysis on the initial image information to determine foreground object information of the initial image information, including:

[0131] Performing background modeling on the initial image information using the historical foreground mask to obtain target background image information of the initial image information;

[0132] Segmenting the target foreground image information in the initial image information according to the initial image information and the target background image information;

[0133] The target foreground image information is subjected to object detection using a preset object detection model to determine foreground object information of the initial image information.

[0134] In a possible implementation of this embodiment, the air conditioning control device uses the historical foreground mask to perform background modeling on the initial image information to obtain target background image information of the initial image information, including:

[0135] Accessing an air conditioning image database to obtain a historical foreground mask of the air conditioning operation area;

[0136] Performing background modeling on the initial image information according to a preset background recognition model to obtain initial background image information;

[0137] The initial background image information is updated according to the historical foreground mask and a preset background detection threshold to obtain target background image information.

[0138] In a possible implementation of this embodiment, the air conditioning control device updates the initial background image information according to the historical foreground mask and the preset background detection threshold to obtain the target background image information, including:

[0139] Obtaining mask pixels in the historical foreground mask;

[0140] If the mask pixel value of the mask pixel point is less than the background detection threshold, the mask pixel point is determined to be a background pixel point;

[0141] If the mask pixel value of the mask pixel is greater than the background detection threshold, the mask pixel is determined to be a foreground pixel;

[0142] The initial background image information is updated according to the background pixel points and the foreground pixel points to obtain target background image information.

[0143] In a possible implementation of this embodiment, the air conditioning control device performs image processing on the foreground object information according to the object projection curve associated with the foreground object information to obtain the target object information, including:

[0144] Performing morphological processing on the foreground object information to obtain an object feature image of the foreground object information;

[0145] Performing projection processing based on feature pixel values ​​in the object feature image to obtain an object projection curve of the foreground object information;

[0146] Occlusion detection is performed on the foreground object information based on the object projection curve to determine target object information in the foreground object information.

[0147] In a possible implementation of this embodiment, the air conditioning control device performs projection processing based on the feature pixel values ​​in the object feature image to obtain the object projection curve of the foreground object information, including:

[0148] Acquire characteristic pixel values ​​in the object characteristic image, wherein the characteristic pixel values ​​include horizontal characteristic pixel values ​​and vertical characteristic pixel values;

[0149] Pixel projection is performed according to the horizontal characteristic pixel value and the lateral characteristic pixel value to obtain an object projection curve of the foreground object information.

[0150] In a possible implementation of this embodiment, the air conditioning control device performs occlusion detection on the foreground object information based on the object projection curve to determine the target object information in the foreground object information, including:

[0151] Perform boundary point detection based on the object projection curve to obtain target boundary points of the object projection curve, wherein the target boundary points include peak boundary points and trough boundary points;

[0152] Performing occlusion detection on the foreground object information according to the peak boundary point and the trough boundary point to determine object occlusion information in the foreground object information;

[0153] The foreground object information is segmented according to the object occlusion information to obtain target object information in the foreground object information.

[0154] In a possible implementation of this embodiment, the air conditioning control device identifies the object state information corresponding to the target object information, and adjusts the air conditioning operation parameters corresponding to the air conditioning operation area according to the object state information, including:

[0155] Performing status detection on the target object information to obtain object status information corresponding to the target object information;

[0156] Accessing an air conditioning operation database to obtain an air conditioning correction parameter associated with the object state information in the air conditioning operation database;

[0157] The air conditioning operation parameters corresponding to the air conditioning operation area are adjusted according to the air conditioning correction parameters to obtain an air conditioning correction result.

[0158] In this embodiment, the air conditioning control device obtains the initial image information in the air conditioning operation area by responding to the air conditioning control request; performs background analysis on the initial image information to determine the foreground object information of the initial image information; performs image processing on the foreground object information according to the object projection curve associated with the foreground object information to obtain the target object information; identifies the object state information corresponding to the target object information, and adjusts the air conditioning operation parameters corresponding to the air conditioning operation area according to the object state information. When the air conditioner collects the image information in the air conditioning operation area, it can extract the foreground object information containing the user object in the image information, and also use the object projection curve associated with the foreground object information to determine whether the foreground image information is adhered or blocked, and perform image processing on the foreground object information to obtain the separated target object information, and perform parameter correction on the air conditioner according to the object state information of the target object information. In this way, in the case of object adhesion or occlusion, the target object can be accurately identified, the recognition accuracy of the target object is improved, and then the control accuracy of the personalized air conditioning control based on the target recognition result is improved, and the user's air conditioning use experience is improved.

[0159] The embodiment of the present invention also provides an air conditioner, such as Figure 7 As shown, Figure 7 This is a schematic structural diagram of an embodiment of an air conditioner provided in an embodiment of the present application.

[0160] An air conditioner integrates any one of the air conditioning control devices provided in the embodiments of the present invention, and the air conditioner includes:

[0161] one or more processors;

[0162] Memory; and

[0163] One or more applications, wherein the one or more applications are stored in the memory and are configured so that the processor executes the steps of the air conditioning control method described in any of the above air conditioning control method embodiments.

[0164] Specifically, the air conditioner may include one or more processing core processors 601, one or more computer-readable storage media memories 602, a power supply 603, an input unit 604, and other components. Those skilled in the art will appreciate that Figure 7 The air conditioner structure shown in the figure does not constitute a limitation on the air conditioner, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0165] The processor 601 is the control center of the air conditioner. It uses various interfaces and lines to connect various parts of the entire air conditioner. By running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, it performs various functions of the air conditioner and processes data, thereby monitoring the air conditioner as a whole. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 601.

[0166] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the air conditioner, etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0167] The air conditioner also includes a power supply 603 for supplying power to each component. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, so that the power management system can manage charging, discharging, power consumption and other functions. The power supply 603 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.

[0168] The air conditioner may further include an input unit 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0169] Although not shown, the air conditioner may further include a display unit, etc., which will not be described in detail herein. Specifically, in this embodiment, the processor 601 in the air conditioner will load the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 will run the application programs stored in the memory 602, thereby realizing various functions, as follows:

[0170] In response to an air conditioning control request, initial image information in an air conditioning operation area is obtained;

[0171] Performing background analysis on the initial image information to determine foreground object information of the initial image information;

[0172] Performing image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information;

[0173] The object state information corresponding to the target object information is identified, and the air-conditioning operation parameters corresponding to the air-conditioning operation area are adjusted according to the object state information.

[0174] To this end, an embodiment of the present invention provides a computer-readable storage medium, which may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the air conditioning control methods provided in the embodiments of the present invention. For example, the computer program can be loaded by the processor to execute the following steps:

[0175] In response to an air conditioning control request, initial image information in an air conditioning operation area is obtained;

[0176] Performing background analysis on the initial image information to determine foreground object information of the initial image information;

[0177] Performing image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information;

[0178] The object state information corresponding to the target object information is identified, and the air-conditioning operation parameters corresponding to the air-conditioning operation area are adjusted according to the object state information.

[0179] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of other embodiments above, and will not be repeated here.

[0180] In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units or structures can refer to the previous method embodiments, which will not be repeated here.

[0181] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0182] The above is a detailed introduction to an air conditioning control method provided in an embodiment of the present application. Specific embodiments are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. An air conditioning control method, characterized in that: The air conditioning control method comprises: In response to an air conditioning control request, initial image information in an air conditioning operation area is obtained; Performing background analysis on the initial image information to determine foreground object information of the initial image information; Performing image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information; The object state information corresponding to the target object information is identified, and the air-conditioning operation parameters corresponding to the air-conditioning operation area are adjusted according to the object state information.

2. The air conditioning control method according to claim 1, characterized in that: The performing background analysis on the initial image information to determine the foreground object information of the initial image information includes: Performing background modeling on the initial image information using the historical foreground mask to obtain target background image information of the initial image information; Segmenting the target foreground image information in the initial image information according to the initial image information and the target background image information; The target foreground image information is subjected to object detection using a preset object detection model to determine foreground object information of the initial image information.

3. The air conditioning control method according to claim 2, characterized in that: The method of performing background modeling on the initial image information by using the historical foreground mask to obtain target background image information of the initial image information includes: Accessing an air conditioning image database to obtain a historical foreground mask of the air conditioning operation area; Performing background modeling on the initial image information according to a preset background recognition model to obtain initial background image information; The initial background image information is updated according to the historical foreground mask and a preset background detection threshold to obtain target background image information.

4. The air conditioning control method according to claim 3, characterized in that: The updating of the initial background image information according to the historical foreground mask and the preset background detection threshold to obtain the target background image information includes: Obtaining mask pixels in the historical foreground mask; If the mask pixel value of the mask pixel point is less than the background detection threshold, the mask pixel point is determined to be a background pixel point; If the mask pixel value of the mask pixel is greater than the background detection threshold, the mask pixel is determined to be a foreground pixel; The initial background image information is updated according to the background pixel points and the foreground pixel points to obtain target background image information.

5. The air conditioning control method according to claim 1, characterized in that: The performing image processing on the foreground object information according to the object projection curve associated with the foreground object information to obtain the target object information includes: Performing morphological processing on the foreground object information to obtain an object feature image of the foreground object information; Performing projection processing based on feature pixel values ​​in the object feature image to obtain an object projection curve of the foreground object information; Occlusion detection is performed on the foreground object information based on the object projection curve to determine target object information in the foreground object information.

6. The air conditioning control method according to claim 5, characterized in that: The performing projection processing based on the feature pixel values ​​in the object feature image to obtain the object projection curve of the foreground object information includes: Acquire characteristic pixel values ​​in the object characteristic image, wherein the characteristic pixel values ​​include horizontal characteristic pixel values ​​and vertical characteristic pixel values; Pixel projection is performed according to the horizontal characteristic pixel value and the lateral characteristic pixel value to obtain an object projection curve of the foreground object information.

7. The air conditioning control method according to claim 5, characterized in that: The performing occlusion detection on the foreground object information based on the object projection curve to determine the target object information in the foreground object information includes: Perform boundary point detection based on the object projection curve to obtain target boundary points of the object projection curve, wherein the target boundary points include peak boundary points and trough boundary points; Performing occlusion detection on the foreground object information according to the peak boundary point and the trough boundary point to determine object occlusion information in the foreground object information; The foreground object information is segmented according to the object occlusion information to obtain target object information in the foreground object information.

8. The air conditioning control method according to any one of claims 1 to 7, characterized in that: The identifying the object state information corresponding to the target object information, and adjusting the air-conditioning operation parameters corresponding to the air-conditioning operation area according to the object state information, includes: Performing status detection on the target object information to obtain object status information corresponding to the target object information; Accessing an air conditioning operation database to obtain an air conditioning correction parameter associated with the object state information in the air conditioning operation database; The air conditioning operation parameters corresponding to the air conditioning operation area are adjusted according to the air conditioning correction parameters to obtain an air conditioning correction result.

9. An air conditioning control device, characterized in that: The air conditioning control device comprises: An image acquisition module is configured to respond to an air conditioning control request and acquire initial image information in an air conditioning operation area; An image segmentation module is configured to perform background analysis on the initial image information to determine foreground object information of the initial image information; An image processing module is configured to perform image processing on the foreground object information according to an object projection curve associated with the foreground object information to obtain target object information; The air conditioning control module is configured to identify object status information corresponding to the target object information, and adjust the air conditioning operation parameters corresponding to the air conditioning operation area according to the object status information.

10. An air conditioner, characterized in that: The air conditioner comprises: one or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and are configured to be executed by the processor to implement the steps of the air conditioning control method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of the air conditioning control method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Adhered crowd segmenting and tracking methods based on superpixel and graph model

    CN103164858A

  • Running control method and device of air conditioner and air conditioner system

    CN106871365A

  • Human body detection method, system and device based on RGB-D image and medium

    CN115862061A

  • System and process for locating and tracking a person or object in a scene using a series of range images

    US6658136B1