Air conditioning system

Through the camera and image acquisition components combined with the object detection algorithm, the obstacle interference and cost problems of the air conditioning system when detecting the distance of the target object in the room are solved, and intelligent air conditioning system operation and precise air supply adjustment are realized.

WO2024230206A1PCT designated stage expired Publication Date: 2024-11-14QINGDAO HISENSE HITACHI AIR CONDITIONING SYST
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/070207
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-11
Filing Date
2024-01-02
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

When detecting the distance between indoor target objects, existing air conditioning systems have problems such as obstacle interference, sound-absorbing materials, and high costs, especially the accuracy and cost problems of ultrasonic and infrared sensors.

Method used

Using camera and image acquisition components combined with object detection algorithm, the positions of reference objects and target objects are determined by taking indoor room images, and the distance between the distance measurement device and the target object is calculated to realize automatic power switch and air supply adjustment of the intelligent air conditioning system. .

Benefits of technology

It improves the detection accuracy and accuracy of the air conditioning system in complex environments, reduces system costs, and realizes intelligent air conditioning operation, which is suitable for various indoor environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024070207_14112024_PF_FP_ABST
    Figure CN2024070207_14112024_PF_FP_ABST
Patent Text Reader

Abstract

An air conditioning system, comprising a ranging device and a controller. The ranging device comprises an image collection portion, wherein the image collection portion comprises a camera; and the image collection portion is configured to collect an image of an indoor room by means of photographing. The controller is configured to: according to the position and pose of the camera and physical parameters of the indoor room, acquire a reference object from the image of the indoor room, which image is photographed by means of the image collection portion; and according to an image that comprises the reference object and a target object, and the real distance from the reference object, determine the distance between the ranging device and the target object.
Need to check novelty before this filing date? Find Prior Art

Description

Air conditioning system

[0001] This application claims priority to Chinese patent application No. 202310529251.8 filed on May 11, 2023, and priority to Chinese patent application No. 202310531866.4 filed on May 11, 2023, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present disclosure relates to the technical field of air conditioning, and in particular to an air conditioning system. Background Art

[0003] With the development of science and technology and the improvement of people's living standards, people have higher and higher requirements for air conditioning equipment. For example, an air conditioning system, as an air conditioning device, performs the cooling or heating cycle of the air conditioner by using a compressor, condenser, expansion valve and evaporator.

[0004] Summary of the Invention

[0005] In one aspect, an air conditioning system is provided. The air conditioning system includes an outdoor unit, an indoor unit, a distance measuring device, and a controller. The indoor unit is connected to the outdoor unit to transmit refrigerant. The distance measuring device is disposed in the indoor unit. The distance measuring device includes an image acquisition unit. The image acquisition unit includes a camera. The image acquisition unit is configured to capture images of an indoor room by photographing. The images of the indoor room include a first image and a second image, the first image including a reference object, and the second image including the reference object and a target object. The controller is communicatively connected to the image acquisition unit. The controller is configured to: capture the reference object in the image of the indoor room captured by the image acquisition unit based on the position and posture of the camera and physical parameters of the indoor room; and determine the distance between the distance measuring device and the target object based on the second image including the reference object and the target object and the actual distance to the reference object. The position of the camera includes its height. The posture of the camera includes its installation angle. The height is the height of the camera relative to the floor of the indoor room, and the installation angle is the tilt angle of the camera relative to the height of the indoor room.

[0006] In another aspect, an air conditioning system is provided. The air conditioning system includes an outdoor unit, an indoor unit, a distance measuring device, and a controller. The indoor unit is connected to the outdoor unit to transmit refrigerant. The distance measuring device is disposed in the indoor unit. The distance measuring device includes an image acquisition unit. The image acquisition unit includes a camera. The image acquisition unit is configured to capture an image of an indoor room by photographing. The image of the indoor room includes a first image and a second image, the first image including a reference object, and the second image including the reference object and a target object. The controller is communicatively connected to the image acquisition unit. The controller is configured to: acquire the reference object, the two-dimensional field of view, and a plurality of two-dimensional units in the image of the indoor room captured by the image acquisition unit based on the position and posture of the camera and the physical parameters of the indoor room; control the image acquisition unit to acquire the second image; determine the target object in the second image using a target detection algorithm and determine the bounding box of the target object; determine a set pixel point of the target object; determine the relative position of the set pixel point and the reference object, and determine the two-dimensional unit or the edge of the two-dimensional unit where the set pixel point of the target object is located; and determine the physical distance of the two-dimensional unit or the edge of the two-dimensional unit corresponding to the set pixel point as the distance between the target object and the ranging device. The physical distance of the two-dimensional unit is linearly related to the pixel coordinates of the two-dimensional unit.

[0007] In yet another aspect, an air conditioning system is provided. The air conditioning system includes an outdoor unit, an indoor unit, a distance measuring device, and a controller. The indoor unit is connected to the outdoor unit to transmit refrigerant. The distance measuring device is disposed in the indoor unit. The distance measuring device includes an image acquisition unit. The image acquisition unit includes a camera. The image acquisition unit is configured to capture an image of an indoor room by photographing. The image of the indoor room includes a target object and a reference object. The controller is communicatively connected to the image acquisition unit. The controller is configured to: obtain the position and posture of the camera; obtain the image of the indoor room captured by the image acquisition unit; identify the target object in the image of the indoor room using an object detection algorithm and determine a bounding box of the target object; determine a set pixel point of the target object; determine the physical distance of the target object's set pixel point in a physical ground coordinate system along a vertical axis component based on the position and posture of the camera; determine the physical distance of the target object's set pixel point in a physical ground coordinate system along a horizontal axis component based on the vanishing points of the target object and the reference object in the image of the indoor room; and determine the distance between the distance measuring device and the target object based on the physical distance of the horizontal axis component and the physical distance of the vertical axis component. The camera position includes the camera's height. The camera's posture includes the camera's field of view and installation angle. The height is the camera's height relative to the floor of the indoor room. The installation angle is the camera's tilt angle relative to the height of the indoor room. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] FIG1 is a structural diagram of an air conditioning system according to some embodiments;

[0009] FIG2 is a block diagram of a distance measuring device in an air conditioning system according to some embodiments;

[0010] FIG3 is another block diagram of a distance measuring device in an air conditioning system according to some embodiments;

[0011] FIG4 is a flow chart of steps performed by a ranging device according to some embodiments;

[0012] FIG5 is a block diagram of a two-dimensional field of view according to some embodiments;

[0013] FIG6 is a schematic diagram of a first image according to some embodiments;

[0014] FIG7 is another flow chart of steps performed by a ranging device according to some embodiments;

[0015] FIG8 is a schematic diagram of a second image according to some embodiments;

[0016] FIG9 is a schematic diagram illustrating a distance measuring device according to some embodiments when determining the relative position of a set pixel point and a two-dimensional unit;

[0017] FIG10 is another schematic diagram illustrating a distance measuring device according to some embodiments when determining the relative position of a set pixel point and a two-dimensional unit;

[0018] FIG11 is another schematic diagram illustrating a distance measuring device according to some embodiments for determining the relative position of a set pixel point and a two-dimensional unit;

[0019] FIG12 is a schematic diagram illustrating a distance measurement device according to some embodiments when calculating the distance between a target object and the distance measurement device;

[0020] FIG13 is another schematic diagram illustrating a distance measurement device calculating a distance between a target object and the distance measurement device according to some embodiments;

[0021] FIG14 is another schematic diagram illustrating a distance measurement device according to some embodiments when calculating the distance between a target object and the distance measurement device;

[0022] FIG15 is another schematic diagram illustrating a distance measurement device according to some embodiments when calculating the distance between a target object and the distance measurement device;

[0023] FIG16 is another flow chart of steps performed by a ranging device according to some embodiments;

[0024] FIG17 is another flow chart of steps performed by a ranging device according to some embodiments;

[0025] FIG18 is another flow chart of steps performed by a ranging device according to some embodiments;

[0026] FIG19 is a schematic diagram of a physical ground coordinate system in an air conditioning system according to some embodiments;

[0027] FIG20 is a schematic diagram of a physical ground coordinate system in an air conditioning system according to some embodiments;

[0028] FIG21 is another flow chart of steps performed by a ranging device according to some embodiments;

[0029] FIG22 is a schematic diagram illustrating a distance measuring device according to some embodiments for determining a physical distance of a longitudinal axis component;

[0030] FIG23 is a schematic diagram illustrating a distance measuring device according to some embodiments for obtaining a vertical axis pixel distance of a set pixel point in a target pixel coordinate system;

[0031] FIG24 is another flow chart of steps performed by a ranging device according to some embodiments;

[0032] FIG25 is a schematic diagram of an image acquisition unit capturing an image according to some embodiments;

[0033] FIG26 is another schematic diagram illustrating a distance measuring device determining a physical distance of a longitudinal axis component according to some embodiments;

[0034] FIG27 is another flow chart of steps performed by a ranging device according to some embodiments;

[0035] FIG28 is a schematic diagram of image distortion according to some embodiments;

[0036] FIG29 is a schematic diagram of another image distortion according to some embodiments;

[0037] FIG30 is a schematic diagram of yet another image distortion according to some embodiments;

[0038] FIG31 is another flow chart of steps performed by a ranging device according to some embodiments;

[0039] FIG. 32 is a schematic diagram illustrating a distance measuring device according to some embodiments when determining the height of a target object. DETAILED DESCRIPTION

[0040] The following will clearly and completely describe some embodiments of the present disclosure in conjunction with the accompanying drawings. However, the described embodiments are only some embodiments of the present disclosure, not all embodiments. Based on the embodiments provided by the present disclosure, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of the present disclosure.

[0041] Unless the context requires otherwise, throughout the specification and claims, the term "comprise" and its other forms, such as the third person singular form "comprises" and the present participle form "comprising", are to be interpreted as open and inclusive, that is, "including, but not limited to". In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific example" or "some examples" are intended to indicate that the particular features, structures, materials or characteristics associated with the embodiment or example are included in at least one embodiment or example of the present disclosure. The schematic representation of the above terms does not necessarily refer to the same embodiment or example. In addition, the particular features, structures, materials or characteristics may be included in any one or more embodiments or examples in any appropriate manner.

[0042] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present disclosure, unless otherwise specified, "plurality" means two or more.

[0043] When describing some embodiments, the word "connected" and its derivatives may be used. The term "connected" should be understood broadly. For example, "connected" can mean fixed, removable, or integrated; it can be directly connected or indirectly connected through an intermediary. The embodiments disclosed herein are not necessarily limited to the contents of this document.

[0044] “At least one of A, B and C” has the same meaning as “at least one of A, B or C” and both include the following combinations of A, B and C: A only, B only, C only, the combination of A and B, the combination of A and C, the combination of B and C, and the combination of A, B and C.

[0045] The use of "adapted to" or "configured to" herein is intended to be open and inclusive language that does not exclude devices adapted or configured to perform additional tasks or steps.

[0046] As used herein, "about," "substantially," or "approximately" includes the stated value and an average value that is within an acceptable range of deviation from the particular value as determined by one of ordinary skill in the art taking into account the measurements in question and the errors associated with the measurement of the particular quantity (i.e., the limitations of the measurement system).

[0047] As used herein, "parallel," "perpendicular," and "equal" include the stated conditions and conditions approximating the stated conditions within an acceptable range of deviation as determined by one of ordinary skill in the art taking into account the measurement in question and the errors associated with the measurement of the particular quantity (i.e., the limitations of the measurement system).

[0048] For ease of description, unless otherwise specified, all references to up, down, left, right, front, and back in this disclosure are based on the air conditioning system's state when in use. The side of the air conditioning system facing the user when in use is the front side, and the side opposite to it is the back side. The height of the air conditioning system is the up and down direction. The left and right directions of the air conditioning system are opposite to the left and right directions of the user. For example, the left side of the air conditioning system is the right side of the user, and the right side of the air conditioning system is the left side of the user.

[0049] In air conditioning equipment (such as air conditioning systems), the air conditioning system can obtain information such as the distance, posture, and motion status of target objects (such as people or objects) to provide data for intelligent operation of the air conditioning system. For example, the air conditioning system automatically turns on when a person is in a room and automatically turns off when no one is in the room.

[0050] In some approaches, ultrasonic waves (such as millimeter-wave radar sensors) can be used to detect the distance between the air conditioning system and the target object. For example, an ultrasonic transmitter in the air conditioning system emits an ultrasonic wave. Upon hitting the target object, the wave is reflected back to the air conditioning system and received by the ultrasonic receiver in the air conditioning system. The propagation time of the ultrasonic wave can be used to calculate the distance between the air conditioning system and the target object, thereby determining whether a person is in the room. However, the room may contain many obstacles, which can easily reflect the ultrasonic wave, affecting detection. Furthermore, ultrasonic waves are easily absorbed by sound-absorbing or sound-insulating materials on the walls, affecting detection. Furthermore, ultrasonic detection cannot measure the direction of the target object. Regarding the use of infrared sensors to detect the distance between the air conditioning system and the target object, the infrared sensors in this approach are easily affected by temperature, which can affect detection accuracy. Furthermore, the use of binocular cameras can easily increase the cost of the air conditioning system.

[0051] In order to solve the above problems, some embodiments of the present disclosure provide an air conditioning device.

[0052] Air conditioning equipment uses air conditioning technology to maintain indoor air conditions. Air conditioning equipment 1 can make indoor rooms or buildings have comfortable, healthy and energy-saving characteristics. For example, indoor rooms have a good thermal environment, suitable indoor air temperature, humidity, flow rate, cleanliness and freshness, so as to provide good living conditions and working conditions for indoor personnel. In the industrial field, air conditioning equipment 1 can provide a suitable indoor environment, meet production process requirements, improve product quality, improve air quality, eliminate substances harmful to the human body (microorganisms, volatile organic gases, etc.), and maintain a good indoor environment with lower energy consumption. Therefore, air conditioning equipment 1 can be a device that heats, wets and purifies air to meet the requirements of indoor room air supply. Here, the equipment that heats and wets air includes but is not limited to heating equipment, cooling equipment, humidifying equipment and dehumidifying equipment, etc.

[0053] For ease of explanation, some embodiments of the present disclosure are introduced by taking the air conditioning equipment as an air conditioning system 1000 as an example.

[0054] As shown in Fig. 1 , an air conditioning system 1000 includes an indoor unit 100 and an outdoor unit 200. The indoor unit 100 and the outdoor unit 200 are connected by a pipeline to transmit refrigerant.

[0055] The indoor unit 100 may be a wall-mounted air supply structure, a floor-standing air supply structure, a ducted air supply structure, or an air supply structure embedded in the ceiling. The indoor unit 100 may include a housing having an indoor air inlet for drawing in indoor air and an indoor air outlet for delivering treated air to the indoor room.

[0056] The indoor unit 100 further includes a first heat exchanger 101. The first heat exchanger 101 is configured to exchange heat between indoor air and a refrigerant transmitted through the first heat exchanger 101. For example, the first heat exchanger 101 operates as an evaporator in the cooling mode of the air conditioning system 1000 and as a condenser in the heating mode of the air conditioning system 1000.

[0057] The indoor unit 100 further includes a first fan 102. The first fan 102 (also referred to as the indoor fan) is disposed within the housing of the indoor unit 100 and is configured to draw indoor air into the indoor unit 100 through the indoor air inlet of the indoor unit 100 and to deliver the indoor air, after heat exchange with the first heat exchanger 101, through the indoor air outlet of the indoor unit 100.

[0058] The outdoor unit 200 includes a compressor 202 configured to compress a refrigerant so that a low-pressure refrigerant is compressed to form a high-pressure refrigerant.

[0059] The outdoor unit 200 further includes a four-way valve 203. The four-way valve 203 is disposed in the refrigerant circuit and is configured to switch the flow direction of the refrigerant in the refrigerant circuit to achieve a cooling mode or a heating mode of the air conditioning system 1000.

[0060] The outdoor unit 200 further includes a second heat exchanger 201. The second heat exchanger 201 is configured to exchange heat between outdoor air and a refrigerant transmitted through the second heat exchanger 201. For example, the second heat exchanger 201 operates as a condenser in the cooling mode of the air conditioning system 1000 and as an evaporator in the heating mode of the air conditioning system 1000.

[0061] The outdoor unit 200 also includes an expansion valve 204, which is connected between the first heat exchanger 101 and the second heat exchanger 201. The opening of the expansion valve regulates the pressure of the refrigerant flowing through the first heat exchanger 101 and the second heat exchanger 201, thereby adjusting the refrigerant flow rate between the first heat exchanger 101 and the second heat exchanger 201. It should be noted that the compressor 202, the second heat exchanger 201, the expansion valve 204, and the first heat exchanger 101 are connected in sequence to form the refrigerant circuit.

[0062] The outdoor unit 200 also includes a second fan 205. The second fan 205 (also called an outdoor fan) is configured to draw outdoor air into the outdoor unit 200 through the outdoor air inlet of the outdoor unit 200, and send the outdoor air after heat exchange with the second heat exchanger 201 out through the outdoor air outlet of the outdoor unit 200.

[0063] In some embodiments, the air conditioning system 1000 may include one indoor unit 100. Of course, in some embodiments, the air conditioning system 1000 may also include multiple indoor units 100.

[0064] In some embodiments, as shown in FIG1 , the air conditioning system 1000 further includes a controller 300 configured to control the operation of various components within the air conditioning system 1000. The controller 300 may be a central processing unit (CPU), a general-purpose processor, a network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The controller 300 may also be other devices with processing capabilities, such as circuits, devices, or software modules, and this disclosure is not limited thereto.

[0065] In some examples, as shown in FIG1 , the controller 300 includes a first controller 301 and a second controller 302. The first controller 301 can be provided in the indoor unit 100, and the second controller 302 can be provided in the outdoor unit 200. The first controller 301 and the second controller 302 are coupled to each other, and information can be transmitted between the first controller 301 and the second controller 302.

[0066] The first controller 301 can also be coupled to the first fan 102 to drive the first fan 102. In addition, the first controller 301 can display various parameters on the display panel of the indoor unit 100, perform human-computer interaction, receive and process sampling signals from various sensors, and implement corresponding communication functions.

[0067] The second controller 302 may also be coupled to the compressor 202 , the expansion valve 204 , the four-way valve 203 , and the second fan 205 to drive the compressor 202 , the expansion valve 204 , the four-way valve 203 , and the second fan 205 to operate.

[0068] It should be noted that the first controller 301 and the second controller 302 may be an integrated unit, or may be separate units that are independently provided.

[0069] In some embodiments, as shown in Figures 1 to 3, the air conditioning system 1000 further includes a distance measuring device 10, which can be disposed in or within the indoor unit 100. The distance measuring device 10 is communicatively coupled to the first controller 301 to transmit data. Thus, the first controller 301 can drive the first fan 102 to operate in different modes based on the distance measured by the distance measuring device 10, or communicate with the second controller 302 to drive components such as the compressor 202, the expansion valve 204, the four-way valve 203, and the second fan 205.

[0070] The ranging device 10 can be an independent camera device integrated with a processor 120, or an integrated intelligent module with a camera component, or a combination of an independently set camera component and a processing component communicated with the camera component, or a camera component built into other electronic devices, and the electronic device can be detachably set in the air-conditioning system 1000, or the ranging device 10 can also be used in conjunction with the air-conditioning system 1000.

[0071] In some examples, as shown in Figures 2 and 3, the distance measuring device 10 includes an image acquisition unit 11 and a distance generating unit 12. The image acquisition unit 11 and the distance generating unit 12 can be integrated into a single unit or can be separate, independent units. The image acquisition unit 11 can be in communication with the distance generating unit 12 to transmit data to each other.

[0072] As shown in FIG3 , the image acquisition unit 11 includes one or more cameras 110. The camera 110 can be embedded in the housing of the indoor unit 100 or partially located outside the housing of the indoor unit 100 so as to be used in conjunction with the indoor unit 100. The image acquisition unit 11 (such as the camera 110) is configured to capture images of an indoor room by photographing. The camera 110 can be a monocular camera, such as an RGB monocular camera. Of course, the camera 110 can also be other types of cameras, and this disclosure does not limit this. Here, the indoor room can refer to a room where the indoor unit 100 is located.

[0073] In some examples, as shown in FIG3 , the camera 110 includes an optical assembly 111, an image sensor 112, and a digital signal processing chip 113. The optical assembly 111 includes optical lenses, filters, and protective films. The image sensor 112 is configured to receive light transmitted by the optical assembly 111 and perform photoelectric conversion. The image sensor 112 can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The digital signal processing chip 113 is configured to process the signal output by the image sensor 112. The processing includes linear correction, noise removal, bad pixel removal, white balance, automatic exposure control, and the like.

[0074] The image of the indoor room captured by the camera 110 is stored in a picture format. Depending on the resolution of the camera 110, the size of the picture can be 320×240, 640×480, 1024×768, 1280×1024, or 1920×1080. Some embodiments of the present disclosure are mainly described by taking the resolution of the camera 110 as 1920×1080 as an example.

[0075] The distance generating unit 12 is configured to receive the image captured by the image acquisition unit 11 and determine the distance between the distance measuring device 10 and the target object based on the position and posture of the camera 110 and the actual physical distance of the reference object in the image captured by the image acquisition unit 11. Here, the target object includes a human body or an object. The following description mainly uses the example of a human body as the target object.

[0076] In some examples, the distance generating unit 12 includes a processor 120 and a memory 130 .

[0077] The memory 130 includes at least one of a volatile memory (Random Access Memory, RAM) 131, a non-volatile memory (NVM) 132, or a slot 133. The memory 130 is configured to store specific programs and at least one of images captured by the image acquisition unit 11 or images processed during an intermediate process. Here, the image captured by the camera 110 includes a reference object, or includes a reference object and a target object.

[0078] The processor 120 can execute specific programs stored in the memory 130 to enable the distance generating unit 12 to perform corresponding functions. For example, the processor 120 is configured to determine the distance between the distance measuring device 10 and the target object based on the image captured by the image acquisition unit 11, the position and posture of the camera 110, and the actual distance of the reference object in the image captured by the image acquisition unit 11. Furthermore, the processor 120 can also be configured to control the operation of the image acquisition unit 11. In some examples, the processor 120 controls the operation of the camera 110. For example, the processor 120 can execute specific programs stored in the memory 130 to enable or stop the camera 110 from capturing images.

[0079] The processor 120 may be a central processing unit (CPU), a general-purpose processor, a network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The processor 120 may also be other devices with processing capabilities, such as circuits, devices, or software modules, which are not limited in this disclosure.

[0080] The processor 120 may include a communication interface 121. When the image acquisition unit 11 and the distance generation unit 12 are independently provided, the image acquisition unit 11 and the distance generation unit 12 may be connected via the communication interface 121 to achieve communication between the image acquisition unit 11 and the distance generation unit 12. The communication interface 121 may be a wired communication interface or a wireless communication interface.

[0081] A removable medium such as a memory card can be inserted into the slot 133. When a memory card is inserted, the processor 120 can perform write or read operations on the memory card. For example, the processor 120 can store at least one of the images captured by the image acquisition unit 11 or images processed during an intermediate process into the memory card or read from the memory card.

[0082] In some embodiments, the distance generating unit 12 can be integrated with the controller 300 of the air conditioning system 1000. For example, the distance generating unit 12 can be integrated into the first controller 301. In this way, the controller 300 can receive images captured by the image acquisition unit 11 and determine the distance between the distance measuring device 10 and the target object based on the position and posture of the camera 110 and the actual physical distance of the reference object in the image captured by the image acquisition unit 11. The following description mainly uses the example of the distance generating unit 12 being integrated into the controller 300.

[0083] The following describes in detail the steps performed by the controller 300 (such as the distance generating unit 12 ) in some embodiments of the present disclosure.

[0084] In some embodiments, the controller 300 is configured to: obtain a reference object in the image of the indoor room taken by the image acquisition unit 11 based on the position and posture of the camera 110 and the physical parameters of the indoor room; determine the distance between the ranging device 10 and the target object based on the image including the reference object and the target object (e.g., the second image) and the actual distance of the reference object.

[0085] In some examples, as shown in FIG. 4 , the controller 300 is configured to perform steps 100 to 106 .

[0086] In step 100 , the position and posture of the camera 110 are obtained.

[0087] Here, the position of the camera 110 may refer to a height H between the camera 110 and the floor of the indoor room. The posture of the camera 110 may refer to a tilt angle of the camera 110.

[0088] For example, some embodiments of the present disclosure utilize a wall-mounted indoor unit 100 as an example. In this case, the height H between the camera 110 and the indoor room floor is 2.6 meters. The camera 110 is tilted toward the floor (i.e., tilted downward) relative to the vertical direction (the height direction of the indoor room or the extension direction of the wall). The tilt angle of the camera 110 relative to the vertical direction (i.e., the installation angle γ) is 40°. The installation angle γ (as shown in FIG. 22 ) can be understood as the minimum angle between the pitch field of view of the camera 110 and the height direction of the indoor room, which is 40°, thereby minimizing the blind spot of the camera 110.

[0089] The position and posture of the camera 110 can be preset and stored in the memory 130 for easy access at any time. The position and posture of the camera 110 can also be detected by a position sensor or an inertial sensor and stored in the memory 130 for easy access at any time.

[0090] For example, based on the position and posture of the camera 110 retrieved from the memory 130, the position and posture of the camera 110 are adjusted during the installation process so that the position and posture of the camera 110 are consistent with the parameters pre-stored in the memory 130. It should be noted that the pre-stored position and posture of the camera 110 need to ensure that the image captured by the camera 110 can substantially cover the entire floor of the indoor room.

[0091] For another example, the air conditioning system 1000 further includes one or more position sensors or inertial sensors. These position sensors are mounted on the housing of the indoor unit 100, while these inertial sensors can be mounted within the distance measuring device 10. These position sensors or inertial sensors are configured to detect the position and posture of the camera 110 relative to the housing of the indoor unit 100. Thus, if the position and posture of the camera 110 change during use, the position and posture of the camera 110 can be adjusted to match the pre-stored position and posture of the camera 110 based on the detection results of the position sensors or inertial sensors, thereby enabling the distance measuring device 10 to function normally.

[0092] In step 101, physical parameters of an indoor room are obtained.

[0093] The physical parameters of an indoor room include the area, length, and width of the indoor room. For example, the area of ​​the indoor room is 100 square meters, the length is 10 meters, and the width is 10 meters. In some embodiments, the physical parameters of the indoor room may also include the height of the indoor room. It should be noted that the area of ​​the indoor room can also be understood as the ground area corresponding to the largest area in the image that can be captured by the camera 110.

[0094] The physical parameters can be preset and stored in the memory 130 for recall at any time.

[0095] In step 102 , the image acquisition unit 11 is controlled to acquire a first image to determine the two-dimensional field of view 31 .

[0096] As shown in Figure 5, the two-dimensional field of view 31 includes the space of the indoor room. In other words, the two-dimensional field of view 31 substantially covers the entire floor area and the space above the floor within the effectively air-conditioned area of ​​the indoor room. Thus, the two-dimensional field of view 31 can include the area within the indoor room where air conditioning can be achieved. For example, the two-dimensional field of view 31 covers a spatial range of 10 meters by 10 meters. It should be noted that the space of the indoor room can also be understood as the space corresponding to the largest area in the image that can be captured by camera 110.

[0097] The two-dimensional field of view 31 may be stored in units of the maximum number of pixels of the image captured by the camera 110. For example, depending on the resolution of the camera 110, the maximum number of pixels corresponding to the two-dimensional field of view 31 may be 320×240, 640×480, 1024×768, 1280×1024, or 1920×1080, etc. Some embodiments of the present disclosure are described using the maximum number of pixels corresponding to the two-dimensional field of view 31 as 1920×1080 as an example.

[0098] As shown in FIG6 , the first image 30 is an image captured by the image acquisition unit 11 and includes a reference object.

[0099] In step 103 , a plurality of two-dimensional units 32 in the two-dimensional field of view 31 are determined according to the set unit, and the plurality of two-dimensional units 32 are used as reference objects.

[0100] The two-dimensional field of view 31 is divided into a plurality of two-dimensional units 32 in a set unit. The set unit can be in meters. The two-dimensional unit 32 can be a polygon. That is, the number of sides of any two-dimensional unit 32 is greater than or equal to 3. In some embodiments, the two-dimensional unit 32 can be a rectangle (such as a square) or a regular polygon with another number of sides. For example, when the length of an indoor room is 10 meters and the width is 10 meters, the two-dimensional unit 32 is a square and corresponds to an indoor area of ​​1 meter by 1 meter, so that the two-dimensional field of view 31 can be divided into 100 two-dimensional units 32, each two-dimensional unit 32 corresponding to an indoor area of ​​1 square meter.

[0101] In step 104 , corner points of a plurality of two-dimensional units 32 , pixel coordinates of the corner points of the two-dimensional units 32 in the two-dimensional field of view 31 , and rows and columns of the two-dimensional units 32 are determined in the first image 30 .

[0102] In the first image 30, the corner points of multiple two-dimensional units 32 and the rows and columns of the two-dimensional units 32 are calibrated, and the pixel coordinates of the corner points of the two-dimensional units 32 in the two-dimensional field of view 31 are stored. Here, calibrating the corner points of multiple two-dimensional units 32 can be understood as establishing a relationship between the pixels in the image and the actual scene points in the indoor room. For example, the corresponding scene points can be marked with a special color and the pixels corresponding to this color can be identified in the image to achieve corner point calibration. Of course, the calibration method is not limited to this.

[0103] A rectangular coordinate system with pixels as units can be established with a corner point of the first image 30 as the origin, so that the corner points of the two-dimensional unit 32 have pixel coordinates. For example, according to the provisions of computer graphics, as shown in FIG6 , an original pixel coordinate system O-UV is established with the upper left corner of the first image 30 as the coordinate point.

[0104] The corner points of a plurality of two-dimensional quadrilateral units 32 are marked in the first image 30, and the coordinates of the corner points are stored as follows: 11 (X 11 , Y 11 ), A 12 (X 12 , Y 12 ),…,A 1N (X 1N , Y 1N ),…,A MN (X MN , Y MN )}.

[0105] M = 1, 2, ..., 10. N = 1, 2, ..., 10. M represents the row number of the two-dimensional unit 32, and N represents the column number of the two-dimensional unit 32. MN The horizontal coordinate of the pixel coordinate of the two-dimensional unit 32 at the Mth row and Nth column (i.e., the coordinate on the U axis in FIG6 ), Y MN The ordinate represents the pixel coordinate of the two-dimensional unit 32 in the Mth row and Nth column (ie, the coordinate on the V axis in FIG6 ). It should be noted that since the corner points of adjacent two-dimensional units 32 overlap, repeated corner points are not stored repeatedly.

[0106] In step 105 , the physical distances between some corner points of a plurality of 2D units 32 (eg, each 2D unit 32 ) and the orthographic projection point E of the camera 110 on the ground (as shown in FIG. 5 ) are obtained as the real distance of the reference object.

[0107] The physical distance can be manually collected or measured. Alternatively, a collection object is set at the corner point where the collection is required, and the physical distance is measured using a time of flight (TOF) method such as ultrasound or infrared. The physical distance can be stored in the memory 130. It should be noted that the orthographic projection point E of the camera 110 on the ground can be understood as the center of the orthographic projection of the camera 110 on the ground.

[0108] Some corner points in the two-dimensional unit 32 can be understood as the three corner points of the quadrilateral two-dimensional unit 32. For example, the controller 300 can collect the physical distances between the two corner points of each quadrilateral two-dimensional unit 32 that are far from the camera 110 and the orthographic projection point E of the camera 110, as well as the physical distance between the corner point of each quadrilateral two-dimensional unit 32 that is closest to the camera 110 and the orthographic projection point E of the camera 110.

[0109] The physical distances of some corner points in the plurality of two-dimensional units 32 are recorded as: 11_left1 ,A 11_right1 ,A 11_right2};…;{A MN_left1 ,A MN_right1 ,A MN_right2}.

[0110] In step 106 , a two-dimensional unit distance table is determined.

[0111] The 2D unit distance table includes pixel coordinates of corner points of the 2D unit 32 (e.g., each 2D unit 32), physical distances of some corner points, and row and column numbers of the 2D unit 32. The 2D unit distance table can be stored in the memory 130 for easy recall.

[0112] After establishing the two-dimensional unit distance table, as shown in FIG7 , the controller 300 is further configured to execute steps 200 to 204 .

[0113] In step 200 , the image acquisition unit 11 is controlled to acquire a second image.

[0114] The second image includes the target object. This step is typically used in conjunction with the intelligent functions of the air conditioning system 1000, which include but are not limited to: automatically turning on the air conditioning system 1000 when a person is detected in the indoor room, automatically shutting down the air conditioning system 1000 when no one is in the indoor room, and adjusting the air supply. Here, adjusting the air supply can be understood as adjusting the air supply mode of the indoor unit 100. For example, the wind speed of the first fan 102 can be adjusted according to the distance between the target object and the ranging device 10, or the angle of the air guide plate can be adjusted to adjust the air supply angle, or air can be supplied to different areas of the indoor room, or the first fan 102 can be activated in different locations. Of course, the present disclosure is not limited to this.

[0115] The second image and the first image cover the same two-dimensional field of view 31. Furthermore, the two-dimensional unit distance table generated in step 106 is also applicable to the second image.

[0116] In step 201, a target object is determined in a second image using a target detection algorithm, and a bounding box of the target object is determined.

[0117] The object detection algorithm can be the YOLO (You Only Look Once) algorithm, which can identify the category and location of objects in an image with a single image scan. For example, computer graphics (or deep learning (DL)) are used to analyze the second image and identify multiple areas where the target object may be located. These areas are extracted as rectangular boxes and placed into a classifier for classification, thereby identifying the target object and determining its location.

[0118] The target object may be selected with a rectangular frame (ie, border), and the pixel coordinates of the starting point and the ending point of the rectangular frame where the target object is located are stored.

[0119] For example, as shown in FIG8 , after the target object is determined in the second image using the target detection algorithm, a processed second image can be obtained, and the target object is selected by a rectangular frame 35 in the processed second image.

[0120] The pixel coordinates of the target object's starting point As are marked as (Xmin, Ymin); the pixel coordinates of the target object's ending point Ae are marked as (Xmax, Ymax). The target object's starting point As and the target object's ending point Ae are a pair of diagonal points of the rectangular frame 35 where the target object is located.

[0121] In step 202, a set pixel point of the target object is determined.

[0122] The set pixel point can be any point on the first position of the target object, and the set pixel point is represented by pixel coordinates. Here, the first position corresponds to the bottom of the target object in the height direction of the indoor room. For example, when the target object is a person, the first position represents the foot of the human body, and the set pixel point of the first position is the midpoint of the foot. Thus, the pixel coordinates of the set pixel point P1 at the first position are as follows: P1(X foot , Y foot )=P1((Xmin+Xmax) / 2, Ymax).

[0123] The set pixel point can also be any point on the second position of the target object, and the set pixel point is represented by pixel coordinates. Here, the second position corresponds to the fixed part of the target object in the height direction of the indoor room. For example, when the target object is a person, the second position represents the head of the human body, and the set pixel point of the second position is the midpoint of the head. In this way, the pixel coordinates of the set pixel point P2 at the second position are as follows: P2(X head , Y head )=P2((Xmin+Xmax) / 2, Ymin).

[0124] The first position corresponds to the bottom of the target object in the height direction, and the second position corresponds to the top of the target object in the height direction. The following mainly uses the example of setting the pixel point as the midpoint of the foot.

[0125] In step 203 , the relative position of the set pixel point and the reference object is determined, and the two-dimensional unit 32 where the set pixel point is located or the edge of the two-dimensional unit 32 where the set pixel point is located is determined.

[0126] In some examples, the controller 300 is further configured to: determine the edge of any two-dimensional unit 32 as multiple first vectors connected in sequence in the same order (such as counterclockwise or clockwise); determine multiple second vectors between multiple corner points of the two-dimensional unit 32 and the set pixel point; determine the cross products of the multiple first vectors and the multiple second vectors respectively; if the cross products of the multiple first vectors and the multiple second vectors of a two-dimensional unit 32 are respectively greater than 0, determine that the set pixel point is located within the two-dimensional unit 32; if one of the cross products of the multiple first vectors and the multiple second vectors of a two-dimensional unit 32 is equal to 0, determine that the set pixel point is located on the edge of the two-dimensional unit 32.

[0127] Here, in a two-dimensional unit 32 , a plurality of first vectors correspond to a plurality of second vectors respectively, and a second vector corresponding to a first vector refers to a vector that shares the same corner point with the first vector.

[0128] The theoretical basis of the method for determining the two-dimensional unit 32 where a set pixel point is located is described in detail below.

[0129] In the triangle shown in Figure 9, there are vectors AB, BC, and CA in a counterclockwise direction. Assuming there is a point P in Figure 9, there are vectors AP, BP, and CP.

[0130] According to the left-hand rule, when the cross product of vector AB and vector AP, the cross product of vector BC and vector BP, and the cross product of vector CA and vector CP are respectively greater than 0 (i.e., AB×AP>0, BC×BP>0, CA×CP>0), point P is located in the triangle enclosed by vector AB, vector BC, and vector CA.

[0131] When one of the cross product of vector AB and vector AP, the cross product of vector BC and vector BP, and the cross product of vector CA and vector CP is equal to 0, point P is located on a side of the triangle formed by vector AB, vector BC, and vector CA.

[0132] When one of the cross product of vector AB and vector AP, the cross product of vector BC and vector BP, and the cross product of vector CA and vector CP is less than 0, point P is outside the triangle enclosed by vector AB, vector BC, and vector CA.

[0133] The above rules also apply to quadrilaterals (e.g., a square corresponding to a two-dimensional unit 32). As shown in Figure 10, in the square, there are vectors AB, BC, CD, and DA in a counterclockwise direction. Assuming there is a point P in Figure 10, there are vectors AP, BP, CP, and DP.

[0134] According to the left-hand rule, when the cross product of vector AB and vector AP, the cross product of vector BC and vector BP, the cross product of vector CD and vector CP, and the cross product of vector DA and vector DP are respectively greater than 0 (i.e., AB×AP>0, BC×BP>0, CD×CP>0, DA×DP>0), point P is located in the square enclosed by vector AB, vector BC, vector CD and vector DA.

[0135] When one of the cross product of vector AB and vector AP, the cross product of vector BC and vector BP, the cross product of vector CD and vector CP, and the cross product of vector DA and vector DP is equal to 0, point P is located on a side of the square enclosed by vector AB, vector BC, vector CD, and vector DA.

[0136] When one of the cross product of vector AB and vector AP, the cross product of vector BC and vector BP, the cross product of vector CD and vector CP, and the cross product of vector DA and vector DP is less than 0, point P is outside the square enclosed by vector AB, vector BC, vector CD, and vector DA.

[0137] According to the cross product formula of two-dimensional vectors, assuming that vector AA = (X1, Y1) and vector BB = (X2, Y2), then AA×BB = X1×Y2-X2×Y1.

[0138] Based on the above theoretical basis, it can be determined whether the first position is within, outside or on the edge of a two-dimensional unit 32.

[0139] Take a two-dimensional unit 32 as an example, as shown in FIG11 , and assume that the four corner points of the two-dimensional unit 32 are A11, A12, A21, and A22. The pixel coordinates of the four corner points are A 11 (X 11 , Y 11 ), A 12 (X 12 , Y 12 ), A 21 (X 21 , Y 21 ), A 22 (X 22 , Y 22 ), vector AB, vector BC, vector CD and vector DA are the four edges that enclose the two-dimensional unit 32.

[0140] According to the set pixel point P1 (X foot , Y foot ) and the pixel coordinates of the four corner points, we can get:

[0141] Vector AB=(X 12 -X 11 , Y 12 -Y 11 ), vector AP=(X foot -X 11 , Y foot -Y 11 );

[0142] Vector BC=(X 22 -X 12 , Y 22 -Y 12 ), vector BP=(X foot -X 12 , Y foot -Y 12 );

[0143] Vector CD=(X 21 –X 22 , Y 21 –Y 22 ), vector CP=(X foot –X 22 , Yfoot –Y 22 );

[0144] Vector DA=(X 11 –X 21 , Y 11 –Y 21 ), vector DP=(X foot –X 21 , Y foot –Y 21 ).

[0145] According to the cross product formula of two-dimensional vectors, we can get:

[0146] AB×AP=(X 12 -X 11 )×(Y foot -Y 11 )-(X foot -X 11 )×(Y 12 -Y 11 );

[0147] BC×BP=(X 22 -X 12 )×(Y foot -Y 12 )-(X foot -X 12 )×(Y 22 -Y 12 );

[0148] CD×CP=(X 21 –X 22 )×(Y foot –Y 22 )-(X foot –X 22 )×(Y 21 –Y 22 );

[0149] DA×DP=(X 11 –X 21 )×(Y foot –Y 21 )-(X foot –X 21 )×(Y 11 –Y 21 ).

[0150] If the cross product of vector AB and vector AP, the cross product of vector BC and vector BP, the cross product of vector CD and vector CP, and the cross product of vector DA and vector DP are respectively greater than 0, the set pixel point P1 at the first position is located within the two-dimensional unit 32. If one of the cross product of vector AB and vector AP, the cross product of vector BC and vector BP, the cross product of vector CD and vector CP, and the cross product of vector DA and vector DP is equal to 0, the set pixel point P1 at the first position is located on the edge of the two-dimensional unit 32.

[0151] For example, if the cross product of vector AB and vector AP is equal to 0, it is further determined whether the set pixel point P1 at the first position is on vector AB. In this case, if the horizontal coordinate X of the set pixel point P1 is foot Greater than or equal to the horizontal coordinate X11 of the corner point A11, and less than or equal to the horizontal coordinate X12 of the corner point A12, and set the vertical coordinate Y of the pixel point P1 foot The set pixel point P1 at the first position is greater than or equal to the vertical coordinate Y11 of the corner point A11 and less than or equal to the vertical coordinate Y12 of the corner point A12.

[0152] By using the above method, the set pixel point P1 at the first position can be compared with all the two-dimensional units 32 , so that the two-dimensional unit 32 or the edge of the two-dimensional unit 32 where the set pixel point P1 at the first position is located can be determined.

[0153] In step 204 , the distance between the set pixel and the camera 110 is determined based on the physical distance of some corner points of the two-dimensional unit 32 corresponding to the set pixel and the pixel coordinates of the set pixel to serve as the distance between the ranging device 10 and the target object.

[0154] As shown in FIG12 , in the two-dimensional field of view 31, the set pixel point P1 (X foot , Y foot ) to the camera 110 can be obtained by formula (1): R1 2 =H 2 +EP1 2 ; (1)

[0155] H is the height between the camera 110 and the ground, and EP1 is the physical distance between the orthographic projection point E of the camera 110 in the ground direction and the set pixel point P1 in the two-dimensional field of view 31.

[0156] For ease of calculation, assuming that the orthographic projection point E of the camera 110 in the ground direction is located at the midpoint of the length direction of the two-dimensional field of view 31, with the length direction as the X axis and the width direction as the Y axis, the physical distance EP1 between the orthographic projection point E of the camera 110 in the ground direction and the set pixel point P1 can satisfy formula (2): EP12 =EF 2 +FP1 2 ; (2)

[0157] Point F is the perpendicular point of point P1 on the vertical axis Y.

[0158] The physical distance corresponding to line segment EF and the horizontal coordinate X of point P1 foot Linear correlation, the corresponding linear coefficient can be expressed as Ka; the physical distance corresponding to the line segment FP1 and the vertical coordinate Y of the point P1 foot Linear correlation, the corresponding linear coefficient is expressed in Kb, from which we can get formula (3): EP1 2 =EF 2 +FP1 2 =(Ka×(X foot -960)) 2 +(Kb×(1080-Y foot )) 2 ; (3)

[0159] X1 represents Ka 2 , X2 represents Kb 2 , we can get the fitting formula (4):

[0160] R1 2 =H 2 +EP1 2 =H 2 +(Ka×(X foot -960)) 2 +(Kb×(1080-Y foot )) 2 =X1×(X foot -960) 2 +X2×(1080-Y foot ) 2 +1×X3;(4)

[0161] Here, X3 represents H 2 However, due to the influence of image distortion, X3 actually represents a height correction coefficient.

[0162] The following is a fitting solution for the parameters X1, X2 and X3 in formula (4).

[0163] Substitute the physical distances and pixel coordinates of some corner points in the two-dimensional unit 32 where point P1 is located into formula (4).

[0164] As shown in FIG13 , it is assumed that the four corner points of the two-dimensional unit 32 where the point P1 is located are A xx (X xx , Y xx ), A xy(X xy , Y xy ), A yx (X yx , Y yx ), A yy (X yy , Y yy ), some corner points of the collected physical distance are A xx , A xy and A yy The physical distances corresponding to the three corner points are A xx_left1 , A xy_right1 , A yy_right2 .

[0165] When the size of the two-dimensional field of view 31 is 1920×1080, the following can be obtained based on the above parameters: D11=(X xx -960) 2 ; D12 = (1080-Y xx ) 2 ;D13=1;B1=A xx_left1 2 ; D21=(X xy -960) 2 ; D22 = (1080-Y xy ) 2 ;D23=1;B2=A xy_right1 2 ; D31=(X yy -960) 2 ; D32 = (1080-Y yy ) 2 ;D33=1;B3=A yy_right2 2 ;

[0166] Substituting the above parameters into formula (4) we can get the following formula:

[0167] The above formula (5) can be expressed as: D×X=B;

[0168] Use Cramer's rule to solve the determinant of the above matrix, replacing the first, second and third columns of matrix D with matrix B to obtain the determinants D1, D2 and D3:

[0169] In this way, after calculating the values ​​of each determinant separately, we can get:

[0170] X1=D1 / |D|; X2=D2 / |D|; X3=D3 / |D|.

[0171] After fitting the parameters X1, X2, and X3 in formula (4), the distance R1 between the set pixel point P1 at the first position and the camera 110 can be determined.

[0172] For example, the set pixel point P1 (X foot , Y foot ), and the obtained parameters X1, X2 and X3 are substituted into formula (4): R1 2 =X1×(X foot -960) 2 +X2×(1080-Y foot ) 2 +1×X3;

[0173] The solution is:

[0174] It should be noted that the distance R1 between the set pixel point P1 at the first position and the camera 110 is the physical distance between the first position and the camera 110 .

[0175] In some embodiments of the present disclosure, the field of view is evenly divided by an array grid, so that the physical grid corresponds to the pixels of the image. Within the subdivided grid, the pixels can be considered to correspond evenly to the physical grid. Furthermore, using triangle or polygon cross multiplication, the desired point is placed into the corresponding grid. The functional relationship formed by the grid corner points is used to calculate the actual physical distance between the target point within the grid and the ranging device 10. This method has the advantages of fast calculation speed, no need for distortion correction, elimination of distortion effects, and high ranging accuracy.

[0176] In some embodiments, the controller 300 may be further configured to determine a distance between the ranging device 10 and a second location of the target object.

[0177] Since the target object can be a human or an animal, and the target object can have a certain height relative to the height of the indoor room, to achieve precise control of the air conditioning system 1000, as shown in Figures 14 and 15, the controller 300 can also determine the distance between the distance measuring device 10 and the second location of the target object. Here, precise control of the air conditioning system 1000 can include zoned air supply or activating first fans 102 at different locations based on height.

[0178] In some examples, as shown in FIG. 16 , the controller 300 is further configured to perform steps 300 to 308 .

[0179] In step 300 , a set pixel point P1 at a first position of a target object is determined.

[0180] The relevant contents of step 300 can be found in the relevant contents above, which will not be repeated here.

[0181] In step 301 , a set pixel point P2 at a second position of a target object is determined.

[0182] In step 302 , the relative position between the set pixel point P1 at the first position and the reference object is determined, and the two-dimensional unit 32 or the edge of the two-dimensional unit 32 where the set pixel point P1 at the first position is located is determined.

[0183] In step 303 , the distance R1 between the first pixel point P1 and the camera 110 is determined based on the physical distances of some corner points of the two-dimensional unit 32 corresponding to the first pixel point P1 and the pixel coordinates of the first pixel point P1 .

[0184] In step 304 , the relative position between the set pixel point P2 at the second position and the reference object is determined, and the two-dimensional unit 32 or the edge of the two-dimensional unit 32 where the set pixel point P2 at the second position is located is determined.

[0185] In step 305 , the distance R2 between the second pixel point P2 and the camera 110 is determined based on the physical distances of some corner points of the two-dimensional unit 32 corresponding to the second pixel point P2 and the pixel coordinates of the second pixel point P2.

[0186] Here, the algorithm for determining distance R2 between the set pixel point P2 at the second position and camera 110 is similar to the algorithm for determining distance R1 between the set pixel point P1 at the first position and camera 110 described above, and will not be repeated here. It should be noted that due to the height of the second position, distance R2 between the set pixel point P2 at the second position and camera 110 does not represent the actual physical distance between the second position and camera 110. The actual physical distance between the second position and camera 110 needs to be calculated using the following steps.

[0187] In step 306 , a first pitch angle α1 of the set pixel point P1 at the first position relative to the camera 110 is determined based on the pixel coordinates of the set pixel point P1 at the first position, the distance R1 between the set pixel point P1 at the first position and the camera 110 , and the height H of the camera 110 .

[0188] Here, as shown in FIG. 15 , the first pitch angle α1 can be calculated according to the law of cosines: α1 = arcsin(EP1 / R1).

[0189] In step 307, the second pitch angle α2 of the set pixel point P2 at the second position relative to the camera 110 is determined based on the pixel coordinates of the set pixel point P2 at the second position, the distance R2 between the set pixel point P2 at the second position and the camera 110, and the height H of the camera 110.

[0190] Here, as shown in FIG. 15 , the second pitch angle α2 can be calculated according to the law of cosines: α2=arcsin(EP2 / R2).

[0191] In step 308 , the distance Dd between the second location and the camera 110 is determined.

[0192] When the target object is a human body, the human body has a certain height. When the human body is in an upright position, EP1 and GP3 as shown in Figure 15 can be considered equal, and the distance Dd between the second position and the camera 110 can be calculated according to the following formula: Dd = (EP1) / sin(α2) = R1×sin(α1) / sin(α2).

[0193] Here, the distance Dd between the second position and the camera 110 is the actual physical distance between the second position and the camera 110. The distance between the ranging device 10 and the target object includes the distance R1 between the set pixel point P1 at the first position and the camera 110, and the distance Dd between the second position and the camera 110. Furthermore, after determining the distance Dd between the second position and the camera 110, the air conditioning system 1000 can be controlled based on the height of the person.

[0194] In some embodiments, as shown in FIG. 17 , the controller 300 is further configured to execute steps 400 to 405 .

[0195] In step 400 , a reference object, a two-dimensional field of view 31 , and a plurality of two-dimensional units 32 are acquired from the image of the indoor room captured by the image acquisition unit 11 according to the position and posture of the camera 110 and the physical parameters of the indoor room.

[0196] The specific content of step 400 can be found in the relevant content of steps 100 to 104 above, which will not be repeated here.

[0197] In step 401 , the image acquisition unit 11 is controlled to acquire a second image.

[0198] In step 402, a target object is identified in the second image using a target detection algorithm, and a bounding box of the target object is determined.

[0199] In step 403, the set pixel points of the target object are determined.

[0200] In step 404 , the relative position of the set pixel point and the reference object is determined, and the two-dimensional unit 32 where the set pixel point of the target object is located or the edge of the two-dimensional unit 32 where the set pixel point is located is determined.

[0201] Here, the specific contents of steps 401 to 404 can refer to the relevant contents of steps 200 to 203, which will not be repeated here.

[0202] In step 405 , the physical distance of the two-dimensional unit 32 or the edge of the two-dimensional unit 32 corresponding to the set pixel point is determined as the distance between the target object and the distance measuring device 10 .

[0203] Here, the physical distance of the two-dimensional unit 32 may be linearly related to the pixel coordinates of the two-dimensional unit 32. In other words, the physical distance of the two-dimensional unit 32 may be directly converted from the pixel coordinates of the two-dimensional unit 32.

[0204] When the target object is a human body, after determining the two-dimensional unit 32 or the edge of the two-dimensional unit 32 where the set pixel point of the target object is located, the pixel coordinates of the two-dimensional unit 32 can be directly converted into the physical distance of the two-dimensional unit 32, thereby determining the distance between the target object and the distance measuring device 10. It should be noted that this method has lower accuracy, but it can increase the speed of determining the distance between the target object and the distance measuring device 10.

[0205] The above mainly uses a method of presetting a two-dimensional field of view to determine the distance between the target object and the distance measuring device 10. Of course, the present disclosure is not limited thereto.

[0206] In other embodiments, the controller 300 is configured to: receive an image captured by the image acquisition unit 11; determine the physical distance of the vertical axis component of the set pixel point of the target object in the physical ground coordinate system based on the position and posture of the camera 110; determine the physical distance of the horizontal axis component of the set pixel point of the target object in the physical ground coordinate system based on the vanishing points of the target object and the reference object in the image of the indoor room; determine the distance between the ranging device 10 and the target object based on the physical distance of the vertical axis component and the physical distance of the horizontal axis component.

[0207] As shown in FIG. 18 , the controller 300 is configured to execute steps 500 to 506 .

[0208] In step 500 , the position and posture of the camera 110 are acquired.

[0209] Here, the position of the camera 110 includes but is not limited to the height H of the camera 110. The posture of the camera 110 includes but is not limited to the field of view angle α3 and the installation angle γ. The field of view angle α3 refers to the pitch field of view angle of the camera 110.

[0210] It should be noted that some embodiments of the present disclosure are described using an example in which the resolution of camera 110 is 1920×1080, the height H of camera 110 is 2.6 meters, the tilt angle of camera 110 (i.e., the installation angle γ) is 40°, and the field of view angle α3 of camera 110 is 67°. Here, the field of view of camera 110 can cover the entire indoor room. For example, the horizontal field of view angle of camera 110 is 122°, and the pitch field of view angle (i.e., the field of view angle α3) is 67°.

[0211] The position and posture of the camera 110 may be pre-stored in the memory 130 .

[0212] In step 501 , an image of an indoor room captured by the image acquisition unit 11 is acquired.

[0213] The image of the indoor room is an image including a target object and a reference object.

[0214] In step 502, a target object is identified in the image of the indoor room using a target detection algorithm, and a bounding box of the target object is determined.

[0215] In step 503, the set pixel points of the target object are determined.

[0216] Here, for the specific contents of steps 500 to 503, please refer to the relevant contents above, which will not be repeated here.

[0217] The following mainly uses the example of setting the pixel point as the midpoint of the foot.

[0218] In step 504 , the physical distance of the vertical axis component of the set pixel point of the target object in the physical ground coordinate system is determined according to the position and posture of the camera 110 .

[0219] For camera 110, the depth of field and the distance to the target object cannot be determined solely from the image of the indoor room. However, since the angle between a point in the image and camera 110, which has a specific position and posture, is fixed, a physical ground coordinate system can be established, as shown in Figures 19 and 20.

[0220] In the space rectangular coordinate system, as shown in Figure 19, draw a vector K with the coordinate origin O as the starting point. According to the basic theorem of space vectors, there is only one set of real numbers x, y, z such that K = xi + yj + zk.

[0221] Here, i, j, and k are three unit vectors oriented in the same directions as the X, Y, and Z axes, respectively; the coordinates (x, y, z) are the coordinates of point P, and vector K is the position vector of point P. Correspondingly, in the physical ground coordinate system, the physical distance of the horizontal component of position vector K in the X-axis direction in the physical ground coordinate system is denoted as Xbar, and the physical distance of the vertical component of position vector K in the Y-axis direction in the physical ground coordinate system is denoted as Ybar.

[0222] It should be noted that in some embodiments of the present disclosure, as shown in Figure 20, the left and right direction of the ranging device 10 is defined as the X-axis, the front and back direction of the ranging device 10 is defined as the Y-axis, and the height direction of the indoor room is defined as the Z-axis.

[0223] In step 505, the physical distance of the horizontal axis component of the set pixel point of the target object in the physical ground coordinate system is determined according to the vanishing points of the target object and the reference object in the image of the indoor room.

[0224] In step 506 , the distance between the distance measuring device 10 and the target object is determined based on the physical distance of the horizontal axis component and the physical distance of the vertical axis component.

[0225] In some embodiments of the present disclosure, by respectively calculating the physical distance of the horizontal axis component and the physical distance of the vertical axis component of the target object, the accuracy of the distance determined between the ranging device 10 and the target object can be improved, the calculation speed is fast and it is applicable to embedded devices.

[0226] In some embodiments, as shown in FIG. 21 , step 504 includes steps 5041 to 5049 .

[0227] In step 5041 , the height H, field of view angle α3 and installation angle γ of the camera 110 are obtained.

[0228] In step 5042 , the length S of the first line segment is determined based on the height H and the installation angle γ of the camera 110 .

[0229] Here, the first line segment can be understood as the edge of the pitch field of view. As shown in Figure 22, the length S of the first line segment is the distance between point Q1 of camera 110 and the first intersection point Q2 when the camera is at its lowest downward angle. Point Q1 is a point on the optical axis of camera 110, and the first intersection point Q2 is the intersection of the pitch field of view and the ground at the lowest downward angle. The length S of the first line segment of camera 110 is equal to the product of the height H and the cosine of the installation angle γ (i.e., S = H × cosγ).

[0230] In step 5043, the semi-axis pitch field of view is determined.

[0231] The semi-axis pitch field of view is the field of view corresponding to half the field of view angle α3, and the semi-axis pitch angle α4 of the semi-axis pitch field of view is half of the field of view angle α3 (as shown in FIG22 , α4 = α3 × π / 360). It should be noted that determining the semi-axis pitch field of view can be understood as determining the semi-axis pitch angle α4.

[0232] In step 5044, the length L of the second line segment is determined according to the semi-axis pitch angle α4 and the length S of the first line segment.

[0233] Here, the second line segment is the center segment of the elevation field of view. As shown in Figure 22, an isosceles triangle Q1Q2Q3 is constructed with the first line segment Q1Q2 as the waist and the field of view angle α3 as the vertex angle. The length L of the second line segment is the height of the isosceles triangle Q1Q2Q3 perpendicular to the base. In other words, the length L of the second line segment is the length of the line segment Q1Q0. The length L of the second line segment is equal to the product of the length S of the first line segment and the cosine of the semi-axis elevation angle α4 (i.e., L = S × cosα4).

[0234] In step 5045 , the semi-axis physical distance T corresponding to the semi-axis pitch angle α4 is determined according to the length S of the first line segment and the semi-axis pitch angle α4 .

[0235] Here, the semi-axis physical distance T can be understood as the physical distance corresponding to the semi-axis pitch angle α4 in the semi-axis direction (such as the direction of the line segment Q2Q3 in Figure 22). Since the various angles of the camera 110 and the range of angle change are fixed values, the semi-axis physical distance T corresponding to the semi-axis pitch angle α4 can be calculated based on the semi-axis pitch angle α4. As shown in Figure 22, the semi-axis physical distance T is half of the base Q2Q3 of the isosceles triangle Q1Q2Q3 (that is, the line segment Q2Q0). The semi-axis physical distance T is equal to the product of the length S of the first line segment and the sine value of the semi-axis pitch angle α4 (that is, T = S × sinα4). The semi-axis physical distance T can be used as a conversion unit for converting other pixel distances and physical distances.

[0236] In step 5046, the vertical axis pixel distance Xa of the set pixel point in the target pixel coordinate system is obtained.

[0237] Taking the set pixel point P1 at the first position as an example, in the target pixel coordinate system, the pixel distance of the set pixel point P1 at the first position in the vertical axis direction (i.e., the vertical axis pixel distance Xa) is calculated. According to the provisions of computer graphics, as shown in Figure 6, the origin O of the original pixel coordinate system is usually set at the upper left corner of the image, the U axis is parallel to the length direction of the image, and the V axis is parallel to the width direction of the image. For the convenience of calculation, the target pixel coordinate system O1-U1V1 can be used for calculation. Here, as shown in Figure 23, the target pixel coordinate system O1-U1V1 can be understood as the origin O of the original pixel coordinate system is set at the center of the image, and the directions of the U axis and the V axis remain unchanged.

[0238] According to the target pixel coordinate system O1-U1V1 of the image, the vertical axis pixel distance Xa of the set pixel point P1 at the first position in the target pixel coordinate system is equal to the difference between 540 pixels (i.e., the semi-axis pixel distance) and the vertical coordinate of the set pixel point P1 (i.e., Xa=540-Y foot ). Here, the semi-axis pixel distance corresponds to half of the maximum pixel value of the image in the width direction.

[0239] In step 5047, the mapped physical distance of the set pixel point is determined according to the vertical axis pixel distance Xa, the semi-axis physical distance T and the semi-axis pixel distance.

[0240] The mapping physical distance Abar of the set pixel point can be calculated by the following formula: Abar = (Xa × T) / 540; (6)

[0241] The mapped physical distance Abar is the physical distance of the projection of the set pixel point P1 on the base of the isosceles triangle Q1Q2Q3. For example, the mapped physical distance Abar is the length of the line segment Q0Q5 in FIG22.

[0242] In step 5048, the pitch angle α5 is determined according to the mapped physical distance Abar of the set pixel point and the length L of the second line segment.

[0243] As shown in Figure 22, the pitch angle α5 can be calculated by the following formula: α5 = arctan (Abar / L); (7)

[0244] In step 5049 , the physical distance of the longitudinal axis component of the set pixel point in the physical ground coordinate system is determined based on the height H, the semi-axis pitch angle α4, the pitch angle α5 and the installation angle γ of the camera 110 .

[0245] For example, the physical distance Ybar1 of the vertical axis component of the set pixel point P1 at the first position in the physical ground coordinate system is the physical distance corresponding to the line segment EP1 in Figure 22. This physical distance satisfies the following formula: Ybar1 = H × tan(α4 - α5 + γ); (8)

[0246] In some embodiments, as shown in FIG. 24 , step 505 includes steps 5051 to 5057 .

[0247] In step 5051, the intersection of the extended line of the set pixel point of the target object (such as the dotted line Lr in Figure 26) and the extended line of part of the reference object (such as the dotted line Lc in Figure 26) is determined to be the vanishing point (such as point Vp in Figure 26).

[0248] Figure 25 shows an example of an image of an indoor room captured by camera 110. As shown in Figure 25 , the rectangular frame represents the selected target object, and the square tile represents the reference image. According to computer graphics, when camera 110 is used, in a two-dimensional image of an indoor room, the extensions of all lines parallel to the longitudinal axis (i.e., the longitudinal axis) with camera 110 as the starting point intersect at the same point, namely, the vanishing point Vp of the indoor room image.

[0249] Furthermore, every point on these lines parallel to the vertical axis has an equal physical distance from the vertical axis. As shown in Figure 25, every point on the same edge of the same tile has an equal physical distance from the vertical axis. Therefore, every point on the extended line of the target object's set pixel point also has an equal physical distance from the vertical axis. Based on this principle, the physical distance of the horizontal axis component of the target object's set pixel point in the physical ground coordinate system can be determined.

[0250] In step 5052, the calculation coordinate system is determined.

[0251] As shown in FIG. 26 , the vertical axis Yc of the calculation coordinate system is a vertical line passing through the vanishing point Vp and perpendicular to the length direction of the indoor room image Image.

[0252] In step 5053, the horizontal pixel distance and the vertical pixel distance of the set pixel point in the original pixel coordinate system O-UV are obtained.

[0253] Taking the set pixel point P1 at the first position as an example, the horizontal axis pixel distance of the set pixel point in the original pixel coordinate system O-UV is equal to the horizontal coordinate X of the set pixel point P1. foot , the vertical axis pixel distance of the set pixel point in the original pixel coordinate system O-UV is equal to the vertical coordinate Y of the set pixel point P1 foot .

[0254] In step 5054, a vanishing point pixel distance W1 between the vanishing point Vp and an edge of the image of the indoor room away from the vanishing point Vp is obtained.

[0255] The vanishing point pixel distance W1 may be measured in advance and stored in the memory 130 .

[0256] In step 5055, the target angle β of the set pixel point is determined according to the horizontal axis pixel distance, the vertical axis pixel distance and the vanishing point pixel distance W1 of the set pixel point.

[0257] Taking the set pixel point P1 at the first position as an example, as shown in FIG26 , the target angle β is the angle between the connecting line between the set pixel point P1 at the first position and the vanishing point Vp and the vertical axis Yc of the calculation coordinate system. The target angle β satisfies the following formula: tanβ=(X foot –1920 / 2) / (W1-1080+Yfoot ); (9)

[0258] In step 5056, a standard reference line (such as line Ls in FIG. 26) is determined in the image of the indoor room.

[0259] The standard reference line Ls is the line that passes through the extended lines of the target object's set pixel points and the extended lines of a portion of the reference object, and exhibits minimal distortion. For example, the line connecting the multiple tiles in Figure 25 exhibits minimal horizontal edge distortion. The standard reference line Ls can be perpendicular to the vertical axis Yc of the computational coordinate system. The standard reference line Ls can be pre-set, for example, by pre-measurement or directly set.

[0260] In step 5057, the standard reference intersection point (such as point M1 in Figure 26) between the extension line Lr passing through the set pixel point and the standard reference line Ls is obtained, and the physical distance between the standard reference intersection point M1 and the vertical axis Yc of the calculation coordinate system is determined to be the physical distance of the horizontal axis component of the set pixel point of the target object in the physical ground coordinate system.

[0261] In some examples, as shown in FIG. 27 , step 5057 includes steps 50571 to 50575 .

[0262] In step 50571, multiple length units of the standard reference line Ls are determined based on the physical distance of the reference object.

[0263] The standard reference line Ls can be divided into multiple length units. For example, in the real world, the edge length of a square tile can be 0.6 meters, 0.8 meters, or 1 meter. When the standard reference line Ls passes through multiple tiles, it can be divided into multiple length units based on the edge lengths of the tiles. The physical distance of each length unit is the edge length of the tile.

[0264] In step 50572, the unit pixel distance corresponding to the length unit is obtained.

[0265] As shown in Figure 26, the unit pixel distance Xti can be preset. For example, the unit pixel distance Xti is obtained by pre-measurement.

[0266] In step 50573, the ratio of the physical distance in length units to the unit pixel distance is determined as the pixel unit.

[0267] The pixel unit represents the actual physical distance corresponding to each pixel.

[0268] In step 50574, the pixel distance between the standard reference intersection M1 and the vertical axis Yc of the calculation coordinate system is obtained.

[0269] As shown in FIG26 , the pixel distance Xpi between the standard reference intersection M1 and the vertical axis Yc of the calculation coordinate system satisfies the following formula: Xpi = tanβ×(W1-W2); (10)

[0270] W2 is the pixel distance between the standard reference line Ls and the edge of the indoor room image away from the vanishing point Vp. W2 can be preset. For example, W2 can be obtained by pre-measurement.

[0271] In step 50575, the physical distance corresponding to the pixel distance Xpi between the standard reference intersection M1 and the vertical axis Yc of the calculation coordinate system is determined based on the pixel unit as the physical distance of the horizontal axis component of the set pixel point of the target object in the physical ground coordinate system.

[0272] The pixel distance Xpi between the standard reference intersection M1 and the vertical axis Yc of the computational coordinate system is converted to a physical distance in pixels. Taking the first set pixel P1 as an example, as shown in Figure 26, the physical distance Xbar1 of the horizontal axis component of the set pixel P1 in the physical ground coordinate system is equal to the physical distance corresponding to the pixel distance Xpi. It should be noted that the physical distance Xbar1 in Figure 26 is for illustration only and does not represent the actual physical distance corresponding to the physical distance Xbar1.

[0273] In some embodiments, the controller 300 may be further configured to perform distortion correction on the obtained physical distance of the horizontal axis component and the physical distance of the vertical axis component using a neural network.

[0274] The physical distance of the horizontal axis component and the physical distance of the vertical axis component are recorded as multiple points in a two-dimensional plane. The controller 300 corrects the positions of the multiple points to obtain multiple points after distortion correction. In other words, the controller 300 obtains the physical distance of the horizontal axis component and the physical distance of the vertical axis component after distortion correction.

[0275] The distortion in images captured by camera 110 is caused by lens distortion in optical assembly 111. As shown in Figures 28 to 30 , this distortion includes barrel distortion, pincushion distortion, and mustache distortion. Because the lens of camera 110 can be predetermined, the distortion of camera 110 can be determined in advance. Thus, after obtaining the physical distance of the horizontal and vertical axis components, the distortion can be corrected.

[0276] Typically, in an image, distortion in the horizontal and vertical directions is minimal, and distortion increases as the distance from the center of the image increases. Because the correction effect of Zhang Zhengyou's calibration correction formula deviates significantly from the degree of matching the measured data, in some embodiments of the present disclosure, a neural network can be constructed using deep learning methods and trained using known points. The obtained physical distances of the horizontal and vertical axis components are then input into the trained neural network for distortion correction.

[0277] In some examples, as shown in FIG. 31 , the controller 300 is further configured to perform steps 600 to 606 .

[0278] In step 600, a true distance matrix is ​​obtained.

[0279] To facilitate obtaining real-world coordinate values, as shown in FIG5 , the two-dimensional field of view 31 of the camera 110 is divided into N squares with a unit length of 0.8 meters, using the orthographic projection point E of the camera 110 on the ground as the coordinate origin. The unit length may also be other sizes, and the present disclosure is not limited thereto.

[0280] A person stands at each vertex (i.e., corner point) of each grid square in turn, captures N images with camera 110, and associates the pixel coordinates of each vertex in the obtained images with the real physical coordinates (Xx_act, Yx_act) of the human foot, where x = 1, 2, 3, ..., N. In this way, a real distance matrix composed of multiple measurement points (i.e., vertices of multiple grid squares) can be obtained. This real distance matrix includes the pixel coordinates of each vertex in the image and the real physical coordinates (Xx_act, Yx_act) corresponding to each vertex.

[0281] It should be noted that repeated vertices are recorded only once. Here, the real physical coordinates of the human foot represent the physical distance of the foot in the physical ground coordinate system.

[0282] In step 601, a target detection algorithm is used to determine the target object in the N captured images, obtain the set pixel points of the target object, and determine the physical distance of the horizontal axis component and the physical distance of the vertical axis component of the set pixel points in the physical ground coordinate system.

[0283] How to determine the physical distance of the horizontal axis component and the physical distance of the vertical axis component of the set pixel point can be found in the relevant content above and will not be repeated here.

[0284] In this way, a prediction distance matrix can be obtained for each prediction point (Xx_pre, Yx_pre), where x = 1, 2, 3, ..., N. The horizontal coordinate Xx_pre corresponds to the physical distance of the horizontal component of the set pixel point; the vertical coordinate Yx_pre corresponds to the physical distance of the vertical component of the set pixel point. The prediction distance matrix can include the pixel coordinates of the set pixel point and the physical distance of the horizontal component and the physical distance of the vertical component of the set pixel point in the physical ground coordinate system.

[0285] In step 602, a deviation value matrix is ​​obtained.

[0286] The matrix formed by the deviation values ​​of the corresponding parameters in the true distance matrix and the predicted distance matrix is ​​used as the deviation value matrix DZ (DZ = (Dx, Dy)). Here, Dx = Xx_act - Xx_pre; Dy = Yx_act - Yx_pre.

[0287] In step 603, the neural network structure is determined and the bias matrix DZ is input. The neural network structure includes the number of neurons in the input layer, the number of neurons in the hidden layer, the number of neurons in the output layer, the number of samples for one training, the input layer function, the activation function, and the output layer function.

[0288] In step 604, the loss function and optimizer of the neural network are determined.

[0289] In step 605, the neural network is trained and distortion correction parameters are obtained.

[0290] In step 606, the obtained physical distance of the horizontal axis component and the physical distance of the vertical axis component are subjected to distortion correction using the trained neural network.

[0291] In some embodiments of the present disclosure, a gridding method is used to collect real distance data, which together with the predicted data obtained by the vanishing point method constitutes training data. This can eliminate the effects of distortion and further improve detection accuracy. This method is particularly suitable for wide-angle lenses.

[0292] In some embodiments, the controller 300 may also be configured to control the air conditioning system 1000 according to the height of the target object, thereby achieving an intelligent air conditioning effect.

[0293] When the target object is a human body, since the target object has a height relative to the height of the indoor room, the controller 300 can also accurately control the air conditioning system 1000 based on the height of the target object. For example, the controller 300 can provide zoned air supply or activate the first fan 102 at different locations based on the height.

[0294] In some embodiments, the controller 300 can also be configured to: after determining the set pixel point P1 of the first position and the set pixel point P2 of the second position of the target object in the image of the indoor room, determine the height of the target object based on the physical distance of the longitudinal axis component of the set pixel point P1 at the first position in the physical ground coordinate system, the physical distance of the longitudinal axis component of the set pixel point P2 at the second position in the physical ground coordinate system, and the height H of the camera 110.

[0295] As shown in Figure 32, the height of the target object is represented by the line segment P1P2. According to the similarity of triangles, the length of the line segment P1P2 satisfies the following formula: P1P2 = H × (Ybar2 – Ybar1) / Ybar2; (11)

[0296] Ybar2 represents the physical distance of the vertical axis component of the set pixel point P2 at the second position in the physical ground coordinate system, and Ybar1 represents the physical distance of the vertical axis component of the set pixel point P1 at the first position in the physical ground coordinate system.

[0297] In some embodiments, the controller 300 can also be configured to calculate the distance R1 between the set pixel point P1 at the first position of the target object and the ranging device 10 based on the physical distance Ybar1 of the longitudinal axis component of the set pixel point P1 at the first position of the target object in the physical ground coordinate system and the height H of the camera 110.

[0298] As shown in FIG32 , the distance R1 between the set pixel point P1 at the first position and the distance measuring device 10 satisfies the following formula:

[0299] In some embodiments, the controller 300 can also be configured to calculate the distance Dd between the set pixel point P2 at the second position of the target object and the ranging device 10 based on the physical distance Ybar1 of the longitudinal axis component of the set pixel point P1 at the first position of the target object in the physical ground coordinate system, the height H of the camera 110 and the height of the target object.

[0300] As shown in FIG32 , the distance Dd between the set pixel point P2 at the second position and the distance measuring device 10 satisfies the following formula:

[0301] In some embodiments, the controller 300 can also be configured to: determine the first pitch angle α1 corresponding to the first position based on the physical distance of the longitudinal axis component of the set pixel point P1 at the first position in the physical ground coordinate system, and the height H of the camera 110; determine the second pitch angle α2 corresponding to the second position based on the physical distance of the longitudinal axis component of the set pixel point P2 at the second position in the physical ground coordinate system, the height H of the camera 110 and the height of the target object.

[0302] As shown in FIG32 , the first pitch angle α1 and the second pitch angle α2 satisfy the following formulas: α1 = arctan(Ybar1 / H); (14) α2 = arctan(Ybar1 / (H–P1P2)). (15)

[0303] In some embodiments, the controller 300 may be further configured to determine a first heading angle Angle1 and a second heading angle Angle2 based on the physical distance of the horizontal axis component and the physical distance of the vertical axis component of the set pixel point P1 at the first position in the physical ground coordinate system, and the physical distance of the horizontal axis component and the physical distance of the vertical axis component of the set pixel point P2 at the second position in the physical ground coordinate system. The first heading angle Angle1 and the second heading angle Angle2 respectively satisfy the following formulas: Angle1 = arctan(Xbar1 / Ybar1) + π / 2; (16) Angle2 = arctan(Xbar2 / Ybar2) + π / 2. (17)

[0304] Here, Xbar2 is the physical distance of the horizontal axis component of the set pixel point P2 at the second position in the physical ground coordinate system. The heading angle is the azimuth of the first position or the second position relative to the orthographic projection point E of the camera 110 on the horizontal plane.

[0305] The first pitch angle α1, the second pitch angle α2, the first heading angle Angle1, and the second heading angle Angle2 are each expressed in radians. Thus, based on the distance R1, the distance Dd, the first pitch angle α1, the second pitch angle α2, the first heading angle Angle1, and the second heading angle Angle2, the air guide plate at the air outlet of the indoor unit 100 can be more accurately controlled, thereby improving the operating performance of the air conditioning system 1000.

[0306] In some embodiments, the controller 300 can determine the longitudinal distance between the set pixel point of the target object and the ranging device 10 in the height direction of the indoor room based on the position and posture of the camera 110. For example, when the air supply angle is determined, the air conditioning system 1000 can accurately adjust the wind speed of the first fan 102 or the operating frequency of the compressor 202 based on this longitudinal distance. Here, the longitudinal distance is the physical distance between the set pixel point of the target object and the longitudinal axis component in the physical ground coordinate system.

[0307] In this application scenario, the ranging device 10 can execute the steps described above, which will not be repeated here.

[0308] In some embodiments, the controller 300 may also determine the horizontal distance between the target object's set pixel and the ranging device 10 in the indoor room based on the vanishing points of the target object and the reference object in the image of the indoor room. For example, the air conditioning system 1000 may further adjust the air deflector at the indoor unit 100's air outlet based on this horizontal distance, thereby implementing a control mode in which air is supplied to follow the user or avoid the user. Here, this horizontal distance is the physical distance between the target object's set pixel and the horizontal axis component in the physical ground coordinate system.

[0309] In this application scenario, the ranging device 10 can execute the steps described above, which will not be repeated here.

[0310] In the description of the above embodiments, specific features, structures, materials or characteristics may be combined in an appropriate manner in any one or more embodiments or examples.

[0311] Those skilled in the art will understand that the scope of the present disclosure is not limited to the above specific embodiments, and that certain elements of the embodiments may be modified and replaced without departing from the spirit of the present disclosure. The scope of the present disclosure is limited by the appended claims.

Claims

1. Air conditioning system, including: Outdoor unit; an indoor unit connected to the outdoor unit to transmit refrigerant; a distance measuring device, arranged in the indoor unit, comprising an image acquisition unit, the image acquisition unit comprising a camera, and configured to acquire an image of an indoor room by photographing; the image of the indoor room comprising a first image and a second image, the first image comprising a reference object, the second image comprising the reference object and a target object; and A controller is connected to the image acquisition unit for communication, and the controller is configured to: According to the position and posture of the camera and the physical parameters of the indoor room, acquiring the reference object in the image of the indoor room taken by the image acquisition unit; and determining the distance between the distance measuring device and the target object according to the second image including the reference object and the target object, and the real distance of the reference object; Among them, the position of the camera includes the height of the camera, and the posture of the camera includes the installation angle of the camera; the height is the height of the camera relative to the ground of the indoor room, and the installation angle is the inclination angle of the camera relative to the height direction of the indoor room.

2. The air conditioning system according to claim 1, wherein: The controller is configured to perform the following steps to obtain the reference object in the image of the indoor room taken by the image acquisition unit: Obtaining the position and posture of the camera; Acquiring physical parameters of the indoor room; Controlling the image acquisition unit to acquire the first image to determine a two-dimensional field of view; Determine a plurality of two-dimensional units in the two-dimensional field of view according to a set unit, and use the plurality of two-dimensional units as the reference objects; wherein the two-dimensional units are polygons; Determine, in the first image, corner points of the plurality of two-dimensional units, pixel coordinates of the corner points of the two-dimensional units in the two-dimensional field of view, and rows and columns of the two-dimensional units; Obtaining the physical distances between some corner points of the plurality of two-dimensional units and the orthographic projection points of the camera on the ground as the real distances of the reference object; and Determine a two-dimensional unit distance table; wherein the two-dimensional unit distance table includes pixel coordinates of corner points of the two-dimensional unit, physical distances of some corner points, and row and column numbers of the two-dimensional unit.

3. The air conditioning system according to claim 2, wherein: The controller is configured to perform the following steps to determine the distance between the distance measuring device and the target object based on the second image including the reference object and the target object, and the real distance of the reference object: Controlling the image acquisition unit to acquire the second image; Determine the target object in the second image using a target detection algorithm, and determine a bounding box of the target object; Determine a set pixel point of the target object; Determine the relative position of the set pixel point and the reference object, and determine the two-dimensional unit where the set pixel point is located or the edge of the two-dimensional unit where the set pixel point is located; as well as According to the physical distance of some corner points of the two-dimensional unit corresponding to the set pixel point and the pixel coordinates of the set pixel point, the distance between the set pixel point and the camera is determined as the distance between the ranging device and the target object.

4. The air conditioning system according to claim 3, wherein: The controller is configured to perform the following steps to determine the two-dimensional unit where the set pixel point is located or the edge of the two-dimensional unit where the set pixel point is located: Determine the edge of any one of the plurality of two-dimensional units as a plurality of first vectors connected sequentially in the same order; Determine a plurality of second vectors between a plurality of corner points of the two-dimensional unit and the set pixel point; determining cross products of the plurality of first vectors and the plurality of second vectors respectively; If the cross products of the plurality of first vectors and the plurality of second vectors of the two-dimensional unit are respectively greater than 0, it is determined that the set pixel point is located within the two-dimensional unit; as well as If one of the cross products of the plurality of first vectors and the plurality of second vectors of the two-dimensional unit is equal to 0, it is determined that the set pixel point is located at an edge of the two-dimensional unit.

5. The air conditioning system according to claim 3 or 4, wherein: The target object has a height in the height direction of the indoor room; the set pixel points of the target object include set pixel points at a first position and set pixel points at a second position, the first position corresponds to the bottom of the target object in the height direction of the indoor room, and the second position corresponds to the top of the target object in the height direction of the indoor room; The controller is further configured to perform the following steps to determine the distance between the distance measuring device and the target object based on the second image including the reference object and the target object, and the real distance of the reference object: Determining a set pixel point of a first position of the target object; Determining a set pixel point of a second position of the target object; Determine the relative position of the set pixel point at the first position and the reference object, and determine the two-dimensional unit or the edge of the two-dimensional unit where the set pixel point at the first position is located; Determine the distance between the set pixel point at the first position and the camera according to the physical distance of some corner points of the two-dimensional unit corresponding to the set pixel point at the first position and the pixel coordinates of the set pixel point at the first position; Determine the relative position of the set pixel point at the second position and the reference object, and determine the two-dimensional unit or the edge of the two-dimensional unit where the set pixel point at the second position is located; Determine the distance between the set pixel point at the second position and the camera according to the physical distance of some corner points of the two-dimensional unit corresponding to the set pixel point at the second position and the pixel coordinates of the set pixel point at the second position; Determine a first pitch angle of the set pixel point at the first position relative to the camera according to the pixel coordinates of the set pixel point at the first position, the distance between the set pixel point at the first position and the camera, and the height of the camera; Determine a second pitch angle of the set pixel point at the second position relative to the camera according to the pixel coordinates of the set pixel point at the second position, the distance between the set pixel point at the second position and the camera, and the height of the camera; as well as determining a distance between the second position and the camera; The distance between the distance measuring device and the target object includes the distance between the set pixel point of the first position and the camera, and the distance between the second position and the camera.

6. The air conditioning system according to claim 5, wherein: The target object includes a human body; the first position includes a foot of the human body, and the set pixel point of the first position includes a midpoint of the foot; the second position includes a head of the human body, and the set pixel point of the second position includes a midpoint of the head.

7. Air conditioning system, including: Outdoor unit; an indoor unit connected to the outdoor unit to transmit refrigerant; a distance measuring device, arranged in the indoor unit, comprising an image acquisition unit, the image acquisition unit comprising a camera, and configured to acquire an image of an indoor room by photographing; the image of the indoor room comprising a first image and a second image, the first image comprising a reference object, the second image comprising the reference object and a target object; and A controller is connected to the image acquisition unit for communication, and the controller is configured to: According to the position and posture of the camera and the physical parameters of the indoor room, the reference object, the two-dimensional field of view, and the plurality of two-dimensional units are acquired in the image of the indoor room taken by the image acquisition unit; Controlling the image acquisition unit to acquire the second image; Determine the target object in the second image using a target detection algorithm, and determine a bounding box of the target object; Determine a set pixel point of the target object; Determine the relative position of the set pixel point and the reference object, and determine the two-dimensional unit where the set pixel point of the target object is located or the edge of the two-dimensional unit; as well as Determine the physical distance of the two-dimensional unit or the edge of the two-dimensional unit corresponding to the set pixel point as the distance between the target object and the distance measuring device; The physical distance of the two-dimensional unit is linearly related to the pixel coordinates of the two-dimensional unit.

8. The air conditioning system according to claim 7, wherein: The controller is configured to perform the following steps to obtain the reference object, the two-dimensional field of view, and the plurality of two-dimensional units in the image of the indoor room captured by the image acquisition unit: Obtaining the position and posture of the camera; Acquiring physical parameters of the indoor room; Controlling the image acquisition unit to acquire the first image to determine the two-dimensional field of view; Determine the plurality of two-dimensional units in the two-dimensional field of view according to a set unit, and use the plurality of two-dimensional units as the reference objects; wherein the two-dimensional units are polygons; as well as Corner points of the plurality of two-dimensional units, pixel coordinates of the corner points of the two-dimensional units in the two-dimensional field of view, and rows and columns of the two-dimensional units are determined in the first image.

9. Air conditioning system, including: Outdoor unit; an indoor unit connected to the outdoor unit to transmit refrigerant; A distance measuring device is provided in the indoor unit, the distance measuring device comprises an image acquisition unit, the image acquisition unit comprises a camera, and is configured to acquire an image of an indoor room by photographing, the image of the indoor room comprises a target object and a reference object; as well as A controller is connected to the image acquisition unit for communication, and the controller is configured to: Obtaining the position and posture of the camera; Acquire the image of the indoor room acquired by the image acquisition unit; Determine the target object in the image of the indoor room using a target detection algorithm, and determine a bounding box of the target object; Determine a set pixel point of the target object; Determine, according to the position and posture of the camera, the physical distance of the longitudinal axis component of the set pixel point of the target object in the physical ground coordinate system; determining, according to the vanishing points of the target object and the reference object in the image of the indoor room, a physical distance of a horizontal axis component of a set pixel point of the target object in the physical ground coordinate system; as well as Determining the distance between the distance measuring device and the target object according to the physical distance of the horizontal axis component and the physical distance of the vertical axis component; Among them, the position of the camera includes the height of the camera, and the posture of the camera includes the field of view angle and installation angle of the camera; the height is the height of the camera relative to the ground of the indoor room, and the installation angle is the inclination angle of the camera relative to the height direction of the indoor room.

10. The air conditioning system according to claim 9, wherein: The controller is configured to perform the following steps to determine the physical distance of the longitudinal axis component of the set pixel point of the target object in the physical ground coordinate system according to the position and posture of the camera: Obtaining the height, the field of view angle, and the installation angle of the camera; Determining a length of a first line segment according to the height and the installation angle of the camera; Determine the semi-axis pitch field of view to obtain the semi-axis pitch angle; Determining the length of the second line segment according to the semi-axis pitch angle and the length of the first line segment; Determining a semi-axis physical distance corresponding to the semi-axis pitch angle according to the length of the first line segment and the semi-axis pitch angle; Obtaining the vertical axis pixel distance of the set pixel point in the target pixel coordinate system; Determine the mapping physical distance of the set pixel point according to the vertical axis pixel distance, the semi-axis physical distance and the semi-axis pixel distance; Determine a pitch angle according to the mapped physical distance of the set pixel point and the length of the second line segment; as well as The physical distance of the longitudinal axis component of the set pixel point in the physical ground coordinate system is determined according to the height of the camera, the semi-axis pitch angle, the pitch angle and the installation angle.

11. The air conditioning system according to claim 9 or 10, wherein: The controller is configured to perform the following steps to determine the physical distance of the horizontal axis component of the set pixel point of the target object in the physical ground coordinate system according to the vanishing points of the target object and the reference object in the image of the indoor room: Determine the intersection of the extended line of the set pixel point of the target object and the extended line of part of the reference object as a vanishing point; Determine a calculation coordinate system; wherein the longitudinal axis of the calculation coordinate system is a vertical line passing through the vanishing point and perpendicular to the length direction of the image of the indoor room; Obtain the horizontal pixel distance and the vertical pixel distance of the set pixel point in the original pixel coordinate system; Acquire a vanishing point pixel distance between the vanishing point and an edge of the image of the indoor room far from the vanishing point; Determine a target angle of the set pixel point according to the horizontal axis pixel distance, the vertical axis pixel distance and the vanishing point pixel distance of the set pixel point; wherein the target angle is an angle between a connecting line between the set pixel point and the vanishing point and the vertical axis of the calculation coordinate system; Determining a standard reference line in the image of the indoor room; wherein the standard reference line is an extension line passing through a set pixel point of the target object, an extension line of a part of the reference object, and a straight line with minimal distortion; and Obtain a standard reference intersection point between an extension line passing through the set pixel point and the standard reference line, and determine the physical distance between the standard reference intersection point and the longitudinal axis of the calculation coordinate system as the horizontal distance of the set pixel point of the target object in the physical ground coordinate system. The physical distance of the axis components.

12. The air conditioning system according to claim 11, wherein: The controller is further configured to perform the following steps to determine the physical distance between the standard reference intersection and the longitudinal axis of the calculation coordinate system as the physical distance of the horizontal axis component of the set pixel point of the target object in the physical ground coordinate system: Determining a plurality of length units of the standard reference line according to the physical distance of the reference object; Obtain the unit pixel distance corresponding to the length unit; Determine a ratio of the physical distance of the length unit to the unit pixel distance as a pixel unit; Obtaining the pixel distance between the standard reference intersection point and the longitudinal axis of the calculation coordinate system; as well as According to the pixel unit, the physical distance corresponding to the pixel distance between the standard reference intersection and the vertical axis of the calculation coordinate system is determined as the physical distance of the horizontal axis component of the set pixel point of the target object in the physical ground coordinate system.

13. The air conditioning system according to any one of claims 9 to 12, wherein: The controller is also configured to perform distortion correction on the obtained physical distance of the horizontal axis component and the obtained physical distance of the vertical axis component using a neural network.

14. The air conditioning system according to any one of claims 9 to 13, wherein: The target object has a height in the height direction of the indoor room; the set pixel points of the target object include set pixel points at a first position and set pixel points at a second position, the first position corresponds to the bottom of the target object in the height direction of the indoor room, and the second position corresponds to the top of the target object in the height direction of the indoor room; The controller is also configured to determine the height of the target object based on the physical distance of the longitudinal component of the set pixel point of the first position of the target object in the physical ground coordinate system, the physical distance of the longitudinal component of the set pixel point of the second position of the target object in the physical ground coordinate system, and the height of the camera.

15. The air conditioning system according to claim 14, wherein: The controller is also configured to determine the distance between the set pixel point at the first position of the target object and the ranging device based on the physical distance of the longitudinal axis component of the set pixel point at the first position of the target object in the physical ground coordinate system and the height of the camera.

16. The air conditioning system according to claim 14 or 15, wherein: The controller is also configured to determine the distance between the set pixel point at the second position of the target object and the ranging device based on the physical distance of the longitudinal axis component of the set pixel point at the first position of the target object in the physical ground coordinate system, the height of the camera and the height of the target object.

17. The air conditioning system according to any one of claims 14 to 16, wherein: The controller is also configured to determine a first pitch angle corresponding to the first position according to a physical distance of a longitudinal axis component of a set pixel point of the first position of the target object in the physical ground coordinate system and a height of the camera.

18. The air conditioning system according to any one of claims 14 to 17, wherein: The controller is also configured to determine a second pitch angle corresponding to the second position of the target object based on the physical distance of the longitudinal axis component of the set pixel point of the second position of the target object in the physical ground coordinate system, the height of the camera and the height of the target object.

19. The air conditioning system according to any one of claims 14 to 18, wherein: The controller satisfies at least one of the following: The controller is further configured to determine a first heading angle according to a physical distance of a longitudinal axis component and a physical distance of a transverse axis component of a set pixel point at a first position of the target object in the physical ground coordinate system; or The controller is further configured to determine a second heading angle according to a physical distance of a longitudinal axis component and a physical distance of a transverse axis component of a set pixel point at a second position of the target object in the physical ground coordinate system.

20. The air conditioning system according to any one of claims 14 to 19, wherein: The target object includes a human body; the first position includes a foot of the human body, and the set pixel point of the first position includes a midpoint of the foot; the second position includes a head of the human body, and the set pixel point of the second position includes a midpoint of the head.

Citation Information

Patent Citations

  • Human body detection and positioning method and device applied to air conditioner and intelligent sensing system

    CN114120354A

  • Air conditioner and control method thereof

    CN114846275A

  • Air conditioning device

    CN116734807A

  • Air conditioning system

    CN116753919A

  • Distance image processing device

    JP2003196656A