Air-conditioning control system, control device, and computer program

Abstract

To improve the control accuracy of airflow delivered to a user without a need for the user to actively operate.SOLUTION: A single imaging device 11 outputs an image data ID corresponding to an image in which a subject appears. A control device 12 individually controls at least one of a flow rate and a direction of airflow delivered to a user from each of a first air-conditioning device 131 and a second air-conditioning device 132, based on the image data ID.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an air conditioning control system that controls the operation of an air conditioning device based on image data output from an imaging device. The present disclosure also relates to a control device that can be included in the system and a computer program executable by a processor installed in the device. [Background technology]

[0002] Patent Document 1 discloses an air conditioning control system that changes the direction of airflow sent out from an air conditioner in response to the movement of a user's hand captured in an image captured by an imaging device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-206308 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a need for greater control over the airflow delivered to a user without requiring active action by the user. [Means for solving the problem]

[0005] One example aspect provided by the present disclosure is an air conditioning control system, comprising: a single imaging device that outputs image data corresponding to an image in which a subject is captured; A plurality of air conditioners; a control device that individually controls at least one of a volume and a direction of an airflow sent from each of the plurality of air conditioners to a user based on the image data; Contains:

[0006] One example aspect provided by the present disclosure is a control device, comprising: an interface that receives image data corresponding to an image including a subject from a single imaging device; a processor that individually controls at least one of a flow rate and a direction of an airflow delivered to a user from each of the plurality of air conditioners based on the image data; It is equipped with:

[0007] One example of an aspect provided by the present disclosure is a computer program executable by a processor installed in a control device, the computer program comprising: By being executed, the control device receiving image data corresponding to an image in which a subject is captured from a single imaging device; At least one of the flow rate and the direction of the airflow delivered to the user from each of the plurality of air conditioners is individually controlled based on the image data.

[0008] According to the configurations of the above-mentioned embodiments, the operation of each of the multiple air conditioners is individually controlled based on an image captured by a single imaging device. In other words, if a user is subjected to imaging by a single imaging device, the multiple air conditioners can be made to perform a desired operation without the need for active action by the user. At least one of the flow rate and direction of the airflow sent out by each air conditioner is individually controlled, so that the desired operation can be performed with high precision.

[0009] In addition, compared to a configuration in which an imaging device and a control device are provided for each of a number of air conditioners, the number of element devices and wiring that make up the air conditioning control system can be reduced, which not only prevents the system from becoming larger in scale, but also prevents a decrease in the efficiency of installing the system in facilities. [Brief description of the drawings]

[0010] [Figure 1] 2 illustrates an example of a functional configuration of an air conditioning control system according to an embodiment. [Diagram 2] 2 illustrates a vehicle equipped with the air conditioning control system of FIG. 1. [Diagram 3] 2 illustrates an example of the arrangement of the first air conditioner and the second air conditioner in FIG. 1; [Figure 4] 2 shows an example of a flow of processing executed by the air conditioning control system of FIG. [Diagram 5] 2 illustrates an example of an image that can be captured by the imaging device of FIG. 1. [Figure 6] The image in Figure 4 shows an example of the skeleton model applied. [Figure 7] 2 shows an example of an operation executed by the air conditioning control system of FIG. [Figure 8] 13 illustrates another example of the operation executed by the air conditioning control system of FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, examples of embodiments will be described in detail with reference to the accompanying drawings. In each drawing used in the following description, the scale is appropriately changed so that each element can be recognized.

[0012] 1 illustrates an example of a functional configuration of an air conditioning control system 10 according to an embodiment. The air conditioning control system 10 includes an imaging device 11, a control device 12, a first air conditioner 131, and a second air conditioner 132. The air conditioning control system 10 is configured to control the operation of each of the first air conditioner 131 and the second air conditioner 132 based on image data output from the imaging device 11. The first air conditioner 131 and the second air conditioner 132 are examples of a plurality of air conditioners.

[0013] Specifically, the imaging device 11 is disposed at an appropriate location in a vehicle 20 illustrated in Fig. 2. A driver 30 seated in a seat 22 disposed in a vehicle interior 21 is imaged by the imaging device 11. The vehicle interior 21 in which the driver 30 sits is an example of a subject. The driver 30 is an example of a user.

[0014] In the accompanying drawings, arrow F represents the forward direction as seen by the driver 30. Arrow B represents the rearward direction as seen by the driver 30. Arrow L represents the leftward direction as seen by the driver 30. Arrow R represents the rightward direction as seen by the driver 30. Arrow U represents the upward direction as seen by the driver 30. Arrow D represents the downward direction as seen by the driver 30.

[0015] 1, the imaging device 11 is configured to output image data ID corresponding to an image that a subject is captured in. The image data ID may be in the form of analog data or digital data depending on the specifications of the imaging device 11.

[0016] The control device 12 includes an input interface 121. The input interface 121 is configured as a hardware interface that receives image data ID from the imaging device 11. When the image data ID is in the form of analog data, the input interface 121 includes an appropriate conversion circuit including an A / D converter.

[0017] The control device 12 includes a processor 122 and an output interface 123. The processor 122 is configured to execute image processing, which will be described later, on the received image data ID, and output from the output interface 123 a first control signal CS1 for controlling the operation of the first air conditioner 131 and a second control signal CS2 for controlling the operation of the second air conditioner 132 based on the results of the processing.

[0018] The output interface 123 is configured as a hardware interface that outputs the first control signal CS1 and the second control signal CS2. Each of the first control signal CS1 and the second control signal CS2 may be an analog signal or a digital signal depending on the specifications of the first air conditioner 131 and the second air conditioner 132. When each of the first control signal CS1 and the second control signal CS2 is an analog signal, the output interface 123 includes an appropriate conversion circuit including a D / A converter.

[0019] 3, the first air conditioner 131 includes a first air outlet 131a. The first air outlet 131a is disposed to the left of the steering device 23. The first air conditioner 131 is configured to send out a first airflow AF1 from the first air outlet 131a. The first air conditioner 131 is configured to be able to adjust the flow rate and direction of the first airflow AF1 based on a first control signal CS1.

[0020] Similarly, the second air conditioner 132 includes a second air outlet 132a. The second air outlet 132a is disposed to the right of the steering device 23. The second air conditioner 132 is configured to send out a second airflow AF2 from the second air outlet 132a. The second air conditioner 132 is configured to be able to adjust the flow rate and direction of the second airflow AF2 based on a second control signal CS2.

[0021] The image processing and the control processing of the first air conditioner 131 and the second air conditioner 132 executed by the control device 12 will be described in detail with reference to Fig. 4 to Fig. 8. Fig. 4 illustrates the flow of this processing.

[0022] The processor 122 receives image data ID from the imaging device 11 through the input interface 121 (STEP 1). Fig. 5 illustrates an image IM in which the vehicle interior 21 including the driver 30 is captured and is captured by the imaging device 11. The image data ID corresponds to the image IM.

[0023] Next, the processor 122 performs a process of applying the skeletal model to the subject (STEP 2). The term "process of applying the skeletal model to the subject" used in this specification means detecting a plurality of feature points defined in the skeletal model of the driver 30 captured in the image IM acquired by the imaging device 11, and connecting the plurality of feature points with a plurality of skeletal lines defined in the skeletal model.

[0024] 6 shows an example in which a skeletal model M is applied to a driver 30 captured in an image IM acquired by the imaging device 11. In this example, the skeletal model M includes a head feature point H, a neck feature point N, a waist feature point W, a left shoulder feature point LS, a right shoulder feature point RS, a left elbow feature point LE, a right elbow feature point RE, a left wrist feature point LW, and a right wrist feature point RW.

[0025] The head feature point H corresponds to the center of the head of the model human body. The neck feature point N corresponds to the neck of the model human body. The waist feature point W corresponds to the waist of the model human body. The head feature point H, the neck feature point N, and the waist feature point W are connected by a skeleton line.

[0026] The left shoulder feature point LS corresponds to the left shoulder of the model human body. The left elbow feature point LE corresponds to the left elbow of the model human body. The left wrist feature point LW corresponds to the left wrist of the model human body. The neck feature point N is connected to the left shoulder feature point LS by a skeleton line. The left elbow feature point LE is connected to each of the left shoulder feature point LS and left wrist feature point LW by skeleton lines.

[0027] The right shoulder feature point RS corresponds to the right shoulder of the model human body. The right elbow feature point RE corresponds to the right shoulder of the model human body. The right wrist feature point RW corresponds to the right wrist of the model human body. The neck feature point N is connected to the right shoulder feature point RS by a skeleton line. The right elbow feature point RE is connected to each of the right shoulder feature point RS and the right wrist feature point RW by skeleton lines.

[0028] The processor 122 identifies points of the driver 30 captured in the image IM that correspond to the respective feature points of the skeleton model M (STEP 3 in FIG. 4). In other words, feature points corresponding to specific body parts of the driver 30 are identified in the image IM. The processor 122 connects the identified multiple points with the above-mentioned skeleton lines. The algorithm for performing this process is well known, and therefore a detailed description thereof will be omitted.

[0029] The processor 122 determines the operation of each of the first air conditioner 131 and the second air conditioner 132 based on the identified at least one characteristic point, and outputs a first control signal CS1 and a second control signal CS2 corresponding to the operation to the output interface 123 (STEP 4). Specifically, the first control signal CS1 is configured to determine at least one of the flow rate and direction of the first airflow AF1 sent by the first air conditioner 131 into the vehicle compartment 21. The second control signal CS2 is configured to determine at least one of the flow rate and direction of the second airflow AF2 sent by the second air conditioner 132 into the vehicle compartment 21. After that, the process returns to STEP 1.

[0030] The operation of the first air conditioner 131 and the second air conditioner 132 controlled by the control device 12 can be specified by the driver 30. As an example, as illustrated in Fig. 7, the first airflow AF1 and the second airflow AF2 can be set to be sent out so as to avoid the face of the driver 30.

[0031] In this case, the processor 122 of the control device 12 identifies a neck characteristic point N corresponding to the neck of the driver 30 captured in the image IM acquired by the imaging device 11, and outputs a first control signal CS1 to the first air conditioner 131 to send a first airflow AF1 to the left of the neck characteristic point N from the output interface 123. In addition, the processor 122 outputs a second control signal CS2 to the second air conditioner 132 to send a second airflow AF2 to the right of the neck characteristic point N from the output interface 123. This makes it possible to provide an air-conditioned environment suitable for the driver 30 who dislikes airflow hitting his face.

[0032] As another example, as illustrated in FIG. 8, a setting may be made in which a first airflow AF1 and a second airflow AF2 are delivered toward both sides of the driver 30.

[0033] In this case, the processor 122 of the control device 12 identifies a left shoulder feature point LS corresponding to the left shoulder of the driver 30 reflected in the image IM acquired by the imaging device 11, and outputs a first control signal CS1 from the output interface 123 to cause the first air conditioner 131 to send a first airflow AF1 downward. In addition, the processor 122 identifies a right shoulder feature point RS corresponding to the right shoulder of the driver 30 reflected in the image IM acquired by the imaging device 11, and outputs a second control signal CS2 from the output interface 123 to cause the second air conditioner 132 to send a second airflow AF2 downward. The symbol T represents the target position of each airflow to be sent out. This makes it possible to provide an air-conditioned environment suitable for the driver 30 who wants to feel cool quickly.

[0034] According to the configuration of this embodiment, the operation of each of the first air conditioner 131 and the second air conditioner 132 is individually controlled based on the image IM captured by the single imaging device 11. That is, if the driver 30 is subjected to imaging by the imaging device 11, the first air conditioner 131 and the second air conditioner 132 can be caused to perform a desired operation without the need for active action by the driver 30. Since at least the flow rate and direction of the first airflow AF1 delivered by the first air conditioner 131 and the second airflow AF2 delivered by the second air conditioner 132 are individually controlled, the desired operation can be performed with high precision.

[0035] In addition, compared to a configuration in which an imaging device and a control device are provided for each of a plurality of air conditioners, it is possible to reduce the number of element devices and wiring that make up the air conditioning control system 10. This not only prevents the system from becoming large in scale, but also prevents a decrease in the work efficiency of installing the system in the vehicle 20.

[0036] In this embodiment, when the driver 30 is imaged by the imaging device 11, the skeleton model M is applied to the image IM in which the driver 30 appears, and feature points corresponding to the body parts of the driver 30 required to cause each of the first air conditioner 131 and the second air conditioner 132 to perform a desired operation are identified. Therefore, the driver 30 can cause the first air conditioner 131 and the second air conditioner 132 to perform detailed and complex operations based on the identified feature points without the need for active operation with respect to the imaging device 11.

[0037] However, the operation of the first air conditioner 131 and the second air conditioner 132 may be controlled based on simpler image processing. The positional relationship between the imaging device 11, the first air outlet 131a, and the second air outlet 132a after the air conditioning control system 10 is mounted on the vehicle 20 is known and invariant depending on the specifications and type of the vehicle 20, so if the position in the image IM acquired by the imaging device 11 can be identified, the positional relationship between the first air outlet 131a and the second air outlet 132a relative to the position can also be identified. Therefore, the processor 122 of the control device 12 can individually control at least one of the flow rate and direction of the first airflow AF1 discharged from the first air outlet 131a and the second airflow AF2 discharged from the second air outlet 132a based on the positional relationship.

[0038] As an example, image processing may be applied to detect the face or head of the driver 30 from an image IM in which the driver 30 is captured by the imaging device 11. The processor 122 may identify the position of the detected face or head in the image IM, and individually control the first airflow AF1 and the second airflow AF2 based on the position.

[0039] As another example, image processing may be applied to detect the position of the seat 22 in which the driver 30 is seated, for the image IM in which the driver 30 is captured by the imaging device 11. The processor 122 may identify the detected position of the seat 22 in the image IM, and individually control the first airflow AF1 and the second airflow AF2 based on the position.

[0040] 3, the first air outlet 131a of the first air conditioner 131 and the second air outlet 132a of the second air conditioner 132 are spaced apart in the left-right direction of the vehicle 20. Specifically, the first air outlet 131a is disposed to the left of the center in the left-right direction of the seat 22 in which the driver 30 sits. The second air outlet 132a is disposed to the right of the center in the left-right direction of the seat 22 in which the driver 30 sits.

[0041] The expression "separately" in this specification is used with the intention of describing a state in which the edges of the two air outlets are not in contact with each other. Therefore, the first air outlet 131a and the second air outlet 132a do not necessarily need to be arranged so as to be spaced apart in the left-right direction of the vehicle 20. The first air outlet 131a and the second air outlet 132a may be arranged so as to be spaced apart in the up-down direction of the vehicle 20.

[0042] According to a configuration such as that of this embodiment in which the first air outlet 131a and the second air outlet 132a are spaced apart, the range in which the direction in which each of the first airflow AF1 and the second airflow AF2 is blown out can be adjusted is expanded, so that the effect of individually controlling multiple air conditioning devices becomes more pronounced.

[0043] The processor 122 of the control device 12 having the various functions described above may be realized by a general-purpose microprocessor operating in cooperation with a general-purpose memory. Examples of the general-purpose microprocessor include a CPU, an MPU, and a GPU. Examples of the general-purpose memory include a ROM and a RAM. In this case, a computer program for realizing the function may be stored in the ROM. The ROM is an example of a non-transitory computer-readable medium storing a computer program. The general-purpose microprocessor specifies at least a part of the computer program stored in the ROM, expands it on the RAM, and executes the above-mentioned process in cooperation with the RAM. The above-mentioned computer program may be pre-installed in the general-purpose memory, or may be downloaded from an external server via a communication network and installed in the general-purpose memory. In this case, the external server is an example of a computer-readable medium storing a computer program.

[0044] The processor 122 may be realized by a dedicated integrated circuit capable of executing the above computer program, such as a microcontroller, an ASIC, or an FPGA. In this case, the above computer program is pre-installed in a storage element included in the dedicated integrated circuit. The storage element is an example of a computer-readable medium storing a computer program. The processor 122 may also be realized by a combination of a general-purpose microprocessor and a dedicated integrated circuit.

[0045] The configurations described above are merely examples for facilitating understanding of the present disclosure. Each configuration example may be appropriately modified and combined with other configuration examples without departing from the spirit of the present disclosure.

[0046] The number of air conditioners whose operation is controlled based on images captured by a single imaging device 11 may be three or more. If the operation of a plurality of air conditioners is controlled based on images captured by each imaging device 11, the number of imaging devices 11 included in the air conditioning control system 10 may be two or more.

[0047] The operation control of the first air conditioner 131 and the second air conditioner 132 by the control device 12 does not need to be performed only for the driver 30 of the vehicle 20. The skeleton model M can also be applied to other occupants of the vehicle 20 who may appear in the image IM acquired by the imaging device 11, and the operation control of the first air conditioner 131 and the second air conditioner 132 can be performed based on the feature points corresponding to the identified body parts of the occupants.

[0048] The air conditioning control system 10 may be mounted on a moving object other than the vehicle 20. Examples of such moving objects include trains, airplanes, ships, etc. The moving object may not require a driver.

[0049] The air-conditioning control system 10 does not necessarily need to be mounted on a mobile object. As long as the operation of multiple air-conditioning devices is controlled based on images captured by a single imaging device 11, the air-conditioning control system 10 can be mounted on an appropriate house, facility, equipment, etc.

[0050] Each of the configurations listed below also constitutes part of this disclosure. Item 1: a single imaging device that outputs image data corresponding to an image in which a subject is captured; A plurality of air conditioners; a control device that individually controls at least one of a volume and a direction of an airflow sent from each of the plurality of air conditioners to a user based on the image data; Contains Climate control system. Item 2: The control device controls at least one of a volume flow rate and a direction of the airflow based on a relationship between a position of the user captured in the image, a position of the imaging device, and a position of each of the plurality of air conditioners. Item 1. An air conditioning control system according to item 1. Item 3: the control device performs a process on the image data to apply a skeleton model to the subject, the skeleton model having a plurality of connected feature points, each of which corresponds to a specific human body part, thereby identifying feature points in the image that correspond to specific human body parts, and controls at least one of the amount and direction of the airflow based on the positions of the feature points. 3. An air conditioning control system according to item 1 or 2. Item 4: the plurality of air conditioners include a first air conditioner that blows out an airflow from a first air outlet and a second air conditioner that blows out an airflow from a second air outlet, The first air outlet and the second air outlet are spaced apart from each other. 4. An air conditioning control system according to any one of items 1 to 3. Item 5: The first air outlet is disposed to the left of a center in a left-right direction of a seat on which a user is seated, The second air outlet is disposed to the right of the center. Item 4. An air conditioning control system. [Explanation of symbols]

[0051] 10: air conditioning control system, 11: imaging device, 12: control device, 121: input interface, 122: processor, 131: first air conditioner, 131a: first air outlet, 132: second air conditioner, 132a: second air outlet, 21: vehicle interior, 22: seat, 30: driver, AF1: first air flow, AF2: second air flow, ID: image data, IM: image, LS: left shoulder feature point, M: skeletal model, N: neck feature point, RS: right shoulder feature point

Claims

1. A single imaging device that outputs image data corresponding to an image in which a subject is captured; A plurality of air conditioners; a control device that individually controls at least one of a volume and a direction of an airflow sent from each of the plurality of air conditioners to a user based on the image data; Contains Climate control system.

2. The control device controls at least one of a flow rate and a direction of the airflow based on a relationship between a position of the user captured in the image, a position of the imaging device, and a position of each of the plurality of air conditioners. The air conditioning control system according to claim 1 .

3. the control device performs a process on the image data to apply a skeleton model to the subject, in which a plurality of feature points are connected, each of which corresponds to a specific human body part, thereby identifying feature points in the image that correspond to specific human body parts, and controls at least one of the amount and direction of the airflow based on the positions of the feature points. The air conditioning control system according to claim 1 .

4. the plurality of air conditioners include a first air conditioner that blows out an airflow from a first air outlet and a second air conditioner that blows out an airflow from a second air outlet, The first air outlet and the second air outlet are spaced apart from each other. The air conditioning control system according to claim 1 .

5. The first air outlet is disposed to the left of a center in a left-right direction of a seat on which a user is seated, The second air outlet is disposed to the right of the center. The air conditioning control system according to claim 4.

6. an interface that receives image data corresponding to an image including a subject from a single imaging device; a processor that individually controls at least one of a flow rate and a direction of an airflow delivered to a user from each of the plurality of air conditioners based on the image data; Equipped with Control device.

7. A computer program executable by a processor mounted on the control device, By being executed, the control device receiving image data corresponding to an image in which a subject is captured from a single imaging device; individually controlling at least one of the flow rate and the direction of the airflow delivered to the user from each of the plurality of air conditioners based on the image data; Computer program.

Images