Illumination management device and illumination management method

Abstract

A lighting management device (101) comprises a first acquisition unit (111) and a signal generation unit (112). The first acquisition unit (111) acquires analysis information based on a result estimated by using an analysis of an image taken of a target area TA. The analysis information includes a pose of a person P present in the target area TA. The signal generation unit (112) generates, using the analysis information and the purpose of use of the target area TA, a control signal for controlling one or a plurality of pieces of lighting equipment LE associated with the target area TA.

Description

Technical Field

[0001] The present invention relates to a lighting management device and lighting management method by the law and related thereto.

Background Art

[0002] Patent Document 1 discloses a lighting control device that controls a plurality of lighting devices distributed in a control target area. The lighting control device described in Patent Document 1 includes a first acquisition unit, a first control unit, a second acquisition unit, and a second control unit.

[0003] The first acquisition unit described in Patent Document 1 acquires the position information of a person in the control target area together with the identification information of the portable device possessed by the person. The first control unit described in Patent Document 1 identifies the lighting device corresponding to the position where the person in the control target area stays based on the position information, associates the identified lighting device with the identification information, and controls the identified lighting device to a first state.

[0004] The second acquisition unit described in Patent Document 1 acquires an operation signal corresponding to an operation on the portable device together with the identification information. The second control unit described in Patent Document 1 controls the lighting device associated with the identification information acquired by the second acquisition unit to a second state according to the operation signal.

[0005] Citation Document 2 describes "a device that controls the environment such as lighting and sound according to the position of a person using a foot position detection means or an activity amount detection unit."

[0006] Citation Document 2 describes that for the foot position detection means, the foot position of each occupant is detected from the human pixel blocks separated by the number of people detection means for each occupant and the thermal image. For the number of people detection means, it is described that the number of people is determined from the number of human pixel blocks in the room detected by the human area detection means and the number of pixels of each block. For the human area detection unit, it is described that the area of the human part is detected from the thermal image and a human pixel block is output.

[0007] In addition, Citation Document 2 describes that the activity amount detection unit detects the activity amount representing each individual or the interior of the room from the personal information output by the personal information output unit. Regarding the personal information output unit, it is described that personal information of the occupants in the room is extracted based on the human pixel blocks detected by the human area detection unit.

[0008] Citation Document 3 describes a workplace environment management system including an operator recognition means capable of area scanning the entire target workplace and a data processing means.

[0009] The data processing means described in Citation Document 3 determines the seating state of the operator in a plurality of assumed seating recognition areas in the workplace from the scan information from the operator recognition means, assigns an operator ID to each seating recognition area to identify the operator, and grasps the work state of the operator in the workplace. According to the work state, the data processing means issues operation command information for the equipment in the workplace. Citation Document 3 describes that the equipment to be controlled includes task lighting, ambient lighting, etc.

[0010] Citation Document 4 describes an air conditioner including an imaging unit for imaging the air-conditioned room interior and a control unit. The control unit described in Citation Document 4 recognizes whether there is a person in the air-conditioned room interior, the body posture of the person present in the air-conditioned room interior, and the brightness of the air-conditioned room interior from the image information captured by the imaging unit, estimates the actions of the person, and switches the operation conditions of the air-conditioning operation.

[0011] Citation Document 5 describes a data processing device including a user extraction means, a situation determination means, and an environment adjustment means.

[0012] The user extraction means described in Citation Document 5 extracts user image data from the spatial image data of a user utilization space where a general user freely enters and exits and where an environment adjustment device for adjusting the spatial environment is installed, by a spatial imaging device.

[0013] The situation determination means described in Citation Document 5 determines at least the clothing situation of a general user from the extracted user image data and generates user situation data. The environment adjustment means described in Citation Document 5 outputs operation control data to an environment adjustment device corresponding to the generated user situation data. Citation Document 5 describes that the environment adjustment device has at least one of lighting equipment, air conditioning equipment, and acoustic equipment in the user use space.

[0014] Note that Patent Document 6 describes a technique for calculating the feature amount of each of a plurality of key points of a human body included in an image, searching for an image including a human body with a similar posture or a human body with a similar movement based on the calculated feature amount, or classifying together those with similar postures and movements. In addition, Non-Patent Document 1 describes a technique related to human skeleton estimation.

Prior Art Documents

Patent Documents

[0015]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Patent Document 5

Patent Document 6

Non-Patent Documents

[0016]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0017] In the lighting control device described in Patent Document 1, the lighting device is controlled using a portable device and an operation signal held by a person in the control target area. Therefore, when a person in the control target area does not have a portable device, it is difficult to improve the convenience regarding lighting.

[0018] In the device described in Patent Document 2, the foot position or activity amount of an occupant is detected based on a thermal image. Therefore, it is difficult to improve the convenience regarding lighting using at least other than the foot position or activity amount of the occupant.

[0019] In the management system of the workplace environment described in Patent Document 3, the facilities in the workplace are the control targets. Therefore, it is difficult to improve the convenience regarding lighting in various target areas.

[0020] The technology described in Patent Document 4 is a technology for controlling an air conditioner. Therefore, it is difficult to improve the convenience regarding lighting with the technology described in this document.

[0021] The data processing device described in Cited Document 5 controls an environment adjustment device based on the clothing situation of a general user. Therefore, it is difficult to improve the convenience regarding lighting using at least other than the clothing situation of the general user.

[0022] Note that Patent Document 6 and Non-Patent Document 1 do not describe the application to the control of lighting equipment. Therefore, it is difficult to improve the convenience regarding lighting with the technologies described in Patent Document 6 and Non-Patent Document 1.

[0023] An example of the object of the present invention is to provide a lighting management device, a lighting management system, a lighting management method, and a recording medium that solve the problem of improving the convenience regarding lighting in view of the above-described problems.

Means for Solving the Problems

[0024] According to one aspect of the present invention, a first acquisition means for acquiring analysis information based on a result estimated by using analysis of an image obtained by photographing a target area; signal generation means for generating a control signal for controlling one or more lighting devices associated with the target area by using the analysis information and the purpose of use of the target area; wherein the analysis information includes the posture of a person in the target area a lighting management device is provided. before The lighting management device further includes second acquisition means for predicting the behavior of a person in the target area based on a result of statistically processing the analysis information, and the signal generation means may further generate the control signal by using the result predicted by the second acquisition means. The analysis information further includes personal identification information for identifying a person in the target area estimated by using analysis of an image obtained by photographing the target area, and the signal generation means may further generate the control signal by using an individual control pattern in which a control pattern corresponding to the personal identification information is determined.

[0026] According to one aspect of the present invention, a computer acquires analysis information based on a result estimated by using analysis of an image obtained by photographing a target area, Generate a control signal for controlling one or more lighting devices associated with the target area by using the analysis information and the purpose of use of the target area. The analysis information includes the postures of people in the target area. A lighting management method is provided. before The lighting management method may further include predicting the behavior of a person in the target area based on the result of statistically processing the analysis information, and generating the control signal by using the predicted result. The analysis information further includes personal identification information for identifying a person in the target area estimated by using the analysis of an image obtained by photographing the target area. In generating the control signal, the control signal may be generated by using an individual control pattern in which a control pattern corresponding to the personal identification information is determined.

Advantages of the Invention

[0028] According to the present invention, it becomes possible to provide a lighting management device, a lighting management system, a lighting management method, and a recording medium that solve the problem of improving convenience regarding lighting.

Brief Description of the Drawings

[0029]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Embodiments for Carrying Out the Invention

[0030] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are denoted by the same reference numerals, and the description will be omitted as appropriate.

[0031] <Embodiment 1> FIG. 1 is a diagram showing an overview of the lighting management device 101 according to Embodiment 1. The lighting management device 101 includes a first acquisition unit 111 and a signal generation unit 112.

[0032] The first acquisition unit 111 acquires analysis information based on the result estimated by analyzing the image obtained by photographing the target area TA. The analysis information includes the posture of the person P in the target area TA. The signal generation unit 112 generates a control signal for controlling one or more lighting devices LE associated with the target area TA, using the analysis information and the purpose of use of the target area TA.

[0033] According to this lighting management device 101, it becomes possible to provide a lighting management device 101 that solves the problem of improving the convenience regarding lighting.

[0034] FIG. 2 is a diagram showing an overview of the lighting management system 100 according to Embodiment 1. The lighting management system 100 includes a lighting management device 101, one or more photographing devices PE that generate image information including an image obtained by photographing the target area TA, and one or more lighting devices LE associated with the target area TA.

[0035] According to this lighting management system 100, it becomes possible to provide a lighting management system 100 that solves the problem of improving the convenience regarding lighting.

[0036] FIG. 3 is a flowchart showing an overview of the lighting management process according to Embodiment 1.

[0037] The first acquisition unit 111 acquires analysis information based on the result estimated by analyzing the image obtained by photographing the target area TA (step S111). The analysis information includes the posture of the person P in the target area TA. The signal generation unit 112 generates a control signal for controlling one or more lighting devices LE associated with the target area TA, using the analysis information and the purpose of use of the target area TA (step S121).

[0038] According to this lighting management process, it becomes possible to provide a lighting management method that solves the problem of improving the convenience regarding lighting.

[0039] Hereinafter, a detailed example of the lighting management system 100 according to Embodiment 1 will be described.

[0040] FIG. 4 is a diagram showing a detailed configuration example of the lighting management system 100 according to the present embodiment. The lighting management system 100 according to the present embodiment is a system for managing lighting devices LEa to LEh installed in target areas TAa to TAd. The lighting management system 100 includes imaging devices PEa to PEe, lighting devices LEa to LEh, a lighting management device 101, and an analysis device 102.

[0041] The lighting management device 101, the imaging devices PEa to PEe, and the lighting devices LEa to LEh are connected via a communication network (for example, a LAN (Local Area Network)) configured by wire, wirelessly, or a combination thereof. The lighting management device 101, the imaging devices PEa to PEe, and the lighting devices LEa to LEh transmit and receive information to and from each other via the communication network.

[0042] The lighting management device 101 and the analysis device 102 are connected via a communication network (for example, a LAN and the Internet) configured by wire, wirelessly, or a combination thereof. The lighting management device 101 and the analysis device 102 transmit and receive information to and from each other via the communication network, just as the lighting management device 101, the imaging devices PEa to PEe, and the lighting devices LEa to LEh do.

[0043] FIG. 5 is a plan view showing an installation example of the imaging devices PEa to PEe and the lighting devices LEa to LEh in the target areas TAa to TAd according to the present embodiment.

[0044] Each of the imaging devices PEa to PEe is an example of the imaging device PE. Each of the imaging devices PEa to PEe is, for example, a camera and is installed on the ceiling, wall, or the like. Each of the imaging devices PEa to PEe captures the associated target area TA and generates image information including the captured image. The image information is information in which a shooting ID (Identifier) for identifying each of the imaging devices PEa to PEe, the shooting time, and the image are associated.

[0045] The images generated by each of the imaging devices PEa to PEe are, for example, images based on visible light.

[0046] Each of the lighting devices LEa to LEh is an example of the lighting device LE. Each of the target areas TAa to TAd is an example of the target area TA included in the house where the people Pa to Pd live. The target areas TAa to TAd are a living room, a dining room, a children's room, and a bedroom, respectively. Each of the people Pa to Pd is an example of the person P in the target area TA.

[0047] The imaging devices PEa to PEb photograph the target area TAa (living room). The imaging devices PEa to PEb generate image information including an image of the photographed target area TAa.

[0048] In the target area TAa shown in FIG. 5, a television TV and a sofa S are installed, and a table Ta is installed between them. A lighting device LEa is installed on the ceiling above the table Ta. A lighting device LEb is installed on the ceiling near the window W (to the left of the lighting device LEb in FIG. 5).

[0049] The imaging devices PEb to PEc photograph the target area TAb (dining room). The imaging devices PEb to PEc generate image information including an image of the photographed target area TAb.

[0050] In the target area TAb shown in FIG. 5, the people Pa to Pd are having a meal while sitting on the chairs C around the table Tb on which the tableware D is placed. A lighting device LEc is installed on the ceiling above the table Tb. Also, a lighting device LEd is installed on the ceiling on the side (above in FIG. 5) of the lighting device LEc.

[0051] The imaging device PEd photographs the target area TAc (children's room). The imaging device PEd generates image information including an image of the photographed target area TAc.

[0052] In the target area TAc shown in FIG. 5, desks Tc and Td are installed, and lighting fixtures LEe to LEf are placed on each of desks Tc to Td. In approximately the center of the ceiling of the target area TAc, a lighting fixture LEg is installed.

[0053] The imaging device PEe captures the target area TAd (bedroom). The imaging device PEe generates image information including an image of the captured target area TAd.

[0054] In the target area TAd shown in FIG. 5, a bed B is installed. In approximately the center of the ceiling of the target area TAd, a lighting fixture LEh is installed.

[0055] Hereinafter, when not distinguishing between the target areas TAa to TAd, each of them is also referred to as the target area TA. When not distinguishing between the imaging devices PEa to PEe, each of them is also referred to as the imaging device PE. When not distinguishing between the lighting fixtures LEa to LEh, each of them is also referred to as the lighting fixture LE.

[0056] (Functional configuration example of the lighting management device 101) As shown in FIG. 4 in detail, the lighting management device 101 according to the present embodiment functionally includes a first acquisition unit 111, a signal generation unit 112, an image transfer unit 113, and a lighting control unit 114.

[0057] As described above, the first acquisition unit 111 acquires analysis information based on the result estimated by using the analysis of the image of the target area TA. The first acquisition unit 111 according to the present embodiment acquires the analysis information from the analysis device 102. The first acquisition unit 111 may store the analysis information.

[0058] The analysis information includes the posture of the person P in the target area TA. The posture of the person P included in the analysis information is shown, for example, using a skeleton model that models the human skeleton. The posture includes, for example, a standing posture (standing position), a sitting posture (sitting position), a lying posture (lying position), a crouched posture, a hunched posture, etc. The sitting position may be further subdivided into a forward-leaning sitting position where the person is sitting and leaning forward, a backward-leaning sitting position where the person is sitting and leaning against the backrest, etc.

[0059] In addition, the posture may include whether it is a stationary posture. A stationary posture is simply being in the same posture (e.g., simply standing, simply sitting) for a predetermined time (e.g., 5 seconds) or more. More specifically, a stationary posture means being in the same posture for a predetermined time without performing a predetermined action (e.g., watching TV, browsing books, documents, tablet terminals, mobile terminals, eating, working).

[0060] The analysis information may further include at least one of the number of people P in the target area TA (including zero), the orientation, and the position.

[0061] The signal generation unit 112 generates a control signal for controlling one or more lighting devices LE associated with the target area TA by using the analysis information acquired by the first acquisition unit 111 and the purpose of use of the target area TA. The control signal includes at least one of lighting (on) or extinguishing (off), brightness, and color of the lighting device LE. The signal generation unit 112 may store the history of the control signal.

[0062] FIG. 6 is a diagram showing a configuration example of the signal generation unit 112 according to the present embodiment. The signal generation unit 112 includes an area storage unit 115 for storing area information 115a, a lighting storage unit 116 for storing lighting information 116a, a pattern storage unit 117 for storing control pattern information 117a, and a generation unit 118.

[0063] FIG. 7 is a diagram showing an example of the area information 115a according to the present embodiment. The area information 115a is information in which an area ID and a purpose of use are associated. The area information 115a is preset in the area storage unit 115, for example, based on user input.

[0064] The area ID is information for identifying the target area TA. The purpose of use is the purpose of use of the target area TA identified using the associated area ID.

[0065] FIG. 8 is a diagram showing an example of the lighting information 116a according to the present embodiment. The lighting information 116a includes a lighting ID, a region ID, a brightness range, a color type, a lighting flag, brightness, and color.

[0066] The lighting ID is information for identifying the lighting device LE. The region ID is the region ID of the target region TA illuminated by the lighting device LE identified using the associated lighting ID. That is, in the present embodiment, the lighting information 116a associates one or more lighting devices LE with the target region TA.

[0067] The brightness range and the color type indicate the brightness range and the color type that can be set for the lighting device LE identified using the associated lighting ID, respectively.

[0068] The “1 to 3” of the brightness range indicates that the lighting device LE identified using the associated lighting ID can set the color brightness in three steps. The “1 to 5” of the brightness range indicates that the lighting device LE identified using the associated lighting ID can set the color brightness in five steps. The “-” of the brightness range indicates that the lighting device LE identified using the associated lighting ID cannot set the brightness.

[0069] Note that for the lighting device LE for which the brightness can be set, the set brightness is not limited to three steps or five steps, and may be two steps or more.

[0070] The “incandescent / noon white” of the color type indicates that the lighting device LE identified using the associated lighting ID can set two types of colors, incandescent color and noon white color. The incandescent color is, for example, an orange-tinged color with a color temperature of about 3000 K (Kelvin). The noon white color is, for example, a whitish color with a color temperature of about 5000 K. The “-” of the color type indicates that the lighting device LE identified using the associated lighting ID cannot set the color.

[0071] Regarding the lighting device LE whose color can be set, the colors to be set are not limited to two types, and may be three or more types. Further, the colors to be set are not limited to electric lamp color and daylight white, and may be appropriate colors defined in the lighting device LE.

[0072] FIG. 9 is a diagram showing an example of the control pattern information 117a according to the present embodiment. The control pattern information 117a includes control patterns in which control conditions and control contents are associated. The control pattern information 117a illustrated in FIG. 9 is information that associates a control ID and a control pattern. The control pattern information 117a is set in advance.

[0073] The control ID is information for identifying the control pattern included in the control pattern information 117a. In FIG. 9, the control ID is indicated by a number, but is not limited thereto, and may be appropriately assigned.

[0074] For example, the control patterns of the control IDs "1", "2", and "4" are all examples including control conditions based on the usage purpose and posture of the target area TA. The control pattern of the control ID "1" is an example of control for relaxing comfortably in the living room. The control pattern of the control ID "2" is an example of control for comfortably enjoying a meal in the dining room. The control pattern of the control ID "4" is an example of control for comfortably sleeping.

[0075] The control condition of the control ID "3" is an example including control conditions based on the usage purpose, the orientation and posture of the person P. The control pattern of the control ID "3" is an example of control for making it easier to study in the children's room.

[0076] The control condition of the control ID "5" is an example including control conditions based on the number of people P. The control condition of the control ID "6" is an example including control conditions based on the position of the person P. The control patterns of the control IDs "5" and "6" are examples of control for suppressing power consumption.

[0077] The control conditions for control ID "7" are an example including control conditions based on the orientation of person P. The control conditions for control ID "7" are an example of control for ensuring the safety of the movement of person P who is about to move or is in motion. Note that "a person facing the direction of the irradiation area of the lighting device" included in the control conditions for control ID "7" may further include being in a stationary posture, that is, for example, "a stationary posture in which a person is facing the direction of the irradiation area of the lighting device".

[0078] The control conditions for control ID "8" are an example including control conditions based on a stationary state. The control conditions for control ID "8" are an example of control for allowing person P in a stationary state to relax comfortably while suppressing power consumption.

[0079] Refer to FIG. 6 again. The generation unit 118 generates a control signal for controlling one or more lighting devices LE associated with the target area TA by using the analysis information acquired by the first acquisition unit 111 and the usage purpose of the target area TA.

[0080] Specifically, the generation unit 118 generates a control signal based on the analysis information, the area information 115a, the lighting information 116a, and the control pattern information 117a.

[0081] More specifically, the generation unit 118 stores information for associating each shooting area of the imaging device PE with the target area TA. Based on this information, the generation unit 118 specifies the target area TA corresponding to the device ID of the imaging device PE that captured the image serving as the basis for the analysis information, and specifies the target area TA corresponding to the analysis information. The generation unit 118 determines whether the control conditions are satisfied based on the specified target area TA, the area information 115a, and the analysis information.

[0082] When the control conditions are satisfied, the generation unit 118 generates a control signal for controlling the lighting device LE identified by using the lighting ID associated with the target area TA (area ID) based on the control content associated with the control conditions and the lighting information 116a.

[0083] Refer to FIG. 4 again. The image transfer unit 113 acquires the image information generated by the imaging device PE from the imaging device PE. The image transfer unit 113 transfers the acquired image information to the analysis device 102. The image transfer unit 113 may store the image information for a predetermined period or all of the image information.

[0084] The illumination control unit 114 outputs the control signal generated by the signal generation unit 112 to one or more lighting devices LE.

[0085] (Functional configuration example of the analysis device 102) Refer to FIG. 4 again. When the analysis device 102 acquires the image information from the lighting management device 101, it is a device that analyzes the images included in the acquired image information. The analysis device 102 has a function of analyzing the images to obtain analysis information.

[0086] The analysis functions provided by the analysis device 102 are, for example, one or more of (1) object detection function, (2) face analysis function, (3) humanoid analysis function, (4) posture analysis function, (5) behavior analysis function, (6) appearance attribute analysis function, (7) gradient feature analysis function, (8) color feature analysis function, (9) traffic flow analysis function, etc.

[0087] (1) The object detection function detects objects from the image. The object detection function can also obtain the position, size, etc. of the objects in the image. As a model applied to the object detection process, for example, there is YOLO (You Only Look Once). Objects include people and things. The object detection function detects, for example, a person P, tableware D, a TV TV, tables Ta~Td, a sofa S, a chair C, a bed B, etc.

[0088] (2) The face analysis function detects a person's face from the image, extracts the feature amount (face feature amount) of the detected face, classifies (classifies) the detected face, etc. The face analysis function can also obtain the position of the face in the face image. The face analysis function can also determine the identity of the persons detected from different images based on, for example, the similarity between the face feature amounts of the persons detected from different images.

[0089] (3) The human body analysis function extracts human body feature amounts (for example, values indicating overall features such as the fatness or thinness of body shape, height, clothing, etc.) included in the image, classifies (categorizes) the people included in the image, and so on. The human body analysis function can also identify the position of a person within the image of the person. The human body analysis function can also determine the identity of people included in different images based on human body feature amounts and the like of the people included in the different images.

[0090] (4) The pose analysis function detects the joint points of a person from the image, connects the joint points, and creates a skeleton model that models the skeleton of person P. Then, the pose analysis function uses the information of the skeleton model to estimate the pose of the person, extracts feature amounts (pose feature amounts) of the estimated pose, classifies (categorizes) the people included in the image, and so on. The pose analysis function can also determine the identity of people included in different images based on pose feature amounts and the like of the people included in the different images.

[0091] For example, the pose analysis function estimates poses such as standing position, sitting position, lying position, squatting position, bending position, forward-tilted sitting position, backward-tilted sitting position, etc. from the image, and extracts pose feature amounts indicating each pose. Also for example, the pose analysis function can estimate the pose of person P with respect to an object detected using an object detection function or the like from the image, and extract a pose feature amount indicating the pose.

[0092] The pose feature amount is a feature amount indicating the skeleton model.

[0093] For the pose analysis function, for example, the techniques disclosed in Patent Document 3 and Non-Patent Document 1 can be applied.

[0094] (5) The motion analysis process can estimate human movements using information such as the skeletal model and posture changes, and can perform tasks such as extracting feature quantities (motion feature quantities) of human movements and classifying (categorizing) the people included in the image. In the motion analysis process, it is also possible to estimate a person's height or identify the position within the person's image using the information of the skeletal model. The motion analysis process can, for example, estimate actions such as changes or transitions in posture, movement (changes or transitions in position) from the image, and extract the motion feature quantities of those actions.

[0095] (6) The appearance attribute analysis function can recognize the appearance attributes associated with a person. The appearance attribute analysis function performs tasks such as extracting feature quantities (appearance attribute feature quantities) related to the recognized appearance attributes and classifying (categorizing) the people included in the image. Appearance attributes are attributes in terms of appearance and include, for example, one or more of the color of clothing, the color of shoes, hairstyle, wearing or not wearing hats, ties, glasses, etc.

[0096] (7) The gradient feature analysis function extracts the feature quantities (gradient feature quantities) of the gradients in the image. For the gradient feature detection process, for example, techniques such as SIFT, SURF, RIFF, ORB, BRISK, CARD, HOG, etc. can be applied.

[0097] (8) The color feature analysis function can detect objects from the image and perform tasks such as extracting the feature quantities (color feature quantities) of the colors of the detected objects and classifying (categorizing) the detected objects. The color feature quantity is, for example, a color histogram.

[0098] (9) The flow line analysis function can obtain the flow line (trajectory of movement) of the moving object included in the image using, for example, the result of the identity determination or the result of categorization in any of the analysis functions (2) to (8) described above. Specifically, for example, by connecting the moving objects determined to be the same between images that are different in time series, the flow line of that moving object can be obtained. Note that the flow line analysis function can also obtain the flow line that spans between a plurality of images taken by a plurality of imaging devices PE that image different imaging regions when, for example, video taken by the plurality of imaging devices is acquired.

[0099] The above-described analysis functions provided by the analysis device 102 may be configured such that the analysis results can be used with each other. Then, the analysis device 102 may include a function (analysis function) of analyzing an image using the above-described analysis functions to obtain the number of persons P, the orientation of the person P, and the like.

[0100] Note that the analysis functions described here are an example of an image analysis method for obtaining analysis information, and the method for obtaining analysis information is not limited to this.

[0101] So far, the functional configuration of the lighting management system 100 according to the first embodiment has been mainly described. Hereinafter, the physical configuration of the lighting management system 100 according to the present embodiment will be described.

[0102] (Example of the physical configuration of the lighting management system 100)

[0103] The lighting management device 101 is physically, for example, a general-purpose computer or the like. FIG. 10 is a diagram showing an example of the physical configuration of the lighting management device 101 according to the present embodiment.

[0104] The lighting management device 101 includes, for example, a bus 1010, a processor 1020, a memory 1030, a storage device 1040, a network interface 1050, an input interface 1060, and an output interface 1070.

[0105] The bus 1010 is a data transmission path for the processor 1020, the memory 1030, the storage device 1040, the network interface 1050, the input interface 1060, and the output interface 1070 to transmit and receive data to and from each other. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0106] The processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0107] The memory 1030 is a main memory device realized by, for example, a RAM (Random Access Memory).

[0108] The storage device 1040 is an auxiliary storage device realized by, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a memory card, or a ROM (Read Only Memory). The storage device 1040 stores program modules for realizing the functions of the lighting management device 101. By the processor 1020 loading these program modules into the memory 1030 and executing them, the functions corresponding to the program modules are realized.

[0109] The network interface 1050 is an interface for connecting the lighting management device 101 to a network.

[0110] The input interface 1060 is an interface for a user to input information, and is composed of, for example, a touch panel, a keyboard, a mouse, etc.

[0111] The output interface 1070 is an interface for presenting information to the user, and is composed of, for example, a liquid crystal panel, an organic EL (Electro-Luminescence) panel, etc.

[0112] The analysis device 102 is physically, for example, a general-purpose computer, etc. The analysis device 102 has the same bus 1010, processor 1020, memory 1030, storage device 1040, and network interface 1050 as the lighting management device 101 (see FIG. 10).

[0113] The storage device 1040 included in the analysis device 102 stores program modules for realizing the functions of the analysis device 102. The network interface 1050 included in the analysis device 102 is an interface for connecting the analysis device 102 to a network. Except for these points, the analysis device 102 may be physically configured in the same manner as the lighting management device 101.

[0114] So far, the physical configuration of the lighting management system 100 according to Embodiment 1 has been mainly described. From here, the operation of the lighting management system 100 according to this embodiment will be described.

[0115] (Operation of Lighting Management System 100) FIG. 11 is a flowchart showing a detailed example of the lighting management process according to Embodiment 1. The lighting management process is a process for managing the lighting devices LEa to LEh installed in the target areas TAa to TAd. The lighting management device 101 repeatedly executes the lighting management process during operation. Also, during operation, the imaging device PE transmits image information including the captured image to the lighting management device 101, for example, in real time.

[0116] The image transfer unit 113 transfers the image information acquired from the imaging device PE to the analysis device 102 (step S101).

[0117] Specifically, for example, the image transfer unit 113 transfers the image information acquired from each of the imaging devices PEa to PEe to the analysis device 102.

[0118] Here, the analysis device 102 acquires the image information transferred in step S101 from the lighting management device 101. Note that the analysis device 102 may acquire image information from the imaging device PE without going through the lighting management device 101.

[0119] The analysis device 102 analyzes the images included in the acquired image information using the above-described analysis function and generates analysis information. The analysis device 102 transmits the generated analysis information to the lighting management device 101.

[0120] The first acquisition unit 111 acquires analysis information based on the result estimated by analyzing the image obtained by photographing the target area TA from the analysis device 102 (step S111).

[0121] The analysis information includes the posture of the person P in the target area TA. In addition, in the present embodiment, the analysis information further includes the number, orientation, and position of the person P in the target area TA.

[0122] The signal generation unit 112 generates a control signal for controlling one or more lighting devices LE associated with the target area TA by using the analysis information acquired in step S111 and the purpose of use of the target area TA (step S121).

[0123] Specifically, for example, it is assumed that the target areas TAa to TAd change from the state shown in FIG. 5 to the state shown in FIG. 12.

[0124] For example, in the target area TAa (living room) shown in FIG. 12, it is assumed that persons Pa and Pc are sitting on the sofa S and watching TV. In this case, the analysis information based on the image obtained by photographing the target area TAa includes that two persons P are sitting on the sofa S in the target area TAa. The generation unit 118 identifies the purpose of use of the target area TAa corresponding to the analysis information as the living room based on the area information 115a.

[0125] The generation unit 118 determines whether control conditions related to the living room (for example, control ID "1" shown in FIG. 9) and control conditions not related to the purpose of use of the target area TA (for example, control IDs "5" to "8" shown in FIG. 9) are satisfied based on the analysis information.

[0126] Since the analysis information includes that the person P is sitting, the generation unit 118 determines that the control conditions associated with the control ID "1" are satisfied. Also, there are two persons P near the table Ta which is the irradiation area of the lighting device LEa, but TAaThere is no person P near the window W. Assuming that the control condition of control ID "6" is "the difference in the number of people P in the irradiation area is 2 or more", in this case, the generation unit 118 determines that the control condition associated with control ID "6" is satisfied. The generation unit 118 determines that the control conditions associated with control IDs "5" and "7" are not satisfied.

[0127] According to the control content associated with control ID "1", the generation unit 118 lights the lighting devices LEa and LEb associated with the target area TAa in the darkest incandescent color (for example, brightness "1"). Also, according to the control content associated with control ID "6", the generation unit 118 makes the lighting device LEb that illuminates a place with low density darker than the lighting device LEa that illuminates a place with high density. Here, for example, it is assumed that a control pattern including control conditions not related to the usage purpose of the target area TA is applied with priority over a control pattern including control conditions related to the usage purpose of the target area TA.

[0128] In this case, the generation unit 118 generates a control signal for lighting the lighting device LEa in incandescent color and with brightness "1" according to the control content associated with control IDs "1" and "6". At the same time, in order to make the lighting device LEb darker than brightness "1", the generation unit 118 generates a control signal for turning off the lighting device LEb. Thereby, while the person P in the living room relaxes, power consumption can be suppressed.

[0129] When watching TV, the person P may remain sitting for, for example, 5 seconds or more. Therefore, the analysis information of the target area TAa may include the fact that it is in a static posture. Therefore, the generation unit 118 determines that the control condition associated with control ID "8" is satisfied. Even if such a determination is made, the control content associated with this control condition is to make the lighting device the darkest. Therefore, it does not conflict with the above control signal, and while the person P in the living room relaxes, power consumption can be suppressed.

[0130] Here, for example, assume that person Pa or Pc in the living room further moves from the state shown in FIG. 12 and enters the irradiation area of the lighting device LEd. In this case, in order to satisfy the control ID "7", the generation unit 118 generates a control signal for lighting the lighting device LEd most brightly. The lighting device LEd corresponds to lighting for passages such as corridors and can ensure the safety of the movement of person P.

[0131] For example, in the target area TAb (dining room) shown in FIG. 12, there is no person P. Therefore, the analysis information based on the image captured of the target area TAb includes that the number of persons P in the target area TAb is zero. The generation unit 118 identifies the purpose of use of the target area TAb corresponding to the analysis information as the dining room based on the area information 115a.

[0132] The generation unit 118 determines whether control conditions related to the dining room (for example, control ID "2" shown in FIG. 9) and control conditions not related to the purpose of use of the target area TA (for example, control IDs "5" to "8" shown in FIG. 9) are satisfied based on the analysis information.

[0133] Since the analysis information includes that the number of persons P is zero, the generation unit 118 determines that the control conditions associated with the control ID "2" are not satisfied. Among the control IDs "5" to "8", it is determined that the control conditions associated with the control ID "5" are satisfied.

[0134] The generation unit 118 generates a control signal for turning off the lighting devices LEc and LEd associated with the target area TAb in a bulb color according to the control content associated with the control ID "5". Thereby, power consumption can be suppressed.

[0135] For example, in the target area TAc (children's room) shown in FIG. 12, assume that a person Pd is sitting on a chair C facing a desk Tc and studying. The analysis information based on the image of the target area TAc includes that one person P is sitting in the target area TAc. When studying, usually for writing or turning the pages of documents, etc., the posture is not a static posture. Therefore, the analysis information does not include being in a static posture. The generation unit 118 identifies the purpose of use of the target area TAc corresponding to the analysis information as a children's room based on the area information 115a.

[0136] The generation unit 118 determines whether control conditions related to the children's room (for example, control IDs "3" and "4" shown in FIG. 9) and control conditions not related to the purpose of use of the target area TA (for example, control IDs "5" to "8" shown in FIG. 9) are satisfied based on the analysis information.

[0137] Since the analysis information includes that the person P is sitting facing the irradiation area of the lighting device LEe and does not include being in a static posture, the generation unit 118 determines that the control ID "3" is satisfied. The generation unit 118 determines that the control conditions associated with the control IDs "4" to "8" are not satisfied.

[0138] The generation unit 118 generates a control signal to make the lighting device LEe in front of the person Pd the brightest among the lighting devices LEe and LEg associated with the target area TAc according to the control content associated with the control ID "3". Also, the generation unit 118 generates a control signal to make the lighting device LEg behind the person Pd darker than the lighting device LEe. Thereby, it is possible to make it easier to study in the children's room.

[0139] For example, in the target area TAd (bedroom) shown in FIG. 12, assume that a person Pb is sleeping. In this case, the analysis information based on the image of the target area TAd includes that one person P is sleeping in the target area TAd. The generation unit 118 identifies the purpose of use of the target area TAd corresponding to the analysis information as a bedroom based on the area information 115a.

[0140] Based on the analysis information, the generation unit 118 determines whether the control conditions related to the bedroom (for example, control ID "4" shown in FIG. 9) and the control conditions not related to the usage purpose of the target area TA (for example, control IDs "5" to "8" shown in FIG. 9) are satisfied.

[0141] Since the analysis information includes that person P is lying on their side, the generation unit 118 determines that the control ID "4" is satisfied. The generation unit 118 determines that the control conditions associated with control IDs "5" to "7" are not satisfied.

[0142] The generation unit 118 generates a control signal for turning off the lighting device LEh associated with the target area TAd according to the control content associated with the control ID "4". Thereby, a comfortable sleep can be taken.

[0143] When sleeping, person P may remain in a lying-on-the-side posture for, for example, 5 seconds or more. Therefore, there may be a case where the analysis information of the target area TAd includes a stationary posture. In this case, the generation unit 118 determines that the control conditions associated with the control ID "8" are satisfied. Even if such a determination is made, the control content associated with this control condition is to make the lighting device the darkest. Therefore, it does not conflict with the above control signal, and a comfortable sleep can be taken.

[0144] Refer to FIG. 11 again. The lighting control unit 114 outputs the control signal generated in step S121 to each corresponding lighting device LE (step S131), and ends the lighting management process.

[0145] When step S131 is executed, the lighting device LE acquires the corresponding control signal. The lighting device LE lights or turns off according to the acquired control signal.

[0146] By executing such lighting management processing, based on the image captured of the target area TA, it is possible to control the lighting device LE associated with the target area TA in substantially real time. In particular, in the present embodiment, based only on the image captured of the target area TA, it is possible to control the lighting device LE associated with the target area TA.

[0147] The above is the description of Embodiment 1.

[0148] (Function and Effect) According to the present embodiment, the lighting management device 101 includes a first acquisition unit 111 and a signal generation unit 112. The first acquisition unit 111 acquires analysis information based on the result estimated by using the analysis of the image captured of the target area TA. The analysis information includes the posture of the person P in the target area TA. The signal generation unit 112 generates a control signal for controlling one or more lighting devices LE associated with the target area TA by using the analysis information and the usage purpose of the target area TA.

[0149] Thereby, it is possible to control one or more lighting devices LE associated with the target area TA by using the posture of the person P in the target area TA obtained from the image captured of the target area TA and the usage purpose of the target area TA. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving the convenience regarding lighting. Also, it becomes possible to suppress power consumption and improve safety.

[0150] According to the present embodiment, the posture is shown by using a skeleton model that models the human skeleton.

[0151] Thereby, it is possible to control one or more lighting devices LE associated with the target area TA by using the posture of the person P in the target area TA obtained from the image captured of the target area TA and the usage purpose of the target area TA. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving the convenience regarding lighting. Also, it becomes possible to suppress power consumption and improve safety.

[0152] According to the present embodiment, the posture includes whether the posture is a stationary posture that has been the same posture for a predetermined time or longer.

[0153] Thereby, using the posture including the stationary posture of the person P and the purpose of use of the target area TA, one or more lighting devices LE associated with the target area TA can be controlled. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving convenience regarding lighting. In addition, it becomes possible to suppress power consumption and improve safety.

[0154] According to the present embodiment, the analysis information further includes at least one of the number of people P in the target area TA, the orientation, and the position.

[0155] Thereby, against Using at least one of the number of people P in the target area TA, the orientation, and the position obtained from the image of the target area TA, one or more lighting devices LE associated with the target area TA can be controlled more appropriately. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving convenience regarding lighting. In addition, it becomes possible to suppress power consumption and improve safety.

[0156] According to the present embodiment, the lighting management device 101 further includes a lighting control unit 114 that outputs a control signal to one or more lighting devices LE.

[0157] Thereby, against According to the control signal generated using the posture of the person P in the target area TA obtained from the image of the target area TA and the purpose of use of the target area TA, one or more lighting devices LE associated with the target area TA can be controlled more appropriately. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving convenience regarding lighting. In addition, it becomes possible to suppress power consumption and improve safety.

[0158] According to this embodiment, the lighting management system 100 includes an analysis device 102 that analyzes an image of the target area TA and generates analysis information. The first acquisition unit 111 acquires the analysis information generated by the analysis device 102.

[0159] As a result, the processing load on the lighting management device 101 can be reduced compared to the lighting management device 101 analyzing the image. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving convenience regarding lighting. Also, it becomes possible to suppress power consumption and improve safety.

[0160] Embodiment 1 may be modified as follows, for example.

[0161] (Modification Example 1) Each of the target areas TAa to TAd according to Embodiment 1 is an example of the target area TA, and the target area TA is not limited to this. For example, there may be at least one target area TA. Also, the target area TA is not limited to a living room, a dining room, a children's room, or a bedroom, and may be, for example, another area in a house, or may be an office, a conference room, a factory, a work area where workers work in a factory, etc.

[0162] The lighting management system 100 may include at least one imaging device PE that images the target area TA. When the lighting management system 100 includes a plurality of imaging devices PE, the number of imaging devices PE may be any number of two or more. The lighting management system 100 may include at least one lighting device LE associated with the target area TA. When the lighting management system 100 includes a plurality of lighting devices LE, the number of lighting devices LE may be any number of two or more. The lighting device LE is not limited to a lighting device LE installed on the ceiling or desks Tc, Td, and may be a lighting device installed on a wall, a floor, etc., and its installation mode may be variously changed.

[0163] The imaging device PE may be incorporated into devices installed in other target areas TA (for example, a television TV, a lighting device LE, an air conditioner not shown, etc.).

[0164] Also according to this modification example, the same operations and effects as those of the first embodiment are achieved.

[0165] (Modification Example 2) In the first embodiment, an example in which the first acquisition unit 111 acquires analysis information from the analysis device 102 has been described. However, the first acquisition unit 111 may be provided with an analysis function included in the analysis device 102 and acquire the analysis information by generating the analysis information by itself. That is, in this modification example, an example in which the first acquisition unit 111 analyzes an image obtained by photographing the target area TA to generate analysis information will be described.

[0166] In this modification example, the lighting management system 100 may not include the analysis device 102. Also, the lighting management device 101 may not include the image transfer unit 113.

[0167] In this modification example, in step S111 of the lighting management process, instead of acquiring the analysis information from the analysis device 102, the first acquisition unit 111 analyzes an image obtained by photographing the target area TA. And the first acquisition unit 111 according to this modification example generates analysis information in the same manner as the analysis device 102 according to the first embodiment. As a result, the first acquisition unit 111 according to this modification example acquires the analysis information.

[0168] Also according to this modification example, the same operations and effects as those of the first embodiment are achieved, except for the operations and effects corresponding to the lighting management system 100 including the analysis device 102. According to this modification example, since it is not necessary to include the analysis device 102, the configuration of the lighting management system 100 can be simplified compared to the first embodiment.

[0169] (Modification Example 3) In this modification example, an example in which the lighting management system 100 further includes a control terminal that acquires a control signal from the lighting management device 101 and outputs the acquired control signal to each of one or more lighting devices LE will be described.

[0170] The lighting management system 100 may further include a control terminal that transfers the control signal and the image information.

[0171] FIG. 13 is a diagram showing a configuration example of the lighting management system 100 according to Modification 3. The lighting management system 100 includes a control terminal 103 in addition to imaging devices PEa to PEe, lighting devices LEa to LEh, a lighting management device 101, and an analysis device 102.

[0172] The control terminal 103 and the lighting management device 101 are connected via a communication network (for example, a LAN (Local Area Network)) configured by wire, wireless, or a combination thereof, and transmit and receive information to and from each other via the communication network.

[0173] Functionally, the control terminal 103 includes an image transfer unit 120 and a lighting control unit 114.

[0174] The image transfer unit 120 acquires the image information generated by the imaging device PE from the imaging device PE, and transfers the acquired image information to the analysis device 102.

[0175] Similar to Embodiment 1, the lighting control unit 114 outputs the control signal generated by the signal generation unit 112 to one or more lighting devices LE. Specifically, the lighting control unit 114 acquires the control signal generated by the signal generation unit 112 from the lighting management device 101, and outputs the acquired control signal to one or more lighting devices LE.

[0176] The lighting management device 101 according to this modification further includes a lighting signal transmission unit 119. The lighting signal transmission unit 119 transmits the control signal generated by the signal generation unit 112 to the control terminal 103.

[0177] Physically, the control terminal 103 may be configured in the same manner as the lighting management device 101 according to Embodiment 1.

[0178] In the lighting management process according to this modification example, the image transfer unit 120 acquires the image information generated by the imaging device PE from the imaging device PE, and transfers the image information acquired from the imaging device PE to the analysis device 102. The image transfer unit 113 acquires the image information generated by the imaging device PE from the control terminal 103 in step S101 (see FIG. 11), and transfers the acquired image information to the analysis device 102.

[0179] The lighting management device 101 executes steps S111 and S112 similar to those in Embodiment 1.

[0180] The lighting signal transmission unit 119 transmits the control signal generated by the signal generation unit 112 to the control terminal 103 in step S131. The lighting control unit 114 according to this modification example acquires the control signal from the lighting management device 101, and outputs the control signal to each of the corresponding lighting devices LE. As a result, the lighting device LE acquires the corresponding control signal, and lights or turns off the light according to the acquired control signal.

[0181] This modification example also exhibits the same operations and effects as those in Embodiment 1. Note that in the lighting management device 101 according to this modification example, the first acquisition unit 111 similar to that in Modification Example 2 may also be applied. As a result, the same operations and effects as those in Modification Example 2 are exhibited.

[0182] <Embodiment 2> In Embodiment 1, an example in which the analysis information includes at least one of the posture of the person P, the number of people P in the target area TA, the orientation, and the position has been described. The analysis information may further include at least one of the movement of the person P in the target area TA and the situation around the person P (the situation within a predetermined range).

[0183] In this embodiment, for the sake of simplicity, the differences from Embodiment 1 will be mainly described, and the overlapping descriptions will be omitted as appropriate.

[0184] The lighting management system according to this embodiment is configured substantially the same as the lighting management system 100 according to Embodiment 1.

[0185] As described above, the analysis information according to this embodiment may further include at least one of the movement of the person P in the target area TA and the situation around the person P (the situation within a predetermined range). The situation around the person P is the situation within a predetermined range from the person P.

[0186] The movement of the person P is, for example, movement, eating actions (e.g., lifting and lowering chopsticks, extending chopsticks to a tableware), writing actions, operations on a terminal (e.g., a tablet terminal, a mobile terminal), turning pages of a book, etc.

[0187] The situation around the person P is, for example, the type of objects within a predetermined range from the person P (e.g., tableware, documents, books, notebooks, tablet terminals, mobile terminals, televisions), the operating state of the objects (e.g., whether a tablet terminal, a mobile terminal, a television, etc. is operating), etc.

[0188] The analysis device 102 can obtain the movement of the person P in the target area TA and the situation around the person P (the situation within a predetermined range) by using the analysis function described in Embodiment 1. Therefore, the analysis device 102 analyzes the images included in the image information obtained from the lighting management device 101, and generates analysis information that further includes at least one of the movement of the person P in the target area TA and the situation around the person P (the situation within a predetermined range).

[0189] The pattern storage unit 117 (see FIG. 6) according to this embodiment stores in advance control pattern information 117b that replaces the control pattern information 117a according to Embodiment 1.

[0190] FIG. 14 is a diagram showing an example of the control pattern information 117b according to this embodiment. The control pattern information 117b is information that associates a control ID, control conditions, and control content, similar to the control pattern information 117a according to Embodiment 1. The control conditions according to this embodiment may include the usage scene.

[0191] The usage scenario is the situation of the person P using the target area TA. Specifically, the usage scenario is, for example, a viewing scenario, a handwriting scenario, a browsing scenario, a meal scenario, a bedtime scenario, etc.

[0192] The viewing scenario is the situation of watching TV. The handwriting scenario is the situation of person P writing something by hand. The browsing scenario is the situation of browsing objects such as books, documents, tablet terminals, mobile terminals, etc. The meal scenario is the situation of having a meal. The bedtime scenario is the situation of going to bed.

[0193] Specifically, for example, in the control pattern information 117b shown in FIG. 14, the control IDs "1", "2", "4", "9" and "10" are examples where control conditions including the usage scenario are associated.

[0194] For example, the control patterns of the control IDs "1", "2", "4" according to this embodiment are all examples of usage scenarios related to the purpose of using the target area TA.

[0195] Specifically, the "viewing scenario" is related to the living room. The "viewing scenario" is associated with control content for comfortably watching TV in the living room. The "meal scenario" is related to the dining room. The "meal scenario" is associated with control content for comfortably enjoying a meal. The "bedtime scenario" is related to the children's room or the bedroom. The "bedtime scenario" is associated with control content for comfortably sleeping.

[0196] For example, the control patterns of the control IDs "9", "10" according to this embodiment are both examples of usage scenarios not related to the purpose of using the target area TA.

[0197] The "handwriting scenario" is associated with control content for comfortably writing. The "browsing scenario" is associated with control content for comfortably browsing objects such as books, documents, tablet terminals, mobile terminals, etc.

[0198] The generation unit 118 (see FIG. 6) according to this embodiment, in addition to functioning in the same manner as in Embodiment 1, estimates a usage scene using the analysis information, and generates a control signal using the estimated usage scene.

[0199] Specifically, the generation unit 118 estimates a usage scene based on the analysis information. Alternatively, the generation unit 118 estimates a usage scene based on the analysis information and the area information 115a. Then, the generation unit 118 generates a control signal based on the estimated usage scene, the analysis information, the lighting information 116a, and the control pattern information 117b.

[0200] For example, the generation unit 118 estimates a viewing scene based on some or all of the following: the usage purpose of the target area TA being a living room, the posture of the person P, and the situation around the person P such as the presence of a TV screen. For example, the generation unit 118 estimates a handwriting scene based on the movement of the person P or the like. For example, the generation unit 118 estimates a browsing scene based on some or all of the following: the situation around the person P such as the presence of books, notebooks, tablet terminals, and mobile terminals, and the operations or actions related thereto.

[0201] For example, the generation unit 118 estimates a meal scene based on some or all of the following: the usage purpose of the target area TA being a dining room, at least one of the movement and posture of the person P, and the situation around the person P such as the presence of tableware D. For example, the generation unit 118 estimates a bedtime scene based on some or all of the following: the usage purpose of the target area TA being a children's room or a bedroom, and the posture of the person P being asleep.

[0202] When there are control conditions including the estimated usage scene, the generation unit 118 determines that the control conditions are satisfied. When the control conditions are satisfied, the generation unit 118 generates a control signal for controlling the lighting device LE identified by the lighting ID associated with the target area TA (area ID) based on the control content associated with the control conditions and the lighting information 116a.

[0203] (Lighting management process according to Embodiment 2) In the lighting management process according to this embodiment, the details of step S121 are different from those in the first embodiment. Except for this point, the lighting management process may be the same as that in the first embodiment.

[0204] In step S121 according to this embodiment, as described above, the generation unit 118 estimates the usage scene and generates a control signal using the estimated usage scene.

[0205] For example, in the target area TAa (living room) shown in FIG. 12, it is assumed that persons Pa and Pc are sitting on the sofa S and watching TV. In this case, the analysis information based on the image of the target area TAa includes that two persons P are sitting on the sofa S in the target area TAa, the TV is in front of the person P, and the TV is operating. The generation unit 118 identifies the usage purpose of the target area TAa corresponding to the analysis information as the living room based on the area information 115a.

[0206] The generation unit 118 estimates a viewing scene based on the analysis information and usage purpose of the target area TAa. The generation unit 118 determines that the control conditions associated with the control ID "1" are satisfied. The generation unit 118 lights the lighting devices LEa and LEb associated with the target area TAa in the darkest bulb color (e.g., brightness "1") according to the control content associated with the control ID "1".

[0207] Also, similar to the first embodiment, the generation unit 118 dims the lighting device LEb that illuminates a low-density area more than the lighting device LEa that illuminates a high-density area according to the control content associated with the control ID "6".

[0208] As a result, in the same manner as the example described with reference to FIG. 12 in Embodiment 1, the generation unit 118 generates a control signal for lighting the lighting device LEa in a bulb color and with a brightness of "1" according to the control contents associated with the control IDs "1" and "6". At the same time, in order to make the lighting device LEb darker than the brightness of "1", the generation unit 118 generates a control signal for turning off the lighting device LEb. Thereby, while the person P in the living room is relaxing, the power consumption can be suppressed.

[0209] For example, in the target area TAc (children's room) shown in FIG. 12, it is assumed that the person Pd is sitting on the chair C facing the desk Tc and studying. The analysis information based on the image obtained by photographing the target area TAc includes that one person P is sitting in the target area TAc, a writing motion, a motion of turning pages of a book or the like, and that books, notebooks, etc. are around the person P. The generation unit 118 identifies the usage purpose of the target area TAc corresponding to the analysis information as the children's room based on the area information 115a.

[0210] The generation unit 118 estimates a handwritten scene and a browsing scene based on the analysis information and the usage purpose of the target area TAc. The generation unit 118 determines that the control conditions associated with the control IDs "9" and "10" are satisfied. Also, in the same manner as in Embodiment 1, the generation unit 118 determines that the control conditions associated with the control ID "3" are satisfied.

[0211] The generation unit 118 controls the lighting devices LEe and LEg associated with the target area TAc according to the control contents associated with the control IDs "3", "9", and "10". For the lighting device LEe in front of the person Pd, when the person Pd writes with the right hand, by turning on the lighting device LEe, the lighting device LE on the opposite side of the hand of the person writing can be made the brightest. Also, by turning on the lighting device LEe, the lighting device LE illuminating the object being browsed can be made the brightest.

[0212] As a result, similar to the example described with reference to FIG. 12 in Embodiment 1, the generation unit 118 according to the present embodiment generates a control signal for making the lighting device LEe in front of the person Pd the brightest. Further, the generation unit 118 generates a control signal for making the lighting device LEg behind the person Pd darker than the lighting device LEe. Thereby, it is possible to make it easier to study in the children's room. Also, writing and browsing can be performed comfortably.

[0213] The above describes Embodiment 2.

[0214] (Operation and Effect) According to the present embodiment, the analysis information further includes at least one of the movement of the person P in the target area TA and the situation around the person P. The signal generation unit 112 (generation unit 118) estimates the usage scene, which is the situation of the person P using the target area TA, using the analysis information, and generates a control signal using the estimated usage scene.

[0215] Thereby, based on at least one of the movement of the person P and the situation around the person P, one or more lighting devices LE associated with the target area TA can be controlled more appropriately. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving the convenience regarding lighting. Also, it becomes possible to suppress power consumption and improve safety.

[0216] According to the present embodiment, the signal generation unit 112 (generation unit 118) generates a control signal using the current usage scene.

[0217] Thereby, based on the current usage scene, one or more lighting devices LE associated with the target area TA can be controlled appropriately. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving the convenience regarding lighting. Also, it becomes possible to suppress power consumption and improve safety.

[0218] (Modification Example 4) In Embodiment 2, an example of generating a control signal using the current usage scene was described. However, the above-described control pattern information 117b is an example of a control pattern using the usage scene and may be appropriately changed. For example, a control signal may be generated using the elapsed time since the start of the usage scene.

[0219] Specifically, for example, the control pattern for the bedtime scene may include, as a control condition, that the elapsed time since the bedtime scene is estimated exceeds a predetermined time (e.g., 30 minutes). For this control condition, for example, the control content may be associated with "turning off the light". This can prevent forgetting to turn off the light after going to bed and enable comfortable sleep.

[0220] Also, for example, the control pattern for the handwriting scene or the browsing scene may include, as a control condition, that a predetermined time (e.g., 60 minutes) has elapsed since the handwriting scene or the browsing scene is estimated. For this control condition, for example, the control content may be associated with blinking or dimming the lighting device LE that illuminates the opposite side of the hand of the person P writing or the lighting device LE that illuminates the object being browsed. This can inform an appropriate time for rest and improve the comfort of the person P writing or browsing.

[0221] According to this modification example, the signal generation unit 112 (generation unit 118) generates a control signal using the elapsed time since the start of the usage scene.

[0222] Thereby, based on the elapsed time since the start of the usage scene, one or more lighting devices LE associated with the target area TA can be appropriately controlled. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving the convenience regarding lighting. Also, it becomes possible to suppress power consumption and improve safety.

[0223] (Modification Example 5) The control conditions may include a time set as appropriate, such as 7:00 in the morning. The control conditions only need to be associated with the control content set as appropriate. For example, it is advisable to associate a control condition of lighting the lighting device LEh in the target area TAd (bedroom) at the brightest daylight white. This enables a person to wake up reliably and comfortably.

[0224] <Embodiment 3> In this embodiment, an example in which the control pattern information includes a control pattern for each person will be described. This enables control of the lighting device LE according to the preferences of each person P. In this embodiment, for the sake of brevity, differences from Embodiment 1 will mainly be described, and overlapping descriptions will be omitted as appropriate.

[0225] The lighting management system according to this embodiment is configured in substantially the same manner as the lighting management system 100 according to Embodiment 1.

[0226] The analysis information according to this embodiment includes personal identification information for identifying the person P in the target area TA estimated by using the analysis of an image obtained by photographing the target area TA. The personal identification information is, for example, a face feature amount. The face feature amount may be converted based on a predetermined table or the like.

[0227] The pattern storage unit 117 (see FIG. 6) according to this embodiment stores in advance control pattern information 117c that replaces the control pattern information 117a according to Embodiment 1.

[0228] FIG. 15 is a diagram showing an example of the control pattern information 117c according to this embodiment. The control pattern information 117c is information that associates a control ID, control conditions, and control content, similar to the control pattern information 117a according to Embodiment 1. The control pattern information 117c according to this embodiment includes a control pattern associated with the control ID "11".

[0229] The control pattern associated with control ID "11" defines a control pattern according to person Pb identified using the personal identification information of "person Pb". That is, the control pattern associated with control ID "11" is an example of an individual control pattern that defines a control pattern according to personal identification information.

[0230] Specifically, in the same manner as in Embodiment 1, the generation unit 118 uses the analysis information acquired by the first acquisition unit 111 and the purpose of use of the target area TA to generate a control signal for controlling one or a plurality of lighting devices LE associated with the target area TA.

[0231] When the individual control pattern and other control patterns conflict, the generation unit 118 gives priority to the individual control pattern.

[0232] For example, in step S121 according to Embodiment 1 (see FIG. 11), an example was described in which, in the target area TAd (bedroom), since person Pb is sleeping, a control signal for turning off the lighting device LEh is generated.

[0233] Based on the analysis information of the target area TAd and the like, when the generation unit 118 performs the same processing as in Embodiment 1, the generation unit 118 determines that the control IDs "4" and "11" are satisfied. Since these control conditions conflict, the individual control pattern of control ID "11" is given priority.

[0234] The generation unit 118 generates a control signal for lighting the lighting device LEh associated with the target area TAd in the darkest bulb color according to the control content associated with the control ID "11". As a result, person Pb can sleep with the brightness according to his or her preference, so that he or she can sleep more comfortably.

[0235] According to the present embodiment, the analysis information further includes personal identification information for identifying the person P present in the target area TA estimated using the analysis of the image obtained by photographing the target area TA. The signal generation unit 112 (generation unit 118) generates a control signal using an individual control pattern that defines a control pattern according to personal identification information.

[0236] Accordingly, one or more lighting devices LE can be controlled according to the preferences of person P. Therefore, it becomes possible to provide a lighting management device 101 or the like that solves the problem of improving the convenience regarding lighting. Further, it becomes possible to suppress power consumption and improve safety.

[0237] <Embodiment 4> In this embodiment, an example will be described in which the behavior of person P in the target area TA is predicted based on the analysis information, and the lighting device LE is controlled based on the prediction result.

[0238] In this embodiment, for the sake of simplicity, the differences from Embodiment 1 will be mainly described, and overlapping descriptions will be omitted as appropriate.

[0239] FIG. 16 is a diagram showing a configuration example of a lighting management system 400 according to this embodiment. The lighting management system 400 according to this embodiment includes a lighting management device 401 that replaces the lighting management device 101 according to Embodiment 1. Except for this point, the lighting management system 400 may be configured in the same manner as the lighting management system 100 according to Embodiment 1.

[0240] The lighting management device 401 includes a signal generation unit 412 that replaces the signal generation unit 112 according to Embodiment 1. Further, the lighting management device 401 includes a second acquisition unit 421. Except for these, the lighting management device 401 may be configured in the same manner as the lighting management device 101 according to Embodiment 1.

[0241] The second acquisition unit 421 acquires the analysis information from, for example, the first acquisition unit 111. The second acquisition unit 421 may acquire the analysis information from the analysis device 102. In this case, the second acquisition unit 421 may store the acquired analysis information.

[0242] The second acquisition unit 421 performs statistical processing on the analysis information. The second acquisition unit 421 predicts the behavior of person P in the target area based on the result of statistically processing the analysis information. The second acquisition unit 421 generates prediction information including the predicted result.

[0243] In addition to the same functions as those in Embodiment 1, the signal generation unit 412 generates a control signal for controlling one or more lighting devices LE associated with the target area TA by using the result predicted by the second acquisition unit 421.

[0244] (Operation of Lighting Management System 400) The lighting management system 400 according to the present embodiment executes lighting management processing. The lighting management processing according to the present embodiment executes prediction control processing in addition to the same lighting management processing as that in Embodiment 1. The prediction control processing is a process for controlling the lighting device LE based on the result of predicting the behavior of the person P in the target area TA.

[0245] FIG. 17 is a flowchart showing an example of the prediction control processing according to the present embodiment. The lighting management device 401 repeatedly executes the prediction control processing, for example, during operation.

[0246] The second acquisition unit 421 acquires analysis information (step SS401). Here, the second acquisition unit 421 acquires not only the current analysis information but also the past analysis information.

[0247] The second acquisition unit 421 performs statistical processing using the analysis information acquired in step SS401 (step SS402).

[0248] For example, the second acquisition unit 421 performs statistical processing on the postures of the person P in each target area TA by time zone.

[0249] The second acquisition unit 421 predicts the behavior of the person P in the target area TA based on the result of the statistical processing in step SS402 (step S403).

[0250] For example, assume that the second acquisition unit 421 obtains, by statistically processing the analysis information, a result that person P is likely to sit in the target area TAb (dining room) at 7:00 p.m. In this case, the second acquisition unit 421 predicts that person P will sit in the dining room at 7:00 p.m. The second acquisition unit 421 generates prediction information including the predicted result.

[0251] Also for example, assume that the second acquisition unit 421 obtains, by statistically processing the analysis information, a result that person P is likely not to be present in the target area TAb (dining room) at 10:00 p.m. In this case, the second acquisition unit 421 predicts that person P will not be present in the dining room at 10:00 p.m. The second acquisition unit 421 generates prediction information including the predicted result.

[0252] Based on the prediction information generated in step S403, the second acquisition unit 421 generates a control signal (step S404).

[0253] For example, the second acquisition unit 421 refers to the control pattern information 117a and identifies a control pattern (control pattern with control ID "2") that includes the condition that person P is sitting in the dining room. The second acquisition unit 421 generates a control signal to make the lighting devices LEa and LEb identified using the lighting I associated with the target area TAb brightest in daylight white at 7:00 p.m. according to the control content included in the identified control pattern and the lighting information 116a. D to For example, the second acquisition unit 421 refers to the control pattern information 117a and identifies a control pattern (control pattern with control ID "5") that includes the condition that person P is not present in the dining room. The second acquisition unit 421 generates a control signal to turn off the lighting devices LEa and LEb identified using the lighting I associated with the target area TAb at 10:00 p.m. according to the control content included in the identified control pattern and the lighting information 116a.

[0254] D to

[0255] ​​The lighting control unit 114 outputs the control signal generated in step S404 to each of the corresponding lighting devices LE (step S405), and ends the lighting management process.

[0256] When step S405 is executed, the lighting device LE acquires the corresponding control signal. The lighting device LE lights or turns off the light according to the acquired control signal.

[0257] By executing such a lighting management process, it is possible to predict the behavior of the person P in the target area TA and control the lighting device LE associated with the target area TA.

[0258] The above is the description of Embodiment 4.

[0259] (Function and effect) According to the present embodiment, the lighting management device 401 further includes a second acquisition unit 421 that predicts the behavior of the person P in the target area TA based on the result of statistically processing the analysis information. The signal generation unit 412 further generates a control signal using the result predicted by the second acquisition unit 421.

[0260] Thereby, it is possible to predict the behavior of the person P in the target area TA and control the lighting device LE associated with the target area TA. Therefore, a lighting management device that solves the problem of improving the convenience regarding lighting can be provided. 4 It becomes possible to provide 01 or the like. In addition, it becomes possible to suppress power consumption.

[0261] The embodiments and modifications of the present invention have been described above with reference to the drawings, but these are examples of the present invention, and various configurations other than the above can also be adopted.

[0262] Also, in the plurality of flowcharts used in the above description, a plurality of steps (processes) are described in order. However, the execution order of the steps executed in each of the embodiments is not limited to the order of the description. In each of the embodiments, the order of the steps shown can be changed within a range that does not substantially affect the content. Also, the above-described embodiments and modifications can be combined within a range where the contents do not conflict with each other.

[0263] Some or all of the above-described embodiments can be described as follows in the appended claims, but are not limited thereto.

[0264] 1. A first acquisition means for acquiring analysis information based on a result estimated by analyzing an image obtained by photographing a target area, a signal generation means for generating a control signal for controlling one or more lighting devices associated with the target area by using the analysis information and the purpose of use of the target area, wherein the analysis information includes the posture of a person in the target area lighting management device. 2. The lighting management device according to 1., wherein the posture is shown using a skeleton model that models the skeleton of the person. The lighting management device according to 1. 3. The lighting management device according to 1. or 2., wherein the posture includes whether or not it is a stationary posture in which the same posture is maintained for a predetermined time or longer. The lighting management device according to 1. or 2. 4. The analysis information further includes at least one of the movement of a person in the target area and the situation around the person, the signal generation means further estimates a usage scene, which is the situation of the person using the target area, using the analysis information, and generates the control signal using the estimated usage scene. The lighting management device according to any one of 1. to 3. 5. The signal generation means generates the control signal using at least one of the current usage scene and the elapsed time since the start of the usage scene. The lighting management device according to 4. 6. The analysis information further includes at least one of the number of people in the target area, the orientation, and the position. 1. The lighting management device according to any one of 1. to 5. 7. The lighting management device further includes second acquisition means for predicting the behavior of people in the target area based on the result of statistically processing the analysis information. The signal generation means further generates the control signal using the result predicted by the second acquisition means. 1. The lighting management device according to any one of 1. to 6. 8. The analysis information further includes personal identification information for identifying people in the target area estimated by using the analysis of an image obtained by photographing the target area. The signal generation means further generates the control signal using an individual control pattern that defines a control pattern according to the personal identification information. 1. The lighting management device according to any one of 1. to 7. 9. The lighting management device further includes a lighting control unit that outputs the control signal to the one or more lighting devices. 1. The lighting management device according to any one of 1. to 8. 10. The first acquisition means generates the analysis information by analyzing an image obtained by photographing the target area. 1. The lighting management device according to any one of 1. to 9. 11. A lighting management device according to any one of 1. to 8., one or more imaging devices that generate image information including the image obtained by photographing the target area, and one or more lighting devices associated with the target area. A lighting management system. 12. The lighting management system further includes an analysis device that analyzes an image obtained by photographing the target area to generate the analysis information. The first acquisition means acquires the analysis information generated by the analysis device. The lighting management system according to 11. 13. The first acquisition means generates the analysis information by analyzing an image obtained by photographing the target area. The lighting management system according to 11. 14. The lighting management device further includes a lighting control unit that outputs the control signal to each of the one or more lighting devices. 11. The lighting management system according to any one of 11. to 13. 15. The lighting management system further includes a control terminal that acquires the control signal from the lighting management device and outputs the acquired control signal to each of the one or more lighting devices. 11. The lighting management system according to any one of 11. to 13. 16. A computer acquires analysis information based on a result estimated using analysis of an image obtained by photographing a target area, generates a control signal for controlling one or more lighting devices associated with the target area using the analysis information and the purpose of use of the target area, wherein the analysis information includes the posture of a person in the target area lighting management method. 17. A computer-readable recording medium having recorded thereon a program for causing a computer to acquire analysis information based on a result estimated using analysis of an image obtained by photographing a target area, to generate a control signal for controlling one or more lighting devices associated with the target area using the analysis information and the purpose of use of the target area, and to cause the analysis information to include the posture of a person in the target area. 18. A program for causing a computer to acquire analysis information based on a result estimated using analysis of an image obtained by photographing a target area, to execute generation of a control signal for controlling one or more lighting devices associated with the target area using the analysis information and the purpose of use of the target area, and to cause the analysis information to include the posture of a person in the target area.

Description of Reference Numerals

[0265] 100, 400 Lighting management system 101, 401 Lighting management device 102 Analysis device 103 Control terminal 111 First acquisition unit 112, 412 Signal generation unit 113 Image transfer unit 114 Lighting control unit 115 Area memory unit 115a Area information 116 Lighting memory unit 116a Lighting information 117 Pattern memory unit 117a~117c Control pattern information 118 Generation unit 119 Lighting signal transmission unit 120 Image transfer unit 421 Second acquisition unit LE, LEa~LEh Lighting equipment P, Pa~Pd Person PE, PEa~PEe Imaging device TA, TAa~TAd Target area

Claims

1. a first acquisition means for acquiring analysis information based on a result estimated by analyzing an image obtained by photographing a target area; a signal generation means for generating a control signal for controlling one or more lighting devices associated with the target area by using the analysis information and the purpose of use of the target area; a second acquisition means for predicting the behavior of a person in the target area based on a result obtained by statistically processing the analysis information, wherein the analysis information includes the posture of a person in the target area, and the signal generation means further generates the control signal by using the result predicted by the second acquisition means; A lighting management device.

2. a first acquisition means for acquiring analysis information based on a result estimated by analyzing an image obtained by photographing a target area; a signal generation means for generating a control signal for controlling one or more lighting devices associated with the target area by using the analysis information and the purpose of use of the target area; wherein the analysis information includes the posture of a person in the target area, wherein the analysis information further includes personal identification information for identifying a person in the target area estimated by analyzing an image obtained by photographing the target area, and the signal generation means further generates the control signal by using an individual control pattern in which a control pattern corresponding to the personal identification information is defined; A lighting management device.

3. The posture is shown using a skeleton model that models the skeleton of the person The lighting management device according to claim 1 or 2.

4. The posture includes whether or not it is a stationary posture in which the same posture is maintained for a predetermined time or longer The lighting management device according to any one of claims 1 to 3.

5. The analysis information further includes at least one of the movement of a person in the target area and the situation around the person, and the signal generation means further estimates a usage scene, which is the situation of the person using the target area, by using the analysis information, and generates the control signal by using the estimated usage scene; The lighting management device according to any one of claims 1 to 4.

6. The analysis information further includes at least one of the number of people, the orientation, and the position of the people in the target area The lighting management device according to any one of claims 1 to 5.

7. A computer acquires analysis information based on a result estimated by analyzing an image obtained by photographing a target area, Generate a control signal for controlling one or more lighting devices associated with the target area by using the analysis information and the purpose of use of the target area. Predict the behavior of people in the target area based on the result of statistical processing of the analysis information. Generate the control signal by using the predicted result. The analysis information includes the postures of people in the target area. Lighting management method.

8. A computer Obtain analysis information based on a result estimated by using the analysis of an image obtained by photographing a target area. Generate a control signal for controlling one or more lighting devices associated with the target area by using the analysis information and the purpose of use of the target area. The analysis information includes the postures of people in the target area. The analysis information further includes personal identification information for identifying a person in the target area estimated by using the analysis of an image obtained by photographing the target area. In generating the control signal, the control signal is further generated by using an individual control pattern that defines a control pattern corresponding to the personal identification information. Lighting management method.

Images