Lighting Control Device

Abstract

To provide an illumination control device which controls an illumination device by enabling image recognition of the movement of an operator.SOLUTION: An illumination control device 5 which controls an illumination device 20 for illuminating the inside of a vehicle 1 includes: an action detection part 43 for detecting an action pattern which is the movement of a body of an operator and / or a passenger of the vehicle 1; and a determination part 40 for determining whether it is the situation requiring illumination control of the illumination device 20, based on the action pattern. The illumination control device controls the illumination device 20 based on the determination of the determination part 40.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a lighting control device for controlling a lighting device in a vehicle. [Background technology]

[0002] Conventionally, when the inside of a vehicle is dark, such as at night, the driver must manually turn on the interior light to search for luggage inside the vehicle, which is time-consuming and inconvenient. Technology for a control device that controls the lighting inside the vehicle using the voice or gestures of the vehicle occupants has been disclosed (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-171287 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, Patent Document 1 does not specifically disclose what gestures are recognized and how the lighting device is controlled. The present invention has been made in view of the above background, and has an object to provide a lighting control device that controls lighting devices by performing image recognition of the driver's movements. [Means for solving the problem]

[0005] As an embodiment for achieving the above object, there is provided a lighting control device that controls a lighting device that illuminates the interior of a vehicle, the lighting control device comprising: a behavior detection unit that detects a behavior pattern, which is the body movement of a driver and / or a passenger of the vehicle; and a judgment unit that judges whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern, the vehicle has a front reading light provided in the front part of the vehicle, the behavior detection unit has a skeleton recognition unit that recognizes a person's skeleton, the behavior pattern is estimated based on at least one of positional information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a chronological order by the skeleton recognition unit, and when the skeleton recognition unit detects that the driver's wrist has been within a first area that is upper and toward the center of the vehicle for a predetermined first period of time or more, the judgment unit judges to turn on the front reading light, and the lighting control device is controlled based on the judgment of the judgment unit. Another aspect for achieving the above-mentioned object is a lighting control device that controls a lighting device that illuminates the interior of a vehicle, the lighting control device comprising: a behavior detection unit that detects a behavior pattern, which is the body movement of a driver and / or passengers of the vehicle; and a judgment unit that judges whether or not the situation is such that lighting control of the lighting device is necessary based on the behavior pattern, the vehicle has a front leg light provided at the front legs inside the vehicle, the behavior detection unit has a skeleton recognition unit that recognizes a person's skeleton, the behavior pattern is estimated based on at least one of positional information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a chronological order by the skeleton recognition unit, and when the skeleton recognition unit recognizes that the driver's elbow has entered a second area lower and toward the center of the vehicle for a predetermined second period of time or more, the judgment unit judges to turn on the front leg light, and the lighting control device is controlled based on the judgment of the judgment unit. Another aspect for achieving the above object is a lighting control device that controls a lighting device that illuminates the interior of a vehicle, the lighting control device comprising: a behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; and a judgment unit that judges whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern, the vehicle has a passenger-side rear reading light provided on the passenger side of a rear seat in the vehicle, the behavior detection unit has a skeleton recognition unit that recognizes a person's skeleton, the behavior pattern is estimated based on at least one of positional information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a chronological order by the skeleton recognition unit, and when the skeleton recognition unit recognizes that the driver's wrist or the driver's elbow has moved to a back of the passenger seat, the judgment unit judges to turn on the passenger-side rear reading light, and controls the lighting device based on the judgment of the judgment unit. Another aspect for achieving the above object is a lighting control device that controls a lighting device that illuminates the interior of a vehicle, the lighting control device comprising: a behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; and a judgment unit that judges whether or not a situation exists where lighting control of the lighting device is to be performed based on the behavior pattern, the behavior detection unit has a skeleton recognition unit that recognizes a person's skeleton, the behavior pattern is estimated based on at least one of positional information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a chronological order by the skeleton recognition unit, the skeleton recognition unit estimates a twist of the driver's body from the positional information of the driver's shoulder and the driver's waist, the judgment unit judges whether or not a situation exists where lighting control of the lighting device is to be performed based on the twist, and the lighting control device is controlled based on the judgment of the judgment unit. As another aspect for achieving the above object, there is provided a lighting control device for controlling a lighting device for illuminating the interior of a vehicle, the lighting control device comprising: a behavior detection unit for detecting a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; and a determination unit for determining whether or not a situation exists for lighting control of the lighting device based on the behavior pattern, the behavior detection unit having a skeleton recognition unit for recognizing a skeleton of a person, and a behavior pattern prediction unit for predicting a future behavior pattern from the behavior pattern recognized in time series by the skeleton recognition unit, and controlling the lighting device based on the determination of the determination unit. the vehicle has a driver's seat side rear reading light provided on the driver's seat side of a rear seat in the vehicle, the behavior pattern is estimated based on at least one of position information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a time series manner by the skeleton recognition unit, and when the position of the driver's wrist or the driver's elbow, which is predicted by the behavior pattern prediction unit, is equal to or higher than a predetermined height, the determination unit determines to turn on the driver's seat side rear reading light. A lighting control device is an example. As another aspect for achieving the above object, there is provided a lighting control device for controlling a lighting device for illuminating the interior of a vehicle, the lighting control device comprising: a behavior detection unit for detecting a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; and a determination unit for determining whether or not a situation exists for lighting control of the lighting device based on the behavior pattern, the behavior detection unit having a skeleton recognition unit for recognizing a skeleton of a person, and a behavior pattern prediction unit for predicting a future behavior pattern from the behavior pattern recognized in time series by the skeleton recognition unit, and controlling the lighting device based on the determination of the determination unit. An example of a lighting control device is one in which the vehicle has a passenger side rear reading light provided on the passenger side of the rear seat inside the vehicle, the behavior pattern is estimated based on at least one of positional information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a chronological order by the skeletal recognition unit, and if the position of the driver's wrist or the driver's elbow, which is predicted by the behavior pattern prediction unit, is less than a predetermined height, the judgment unit judges to turn on the passenger side rear reading light. As another aspect for achieving the above object, there is provided a lighting control device for controlling a lighting device for illuminating the interior of a vehicle, the lighting control device comprising: a behavior detection unit for detecting a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; and a determination unit for determining whether or not a situation exists for lighting control of the lighting device based on the behavior pattern, the vehicle having a driver's seat side rear reading light provided on the driver's seat side of a rear seat in the vehicle, the behavior detection unit having a skeleton recognition unit for recognizing a person's skeleton, the behavior pattern being recognized in a time series by the skeleton recognition unit, the driver's shoulders and the driver's An example of a lighting control device is one in which the facial direction is estimated based on at least one of position information of the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, and the skeletal recognition unit recognizes a facial direction, which is the direction in which the driver's face is facing, from the position information of the driver's face, and if the skeletal recognition unit recognizes that the facial direction is within a predetermined first range for a predetermined third time period or more, or if the skeletal recognition unit does not recognize the driver's face, the judgment unit judges to turn on the driver's side rear reading light and controls the lighting device based on the judgment of the judgment unit. Another aspect for achieving the above object is a lighting control device that controls a lighting device that illuminates the interior of a vehicle, the lighting control device comprising: a behavior detection unit that detects a behavior pattern, which is the body movement of a driver and / or passenger of the vehicle; and a judgment unit that judges whether or not a situation exists for lighting control of the lighting device based on the behavior pattern, the vehicle having a driver's side rear reading light provided on the driver's side of a rear seat in the vehicle, the behavior detection unit having a gaze detection unit that detects a person's gaze, the gaze detection unit detects a driver's gaze direction, which is the direction of the driver's gaze, and when the gaze detection unit detects that the driver's gaze direction is within a predetermined second range for a predetermined fourth time period or more, the judgment unit judges to turn on the driver's side rear reading light, and controls the lighting device based on the judgment of the judgment unit. As another aspect for achieving the above object, there is provided a lighting control device for controlling a lighting device for illuminating the interior of a vehicle, the lighting control device including: a behavior detection unit for detecting a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; and a determination unit for determining whether or not a situation exists in which lighting control of the lighting device is required, based on the behavior pattern; the vehicle includes at least one of a driver's seat side rear reading light provided on the driver's seat side of a rear seat in the vehicle, and a passenger's seat side rear reading light provided on the passenger's seat side of a rear seat in the vehicle; and The lighting control device has a gaze detection unit that detects a person's gaze and a skeleton recognition unit that recognizes the person's skeleton, and the gaze detection unit detects a driver's gaze direction, which is the direction in which the driver is looking, and when the skeleton recognition unit recognizes from the behavior pattern that the driver is stretching his / her arms toward the rear seat, the determination unit determines to turn on the passenger side rear reading light or the driver side rear reading light at the timing when the driver's gaze direction starts to transition toward the rear seat, and controls the lighting device based on the determination of the determination unit.

[0006] In the lighting control device, the lighting device may be configured not to be turned on when the vehicle is moving at or above a predetermined speed.

[0014] In the lighting control device, The vehicle has a passenger side rear reading light provided on the passenger side of a rear seat in the vehicle, When the twist is equal to or greater than a predetermined value, the determining unit may determine to turn on the passenger seat side rear reading light. Effect of the Invention

[0022] According to the lighting control device, the lighting device in the vehicle can be controlled to be turned on or off in response to the driver's gestures and line of sight in the vehicle, thereby improving comfort inside the vehicle. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 is an explanatory diagram of a vehicle equipped with a lighting control device according to this embodiment. [Diagram 2] FIG. 2 is an explanatory diagram illustrating the relationship between the lighting control device and other devices. [Diagram 3] FIG. 3 is an explanatory diagram for explaining an aspect of image recognition of a person. [Figure 4] Figure 4 is an example of image recognition of a driver stretching his arm toward the passenger seat. [Diagram 5] Figure 5 is an example of image recognition of a driver stretching his or her arm out over the bottom of the passenger seat. [Figure 6] FIG. 6 is a flowchart illustrating the operation of the lighting control device. [Figure 7] FIG. 7 is a flowchart illustrating the operation of the lighting control device. [Figure 8] FIG. 8 is a flowchart illustrating the operation of the lighting control device. [Figure 9] FIG. 9 is a flowchart illustrating the operation of the lighting control device. [Figure 10] FIG. 10 is a flowchart illustrating the operation of the lighting control device. [Figure 11] FIG. 11 is a flowchart illustrating the operation of the lighting control device. [Figure 12] FIG. 12 is a flowchart illustrating the operation of the lighting control device. [Figure 13]FIG. 13 is a flowchart illustrating the operation of the lighting control device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] Hereinafter, the embodiments will be described in detail with reference to the drawings. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming more redundant than necessary and to facilitate understanding by those skilled in the art. It should be noted that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0025] [1. Configuration of a vehicle equipped with a lighting control device] With reference to Fig. 1, an overview of a vehicle 1 equipped with a lighting control device 5 that controls a lighting device 20 that illuminates the interior of the vehicle 1 will be described. In Fig. 1, the vehicle 1 is equipped with a driver's seat 10 in which a driver sits, a passenger seat 15 disposed adjacent to the driver's seat 10, and a rear seat 17 disposed on the opposite side of the driver's seat 10 and passenger seat 15 in the vehicle travel direction (the direction of the arrow in Fig. 1).

[0026] The lighting device 20 has a front reading light 21 that illuminates the front of the vehicle 1, a front leg light 23 that illuminates the front feet of the vehicle 1, a passenger-side rear reading light 25 that illuminates the passenger-side side 15 of the rear seat 17 in the vehicle 1, and a driver-side rear reading light 27 that illuminates the driver's seat 10 side of the rear seat 17 in the vehicle 1. The front leg light 23 may illuminate the underside of the passenger seat 15, and may also simultaneously illuminate the underside of the driver's seat 10 and the underside of the rear seat 17. The front reading light 21, the passenger-side rear reading light 25, and the driver-side rear reading light 27 may be provided on the roof of the vehicle 1. The front leg light 23 may be provided in a position that illuminates the floor below the passenger seat 15.

[0027] A lighting control device 5 that controls the lighting device 20 is disposed on a dashboard 6 provided under the windshield of the vehicle 1. The lighting control device 5 may be integrated with a DA (display audio) that is an electronic device that can be linked to a mobile terminal such as a smartphone.

[0028] [2. Configuration of lighting control device and relationship between lighting control device and other devices] The configuration of lighting control device 5 and the relationship between lighting control device 5 and other devices will be described with reference to FIG.

[0029] The lighting control device 5 includes a processor 30 that processes information, a storage unit 50 that stores information, and a lighting device control unit 60 that controls turning on and off the lighting device 20. The lighting control device 5 includes a behavior detection unit 43 that detects a behavior pattern that is the body movement of the driver 80 and / or passengers of the vehicle 1, and a determination unit 40 that determines whether or not it is a situation to control the lighting of the lighting device 20 based on the behavior pattern, and controls the lighting device 20 based on the determination of the determination unit 40. The lighting control may include, for example, control of turning on and off the lighting device 20, control of the brightness of the lighting, control of changing the color tone, specifically, whether it is a cool color or a warm color, etc.

[0030] The behavior detection unit 43 includes a skeleton recognition unit 45 that recognizes the skeleton of a person. The behavior detection unit 43 also includes a gaze detection unit 47 that detects the gaze of a person.

[0031] Here, the behavioral pattern is estimated based on any of the positional information of the driver 80's shoulders, the driver 80's elbows, the driver 80's wrists, the driver 80's waist, the driver 80's face, etc., which are recognized in a chronological order by the skeletal recognition unit 45.

[0032] The behavior pattern also includes the line of sight direction of the person detected by the lighting control device 5.

[0033] The behavior detection unit 43 includes a skeleton recognition unit 45 that recognizes a person's skeleton, and a behavior pattern prediction unit 49 that predicts a future behavior pattern from the behavior pattern recognized in time series by the skeleton recognition unit 45. The lighting control device 5 also includes a behavior pattern prediction unit 49 that predicts a future behavior pattern from the behavior pattern recognized in time series by the gaze detection unit 47.

[0034] The lighting control device 5 detects the speed of the vehicle 1. Vehicle speed detection unit 75, an imaging device 70 that captures image information in the interior of the vehicle 1, and the lighting device 20. The imaging device 70 may be included in the lighting control device 5.

[0035] The lighting control device 5 has a function of not turning on the lighting devices when the vehicle 1 is moving at a predetermined speed or higher. In addition, when the vehicle 1 is moving at a predetermined speed or higher and there is a passenger other than the driver 80, for example, when the passenger is seated in the passenger seat 15, the lighting control device 5 may not turn on the front reading light 21 or the front leg light 23. In addition, for example, when a passenger is seated in the rear seat 17, the lighting control device 5 may not turn on the passenger side rear reading light 25 or the driver side rear reading light 27.

[0036] The imaging device 70 may be a near-infrared camera capable of detecting light in the infrared region, or may be a LIDAR (Laser Imaging Detection and Ranging). The imaging device 70 may be any device capable of detecting the movement of an occupant, and may be, for example, an ultrasonic sensor.

[0037] The lighting control device 5 in the present disclosure may be any device capable of controlling the device in the present disclosure. The processor 30 reads the program from the program storage area 55 of the storage unit 50 storing the program, and the processor 30 executes the program, thereby enabling various processes to be executed. For this reason, the processing contents can be changed by changing the program stored in the storage unit 50, so that the degree of freedom in changing the control contents can be increased. Examples of the processor include a CPU (Central Processing Unit) and an MPU (Micro-Processing Unit). Examples of the storage medium of the storage unit 50 include a hard disk, a flash memory, and an optical disk. In addition, the lighting control device 5 may use a wired logic in which the program cannot be rewritten. Using the wired logic as the lighting control device 5 is effective in improving the processing speed. Examples of the wired logic include an ASIC (Application Specific Integrated Circuit). In addition, the lighting control device 5 may be realized by combining the processor 30 and the wired logic. If the lighting control device 5 is realized by combining the processor and the wired logic, the degree of freedom in software design can be increased while the processing speed can be improved. Furthermore, the lighting control device 5 and a circuit having a different function from the lighting control device 5 may be configured with a single semiconductor element. An example of a circuit having a different function is an A / D-D / A conversion circuit. Furthermore, the lighting control device 5 may be configured with a single semiconductor element, or may be configured with multiple semiconductor elements. When configured with multiple semiconductor elements, each control described in the claims may be realized by a different semiconductor element. Furthermore, the lighting control device 5 may be configured with a configuration including a semiconductor element and a passive component such as a resistor or a capacitor.

[0038] Specifically, using programs and data stored in the behavior pattern memory area 53, the program memory area 55, etc. of the memory unit 50, the processor 30 realizes the functions of the judgment unit 40, the behavior detection unit 43, the skeleton recognition unit 45, the behavior pattern prediction unit 49, and the gaze detection unit 47.

[0039] The processor 30 and the storage unit 50 may be provided inside the vehicle 1, or may be provided in an information processing device disposed outside the vehicle 1 and connected to the vehicle 1 via wireless communication, that is, in a so-called external server. Of course, a mobile terminal carried by an occupant of the vehicle 1 may realize the functions of the lighting control device 5, the imaging device 70, the lighting device control unit 60, etc., and control the lighting device 20. [3. Image Recognition] The image recognition performed by lighting control device 5 will be described with reference to FIG.

[0040] Image recognition is to analyze an image and recognize the meaning of the image. Specifically, in this specification, it is realized by a program for detecting and recognizing the body movement, gestures, change in line of sight, etc. of the occupant of the vehicle 1, represented by the driver 80, from an image and controlling the lighting device 20.

[0041] In recent years, image recognition has made rapid development, and it has become easy to visualize the movement of a person in an image, especially by using a method using deep learning. For example, even a general public program called OpenPose can detect the position of a person's skeleton and joints and recognize the movement of the arms, shoulders, etc. FIG. 3 is a schematic diagram of the result of recognizing a person's skeleton. Joints, which are characteristic points, are represented by white circles, and the movement of the skeleton between the joints is recognized. Specifically, the skeleton recognition unit 45 of the lighting control device 5 recognizes the positions of each part of the driver's body 80, such as the right eye 82, the left eye 84, the right ear 86, the left ear 88, the nose 90, the neck 92, the right shoulder 93, the left shoulder 95, the right elbow 97, the left elbow 99, the right waist 101, the left waist 103, the right wrist 105, and the left wrist 107. Then, the movement of each part is recognized in time series according to the driver's movement and gestures. Note that recognition here includes enabling the lighting control device 5 to acquire and use position information of each part.

[0042] Fig. 4 shows an example in which the skeleton recognition unit 45 of the lighting control device 5 recognizes, using image recognition, a case in which a driver 80 seated in the driver's seat 10 stretches out his right hand to search above the passenger seat 15. Figs. 4 and 5 are schematic diagrams of the inside of the vehicle 1 viewed from the windshield side of the vehicle 1 with the driver 80 seated in the driver's seat 10.

[0043] When the skeleton recognition unit 45 recognizes that the right wrist 105 of the driver 80 remains in the predetermined first area A for a predetermined first time, the determination unit 40 determines to turn on the front reading light 21, and the lighting device control unit 60 controls to turn on the front reading light 21 included in the lighting device 20. The first area A may be determined as a predetermined area in the image captured by the imaging device 70. The first time may be, for example, two seconds. FIG. 5 shows an example in which the skeletal recognition unit 45 of the lighting control device 5 recognizes the body of the driver 80 by using image recognition when the driver 80 seated in the driver's seat 10 stretches out his right hand to search the lower part of the passenger seat 15. When the skeletal recognition unit 45 recognizes that the right elbow 97 of the driver 80 remains in the predetermined second area B for a predetermined second time, the determination unit 40 determines to turn on the front leg light 23, and the lighting device control unit 60 controls to turn on the front leg light 23 included in the lighting device 20. The second area B may be determined as a predetermined area in the image captured by the imaging device 70. The second time may be, for example, two seconds. Of course, the determination by the determination unit 40 may be made based on the movements of multiple parts of the body. Specifically, based on the movements of the right elbow 97, the right wrist 105, and the nose 90, it may be recognized and determined whether the driver 80 is searching above the passenger seat 15 or below the passenger seat 15.

[0044] [4. Control operation of lighting devices] The control operation of the lighting device 20 by the lighting control device 5 will be described with reference to the flowcharts shown in Fig. 6 to Fig. 13. Each of the controls described in Fig. 6 to Fig. 13 may be performed independently, or a plurality of controls may be combined. Of course, the combination of the behavior patterns of each part of the body of the driver 80 recognized by the skeleton recognition unit 45 and the gaze detection unit 47 and the control is not limited to the combinations described in this embodiment, and various other modes are possible.

[0045] FIG. 6 is a flowchart explaining the operation of the lighting control device 5. The skeleton recognition unit 45 performs image recognition of the skeleton of the person in the vehicle 1 from the image acquired by the imaging device 70. Specifically, the skeleton recognition unit 45 performs image recognition of the movement of the driver 80 (step SA1). For example, if the determination unit 40 determines that the right wrist 105 of the driver 80 has been in the first area A for the first time or more (step SA2: YES), the determination unit 40 determines to turn on the front reading light 21, and based on the determination, the lighting device control unit 60 controls the lighting device 20 to turn on the front reading light 21 (step SA3). The time during which the lighting device control unit 60 turns on the front reading light 21 may be limited to, for example, 30 seconds, and the light may be turned off after that. If the determination unit 40 determines that the right wrist 105 of the driver 80 has not been in the first area A for the first time or more (step SA2: NO), the process returns to step SA1.

[0046] FIG. 7 is a flowchart explaining the operation of the lighting control device 5. The skeleton recognition unit 45 performs image recognition of the skeleton of the person in the vehicle 1 from the image acquired by the imaging device 70. Specifically, the skeleton recognition unit 45 performs image recognition of the movement of the driver 80 (step SB1). For example, if the determination unit 40 determines that the right elbow 97 of the driver 80 has been in the second area B for more than the second time (step SB2: YES), the determination unit 40 determines to turn on the front leg light 23, and based on the determination, the lighting device control unit 60 controls the lighting device 20 to turn on the front leg light 23 (step SB3). The time during which the lighting device control unit 60 turns on the front leg light 23 may be limited to, for example, 30 seconds, and the light may be turned off after that. If the determination unit 40 determines that the right elbow 97 of the driver 80 has not been in the second area B for more than the second time (step SB2: NO), the process returns to step SB1.

[0047] FIG. 8 is a flowchart explaining the operation of the lighting control device 5. The skeleton recognition unit 45 performs image recognition of the skeleton of the person in the vehicle 1 from the image acquired by the imaging device 70. Specifically, the skeleton recognition unit 45 performs image recognition of the movement of the driver 80 (step SC1). For example, if the determination unit 40 determines that the right wrist 105 of the driver 80 is in the back of the passenger seat 15 for, for example, 3 seconds or more (step SC2: YES), the determination unit 40 determines to turn on the passenger side rear reading light 25, and based on the determination, the lighting device control unit 60 controls the lighting device 20 to turn on the passenger side rear reading light 25 (step SC3). The time for which the lighting device control unit 60 turns on the passenger side rear reading light 25 may be limited to, for example, 30 seconds, and then the light may be turned off. When the determination unit 40 determines that the right wrist 105 of the driver 80 has not been on the back of the passenger seat 15 for, for example, three seconds or more (step SC2: NO), the process returns to step SC1.

[0048] FIG. 9 is a flowchart explaining the operation of the lighting control device 5. The skeleton recognition unit 45 performs image recognition of the skeleton of the person in the vehicle 1 from the image acquired by the imaging device 70. Specifically, the skeleton recognition unit 45 performs image recognition of the movement of the driver 80 (step SD1). Next, the skeleton recognition unit 45 estimates the body twist of the driver 80 (step SD2). Specifically, the skeleton recognition unit 45 estimates the body twist of the driver 80 from the position information of the shoulders and waist of the driver 80 obtained from the image acquired by the imaging device 70, and the judgment unit 40 judges the lighting device 20 to be turned on and / or off based on the twist. The twist may be quantified by, for example, the angle between the straight line connecting the right shoulder 93 and the left shoulder 95 and the straight line connecting the right waist 101 and the left waist 103. If the driver 80's body twist is equal to or greater than a predetermined value (step SD3), the lighting control device 5 causes the lighting device control unit 60 to turn on the passenger-side rear reading light 25 (step SD4). The lighting device control unit 60 may turn on the passenger-side rear reading light 25 for a period of time limited to, for example, 30 seconds, after which the light is turned off. The state in which the twist is at a predetermined value refers to, for example, a state in which the angle between the line connecting the right shoulder 93 and the left shoulder 95 and the line connecting the right hip 101 and the left hip 103 is 45 degrees. If the driver 80's body twist is less than the predetermined value (step SD3: NO), the lighting control device 5 returns to step SD1 without turning on the lighting device 20.

[0049] FIG. 10 is a flowchart for explaining the operation of the lighting control device 5. The skeleton recognition unit 45 performs image recognition of the skeleton of the person in the vehicle 1 from the image acquired by the imaging device 70. Specifically, the skeleton recognition unit 45 performs image recognition of the movement of the driver 80. Next, the behavior pattern prediction unit 49 predicts the future position of the right wrist 105 or the right elbow 97 of the driver 80 (step SE1). Specifically, for example, the skeleton recognition unit 45 performs image recognition of the movement of the driver 80 every 0.5 seconds, and estimates the positions of each part of the body 0.5 seconds and 1 second later from the positions of each part of the body 1.5 seconds ago, the positions of each part of the body 1 second ago, the positions of each part of the body 0.5 seconds ago, and the current positions of each part of the body. Next, the determination unit 40 determines whether the predicted position of the right wrist 105 of the driver 80 or the right elbow 97 of the driver 80 is equal to or higher than a predetermined height (step SE2). If the predicted position is equal to or higher than the predetermined height (step SE2: YES), the lighting control device 5 controls the lighting device control unit 60 to turn on the driver's side rear reading light 27 (step SE3). The time period for which the lighting device control unit 60 turns on the driver's side rear reading light 27 may be limited to, for example, 30 seconds, after which the light is turned off. If the predicted position is lower than the predetermined height (step SE2: NO), the lighting control device 5 controls the lighting device control unit 60 to turn on the passenger's side rear reading light 25 (step SE4). The time period for which the lighting device control unit 60 turns on the passenger's side rear reading light 25 may be limited to, for example, 30 seconds, after which the light is turned off.

[0050] 11 is a flowchart explaining the operation of the lighting control device 5. The skeleton recognition unit 45 performs image recognition of the skeleton of the person in the vehicle 1 from the image acquired by the imaging device 70 (step SF1). Here, the skeleton recognition unit 45 performs image recognition of the direction of the face of the driver 80. Specifically, the skeleton recognition unit 45 recognizes the facial direction of the driver 80 from the position information of the right eye 82, the position information of the left eye 84, the position information of the right ear 86, the position information of the left ear 88, the position information of the nose 90, and the like (step SF2). The facial direction may be defined by the angle formed by the straight line connecting the right ear 86 and the left ear 88 and the straight line connecting the right waist 101 and the left waist 103. When the face of the driver 80 can be recognized, specifically, when the driver 80 is showing his / her face to the imaging device 70 (step SF3: YES), the determination unit 40 determines whether the face direction of the driver 80 is within the first range for a third time or more (step SF4). Here, the third time is, for example, 3 seconds. The state of being within the first range is, for example, a state in which the angle between the line connecting the right ear 86 and the left ear 88 and the line connecting the right hip 101 and the left hip 103 is, for example, 90 degrees or more. When the determination unit 40 determines that the driver 80 is showing his / her face to the imaging device 70 (step SF4: YES), the lighting control device 5 uses the lighting device control unit 60 to control the lighting device 20 and turn on the driver's seat side rear reading light 27 (step SF5). The time for which the lighting device control unit 60 turns on the driver's seat side rear reading light 27 may be limited to, for example, 30 seconds, and then the light may be turned off.

[0051] When the determination unit 40 determines that the face direction of the driver 80 is not within the first range for the third time period or longer (step SF4: NO), the process returns to step SF1.

[0052] If the face of the driver 80 cannot be recognized, specifically if the driver 80 is not showing his / her face to the imaging device 70 (step SF3: NO), the lighting control device 5 uses the lighting device control unit 60 to control the lighting device 20 to turn on the driver's seat side rear reading light 27 (step SF5). The time for which the lighting device control unit 60 turns on the driver's seat side rear reading light 27 may be limited to, for example, 30 seconds, after which the light is turned off.

[0053] FIG. 12 is a flowchart explaining the operation of the lighting control device 5. The line-of-sight detection unit 47 performs image recognition of the line-of-sight direction of a person in the vehicle 1 from an image acquired by the imaging device 70. Specifically, the line-of-sight detection unit 47 detects the driver's line-of-sight direction, which is the line-of-sight direction of the driver 80 (step SG1). Next, the determination unit 40 determines whether the driver's line-of-sight direction is within a predetermined second range (step SG2). Here, the second range is, for example, the direction toward the driver's seat 10 of the rear seat 17. If the driver's line-of-sight direction is within the predetermined second range (step SG2: YES), the lighting control device 5 uses the lighting device control unit 60 to control the lighting device 20 and turn on the driver's seat-side rear reading light 27 (step SG3). The time during which the lighting device control unit 60 turns on the driver's seat-side rear reading light 27 may be limited to, for example, 30 seconds, and then the light may be turned off.

[0054] If the driver's line of sight direction is not within the predetermined second range (step SG2: NO), the process returns to step SG1.

[0055] FIG. 13 is a flowchart for explaining the operation of the lighting control device 5. The skeleton recognition unit 45 performs image recognition of the skeleton of the person in the vehicle 1 from the image acquired by the imaging device 70. Specifically, the skeleton recognition unit 45 performs image recognition of the movement of the driver 80 (step SH1). Next, the gaze detection unit 47 performs image recognition of the gaze direction of the person in the vehicle 1 from the image acquired by the imaging device 70. Specifically, the gaze detection unit 47 detects the driver's gaze direction, which is the gaze direction of the driver 80 (step SH2). Then, the determination unit 40 determines whether the driver 80 stretches his arm toward the back seat 17 (step SH3). Specifically, for example, it is determined whether the right arm of the driver 80 is stretched toward the back seat 17 from the position information of the right shoulder 93, the position information of the right elbow 97, and the position information of the right wrist 105 of the driver 80. If it is determined that the driver 80 is stretching his / her arm toward the rear seat 17 (step SH3: YES), the determination unit 40 determines whether the driver's line of sight has started to transition toward the rear seat 17 (step SH4). If it is determined that the driver's line of sight has started to transition toward the rear seat 17 (step SH4: YES), the lighting control device 5 uses the lighting device control unit 60 to control the lighting device 20 to turn on the driver's side rear reading light 27 (step SH5). The time that the lighting device control unit 60 turns on the driver's side rear reading light 27 may be limited to, for example, 30 seconds, after which the light is turned off.

[0056] If it is not determined that the driver 80 is stretching his / her arms toward the rear seat 17 (step SH3: NO), the process returns to step SH1. If it is not determined that the driver's line of sight direction has started to transition toward the rear seat 17 (step SH4: NO), the process returns to step SH1.

[0057] [5. Configuration supported by the above embodiment] The above embodiment is a specific example of the following configuration.

[0058] (Item 1) A lighting control device that controls a lighting device that illuminates the interior of a vehicle, comprising: a behavior detection unit that detects behavioral patterns, which are body movements of a driver and / or passengers of the vehicle; and a judgment unit that judges whether or not a situation exists in which lighting control of the lighting device is appropriate, based on the behavioral pattern; and controls the lighting device based on the judgment of the judgment unit. According to the lighting control device of the first aspect, lighting devices in a vehicle can be controlled to be turned on or off in response to the driver's gestures and line of sight in the vehicle, thereby improving comfort inside the vehicle.

[0059] (2) The lighting control device according to claim 1, characterized in that the lighting device is not turned on when the vehicle is moving at or above a predetermined speed. According to the lighting control device of the second paragraph, since the lighting device is not turned on when the vehicle is moving at a speed equal to or faster than a predetermined speed, the phenomenon that the outside world is obscured due to the lighting device in the vehicle being turned on is less likely to occur. Therefore, an effect is achieved that the driver's view of the outside world is less likely to be obstructed.

[0060] (3) The lighting control device described in paragraph 1 or 2, characterized in that the vehicle has any one of a front reading light provided in the front of the vehicle, a front leg light provided in the front leg area of ​​the vehicle, a driver's side rear reading light provided on the driver's side of the rear seat in the vehicle, and a passenger's side rear reading light provided on the passenger's side of the rear seat in the vehicle. According to the lighting control device of paragraph 3, even if the lighting device arranged in the vehicle has a plurality of lighting lamps, it has an excellent effect of being able to selectively control the lighting lamps by the driver's gestures.

[0061] (4) The lighting control device according to claim 3, wherein the behavior detection unit has a skeleton recognition unit that recognizes a person's skeleton. According to the lighting control device of paragraph 4, image recognition technology is used to recognize a person's skeletal structure, thereby enabling the driver's gestures to be accurately recognized, resulting in the excellent effect of the lighting control device being able to accurately control the turning on and off of multiple lighting lamps.

[0062] (Clause 5) The lighting control device described in clause 4, characterized in that the behavior pattern is estimated based on at least one of positional information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a chronological order by the skeletal recognition unit. According to the lighting control device of paragraph 5, the driver's gestures can be captured from the characteristics of the movements of the driver's key parts of the body, making it possible to accurately recognize the gestures, thereby achieving the excellent effect of enabling accurate control of turning multiple lighting lamps on and off.

[0063] (Item 6) The lighting control device described in Item 5, characterized in that when the skeletal recognition unit detects that the driver's wrist is within a first area located above the center of the vehicle for a predetermined first period of time or longer, the judgment unit judges to turn on the front reading light. According to the lighting control device of paragraph 6, it is possible to control the front reading light that illuminates the passenger seat to be turned on in response to the driver's natural gesture of stretching his / her arm toward the passenger seat to look for luggage, etc., thereby achieving the excellent effect of allowing the driver to operate the front reading light without having to memorize any special gestures.

[0064] (Clause 7) A lighting control device as described in clause 5 or 6, characterized in that when the skeletal recognition unit recognizes that the driver's elbow is within a second area that is lower and toward the center of the vehicle for a predetermined second predetermined time or longer, the judgment unit judges to turn on the front leg lights. According to the lighting control device of paragraph 7, it is possible to control the turning on of the front leg lights that illuminate the lower part of the passenger seat in response to the driver's natural gesture of stretching his / her arm under the passenger seat to search for luggage, etc., thereby achieving the excellent effect of allowing the front leg lights to be operated without having to memorize any special gestures.

[0065] (Item 8) A lighting control device as described in any one of items 5 to 7, characterized in that when the skeletal recognition unit recognizes that the driver's wrist or the driver's elbow has moved toward the back of the passenger seat, the judgment unit judges to turn on the passenger side rear reading light. According to the lighting control device of paragraph 8, it is possible to control the passenger side rear reading light, which illuminates the rear passenger seat, to be turned on in response to the driver's natural gesture of stretching his / her arm toward the rear of the passenger seat to look for luggage, etc., thereby achieving the excellent effect of allowing the passenger side rear reading light to be operated without having to memorize any special gestures.

[0066] (Item 9) A lighting control device as described in any one of items 5 to 8, characterized in that the skeletal recognition unit estimates a twist of the driver's body from position information of the driver's shoulders and the driver's waist, and the judgment unit judges whether or not a situation exists in which lighting control of the lighting device is to be performed based on the twist. According to the lighting control device of paragraph 9, the lighting device can be controlled by recognizing the twisting of the driver's body. seat Lateral rear Club Therefore, it is possible to accurately determine which of the two is being searched for, thereby improving comfort inside the vehicle.

[0067] (Item 10) The lighting control device described in item 9, characterized in that when the twist is equal to or greater than a predetermined value, the judgment unit judges to turn on the passenger side rear reading light. According to the lighting control device of the tenth aspect, the passenger side rear reading light that illuminates the passenger side rear seat can be controlled to be turned on in response to the driver's natural gesture of stretching his / her arm toward the passenger side rear to look for luggage, etc., so that the passenger side rear reading light can be operated without memorizing any special gesture, thereby improving comfort inside the vehicle.

[0068] (Item 11) A lighting control device described in any one of items 5 to 10, characterized in that it includes a behavior pattern prediction unit that predicts future behavior patterns from the behavior patterns recognized in time series by the skeleton recognition unit. According to the lighting control device of paragraph 11, the behavior pattern of the driver can be predicted at the early stage of the movement of searching for luggage, so that the lighting is already on when the driver actually searches for luggage. Therefore, it is possible to smoothly search for luggage without waiting time.

[0069] (Item 12) The lighting control device described in Item 11, characterized in that when the position of the driver's wrist or elbow predicted by the behavior pattern prediction unit is at or above a predetermined height, the judgment unit makes a judgment to turn on the driver's side rear reading light. According to the lighting control device of paragraph 12, the driver's rear reading light that illuminates the rear seat on the driver's side can be controlled to be turned on in response to the initial stage of the driver's natural gesture of stretching his / her arm toward the rear of the driver's seat to search for luggage, etc., so that the driver's rear reading light can be controlled early without memorizing a special gesture, thereby improving comfort inside the vehicle.

[0070] (Clause 13) A lighting control device as described in clause 11 or 12, characterized in that when the position of the driver's wrist or elbow predicted by the behavior pattern prediction unit is less than a predetermined height, the judgment unit judges to turn on the passenger side rear reading light. According to the lighting control device of paragraph 13, the passenger side rear reading light that illuminates the passenger side rear seat can be controlled to be turned on in response to the initial stage of the driver's natural gesture of stretching his / her arm toward the rear of the driver's seat to search for luggage, etc., so that the passenger side rear reading light can be controlled early without memorizing a special gesture, thereby improving comfort inside the vehicle.

[0071] (Clause 14) A lighting control device as described in any one of clauses 5 to 13, characterized in that the skeleton recognition unit recognizes a facial direction, which is the direction in which the driver's face is facing, from position information of the driver's facial area, and if the skeleton recognition unit recognizes that the facial direction is within a predetermined first range for a predetermined third time period or more, or if the skeleton recognition unit does not recognize the driver's face, the judgment unit makes a judgment to turn on the driver's side rear reading light. According to the lighting control device of paragraph 14, the driver's side rear reading light can be controlled according to the movement of the driver's face, so that the lighting device can be controlled even when the lighting control device cannot recognize the movement of the driver's wrist or elbow, thereby improving comfort inside the vehicle.

[0072] (Item 15) The lighting control device according to item 5, wherein the behavior detection unit has a gaze detection unit that detects a person's gaze. According to the lighting control device of the fifth aspect, it is possible to control the lighting device according to the line of sight of the driver, not the movement of the driver's arms or torso. Therefore, comfort inside the vehicle is improved.

[0073] (Item 16) The lighting control device described in Item 15, characterized in that the gaze detection unit detects a driver's gaze direction, which is the direction of the driver's gaze, and if the gaze detection unit detects that the driver's gaze direction is within a predetermined second range for a predetermined fourth time period or longer, the judgment unit makes a judgment to turn on the driver's side rear reading light. According to the lighting control device of paragraph 16, it is possible to control the driver's seat rear reading light that illuminates the rear seat on the driver's seat side to be turned on in accordance with the driver's natural line of sight when stretching his / her arm toward the rear of the driver's seat side to search for luggage, etc., so that the driver can operate the driver's seat rear reading light without memorizing any special gestures, thereby improving comfort inside the vehicle.

[0074] (Clause 17) The lighting control device described in clause 15 or 16, characterized in that the gaze detection unit detects a driver's gaze direction, which is the direction in which the driver is looking, and when the skeleton recognition unit recognizes from the behavior pattern that the driver is stretching his / her arms toward the rear seat, the judgment unit determines to turn on the passenger side rear reading light or the driver side rear reading light at the time when the driver's gaze direction starts to transition toward the rear seat. According to the lighting control device of paragraph 17, the driver's rear reading light that illuminates the driver's rear seat can be controlled to be turned on in response to the driver's gaze turning toward the driver's rear and the initial stage of the natural gesture of stretching out one's arm and beginning to look toward the driver's rear, so that the driver's rear reading light can be controlled early without memorizing any special gestures, thereby improving comfort inside the vehicle.

[0075] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. In addition, it is also possible to combine the components described in the above embodiments to create new embodiments.

[0076] For example, the step units of the control operation shown in Fig. 6 to Fig. 13 are divided according to the main processing contents in order to facilitate understanding of the operation of each part of the lighting control device 5, and the present invention is not limited by the manner in which the processing units are divided or the names thereof. The processing units may be further divided into more step units according to the processing contents. Furthermore, one step unit may be further divided to include more processing. Furthermore, the order of the steps may be appropriately changed within a range that does not impede the spirit of the present invention. [Explanation of symbols]

[0077] 1 vehicle 5 Lighting control device 10 Driver's seat 15 Passenger seat 17 Back Seat 20 Lighting Equipment 21 Front reading light 23 Front leg light 25 Passenger side rear reading light 27 Driver's side rear reading light 30 processors 40 Judgment section 43 Behavior Detection Unit 45 Skeleton Recognition Unit 47 Gaze detection unit 49 Behavioral Pattern Prediction Department 50 Storage section 53 Behavioral pattern memory area 55 Program Memory Area 60 Lighting device control section 70 Imaging Device 75 Vehicle speed detection unit 80 Driver 82 Right eye 84 Left Eye 86 Right ear 88 Left Ear 90 Nose 92 Neck 93 Right shoulder 95 Left shoulder 97 Right elbow 99 Left elbow 101 Right waist 103 Left waist 105 Right hand head 107 Left Hand Head A. Field 1 B. Second area

Claims

1. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with the vehicle has a front reading light provided at a front portion of the vehicle; The behavior detection unit has a skeleton recognition unit that recognizes a skeleton of a person, the behavioral pattern is estimated based on at least one of position information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a time-series manner by the skeleton recognition unit; When the skeleton recognition unit detects that the wrist of the driver is within a first region on the upper side near the center of the vehicle for a predetermined first time or more, the determination unit determines to turn on the front reading light, A lighting control device comprising: a lighting control unit that controls the lighting device based on a determination by the determination unit.

2. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with The vehicle has a front leg light provided at a front leg area inside the vehicle, The behavior detection unit has a skeleton recognition unit that recognizes a skeleton of a person, the behavioral pattern is estimated based on at least one of position information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a time-series manner by the skeleton recognition unit; When the skeleton recognition unit recognizes that the elbow of the driver is within a second region on a lower side near the center of the vehicle for a predetermined second time or more, the determination unit determines to turn on the front leg lights, A lighting control device comprising: a lighting control unit that controls the lighting device based on a determination by the determination unit.

3. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with The vehicle has a passenger side rear reading light provided on the passenger side of a rear seat in the vehicle, The behavior detection unit has a skeleton recognition unit that recognizes a skeleton of a person, the behavioral pattern is estimated based on at least one of position information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a time-series manner by the skeleton recognition unit; When the skeleton recognition unit recognizes that the wrist or the elbow of the driver has moved to the back of the passenger seat, the determination unit determines to turn on the passenger seat side rear reading light, A lighting control device comprising: a lighting control unit that controls the lighting device based on a determination by the determination unit.

4. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with The behavior detection unit has a skeleton recognition unit that recognizes a skeleton of a person, the behavioral pattern is estimated based on at least one of position information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a time-series manner by the skeleton recognition unit; the skeleton recognition unit estimates a twist of the body of the driver from position information of the shoulders and the waist of the driver, and determines whether or not the determination unit is in a situation to perform lighting control of the lighting device based on the twist; A lighting control device comprising: a lighting control unit that controls the lighting device based on a determination by the determination unit.

5. The vehicle has a passenger side rear reading light provided on the passenger side of a rear seat in the vehicle, 5. The lighting control device according to claim 4, wherein the determining unit determines to turn on the passenger seat side rear reading light when the twist is equal to or greater than a predetermined value.

6. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with The behavior detection unit has a skeleton recognition unit that recognizes a skeleton of a person, a behavior pattern prediction unit that predicts a future behavior pattern from the behavior pattern recognized in time series by the skeleton recognition unit, Controlling the lighting device based on the determination by the determination unit; The vehicle has a driver's seat side rear reading light provided on the driver's seat side of a rear seat in the vehicle, the behavioral pattern is estimated based on at least one of position information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a time series manner by the skeleton recognition unit; When the position of the wrist or the elbow of the driver predicted by the behavior pattern prediction unit is equal to or higher than a predetermined height, the determination unit determines to turn on the driver's seat side rear reading light. A lighting control device comprising:

7. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with The behavior detection unit has a skeleton recognition unit that recognizes a skeleton of a person, a behavior pattern prediction unit that predicts a future behavior pattern from the behavior pattern recognized in time series by the skeleton recognition unit, Controlling the lighting device based on the determination by the determination unit; The vehicle has a passenger side rear reading light provided on the passenger side of a rear seat in the vehicle, the behavioral pattern is estimated based on at least one of position information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a time series manner by the skeleton recognition unit; When the position of the wrist or the elbow of the driver predicted by the behavior pattern prediction unit is less than a predetermined height, the determination unit determines to turn on the passenger side rear reading light. A lighting control device comprising:

8. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with The vehicle has a driver's seat side rear reading light provided on the driver's seat side of a rear seat in the vehicle, The behavior detection unit has a skeleton recognition unit that recognizes a skeleton of a person, the behavioral pattern is estimated based on at least one of position information of the driver's shoulder, the driver's elbow, the driver's wrist, the driver's waist, and the driver's face, which are recognized in a time series manner by the skeleton recognition unit; the skeleton recognition unit recognizes a facial direction, which is a direction in which the face of the driver is facing, from position information of the face of the driver; Furthermore, when the skeleton recognition unit recognizes that the face direction is within a predetermined first range for a predetermined third time period or more, or when the skeleton recognition unit does not recognize the face of the driver, the determination unit determines to turn on the driver's seat side rear reading light, A lighting control device comprising: a lighting control unit that controls the lighting device based on a determination by the determination unit.

9. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with The vehicle has a driver's seat side rear reading light provided on the driver's seat side of a rear seat in the vehicle, The behavior detection unit has a gaze detection unit that detects a gaze of a person, The gaze detection unit detects a driver's gaze direction, which is a gaze direction of the driver, Furthermore, when the line of sight detection unit detects that the driver's line of sight direction is within a predetermined second range for a predetermined fourth time period or more, the determination unit determines to turn on the driver's seat side rear reading light, A lighting control device comprising: a lighting control unit that controls the lighting device based on a determination by the determination unit.

10. A lighting control device that controls a lighting device that illuminates the interior of a vehicle, A behavior detection unit that detects a behavior pattern, which is a body movement of a driver and / or a passenger of the vehicle; a determination unit that determines whether or not a situation exists in which lighting control of the lighting device is required based on the behavior pattern; Equipped with The vehicle has at least one of a driver's seat side rear reading light provided on the driver's seat side of a rear seat in the vehicle, and a passenger's seat side rear reading light provided on the passenger's seat side of a rear seat in the vehicle, the behavior detection unit includes a gaze detection unit that detects a gaze of a person and a skeleton recognition unit that recognizes a skeleton of the person; The gaze detection unit detects a driver's gaze direction, which is a gaze direction of the driver, When the skeleton recognition unit recognizes from the behavior pattern that the driver is stretching his / her arm toward the rear seat, the determination unit determines to turn on the passenger seat side rear reading light or the driver seat side rear reading light at a timing when the driver's line of sight direction starts to transition toward the rear seat, A lighting control device comprising: a lighting control unit that controls the lighting device based on a determination by the determination unit.

11. 11. The lighting control device according to claim 1, wherein the lighting device is not turned on when the vehicle is moving at a speed equal to or faster than a predetermined speed.

Images