Interior part control device and interior part control method

Abstract

Provided is an interior part control device for controlling an interior part installed in a vehicle cabin, wherein the interior part control device comprises: an image acquisition unit 71 that acquires a captured image from a camera that captures an image of the inside of the vehicle cabin; an identification unit 72 that identifies a behavior of an occupant from the captured image; and a notification control unit 73 that controls a notification device, which is installed corresponding to the interior part and outputs a notification recognizable by the occupant. When the behavior identified by the identification unit 72 is a particular behavior relative to the interior part, the notification control unit 73 outputs to the notification device a notification command to make a notification.

Description

[Technical Field]

[0001] The present invention relates to an interior part control device and an interior part control method. [Background technology]

[0002] One-touch open / close operation vehicle cup holders are known (for example, see Patent Document 1). In the vehicle cup holder described in Patent Document 1, when a vehicle occupant wants to store a beverage container in the storage compartment with the cover open in a dark place such as at night, an LED provided in the lamp unit is turned on, and the light emitted from the LED is diffused widely along the guide lens and irradiated via the illumination protrusion. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2018-522781 Summary of the Invention [Problem to be solved by the invention]

[0004] In order to use the vehicle cup holder described in Patent Document 1 in a dark place, container In addition to the act of placing the LED in the cup holder's storage compartment, the occupant must also perform an operation to turn on the LED, which results in the problem that the occupant spends more time looking at interior components such as the cup holder.

[0005] An object of the present invention is to provide an interior part control device and an interior part control method that shorten the time required to look at interior parts. [Means for solving the problem]

[0006] The present invention solves the above problem by obtaining an image from a camera, identifying the occupant's behavior from the image, controlling a notification device that is provided corresponding to an interior part and outputs a notification that can be recognized by the occupant, and if the identified behavior is a specific behavior toward the interior part, outputting a notification command to the notification device to issue a notification. [Effects of the Invention]

[0007] According to the present invention, the time required to look at interior parts can be reduced. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram illustrating an example of an interior part control system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a perspective view of the interior part of FIG. 1. [Figure 3] 2 is a flowchart showing a controller control process in FIG. 1; [Figure 4] 4 is a flowchart showing a sub-flow of step S40 shown in FIG. 3. DETAILED DESCRIPTION OF THE INVENTION

[0009] First Embodiment Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a block diagram showing an example of an interior part control system according to this embodiment. The interior part control system is a system installed in a vehicle, which identifies the behavior of an occupant from an image captured by an on-board camera, and controls notification devices installed corresponding to the on-board interior parts in accordance with the identified behavior so that the user can recognize the position and state of the on-board interior parts within the vehicle cabin.

[0010] Vehicle interior components, such as cup holders, are components used by occupants in the vehicle cabin. When an occupant places a beverage container they are holding in a cup holder or removes a beverage container from the cup holder, the occupant directs their gaze toward the cup holder to determine its location within the vehicle. When the vehicle interior is dark, such as at night, or when the occupant is riding in a vehicle that is unfamiliar to them, it takes time to determine the location of the beverage container. For example, to determine the location of the cup holder while facing forward, the driver must direct their gaze in a direction away from the front, i.e., the time during which their gaze deviates from its original direction (hereinafter also referred to as gaze deviation time) becomes longer. Furthermore, to make it easier for occupants to determine the location of the cup holder in dark places, a light can be installed in the cup holder. However, if the occupant needs to operate the light to turn it on and off, this places an operational burden on the occupant and increases the gaze deviation time due to the operation required to turn the light on and off. In addition, by turning the cup holder light on and off in conjunction with the on / off of the vehicle's power switch (ignition switch, main switch), the operation of turning the light on and off can be eliminated. However, since the cup holder light remains on for a long period of time even when the passenger is not using the cup holder, this may affect the driver's driving and is best avoided from the perspective of comfort inside the vehicle.

[0011] The interior part control system in this embodiment is provided with a notification device corresponding to an in-vehicle interior part, identifies the behavior of an occupant from an image captured by an in-vehicle camera, and if the identified behavior is a specific behavior with respect to the interior part, RideThe interior part control system transmits a notification command to the notification device to output a notification that can be recognized by the occupant. For example, if the specific behavior with respect to the interior part is "an occupant drinking from a beverage container in their hand," the interior part control system identifies the specific behavior by detecting the occupant's face, hands, and beverage container from the captured image. Then, if the specific behavior is identified, the interior part control system transmits a notification command to the cup holder lighting device to turn on the light, for example, so that the cup holder light is turned on. This prevents the cup holder light from being turned on for a long time when the vehicle interior is dark, and allows the occupant to easily determine the location of the cup holder.

[0012] Hereinafter, each component included in the interior part control system of this embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a block diagram of each component of the interior part control system. Fig. 2 is a perspective view of an interior part 3. The interior part control system includes a camera 1, a vehicle speed sensor 2, interior parts 3 to 6, and an interior part control device 7.

[0013] Camera 1 is a camera installed in a vehicle that captures images of the interior of the vehicle. Camera 1 is activated when the vehicle's power switch or accessory power supply is turned on, continuously captures images of the interior of the vehicle, and outputs the captured images to interior part control device 7. Here, the accessory power supply refers to a power supply that operates when the power switch is off. Vehicle speed sensor 2 is a sensor that detects the vehicle speed and outputs the detected value to interior part control device 7.

[0014] The interior components 3 to 6 are vehicle accessories (vehicle parts) that are provided in the vehicle interior and place, hold, store, or support items used by the occupant. Alternatively, the interior components 3 to 6 are interior equipment such as storage facilities and electrical devices. The items used by the occupant include items that the occupant picks up and food and drink that the occupant puts in their mouths. Examples of storage facilities include cup holders (bottle holders), ticket holders, overhead consoles, luggage hooks, dustbins, and glove boxes. Examples of electrical devices include chargers with wireless charging capabilities, power sockets, and interior lights (reading lights, foot lights that illuminate the occupant's feet). The interior components 3 to 6 are associated with items used by the occupant. For example, if the interior components 3 to 6 are cup holders (bottle holders), ticket holders, overhead consoles, luggage hooks, and dustbins, the corresponding items would be beverage containers (bottles), tickets, eyeglasses (sunglasses), bags with handles (or bags), and food and drink, respectively. In addition, if interior parts 3 to 6 are chargers with wireless charging functions, power sockets, and interior lights (reading lights), the corresponding items are smartphones and tablets. to The interior parts 3 to 6 may be provided in a plurality of seats. For example, the interior part 3 is provided in the driver's seat, the interior part 4 is provided in the passenger seat, the interior part 5 is provided in the right rear seat, and the interior part 6 is located in the rear left seat.

[0015] The interior components 3 to 6 each have a storage compartment 31, 41, 51, 61 and a notification device 32, 42, 52, 62. The storage compartment 31, 41, 51, 61 is a main body that stores a beverage container. The notification device 32, 42, 52, 62 is a device that outputs a notification that can be recognized by the occupant, such as a display device that emits a visual notification (light), a speaker that outputs an auditory notification (sound), or a generator that generates an olfactory notification (aroma, smell). The notification device may also be a vibration generator that generates a tactile notification (vibration). In other words, the notification devices 32 to 62 are devices that provide a stimulus that can be recognized by the occupant through at least one of the senses of sight, hearing, smell, and touch. The notification output from the notification device 32, 42, 52, 62 can be recognized by at least one of the senses of sight, hearing, smell, or touch. The notification devices 32, 42, 52, and 62 switch notifications on and off in response to notification commands received from the notification control unit 73. The notification devices 32 to 62 are provided corresponding to the interior components 3 to 6 that the occupant should be made aware of. For example, the notification device 32 provided corresponding to the interior component 3 outputs a notification from the notification device 32, making it easier for the occupant to recognize the position and state of the interior component 3. In the following description, the interior components 3 to 6 will be described using cup holders as an example. Furthermore, the storage unit 31 will be used as a representative example of the storage units 31, 41, 51, and 61. of , notification device 32 is a representative example of notification devices 32, 42, 52, and 62. Use The control of the notification device 32 by the controller 70 is also applicable to the notification devices 42, 52, and 62.

[0016] As shown in FIG. 2, the storage section 31 of the interior part 3 has a hollow section 31a with an opening to hold a cylindrical container. The hollow section 31a is not limited to multiple hollow sections, and may be one. The notification device 32 is an annular LED, and is provided on the periphery of the opening located on the top surface of the hollow section 31a. The notification device 32 is not limited to being provided on the periphery of the opening, but may also be provided on, for example, the bottom surface of the hollow section 31a or a side wall of the rectangular parallelepiped storage section 31. The notification device 32 is also not limited to being provided in the storage section 31, but may be provided around the interior part 3. The basic structures of the interior parts 4 to 6 are similar to that of the interior part 3, and therefore a description thereof will be omitted.

[0017] The interior part control device 7 identifies the behavior of the occupant from the image captured by the camera, and outputs a notification command to output a notification to the notification device 32 of the interior part 3 to 6 according to the identification result. The interior part control device 7 has a controller 70 and a memory 74. The controller 70 has at least the function of acquiring the captured image, the function of identifying the behavior of the occupant, and the function of controlling the notification device 32, and has an image acquisition unit 71, an identification unit 72, and a notification control unit 73 as functional blocks for each function. The controller 70 has a processor and a memory storing a program. The processor processes the program to execute each function. Note that the controller 70 may have functions other than the image acquisition unit 71, etc.

[0018] The image acquisition unit 71 acquires captured images of the interior of the vehicle cabin from the camera 1. The identification unit 72 identifies the behavior of the occupant from the captured images. The behavior of the occupant identified by the identification unit 72 is identified based on the positions of parts of the body and hands, such as the occupant's hands, eyes, and mouth, the movement of those parts, facial expressions, the occupant's skeleton, etc. The identification unit 72 performs image processing on the captured images to extract the positions and / or movement of parts of the body and hands. Specifically, the behavior of the occupant relative to the cup holder, i.e., the behavior of moving a beverage container to the cup holder, the behavior of removing the beverage container from the cup holder, the behavior of drinking a beverage from the beverage container, etc.

[0019] The recognition unit 72 also recognizes an object (a object) used by the occupant from the captured image. For example, if the occupant is drinking a beverage from a beverage container, the recognition unit 72 recognizes the beverage container as an object used by the occupant.

[0020] The recognition unit 72 also recognizes the state of the interior parts 3 to 6. The state of the interior parts 3 to 6 is the state in which a used object is held in the interior parts 3 to 6. The recognition unit 72 extracts the position and inclination of the used object relative to the interior parts 3 to 6 from the captured image. When a used object is held in the interior parts 3 to 6, the recognition unit 72 determines the state of the interior parts 3 to 6 from the extracted position and inclination of the used object. The recognition unit 72 determines whether the used object is held in the interior parts 3 to 6 in a normal state based on the captured image. Using FIG. 2 as an example, when a beverage container, which is a used object, is placed in the hollow portion 31a of the interior part (cup holder) 3, and the beverage container is upright relative to the hollow portion 31a, the recognition unit 72 determines that the used object is held in the interior part 3 in a normal state. On the other hand, when the beverage container is not held in the hollow portion 31a, the recognition unit 72 determines that the used object is held in the interior part 3 in a normal state. a When the interior part 3 is tilted relative to the object, the recognition unit 72 determines that the object is not held in the interior part 3 in a normal state.

[0021] As another example, consider a case where the object is a communication terminal such as a smartphone and the interior part is a wireless charger. Based on the captured image, the identification unit 72 determines whether the object is held in the interior part 3 to 6 in a normal state from the position of the object relative to the interior parts 3 to 6. If the object is placed in a position on the platform for the interior parts 3 to 6 where it can be charged, the identification unit 72 determines that the object is held in the interior part 3 in a normal state. On the other hand, if the object is shifted from the position where it can be charged on the platform for the interior parts 3 to 6, the identification unit 72 determines that the object is not held in the interior part 3 in a normal state.

[0022] The recognition unit 72 may also determine whether the state of the used object relative to the interior parts 3 to 6 is normal, depending on the position and inclination of the used object when it is moved to the interior parts 3 to 6. Before the used object is placed in the interior parts, the recognition unit 72 extracts the positional relationship between the used object and the interior parts 3 to 6 from the captured image, and determines whether the used object can be placed properly in the interior parts 3 to 6. Using FIG. 2 as an example, if the beverage container is located at the top of the hollow part 31a, the recognition unit 72 determines that the used object is normal relative to the interior part 3. On the other hand, if the beverage container is positioned away from the top of the hollow part 31a, the recognition unit 72 determines that the used object is not normal relative to the interior part 3. Furthermore, before the used object is placed in the interior parts, the recognition unit 72 may also extract the inclination relationship between the used object and the interior parts 3 to 6 from the captured image, and determine whether the used object can be placed properly in the interior parts 3 to 6. 2 as an example, when the inclination of the beverage container is parallel to the inclination of the hollow portion 31a, the recognition unit 72 determines that the used object is in a normal state with respect to the interior part 3. In other words, when the central axis of the cylindrical hollow portion 31a and the central axis of the cylindrical beverage container are parallel, the recognition unit 72 determines that the used object is in a normal state with respect to the interior part 3. On the other hand, when the inclination of the beverage container is not parallel to the inclination of the hollow portion 31a, the recognition unit 72 determines that the used object is not in a normal state with respect to the interior part 3. Note that the recognition unit 72 may determine whether or not the used object is in a normal state with respect to the interior part 3 based on both the position and inclination of the used object.

[0023] The identification unit 72 may also identify the position of the occupant who performed the action, the illuminance inside the vehicle cabin, the facial state of the occupant, etc. from the captured image. The illuminance inside the vehicle cabin may be detected by an illuminance sensor instead of the camera 1.

[0024] The notification control unit 73 determines whether the behavior identified by the identification unit 72 is a specific behavior for the interior components 3 to 6, and if it determines that the identified behavior is a specific behavior for the interior components 3 to 6, outputs a notification command to the notification device 32 to provide a notification that can be recognized by the occupant. The specific behavior is a behavior performed by the occupant in order to use the interior components 3 to 6 and / or a preparatory behavior for using the interior components 3 to 6. For example, when an occupant uses a cup holder, the specific behavior includes the occupant moving a beverage container to the cup holder with their hand, bringing their hand closer to the beverage container held in the cup holder, grabbing the beverage container held in the cup holder with their hand, or moving the beverage container held in their hand from the cup holder. Furthermore, when an occupant is drinking a beverage from a beverage container, it is expected that the occupant will then place the beverage container in the cup holder, and therefore the act of grabbing the beverage container with their hand and drinking from it is a specific behavior (preparatory behavior).

[0025] The behavior data indicating the specific behavior is stored in memory 74 in association with the interior components 3 to 6 that are the control targets of notification control unit 73. For example, if interior components 3 to 6 are cup holders, behavior data such as the movements of the occupant's hands and fingers when using the cup holder, the positions of the hands and fingers, and the shape and color of the object held in the cup holder are stored in memory 74.

[0026] The notification control unit 73 refers to the behavior data in the memory 74 and extracts a specific behavior corresponding to the behavior identified by the identification unit 72. When the specific behavior can be extracted, the notification control unit 73 determines the target interior part that is the target of the specific behavior from the occupant performing the specific behavior and the extracted specific behavior. For example, if the occupant is toWhen the occupant reaches out, the notification control unit 73 extracts the action of the occupant's hand moving toward the cup holder and approaching the cup holder as the specific action. The notification control unit 73 determines the interior part 3 to 6 at the destination of the hand movement as the target interior part. After extracting the specific action and determining the target interior part, the notification control unit 73 outputs a notification command to the notification device 32 of the target interior part. Note that when there are multiple interior parts 3 to 6 to be controlled by the controller 70, the notification control unit 73 may determine the target interior part from among the multiple interior parts 3 to 6 based on the extracted specific action. When there is only one interior part to be controlled, or when the position of the occupant's seat determines only one interior part 3 to 6 corresponding to the specific action, the notification control unit 73 does not need to determine the target interior part from among the multiple interior parts 3 to 6 based on the extracted specific action.

[0027] The notification control unit 73 may determine the target interior part from an object used by the occupant. For example, if the object identified by the identification unit 72 is a beverage container, the cup holder that holds the beverage container is the target interior part. In other words, the cup holder is associated with the beverage container, and other interior parts can also be associated with the object used by the occupant. The notification control unit 73 then determines whether the behavior identified by the identification unit 72 is a specific behavior toward the target interior part. If the identified behavior is a specific behavior toward the target interior part, the notification control unit 73 outputs a notification command to the notification device 32 provided corresponding to the target interior part. For example, after determining the cup holder as the target interior part, it is assumed that the occupant's hand movement indicates that the occupant has finished drinking a drink and removed the beverage container from their mouth. In such a case, the notification control unit 73 determines that the behavior identified from the hand movement and the position of the mouth and the beverage container is a specific behavior toward the cup holder, and outputs a notification command to the notification device of the cup holder used by the occupant.

[0028] When outputting a notification from the notification device 32, the notification control unit 73 may change the notification form of the notification device 32 depending on the seat position of the occupant who performed the action, the state of the items stored in the interior components 3 to 6, the brightness of the interior, the facial state of the occupant, etc. Specific examples of the display form of the notification device 32 will be described below. Note that the notification device 32 is a light (LED) as in FIG. 2.

[0029] When the target interior part 3 that is the target of the specific action includes multiple storage compartments 31, the notification control unit 73 may determine the output destination of the notification command according to the position of the part of the occupant's hand or the like, the movement of the part, the riding position, etc. For example, as shown in FIG. 2, when the interior part 3 includes multiple storage compartments 31, Department When multiple storage units 31 are arranged adjacent to each other, an occupant holds a container of a beverage or the like and moves the container to one of the storage units 31. If multiple devices 32 output notifications at this time, the occupant may become confused as to which storage unit 31 the container should be moved to. Therefore, the notification control unit 73 only needs to output a notification command to the notification device 32 provided corresponding to only the storage unit 31 closest to the occupant who performed the action.

[0030] The notification control unit 73 may determine, among the multiple storage units 31, the storage unit 31 closest to the occupant who performed the action in the following manner. For example, if the identification unit 72 identifies an action from a hand, the notification control unit 73 may determine, among the multiple storage units 31, the storage unit 31 closest to the hand as the storage unit 31 to be targeted for the action. Furthermore, for example, if multiple storage units 31 are provided in association with seats, such as a driver's seat and a passenger seat, the notification control unit 73 may determine, as the storage unit 31 to be targeted for the action, the storage unit 31 closest to the position of the occupant who performed the action. As a result, for example, if the occupant holds a container and brings their hand close to a storage unit 31, the notification device 32 near the storage unit 31 closest to the hand outputs a notification. On the other hand, the notification device 32 near the storage unit 31 farthest from the hand does not output a notification. This allows the occupant to easily determine the location of the storage unit 31 where they should place the container.

[0031] The notification control unit 73 may store usage information of the interior part 3 in a memory or the like. The usage information includes information on whether the interior part 3 is currently being used and / or information on the usage history of the interior part 3. If the interior part 3 has multiple storage compartments 31, the notification control unit 73 may store usage information for each storage compartment 31. The usage information is indicated by the time the interior part 3 was used, a flag indicating whether it is currently being used, a flag indicating whether it has been used in the past, and the like. For example, if the interior light is on, the usage information includes the fact that the interior light is in use. Furthermore, for example, if the interior part 3 (or storage compartment 31) has been used between now and a predetermined time ago, the flag indicating whether it has been used in the past becomes "1 (ON)."

[0032] The notification control unit 73 may also record the usage information for each occupant. For example, if the occupant in the front passenger seat uses the cup holder while the occupant in the driver's seat uses the ticket holder, the notification control unit 73 may store usage information indicating that the occupant in the driver's seat used the ticket holder and usage information indicating that the occupant in the front passenger seat used the cup holder, respectively.

[0033] When the target interior part that is the target of the specific action includes multiple storage compartments 31, the notification control unit 73 may determine the output destination of the notification command based on the action on the interior part 3 and the usage information of the storage compartments 31. The notification control unit 73 refers to the usage information of the storage compartments 31 included in the target interior part, and extracts the storage compartment 31 that is currently in use. Then, the notification control unit 73 outputs a notification command to the notification device 32 provided corresponding to the storage compartment 31 that is in use. In other words, when the action identified by the identification unit 72 is a specific action on an interior part 3 that includes multiple storage compartments 31, the notification control unit 73 outputs a notification command to the notification device 32 provided corresponding to the storage compartment 31 that is in use among the multiple storage compartments 31. As a result, for example, when the occupant approaches to take an item stored in a storage compartment 31, the notification control unit 73 outputs a notification command to the notification device 32 provided corresponding to the storage compartment 31 that is in use. 1 The notification device 32 corresponding to the unused storage section 3 outputs a notification. 1As a result, the passenger can quickly find the location of the storage compartment 31.

[0034] The notification control unit 73 also references the usage information of the storage compartments 31 that include the target interior part, and extracts the storage compartment 31 that was used last time. Then, the notification control unit 73 outputs a notification command to the notification device 32 provided corresponding to the storage compartment 31 that was used last time. That is, when the behavior identified by the identification unit 72 is a specific behavior with respect to the interior part 3 that includes multiple storage compartments 31, the notification control unit 73 outputs a notification command to the notification device 32 provided corresponding to the storage compartment 31 that was used last time out of the multiple storage compartments 31. As a result, for example, when the occupant approaches the storage compartment 31 to store an item in it, the notification control unit 73 can detect the storage compartment 31 that was used last time. 1 The notification device 32 corresponding to the other storage unit 3 outputs a notification. 1 As a result, the passenger can quickly find the location of the storage compartment 31.

[0035] The notification control unit 73 may output a notification command to the notification device 32 depending on the determination result by the identification unit 72 as to whether the object is normally held in the interior part 3. For example, if it is determined that a beverage container is normally held in the cup holder, the notification control unit 73 may output a notification command to turn off the illumination of the notification device. Note that if the notification device 32 outputs a notification by sound or vibration, the notification control unit 73 may output a notification command to the notification device 32 to communicate by sound or vibration that the beverage container has been normally placed in the cup holder.

[0036] The notification control unit 73 is configured to notify the beverage container If it is determined that the cup holder is not in a normal state, the notification form of the notification device 32 may be different from the notification form in a normal state. For example, if the illumination color of the notification device 32 is blue in a normal state, it may be red when the state is not normal.

[0037] Furthermore, when the notification control unit 73 turns on the light of the notification device 32, the notification control unit 73 determines whether to turn on the light in accordance with the time elapsed since the light was turned on. time The time for which the light is on may be extended. In particular, when the interior of the vehicle is dark, if a bright light is emitted, the driver's line of sight may be drawn to the part that is emitting the light unexpectedly. Therefore, in this embodiment, the time for which the light is on is extended over time, and the display form of the notification device 32 is changed so that it first emits a dim light and then gradually emits a bright light. In other words, the output value (brightness) of the notification (illumination) of the notification device 32 is set to a predetermined value or less, and the on-state of the notification device 32 is time By making the "on time" longer than a predetermined time, the time for which the less bright light is illuminated is increased. The on time can be controlled using, for example, PWM control.

[0038] Furthermore, the notification control unit 73 may output a notification command to the interior parts 3 to 6 so that the interior parts 3 to 6 are respectively provided in a plurality of seats, and the plurality of notification devices 32, 42, 52, 62 corresponding to the plurality of interior parts 3 to 6 output notifications in different display forms. For example, the illumination of the notification device 32 of the interior part 3 provided in the driver's seat is dim, and the illumination of the notification devices 4 to 6 other than the driver's seat is dim. 42、52、62 The notification control unit 73 then sets the interior part 3 as a target interior part that is the target of the specific action. Product If the notification control unit 73 determines that the interior parts 4 to 6 are to be the target interior parts for the specific action, the notification control unit 73 outputs a notification command to the interior part 3 so as to dim the light of the notification device 32. Product If it is determined that the notification device 42, 52, 62 is illuminated, a notification command is output to the interior components 4 to 6 so that the illumination of the notification devices 42, 52, 62 is increased.

[0039] The notification control unit 73 may also control the brightness of the output light of the notification device according to the illuminance in the vehicle cabin. When the illuminance in the vehicle cabin is low and the vehicle cabin is dark, the notification control unit 73 outputs a notification command to the interior part 3 to dim the brightness of the output light of the notification device 32. At this time, the brightness of the output light (illumination) of the notification device 32 may be set to a brightness that does not affect the driver's driving. Note that the notification control unit 73 may change the hue or saturation instead of the brightness (brightness). For example, when controlling the display mode of the notification device 32 of the interior part 3 provided in the driver's seat, it is preferable to change the hue of the output light of the notification device 32 to red.

[0040] The notification control unit 73 may also control at least one of the elements of the hue, brightness, and saturation of the output light of the notification device 32 according to the facial state of the occupant identified by the identification unit 72. The facial state is expressed by at least one parameter, for example, the degree of eye closure and the degree of pupil constriction. For example, when the degree of eye closure or the degree of pupil constriction is small, the illuminance in the vehicle interior is low. Therefore, the notification control unit 73 outputs a notification command to change the display mode to one suitable for a dark vehicle interior. Specifically, the notification device 32 extracts the degree of eye closure and / or the degree of pupil constriction from the facial state identified by the identification unit 72. If the extracted degree of eye closure and / or the degree of pupil constriction is equal to or less than a predetermined threshold, the notification control unit 73 outputs a notification command to the interior part 3 to change the display mode of the output light of the notification device 32 to one suitable for a dark vehicle interior. The display mode suitable for a dark vehicle interior may be, for example, a warm hue such as red or orange, low brightness, or low saturation. The lightness, hue, and saturation may be set arbitrarily by the user.

[0041] The memory 74 stores behavior data indicating specific behaviors. subjectWhen there are multiple types of interior parts 3 to 6, behavior data is stored according to the type of interior part 3 to 6. For example, when the interior parts 3 to 6 are cup holders, the behavior data includes data on the behavior of the occupant expected when using the cup holder and data on the behavior of the occupant expected when holding a beverage container. In other words, the behavior data includes data on the behavior of the occupant with respect to the interior parts 3 to 6, data on the behavior of the occupant while using the usable item, etc.

[0042] Next, a series of actions of the occupant and a notification method of the notification device 32 will be described using a cup holder as an example. When the occupant holds a beverage container in his / her hand and brings the beverage container close to the cup holder, the notification device turns on the light (light on). The occupant is notified by the light of the light, mosquito The position of the cup holder can be easily confirmed, and the beverage container can be placed in the cup holder with a short movement of the eye. When the beverage container is held in the cup holder in the normal state, or when the occupant leaves the cup holder without holding the beverage container, the notification device turns off its illumination. When the occupant approaches the cup holder with the beverage container still in the cup holder, the notification device turns on its illumination. When the beverage container is removed from the cup holder, or when the occupant leaves the cup holder while holding the beverage container, the notification device turns off its illumination.

[0043] Furthermore, as shown in FIG. 2, when a cup holder, which is an interior part 3, has multiple storage compartments 31, the notification device 32 may illuminate in response to the occupant's actions in the following example. For example, when an occupant brings a beverage container close to the cup holder, the notification device 32 illuminates. In this case, only the notification device 32 of the multiple cup holders that is closest to the occupant who brought the beverage container close to the cup holder may illuminate. For example, in the example of FIG. 2, when the hand holding the beverage container moves from the right side of the page toward the storage compartment 31 on the right side, only the notification device 32 provided in the storage compartment 31 on the right side illuminates.

[0044] As another example, when a beverage container is stored in a cup holder and the occupant approaches the cup holder to drink the beverage, the notification device 32 lights up. At this time, only the notification device 32 of the storage section 31 in which the beverage container is stored may light up. In other words, only the notification device provided corresponding to the storage section 31 in use is turned on. For example, in the example of FIG. 2, when the beverage container is stored in the storage section 31 on the right side, only the notification device 32 provided in the storage section 31 on the right side lights up.

[0045] As another example, when a beverage container is stored in a cup holder and the occupant approaches the cup holder to drink the beverage, the notification device 32 illuminates. At this time, only the notification device 32 of the storage compartment 31 in which the occupant previously stored a beverage container may illuminate. That is, only the notification device 32 provided corresponding to the storage compartment 31 previously used may be turned on. For example, in the example of FIG. 2 , if the occupant stores a beverage container in the left storage compartment 31, the left storage compartment 31 becomes the storage compartment 31 previously used. Then, if the occupant approaches the left storage compartment 31, only the notification device 32 provided in the left storage compartment 31 illuminates. Note that the notification control unit 73 may turn on the notification device 32 of the storage compartment 31 previously used after determining whether the occupant who stored the beverage container in the storage compartment 31 is the same as the occupant attempting to remove the beverage container from the storage compartment 31.

[0046] In the above example, when the interior part 3 has multiple storage compartments 31 and the multiple storage compartments 31 are adjacent to each other, only the notification device 32 of the storage compartment 31 that is more usable by the occupant lights up, and the notification device 32 that is less usable does not light up. This makes it possible to avoid a notification that would be confusing to the occupant, such as lighting up a notification device 32 that does not store a beverage container or a notification device 32 that was not used last time.

[0047] The notification control unit 73 may also change the display mode of the notification device 32 depending on the determination result of whether the state of the object relative to the interior parts 3 to 6 is normal or not. Taking a cup holder as an example, when an occupant holds a beverage container and moves it to the interior part 3, if the beverage container is located at the top of the hollow part 31a, the identification unit 72 determines that the object is in a normal state relative to the interior part 3. If the determination result by the identification unit 72 is a normal state, the notification control unit 73, for example, turns the illumination of the notification device blue as a display mode indicating the normal state. On the other hand, if the position of the beverage container is shifted from the top of the hollow part 31a, the identification unit 72 determines that the object is not in a normal state relative to the interior part 3. If the determination result by the identification unit 72 is not a normal state, the notification control unit 73, for example, turns the illumination of the notification device red as a display mode indicating the abnormal state. If the position of the beverage container is shifted from the top of the hollow part 31a, the identification unit 72, for example, turns the illumination of the notification device red as a display mode indicating the abnormal state. a If the notification device 32 is misaligned from the top of the seat and the notification device 32 lights up in an incorrect color (e.g., red), the occupant should not lower the beverage container, but should instead reposition the beverage container until it is in the correct position. Once the beverage container is in the correct position, the notification device 32 will light up in the correct color (e.g., blue). The occupant can then lower the beverage container directly below the notification device 32 in the position where it lights up in the correct color, thereby correctly storing the beverage container.

[0048] That is, the recognition unit 72 determines whether the state of the object relative to the interior part 3 is normal or not depending on the position and / or tilt of the object, and the notification control unit 73 controls the notification device 100 to notify the user of the state of the object relative to the interior part 3 depending on the determination result of the recognition unit 72. 32 This allows the occupant to check whether the position or inclination of the object is normal when moving the object to the interior parts 3 to 6. 32 You can check this from the notification.

[0049] The identification unit 72 identifies such a series of occupant actions from the captured image, and the notification control unit 73 determines whether the identified action is a specific action and controls the notification device according to the determination result. In the above notification example, the lighting of the notification device 32 is on only while the occupant uses the cup holder. In particular, when the vehicle interior is dark, the burden on the driver can be reduced by minimizing the lighting time in the vehicle interior. The lighting of the notification device 32 does not necessarily have to be on only while the occupant uses the cup holder; for example, it may also include the time the occupant is drinking a beverage. While the occupant is drinking a beverage, it is expected that the occupant will place the beverage container in the cup holder after finishing drinking. Therefore, turning on the lighting of the notification device 32 while the occupant is drinking a beverage can make it easier for the occupant to place the beverage container in the cup holder.

[0050] Next, the control flow of the controller 70 will be described with reference to Figures 3 and 4. Figure 3 is a flowchart showing the control process of the controller 70. Figure 4 is a sub-flowchart of step S40 shown in Figure 3.

[0051] In step S10, the controller 70 determines whether or not photography is permitted. For example, if photography by the camera 1 is not permitted for privacy reasons, the controller 70 ends this control flow ("N" in step S10). On the other hand, if photography is permitted, in step S20, the notification control unit 73 acquires the vehicle speed from the vehicle speed sensor 2 and determines whether the current vehicle speed is equal to or less than the vehicle speed threshold. If the vehicle speed is higher than the vehicle speed threshold, the controller 70 ends this control flow ("N" in step S20). If the vehicle speed is equal to or less than the vehicle speed threshold, the image acquisition unit 71 acquires a captured image from the camera 1.

[0052] In step S40, the identification unit 72 executes behavior identification processing by image processing on the captured image. The control flow of the behavior identification processing is shown in the subflow of FIG. 4. In step S41, the identification unit 72 identifies the occupant. The occupant is identified by the occupant's riding position, etc. In step S42, the identification unit 72 identifies the occupant's behavior. In step S43, the identification unit 72 identifies the illuminance inside the vehicle cabin. In step S44, the identification unit 72 identifies the occupant's facial state. Then, after completing the processing of the subflows of steps S41 to S45, the controller 70 executes the control flow of step S50.

[0053] In step S50, the notification control unit 73 determines whether the identified behavior matches the specific behavior indicated by the behavior data in the memory 74. If the identified behavior does not match the specific behavior, the controller 70 returns the control flow to step S20 and executes the control flow from step S20 onwards. If the identified behavior matches the specific behavior, in step S60, the notification control unit 73 determines the target interior part that is the target of the specific behavior. In step S70, the notification control unit 73 determines the position of the occupant, the illuminance in the vehicle interior, and face The notification form of the notification device 32 is determined based on at least one of the states. If the notification device is a light, the notification form corresponds to the display form. In step S80, the notification control unit 73 outputs a notification command to the target interior part so that the notification device of the target interior part outputs a notification in the determined notification form. Then, the controller 70 ends the control flow.

[0054] As described above, the interior part control device or interior part control method according to this embodiment acquires an image from the camera 1 that captures images of the interior of the vehicle cabin, identifies the behavior of the occupant from the image, controls the notification devices 32 that are provided corresponding to the interior parts 3 to 6 and output a notification that can be recognized by the occupant, and if the identified behavior is a specific behavior toward an interior part, outputs a notification command to the notification device 32 to issue a notification. This reduces the time that the occupant spends looking at the interior part.

[0055] For example, in the case of a cup holder, a notification device in the cup holder will notify the occupant before and when they place a beverage container in the cup holder, allowing them to recognize where the beverage container is stored and that it has been securely placed. This reduces the workload and cognitive load imposed on the occupant when searching for the cup holder in a dark vehicle cabin, improving the comfort of the vehicle interior. As a result, the amount of time the occupant's line of sight is reduced.

[0056] In this embodiment, the identification unit 72 identifies an object used by the occupant from the captured image, and the notification control unit 73 determines a target interior part associated with the object, and if the identified behavior is a specific behavior toward the target interior part, outputs a notification command to the notification device 32 provided corresponding to the target interior part. This makes it possible to shorten the time the occupant spends looking at the interior part, i.e., the line of sight deviation time.

[0057] In this embodiment, the recognition unit 72 determines whether the object is properly held in the interior part based on the captured image, and the notification control unit 73 outputs a notification command when it is determined that the object is properly held in the interior part, thereby enabling the occupant to recognize that the object is securely held in the interior part 3 to 6.

[0058] In this embodiment, when it is determined that the object is not held in the target interior part in the normal state, the notification control unit 73 changes the display mode of the notification device 32 to a mode different from that in the normal state, thereby allowing the occupant to recognize that the object is not held in the interior part 3 to 6 normally.

[0059] In this embodiment, the notification control unit 73 turns on or off the notification depending on the time elapsed since the visually recognizable notification was turned on. time This reduces the impact on the driver caused by turning on the notification when the interior of the vehicle is dark, for example.

[0060] In this embodiment, the interior parts 3 to 6 are provided in each of the plurality of seats, and the plurality of notification devices 32, 42, 52, and 62 corresponding to the plurality of interior parts output notifications in different notification formats. The notification control unit 73 then determines the target interior part among the plurality of interior parts 3 to 6 that is the target of the specific behavior, and outputs a notification command to the notification devices 32, 42, 52, and 62 provided corresponding to the target interior part. This makes it possible to identify the behavior of the occupant for each seat, and to control notifications according to the identified behavior for each seat.

[0061] In this embodiment, the notification control unit 73 does not output a notification command when the vehicle speed is equal to or greater than the vehicle speed threshold. This allows the control of the interior part control device 7 to be prohibited, for example, when the vehicle is traveling at high speed.

[0062] In this embodiment, the notification control unit 73 controls the brightness of the output light of the notification device 32 according to the illuminance inside the vehicle cabin. This reduces the impact on the driver caused by turning on the notification when the vehicle cabin is dark, for example.

[0063] In this embodiment, the identification unit 72 identifies the facial state of the occupant from the captured image, and the notification control unit 73 controls at least one of the elements of hue, brightness, and saturation of the output light of the notification device 32 according to the facial state. The facial state is expressed by at least one parameter of the degree of eye opening or the degree of pupil constriction. This allows for detailed control of the notification format according to the vehicle interior space.

[0064] 3 and 4, it is not necessary to execute all of the control flows, and some flows may be omitted or the order of the flows may be changed. For example, the controller 70 only needs to execute the control flows of at least steps S30, S40, S50, and S80, and only needs to execute at least S42 of the subflow of step S40.

[0065] The interior part 3 does not necessarily have to have the storage section 31, but only needs to have at least the notification device 32. For example, if the interior part 3 is a light such as a reading lamp or a foot lamp, the storage section 31 is not necessary.

[0066] As a modification of this embodiment, the notification control unit 14 of the controller 10 may notify the driver when the vehicle is running under autonomous driving control. knowledge The devices 32, 42, 52, and 62 turn on certain lights and prohibit turning on the lights when the vehicle is running under manual driving control. This increases the comfort of the driver during autonomous driving and prevents the negative impact of turning on lights on the driver during manual driving.

[0067] Second Embodiment Next, an interior part control system according to a second embodiment will be described. The interior part control system according to the second embodiment adds some control functions to the identification unit 72 compared to the interior part control system according to the first embodiment described above. Since the configuration is the same as that of the first embodiment except for the additional functions of the identification unit 72, the above-mentioned description will be used for the same configuration as that of the first embodiment.

[0068] The interior parts 3 to 6 include at least notification devices 32, 42, 52, and 62. In the following description, the interior part 3 is used as a representative example of the interior parts 3 to 6, and the notification device 32 is used as a representative example of the notification devices 32, 42, 52, and 62. The interior parts 3 are, for example, footlights (lights) that illuminate the feet of occupants, and are installed at the left and right front seats (passenger seat and driver seat) and the left and right rear seats. The camera 1 is installed at a position such that its angle of view includes the seats. Therefore, when an occupant sits in the seat, the angle of view of the camera 1 includes part of the occupant's body. For example, when an occupant sits in the seat, the angle of view of the camera 1 includes at least the upper body of the occupant but does not include the occupant's feet. To capture an image of an occupant in a rear seat, the camera 1 may be installed on the roof (the ceiling of the vehicle interior). Alternatively, the camera 1 may be a wide-angle camera that captures the rear seat surface.

[0069] The identification unit 72 identifies the trajectory of the occupant's body when part of their body moves out of the field of view of the camera 1. For example, consider a scene in which an occupant bends down to pick up an object at their feet while sitting in a seat (hereinafter also referred to as a "picking up an object scene"). In this scene, when the occupant bends down from a sitting position, the occupant's upper body moves downward relative to the seat. The identification unit 72 acquires captured images in time series and extracts the movement of the occupant's body parts (upper body) from the multiple captured images to identify the trajectory of the occupant's upper body. For example, if the center of the field of view of the camera 1 is the center of the occupant's upper body and the scene is one in which an object is being picked up, the trajectory of the upper body will be a line that runs downward from the center point of the field of view. In this way, the identification unit 72 identifies the occupant's behavior when part of their body moves out of the field of view of the camera 1.

[0070] The notification control unit 73 issues a notification command to the notification device 3 in accordance with the body trajectory identified by the identification unit 72. 2 First, the notification control unit 73 identifies the direction in which the body trajectory deviates from the angle of view (hereinafter also referred to as the "outside angle of view direction"). Then, the notification control unit 73 outputs a notification command to turn on the light to the notification device 32 located in the outside angle of view direction. The notification device 32 to which the notification command is sent is located outside the angle of view of the camera 1 and is installed in an area in the outside angle of view direction. thing If the scene is one in which a passenger picks up a bent-over object, the notification control unit 73 specifies the area below the seat as being outside the angle of view. The notification control unit 73 outputs a notification command to turn on the footlights installed at the feet of the bent-over passenger. In other words, the notification control unit 73 determines from the trajectory of the body that the notification device 3 is installed in an area outside the angle of view of the camera 1 and in the direction outside the angle of view. 2 is identified as the device to which the notification command should be sent, so that the area around the occupant's feet is illuminated when the occupant bends down to pick up an object.

[0071] As an example other than a scene of picking up an object, suppose that while the vehicle is stopped, the driver reaches out to retrieve an object from a roof pocket. The driver's hand moves from the position of the steering wheel toward the roof pocket. The identification unit 72 identifies the trajectory of the hand by extracting the movement of the hand. The notification control unit 73 identifies the direction from the position of the steering wheel toward the roof pocket as the out-of-view direction. The out-of-view direction is the direction in which the trajectory of the hand leaves the angle of view. The notification control unit 73 outputs a notification command to turn on a light (room lamp) installed in the direction of the angle of view. As a result, when the driver tries to retrieve an object from the roof pocket, the light installed near the roof pocket turns on before the hand touches the roof pocket.

[0072] Furthermore, the identification unit 72 identifies that after a part of the occupant's body leaves the angle of view of the camera 1, the part of the occupant's body returns to the angle of view. For example, after a scene in which the occupant picks up an object, the occupant returns the upper body to its original position after picking up the object, and the occupant's posture becomes a seated state in the seat. At this time, the upper body leaves the angle of view once to pick up the object, and then returns to the angle of view. The identification unit 72 identifies that the upper body returns to the angle of view. In other words, the identification unit 72 identifies, from a series of upper body movements, that the upper body leaves the angle of view and then returns to the angle of view.

[0073] When the notification control unit 73 determines that a part of the occupant's body is returning to the field of view, it outputs an OFF command to the notification device to turn off the notification. When the occupant picks up an object at their feet and returns to their original sitting position, the notification control unit 73 determines that the upper half of their body is returning to the field of view and outputs an OFF command to turn off the illumination of the foot lamp. Note that the notification control unit 73 may output an OFF command to the foot lamp after a predetermined time has elapsed since it determined that the upper half of their body is returning to the field of view. This allows the notification device 3 to notify the occupant of the status according to their actions. 2 You can turn notifications on and off.

[0074] The notification control unit 73 may output an OFF command to the notification device when a predetermined time has elapsed since it was determined that a part of the occupant's body has moved out of the field of view of the camera 1. This allows the notification by the notification device 32 to be turned off even when it is not possible to determine from the captured image that a part of the occupant's body has returned to the field of view.

[0075] As described above, the interior part control device or the interior part control method according to this embodiment identifies the trajectory of the occupant's body when part of the body moves out of the field of view of the camera 1, and outputs a notification command to the notification device 32 in accordance with the identified trajectory of the body. This makes it possible to identify that the occupant's behavior is a specific behavior toward the interior part 3, even if the interior part 3 is installed outside the field of view of the camera 1. [Explanation of symbols]

[0076] 1 camera 2 Vehicle speed sensor 3~6 Interior parts (cup holders) 7 Interior parts control device 32, 42, 52, 62 notification devices 70 Controller 71 Image acquisition unit 72 Identification unit 73 Notification control section 74 memory

Claims

1. An interior part control device that controls interior parts provided in a vehicle interior, an image acquisition unit that acquires an image captured by a camera that captures an image of the interior of the vehicle; an identification unit that identifies the behavior of an occupant from the captured image; a notification control unit that controls a notification device that is provided corresponding to the interior part and outputs a notification that can be recognized by the occupant, The identification unit identifies an item used by the occupant from the captured image, The notification control unit determining a target interior part associated with the use; If the behavior identified by the identification unit is a specific behavior with respect to the target interior part, the interior part control device outputs a notification command to a notification device provided corresponding to the target interior part to perform the notification.

2. An interior part control device that controls interior parts provided in a vehicle interior, an image acquisition unit that acquires an image captured by a camera that captures an image of the interior of the vehicle; an identification unit that identifies the behavior of an occupant from the captured image; a notification control unit that controls a notification device that is provided corresponding to the interior part and outputs a notification that can be recognized by the occupant, the identification unit identifies a trajectory of the body when a part of the body of the occupant moves out of a field of view of the camera; The notification control unit outputs a notification command to the notification device to perform the notification in accordance with the trajectory of the body identified by the identification unit.

3. An interior part control device that controls interior parts provided in a vehicle interior, an image acquisition unit that acquires an image captured by a camera that captures an image of the interior of the vehicle; an identification unit that identifies the behavior of an occupant from the captured image; a notification control unit that controls a notification device that is provided corresponding to the interior part and outputs a notification that can be recognized by the occupant, The interior part has a plurality of storage sections for storing belongings used by the occupant, The plurality of storage sections are arranged adjacent to each other, When the behavior identified by the identification unit is a specific behavior toward the interior part including the plurality of storage sections, the notification control unit outputs a notification command to the notification device provided corresponding to the storage section among the plurality of storage sections that is closer to the occupant who performed the specific behavior.

4. An interior part control device that controls interior parts provided in a vehicle interior, an image acquisition unit that acquires an image captured by a camera that captures an image of the interior of the vehicle; an identification unit that identifies the behavior of an occupant from the captured image; a notification control unit that controls a notification device that is provided corresponding to the interior part and outputs a notification that can be recognized by the occupant, The interior part has a plurality of storage sections for storing belongings used by the occupant, storing in a memory usage information indicating whether the storage unit is currently in use; When the action identified by the identification unit is a specific action with respect to the interior part including a plurality of the storage units, the notification control unit outputs a notification command to the notification device provided corresponding to the storage unit that is in use among the plurality of storage units.

5. An interior part control device that controls interior parts provided in a vehicle interior, an image acquisition unit that acquires an image captured by a camera that captures an image of the interior of the vehicle; an identification unit that identifies the behavior of an occupant from the captured image; a notification control unit that controls a notification device that is provided corresponding to the interior part and outputs a notification that can be recognized by the occupant, The interior part has a plurality of storage sections for storing belongings used by the occupant, storing usage information indicating a usage history of the storage unit in a memory; When the action identified by the identification unit is a specific action on the interior part including a plurality of storage units, the notification control unit outputs a notification command to the notification device provided corresponding to the storage unit that was used last time among the plurality of storage units.

6. The identification unit determines whether the object is held in the target interior part in a normal state based on the captured image, The interior part control device according to claim 1 , wherein the notification control unit outputs the notification command when it is determined that the item is held in the target interior part in a normal state.

7. 7. The interior part control device according to claim 6, wherein the notification control unit changes the notification form of the notification device to a form different from the form in the normal state when it is determined that the item is not held in the target interior part in the normal state.

8. The notification is visually perceptible; The interior part control device according to any one of claims 1 to 5, wherein the notification control unit extends an on-period of the notification in accordance with an elapsed time from when the notification is turned on.

9. The interior part control device according to any one of claims 1 to 5, wherein the notification can be recognized by at least one of the senses of sight, hearing, smell, and touch.

10. The interior parts are provided on each of the plurality of seats, The interior part control device according to claim 1 , wherein the plurality of notification devices corresponding to the plurality of interior parts output the notification in different notification formats.

11. The interior part control device according to any one of claims 1 to 10, wherein the notification control unit does not output the notification command when the vehicle speed is equal to or greater than a vehicle speed threshold value.

12. The interior part control device according to any one of claims 1 to 11, wherein the notification control unit controls brightness of the output light of the notification device in accordance with illuminance in the vehicle interior.

13. the identifying unit identifies a facial state of the occupant from the captured image, The interior part control device according to any one of claims 1 to 12, wherein the notification control unit controls at least one element of hue, brightness, and saturation of the output light of the notification device according to the facial state.

14. 14. The interior part control device according to claim 13, wherein the facial state is expressed as a parameter of at least one of an eye open / close degree and a pupil constriction degree.

15. The interior part control device according to claim 2 , wherein the notification control unit identifies a direction in which the trajectory of the body deviates from the angle of view, and outputs the notification command to the notification device located in the direction in which the trajectory deviates from the angle of view.

16. the camera has a field of view that includes at least the seat of the vehicle; The notification device includes a footlight that illuminates the foot area of ​​the occupant, The interior part control device according to claim 15, wherein the notification control unit outputs the notification command to the foot lamp when the direction deviating from the angle of view is downward relative to the seat.

17. the identification unit identifies that a part of the body of the occupant moves out of a field of view of the camera and then returns to the field of view of the camera; The interior part control device according to claim 15 or 16, wherein the notification control unit outputs an off command to the notification device to turn off the notification when it identifies that a part of the occupant's body is returning to the angle of view.

18. The interior part control device according to any one of claims 15 to 17, wherein the identification unit outputs an off command to the notification device to turn off the notification when a predetermined time has elapsed since it identified that a part of the occupant's body has moved out of the angle of view of the camera.

19. the notification device is a light; The notification control unit When the vehicle is traveling under autonomous driving control, the lighting is turned on, The interior part control device according to any one of claims 1 to 18, wherein turning on of the light is prohibited when the vehicle is being driven under manual driving control.

20. The identification unit determines whether the state of the object relative to the interior part is normal or not based on the position and / or tilt of the object, The interior part control device according to claim 1 , wherein the notification control unit changes the notification form of the notification device depending on the determination result of the identification unit.

21. An interior part control method for controlling an interior part provided in a vehicle interior for placing or holding an occupant's belongings, the method being executed by a controller, the controller comprising: Acquiring a captured image from a camera capturing an image of the interior of the vehicle; Identifying the behavior of the occupant and the items used by the occupant from the captured image; determining a target interior part associated with the use; controlling a notification device that is provided corresponding to the interior part and outputs a notification that can be recognized by the occupant; When the identified behavior is a specific behavior with respect to the interior part, a notification command is output to a notification device provided corresponding to the target interior part to send the notification to the notification device.