Equipment operation control system, device, method, and program

Abstract

The present invention enables in-vehicle equipment control that corresponds to the attributes of occupants aboard the vehicle. A position specification means (21) specifies respective seated positions of one or more occupants in a vehicle. An attribute specification means (22) specifies the attributes of the occupants from images captured by a camera (30) that captures images of the interior of the vehicle. A control means (23) controls equipment (50) in the vehicle in accordance with the seated positions specified by the position specification means (21) and the attributes specified by the attribute specification means (22).

Description

[Technical Field]

[0001] The present disclosure relates to equipment operation control systems, devices, methods, and computer-readable media. [Background technology]

[0002] As a related technique, Patent Document 1 discloses a control device for a vehicle-mounted device. In Patent Document 1, a load sensor is provided on each seat of a vehicle. The control device described in Patent Document 1 obtains the load distribution on the seat surface from the load detected by the load sensor. The control device determines whether the occupant is an adult from the obtained load distribution. If the control device determines that the occupant is an adult, it obtains the position of the seat in which the occupant is seated. The control device determines whether to permit operation of the device depending on the seat position of the occupant operating the device and the driving state of the vehicle. If the control device determines that the occupant is not an adult, it prohibits operation of the device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-236444 Summary of the Invention [Problem to be solved by the invention]

[0004] The control device described in Patent Document 1 determines whether the occupant is an adult or a child based on the load detected by a load sensor. In Patent Document 1, adults and children can only be distinguished by weight, so a light adult may be mistakenly determined to be a child. Alternatively, a heavy child may be mistakenly determined to be an adult. As such, the device described in Patent Document 1 cannot accurately determine the attributes of the occupant, and therefore cannot control equipment according to the attributes of the occupant.

[0005] In view of the above circumstances, an object of the present disclosure is to provide an appliance operation control system, device, method, and computer-readable medium that are capable of controlling appliances according to the attributes of occupants. [Means for solving the problem]

[0006] To achieve the above object, the present disclosure provides, as a first aspect, an appliance operation control device including: a position identification means for identifying the riding positions of each of one or more occupants riding in a vehicle; an attribute identification means for identifying attributes of each of the one or more occupants from video captured by a camera that captures the interior of the vehicle; and a control means for controlling appliances inside the vehicle in accordance with the identified riding positions and attributes.

[0007] In a second aspect, the present disclosure provides an appliance operation control system. The appliance operation control system includes a camera that captures images of the interior of a vehicle and an appliance operation control device that controls appliances inside the vehicle. The appliance operation control device includes a position identification means that identifies the riding positions of one or more occupants of the vehicle, an attribute identification means that identifies attributes of each of the one or more occupants from the images captured by the camera, and a control means that controls the appliances in accordance with the identified riding positions and attributes.

[0008] In a third aspect, the present disclosure provides a device operation control method, which includes identifying a riding position of each of one or more occupants in a vehicle, identifying attributes of each of the one or more occupants from video captured by a camera that captures the interior of the vehicle, and controlling devices inside the vehicle according to the identified riding positions and attributes.

[0009] In a fourth aspect, the present disclosure provides a computer-readable medium storing a program for causing a processor to execute a process including identifying the riding positions of one or more occupants of a vehicle, identifying attributes of the one or more occupants from video captured by a camera capturing an interior of the vehicle, and controlling equipment inside the vehicle according to the identified riding positions and attributes. [Effects of the Invention]

[0010] The appliance operation control system, device, method, and computer-readable medium according to the present disclosure can control appliances according to the attributes of the occupants of the vehicle. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a schematic configuration of an appliance operation control system according to the present disclosure. [Figure 2] 1 is a block diagram showing an appliance operation control system according to a first embodiment of the present disclosure. [Figure 3] FIG. 10 is a diagram showing an example of the relationship between the position and attributes of an occupant and whether or not the controlled device can be operated. [Figure 4] 4 is a flowchart showing an operation procedure in the appliance operation control device. [Figure 5] FIG. 10 is a block diagram showing an appliance operation control system according to a second embodiment of the present disclosure. [Figure 6] FIG. 10 is a diagram showing an example of the relationship between the position, attribute, and state information of an occupant and whether or not the controlled device can be operated. [Figure 7] FIG. 10 is a block diagram showing an appliance operation control system according to a third embodiment of the present disclosure. [Figure 8] FIG. 10 is a diagram showing an example of whether or not a controlled device can be operated according to vehicle state information. [Figure 9] FIG. 2 is a block diagram showing the hardware configuration of the device operation control device. DETAILED DESCRIPTION OF THE INVENTION

[0012] Prior to describing embodiments of the present disclosure, an overview of the present disclosure will be provided. Fig. 1 shows a schematic configuration of an appliance operation control system according to the present disclosure. The appliance operation control system 10 includes an appliance operation control device 20 and a camera 30. The camera 30 captures images of the interior of a vehicle. The appliance operation control device 20 controls an appliance 50 inside the vehicle.

[0013] The equipment operation control device 20 has a position identification means 21, an attribute identification means 22, and a control means 23. The position identification means 21 identifies the riding position of each of one or more occupants riding in the vehicle. The attribute identification means 22 identifies the attribute of each of the one or more occupants from the video captured by the camera 30. The control means 23 controls the equipment 50 inside the vehicle according to the identified riding position and attribute.

[0014] In the present disclosure, the attribute identification means 22 identifies the attributes of the occupants from the video captured by the camera 30. In the present disclosure, the camera video is used to identify the attributes, so the attributes can be identified more accurately than when a load sensor is used to distinguish between adults and children. This allows the appliance operation control device 20 to control appliances according to the attributes of the occupants riding in the vehicle.

[0015] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. Note that the following description and drawings have been omitted and simplified as appropriate for clarity of explanation. In addition, in each drawing, the same or similar elements are designated by the same reference numerals, and duplicate explanations are omitted as necessary.

[0016] FIG. 2 shows an appliance operation control system according to the first embodiment of the present disclosure. The appliance operation control system 100 includes an appliance operation control device 110 and a camera 130. The camera 130 is mounted on a vehicle and captures images of the interior of the vehicle. The vehicle is a mobile object such as a passenger car, taxi, or van. The camera 130 is installed, for example, between the driver's seat and the passenger seat in a position that allows a view of the entire interior of the vehicle. The appliance operation control system 100 is not limited to one camera 130. The appliance operation control system 100 may include multiple cameras 130 arranged in a single vehicle. The appliance operation control system 100 corresponds to the appliance operation control system 10 shown in FIG. 1. The camera 130 corresponds to the camera 30 shown in FIG. 1.

[0017] The appliance operation control device 110 is connected to a camera 130 and a plurality of controlled appliances 150. The controlled appliances 150 are appliances operated inside the vehicle by a passenger in the vehicle. The controlled appliances 150 include, for example, appliances provided in the vehicle or appliances operated by a passenger when driving the vehicle. For example, the controlled appliances 150 include appliances such as an engine (main switch), power windows, a horn, a steering wheel, a parking brake, and an air conditioner. The controlled appliances 150 may also include in-vehicle appliances such as a display audio (DA) and a car navigation device. Furthermore, the controlled appliances 150 may be user appliances such as a smartphone that a passenger brings into the vehicle. The controlled appliances 150 correspond to the appliances 50 shown in FIG. 1.

[0018] The appliance operation control device 110 acquires video captured by the camera 130 and controls the controlled device 150 using the acquired video. The appliance operation control device 110 has an occupant detection unit 111, a position identification unit 112, an attribute identification unit 113, and a control unit 114. The appliance operation control device 110 is configured as a device including, for example, one or more processors and one or more memories. At least some of the functions of each unit in the appliance operation control device 110 can be realized by the processor performing processing in accordance with a program read from the memory. The appliance operation control device 110 corresponds to the appliance operation control device 20 shown in FIG. 1.

[0019] The occupant detection unit 111 detects occupants riding in the vehicle. The occupant detection unit 111 detects occupants by detecting the facial area of ​​the subject (occupant) from the video (image) captured by the camera 130. When the image includes multiple subjects and multiple facial areas are detected, the occupant detection unit 111 detects that multiple occupants are riding in the vehicle. The position identification unit 112 identifies the position in the vehicle of the occupant detected by the occupant detection unit 111. The occupant detection unit 111 may detect occupants using a sensor such as a pressure sensor provided in the seat.

[0020] When multiple occupants are detected, the position identifying unit 112 identifies the position of each of the multiple occupants. For example, the position identifying unit 112 identifies which seat of the seats in the vehicle the occupant is sitting in. For example, the position identifying unit 112 identifies the position of the occupant from an image captured by the camera 130. The position identifying unit 112 may identify the position of the occupant using a sensor such as a pressure sensor provided in the seat. The position identifying unit 112 corresponds to the position identifying means 21 shown in FIG. 1.

[0021] The attribute identification unit 113 identifies the attributes of the occupant from the video captured by the camera 130. When multiple occupants are detected, the attribute identification unit 113 identifies the attributes of each of the multiple occupants. The occupant attributes include, for example, age and gender. For example, the attribute identification unit 113 detects a face area from the camera video. The attribute identification unit 113 may estimate the age and gender based on the image of the detected face area and identify the estimated age and gender as the occupant's attributes. The attribute identification unit 113 may identify whether the occupant is an adult or a child based on the estimated age. Alternatively, the attribute identification unit 113 may perform face recognition on the image of the face area to identify a person. In this case, the attribute identification unit 113 may acquire the attributes of the identified person from a database or the like. Alternatively, restriction information regarding device usage restrictions may be assigned to people registered in the database, and the restriction information may be acquired as an attribute from the person identified by the attribute identification unit 113. The attribute identification unit 113 corresponds to the attribute identification means 22 shown in FIG. 1.

[0022] The control unit 114 controls the controlled device 150 according to the position of the occupant identified by the position identification unit 112 and the attribute of the occupant identified by the attribute identification unit 113. The control unit 114 can control multiple controlled devices 150 individually. For example, when an occupant attempts to operate a certain controlled device 150, the control unit 114 determines whether to permit the operation of the controlled device 150 according to the riding position and attribute of the occupant. For example, the control unit 114 may determine whether to permit the occupant to operate the controlled device 150 according to the riding position of each occupant and whether the occupant is an adult or a child. If the control unit 114 determines to permit the operation, it does not restrict the occupant from using the controlled device 150. In this case, the controlled device 150 operates according to the operation by the occupant. If the control unit 114 determines not to permit the operation, even if the occupant operates the controlled device 150, the control unit 114 invalidates the operation and restricts the occupant's use of the controlled device 150. The control unit 114 may restrict only some of the functions of the controlled device 150, rather than restricting the functions of the entire controlled device 150. The control unit 114 corresponds to the control means 23 shown in the figure.

[0023] If the controlled device 150 is a device provided in or installed in a vehicle, the control unit 114 may transmit a control signal to the controlled device 150 via an in-vehicle network to control the controlled device 150. If the controlled device 150 is a user device such as a smartphone, an application that communicates with the device operation control device 110 may be installed in the user device. If the control unit 114 determines that operation of the controlled device 150, which is a user device, is not permitted, the control unit 114 notifies the user device of this decision. If the application receives a notification that operation of the user device is not permitted, the application disables a predetermined function of the user device, such as a screen display. In this way, the control unit 114 can restrict operation or use of the user device in the vehicle.

[0024] 3 shows an example of the relationship between the position and attributes of an occupant and whether or not the controlled device can be operated. In this example, the position identification unit 112 identifies whether the occupant is in the right front seat (driver's seat if driving on the right side of the road), the left front seat (passenger seat), the right rear seat, or the left rear seat. The attribute identification unit 113 identifies whether the occupant is an "adult" or a "child." The control unit 114 controls controlled device 1 to controlled device n, where n is an integer equal to or greater than 2.

[0025] In FIG. 3, "YES" indicates that operation of the controlled device 150 is permitted for the combination of the riding position and the attribute. "NO" indicates that operation of the controlled device 150 is not permitted for the combination of the riding position and the attribute. For example, when the attribute of the occupant in the driver's seat is "adult," the control unit 114 permits operation of "controlled device 1" and "controlled device 2." Furthermore, when the attribute of the occupant in the passenger seat is "adult," the control unit 114 permits operation of "controlled device 2," but does not permit operation of "controlled device 1." When the attribute of the occupant in the driver's seat or the passenger seat is "child," the control unit 114 does not permit operation of "controlled device 1" and "controlled device 2."

[0026] The multiple controlled devices 150 may be divided into multiple groups depending on their installation locations (positions) in the vehicle, their uses, and the like. In this case, the control unit 114 holds information indicating which group each controlled device 150 belongs to. One controlled device 150 may belong to multiple groups. The control unit 114 may determine whether or not to allow operation for each group, instead of determining whether or not to allow operation for each controlled device 150, i.e., whether or not to restrict operation. For example, when no adult is seated in the driver's seat, the control unit 114 may not permit operation of controlled devices 150 that belong to a group of controlled devices related to driving operations, such as the engine, horn, or steering wheel. The control unit 114 may permit operation of controlled devices 150 that belong to a group of controlled devices not related to driving operations, even when no adult is seated in the driver's seat.

[0027] Specifically, for example, when there is no one in the driver's seat, the control unit 114 may permit operation of devices such as an air conditioner, but may restrict operation of the accelerator. Furthermore, when the occupant is in the driver's seat and the occupant's attribute is "child," the control unit 114 may restrict operation of the accelerator and operation to start the engine. When the vehicle is an electric vehicle, the control unit 114 may restrict activation of the vehicle system. The control unit 114 may restrict operation of devices located near the occupant's position identified by the position identification unit 112, according to the identified attribute. When the occupant is located on the right side of the rear seat and the occupant's attribute is "child," the control unit 114 may restrict operation of the power window for the rear right seat.

[0028] Next, the operation procedure will be explained. Fig. 4 shows the operation procedure (appliance operation control method) in the appliance operation control device 110. The occupant detection unit 111 acquires camera video from the camera 130 (step S1). The occupant detection unit 111 detects an occupant riding in the vehicle based on the camera video (step S2). The occupant detection unit 111 performs face detection on the camera video, for example. If a face area is detected, the occupant detection unit 111 detects that an occupant is riding in the vehicle.

[0029] The position identification unit 112 identifies the riding position of the occupant detected in step S2 (step S3). After the occupant gets into the vehicle, the position identification unit 112 may track the position of the occupant inside the vehicle. The attribute identification unit 113 identifies the attribute of the occupant detected in step S2 based on the camera image acquired from the camera 130 (step S4). In step S4, the attribute identification unit 113 estimates the age of the occupant using, for example, an image of a face area, and identifies whether the occupant is an adult or a child. The control unit 114 controls the controlled device 150 according to the riding position identified in step S3 and the attribute of the occupant identified in step S4 (step S5).

[0030] In this embodiment, the control unit 114 controls the controlled device 150 according to the position and attribute of the occupant. In this embodiment, the attribute identification unit 113 identifies the attribute of the occupant based on the image of the camera 130. In this embodiment, the camera image is used to identify the attribute. Therefore, the attribute of the occupant can be identified with higher accuracy than when identifying whether the occupant is an adult or a child based on weight. The device operation control device 110 can control the controlled device 150 according to the correctly identified attribute of the occupant.

[0031] For example, consider a case where a vehicle is stopped and an adult is resting with a child on their lap. In this case, suppose the child attempts to operate controlled device 150. In Patent Document 1, adults and children are distinguished by weight, and therefore in the above case, it is mistakenly determined that an adult is operating controlled device 150. In contrast, in this embodiment, camera footage is used to identify attributes, and therefore it is possible to correctly identify that the occupant attempting to operate the controlled device 150 is a child. In this embodiment, control unit 114 can prevent children from operating specific controlled devices 150, thereby improving safety inside the vehicle.

[0032] Next, a second embodiment of the present disclosure will be described. Fig. 5 shows an appliance operation control system according to the second embodiment of the present disclosure. In the appliance operation control system 100a according to this embodiment, the appliance operation control device 110a has an occupant status acquisition unit 115 in addition to the configuration of the appliance operation control device 110 described in the first embodiment shown in Fig. 2.

[0033] The occupant state acquisition unit (occupant state acquisition means) 115 acquires state information of occupants in the vehicle. For example, the occupant state acquisition unit 115 acquires the facial orientation or line of sight direction of each occupant detected by the occupant detection unit 111 as state information. The occupant state acquisition unit 115 outputs the occupant state information to the control unit 114. The control unit 114 controls the controlled device 150 using the occupant state information in addition to the occupant's position and attribute.

[0034] In this embodiment, for example, when an adult and a child are riding in the vehicle, the control unit 114 determines whether the adult is looking at the child based on the passenger status information. The control unit 114 determines, for example, whether the adult's face direction or line of sight direction is facing the position where the child is riding. The control unit 114 can determine whether or not to operate the controlled device 150 depending on whether or not the adult is looking at the child.

[0035] When face authentication is performed in attribute identification unit 113, control unit 114 may control controlled device 150 according to the result of face authentication and state information of the occupant. For example, attribute identification unit 113 identifies, through face authentication, whether or not the occupant is a person registered as a vehicle user. When the occupant is an adult and registered as a vehicle user, and the occupant (adult) is watching a child, control unit 114 may permit operation of specific controlled device 150.

[0036] FIG. 6 shows an example of the relationship between the position, attribute, and state information of an occupant and whether or not the controlled device can be operated. The control unit 114 determines whether or not multiple occupants are detected by the occupant detection unit 111. If multiple occupants are not detected, the control unit 114 determines whether or not the steering wheel, horn, and engine start can be operated depending on whether the occupant is an adult or a child. In the example of FIG. 6, the control unit 114 restricts the operation of the steering wheel, horn, and engine start if the occupant is a child. The control unit 114 permits the operation of the steering wheel, horn, and engine start if the occupant is an adult.

[0037] When multiple occupants are detected, the control unit 114 determines whether the occupants include an adult or a child. When the occupants include both an adult and a child, the control unit 114 determines whether the adult is watching the child. When the control unit 114 determines that the adult is not watching the child, the control unit 114 may permit operation of the steering wheel but restrict operation of the horn and engine start. When the control unit 114 determines that the adult is watching the child, the control unit 114 may permit operation of the steering wheel, horn, and engine start, assuming that the child is under adult supervision.

[0038] In this embodiment, the occupant state acquisition unit 115 acquires state information about the occupant. The control unit 114 can control the controlled device 150 according to the acquired state information. For example, when an adult is watching the child and the child is under the adult's supervision, the control unit 114 can permit the child to operate the controlled device 150. Furthermore, when the adult is not watching the child, the control unit 114 can restrict the child from operating the controlled device 150. In this way, in this embodiment, the child can be allowed to operate the controlled device 150 when the adult is watching the child. Other effects may be similar to those described in the first embodiment.

[0039] Next, a third embodiment of the present disclosure will be described. Fig. 7 shows an appliance operation control system according to the third embodiment of the present disclosure. In an appliance operation control system 100b according to this embodiment, an appliance operation control device 110a includes a vehicle information acquisition unit 116 in addition to the configuration of the appliance operation control device 110 described in the first embodiment shown in Fig. 2. In this embodiment, the appliance operation control device 110b may also include an occupant status acquisition unit 115, similar to the appliance operation control device 110a in the second embodiment shown in Fig. 5.

[0040] The vehicle information acquisition unit (vehicle information acquisition means) 116 acquires vehicle information. The vehicle information may include information indicating whether the vehicle is in operation, information indicating the shift position, and information on the operation status of the parking brake. The vehicle information may also include vehicle location information. The vehicle information acquisition unit 116 may acquire vehicle information from a device such as an ECU (Electronic Control Unit) that controls the vehicle via an in-vehicle network such as a CAN (Controller Area Network).

[0041] In this embodiment, the control unit 114 controls the controlled device 150 by using vehicle information in addition to the position and attributes of the occupant. The control unit 114 may determine whether the vehicle is being driven (traveling) based on the vehicle information, for example. The control unit 114 may determine whether the vehicle is parked in a parking lot, service area, parking area, or the like based on the vehicle position information. The control unit 114 may determine whether or not to operate the controlled device 150 depending on whether the vehicle is being driven or parked.

[0042] FIG. 8 shows an example of whether or not a controlled device can be operated according to vehicle state information. The example shown in FIG. 8 is an example when the attribute is "child." In the example of FIG. 8, control unit 114 restricts operation of the power windows, engine, and parking brake while the vehicle is being driven. When the shift position is in P and the parking brake is ON (the parking brake is applied), control unit 114 permits operation of the power windows and engine but restricts operation of the parking brake. When the shift position is in P and the parking brake is OFF, control unit 114 permits operation of the power windows and parking brake but restricts operation of the engine. In addition to the above, control unit 114 may restrict a predetermined function, such as a screen display function, of a user device such as a smartphone by the driver while the vehicle is being driven.

[0043] In this embodiment, the vehicle information acquisition unit 116 acquires vehicle information. The control unit 114 can control the controlled device 150 according to the acquired vehicle information. The control unit 114 can determine whether or not the occupant can operate the controlled device 150 according to, for example, whether the vehicle is being driven or not, the shift position, and the like. In this way, the control unit 114 can change the control of the controlled device 150 depending on, for example, whether the vehicle is being driven or not. For example, the control unit 114 prohibits children from operating the controlled device 150 related to driving while the vehicle is being driven. In this way, safety in the vehicle can be improved. Other effects may be the same as those described in the first or second embodiment.

[0044] Next, the hardware configuration of the appliance operation control device 110 will be described. Fig. 9 shows the hardware configuration of the appliance operation control device 110. The appliance operation control device 110 has a processor (CPU: Central Processing Unit) 501, a ROM (read only memory) 502, and a RAM (random access memory) 503. In the appliance operation control device 110, the processor 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. Although not shown, the appliance operation control device 110 may include other circuits such as peripheral circuits, communication circuits, and interface circuits.

[0045] The ROM 502 is a non-volatile storage device. For example, a semiconductor storage device with a relatively small capacity, such as a flash memory, is used for the ROM 502. The ROM 502 stores the programs executed by the processor 501.

[0046] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include RAM, ROM, flash memory, solid-state drive (SSD) or other memory technologies, compact discs (CDs), digital versatile discs (DVDs), Blu-ray discs or other optical disc storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices. The program may also be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0047] The RAM 503 is a volatile storage device. Various semiconductor memory devices such as a dynamic random access memory (DRAM) or a static random access memory (SRAM) are used for the RAM 503. The RAM 503 can be used as an internal buffer for temporarily storing data and the like.

[0048] The processor 501 loads the program stored in the ROM 502 into the RAM 503 and executes the program. When the CPU 501 executes the program, the functions of the various units in the appliance operation control device 110 can be realized.

[0049] The appliance operation control device 110 does not necessarily have to be a single device. The appliance operation control device 110 may be configured using multiple physically separated devices. Furthermore, the appliance operation control device 110 only needs to be able to control the controlled device 150 in the vehicle, and all of its functions do not necessarily have to be installed in the vehicle. For example, in the appliance operation control device 110, the attribute identification unit 113 may be located outside the vehicle. In this case, the attribute identification unit 113 may receive a facial image of the occupant detected by the occupant detection unit 111 via a wireless communication network. Furthermore, the attribute identification unit 113 may transmit the identified attributes of the occupant to the control unit 114 via a wireless communication network.

[0050] The above describes the embodiments of the present disclosure in detail, but the present disclosure is not limited to the above-described embodiments, and changes and modifications to the above-described embodiments that do not deviate from the spirit of the present disclosure are also included in the present disclosure.

[0051] For example, some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.

[0052] [Appendix 1] a position identification means for identifying the riding position of each of one or more occupants riding in the vehicle; an attribute identification means for identifying attributes of each of the one or more occupants from an image captured by a camera that captures the interior of the vehicle; and a control means for controlling equipment inside the vehicle in accordance with the specified riding position and attributes.

[0053] [Appendix 2] The equipment operation control device described in Appendix 1, wherein the control means determines whether or not the occupant is allowed to operate the equipment depending on the identified riding position and attributes.

[0054] [Appendix 3] 3. The device operation control device according to claim 1, wherein the attribute identification means estimates an age of the occupant and identifies an attribute of the occupant in accordance with the estimated age.

[0055] [Appendix 4] the attribute specifying means specifies whether the occupant is an adult or a child as an attribute of the occupant; The device for controlling the operation of the equipment according to any one of claims 1 to 3, wherein the control means determines whether or not the occupant is allowed to operate the equipment depending on the riding position and whether the occupant is an adult or a child.

[0056] [Appendix 5] The vehicle further includes an occupant status acquisition means for acquiring status information of the occupant based on the video image, 4. The appliance operation control device according to claim 1, wherein the control means further controls the appliance in accordance with the status information.

[0057] [Appendix 6] 6. The appliance operation control device according to claim 5, wherein the occupant state acquisition means acquires the face direction or line of sight direction of the occupant as the state information.

[0058] [Appendix 7] the attribute specifying means specifies whether the occupant is an adult or a child as an attribute of the occupant; The device operation control device described in Appendix 6, wherein, when multiple occupants are riding in the vehicle, the control means determines whether or not an occupant identified as an adult is looking at an occupant identified as a child based on the facial direction or gaze direction of the occupants, and determines whether or not the occupant identified as an adult is allowed to operate the device depending on whether or not the occupant identified as an adult is looking at the occupant identified as a child.

[0059] [Appendix 8] The vehicle information acquisition means further includes a vehicle information acquisition means for acquiring vehicle information of the vehicle, 8. The appliance operation control device according to claim 1, wherein the control means further controls the appliance in accordance with the vehicle information.

[0060] [Appendix 9] A camera that photographs the interior of the vehicle; an equipment operation control device that controls equipment inside the vehicle; The equipment operation control device includes: a position specifying means for specifying the riding position of each of one or more occupants riding in the vehicle; an attribute identification means for identifying an attribute of each of the one or more occupants from the video captured by the camera; and a control means for controlling the equipment in accordance with the specified riding position and attributes.

[0061] [Appendix 10] The equipment operation control system described in Appendix 9, wherein the control means determines whether or not the occupant is allowed to operate the equipment depending on the identified riding position and attributes.

[0062] [Appendix 11] 11. The device operation control system according to claim 9, wherein the attribute identification means estimates an age of the occupant and identifies an attribute of the occupant in accordance with the estimated age.

[0063] [Appendix 12] Identifying the riding position of each of one or more occupants of the vehicle; Identifying attributes of each of the one or more occupants from an image captured by a camera that captures the interior of the vehicle; An equipment operation control method comprising controlling equipment inside the vehicle according to the specified riding position and attributes.

[0064] [Appendix 13] Identifying the riding position of each of one or more occupants of the vehicle; Identifying attributes of each of the one or more occupants from an image captured by a camera that captures the interior of the vehicle; A non-transitory computer-readable medium storing a program for causing a processor to execute processing including controlling equipment inside the vehicle according to the identified riding location and attributes. [Explanation of symbols]

[0065] 10: Equipment operation control system 20: Equipment operation control device 21: Location identification means 22: Attribute identification means 23: Control means 30: Camera 50:Equipment 100: Equipment operation control system 110: Equipment operation control device 111: Occupant detection unit 112:Positioning part 113: Attribute identification part 114: Control unit 115: Occupant status acquisition unit 116: Vehicle information acquisition unit 130: Camera 150: Controlled equipment 501: Processor 502:ROM 503:RAM

Claims

1. a position specifying means for specifying the riding position of each of one or more occupants riding in the vehicle; an attribute specifying means for specifying, for each of the one or more occupants, whether the occupant is an adult or a child, as an attribute of the occupant, from an image captured by a camera that captures the interior of the vehicle; a control means for controlling equipment inside the vehicle in accordance with the specified riding position and attribute; The control means, when multiple occupants are riding in the vehicle, determines whether or not an occupant identified as an adult is looking at an occupant identified as a child based on the facial direction or gaze direction of the occupants, and determines whether or not the occupant identified as an adult is allowed to operate the equipment depending on whether or not the occupant identified as an adult is looking at the occupant identified as a child.

2. The device according to claim 1 , wherein the control means determines whether or not the occupant is allowed to operate the device, depending on the specified riding position and attribute.

3. The appliance operation control device according to claim 1 , wherein the attribute specifying means estimates an age of the occupant and specifies an attribute of the occupant in accordance with the estimated age.

4. the attribute specifying means specifies whether the occupant is an adult or a child as an attribute of the occupant; 4. The device for controlling operation of an appliance according to claim 1, wherein the control means determines whether or not the occupant is allowed to operate the appliance depending on the riding position and whether the occupant is an adult or a child.

5. The vehicle further includes an occupant status acquisition means for acquiring status information of the occupant based on the video image, The appliance operation control device according to claim 1 , wherein the control means further controls the appliance in accordance with the state information.

6. The appliance operation control device according to claim 5 , wherein the occupant state acquisition means acquires a facial orientation or a line of sight direction of the occupant as the state information.

7. A camera that photographs the interior of the vehicle; an equipment operation control device that controls equipment inside the vehicle; The equipment operation control device includes: a position specifying means for specifying the riding position of each of one or more occupants riding in the vehicle; an attribute specifying means for specifying, for each of the one or more occupants from the video captured by the camera, whether the occupant is an adult or a child as an attribute of the occupant; a control means for controlling the device in accordance with the specified riding position and attribute, The control means, when multiple occupants are riding in the vehicle, determines whether or not an occupant identified as an adult is looking at an occupant identified as a child based on the facial direction or gaze direction of the occupants, and determines whether or not the occupant identified as an adult is allowed to operate the device depending on whether or not the occupant identified as an adult is looking at the occupant identified as a child.

8. Identifying the riding position of each of one or more occupants of the vehicle; identifying, for each of the one or more occupants from an image captured by a camera that captures an image of the interior of the vehicle, whether the occupant is an adult or a child as an attribute of the occupant; Controlling devices inside the vehicle according to the identified riding position and attributes; When multiple occupants are riding in the vehicle, the device operation control method determines whether or not an occupant identified as an adult is looking at an occupant identified as a child based on the facial orientation or gaze direction of the occupants, and determines whether or not the occupant identified as an adult is allowed to operate the device depending on whether or not the occupant identified as an adult is looking at the occupant identified as a child.

9. Identifying the riding position of each of one or more occupants of the vehicle; identifying, for each of the one or more occupants from an image captured by a camera that captures an image of the interior of the vehicle, whether the occupant is an adult or a child as an attribute of the occupant; Controlling devices inside the vehicle according to the identified riding position and attributes; A program for causing a processor to execute processing including, when multiple occupants are riding in the vehicle, determining whether or not an occupant identified as an adult is looking at an occupant identified as a child based on the facial direction or gaze direction of the occupants, and determining whether or not the occupant identified as an adult is allowed to operate the device depending on whether or not the occupant identified as an adult is looking at the occupant identified as a child.

Images