Camera control device, camera control method, and program

Abstract

To properly turn on the power source of a camera while reducing power consumption of the camera.SOLUTION: A camera control device 18 comprises a control unit 3C for photographing using a camera 11 when a first condition is satisfied. When a second condition different from the first condition is satisfied, the control unit 3C turns on the power source of the camera 11. When the second condition is satisfied, coming to a scene using the camera 11 can be predicted.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a camera control device, a camera control method, and a program.

Background Art

[0002] Patent Document 1 describes a camera system that transfers image data while reducing power consumption. In the technology described in Patent Document 1, the camera system is realized by a notebook PC, and a camera module that is a USB device is incorporated into the housing of the notebook PC or connected to the USB connector of the housing of the notebook PC.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, a general camera module such as the camera module described in Patent Document 1 can be put into a suspend state (a state where the system is temporarily stopped) when it is not transferring image data. On the other hand, Patent Document 1 does not describe what kind of control should be performed to reduce the power consumption of the camera when waking up a camera module in the suspend state. Therefore, in the technology described in Patent Document 1, there is a possibility that the power supply of the camera cannot be appropriately switched from OFF to ON while reducing the power consumption of the camera.

[0005] In a general in-vehicle camera, after the camera startup sequence is completed after the vehicle power is turned on (the camera power is turned on), video acquisition (shooting using the camera) and video data transmission to a host device (for example, an ADU (ADAS (Advanced driver-assistance systems) Domain Unit) as shown in FIG. 2, an MM (multimedia) system, etc.) are performed. However, regardless of whether driver assistance for the vehicle driver is being implemented, video processing is always being performed (specifically, the camera acquires video and transmits video data, and the host device receives the video data and performs image processing). That is, in-vehicle power is consumed more than necessary, and the computing resources of the host device are being used. In a general in-vehicle camera, when the vehicle driver requests the display of the camera video, it is necessary to switch the display screen from, for example, the navigation display screen to the camera video display screen within a specified time. Therefore, the camera cannot be suspended as needed. Also, in a general in-vehicle camera, since the camera video is constantly transmitted to the above-described host device, the camera cannot be suspended as needed. If the camera is to be suspended, since it takes a certain amount of time for the camera state to change from the suspended state to the resume state (steady state), it is necessary to ensure that there is no problem with the responsiveness of the display screen switching. In a driver assistance function that performs image recognition (detection) using camera video, it is necessary to execute the recognition process before a driver assistance execution request is issued by the vehicle driver. Therefore, the camera video is constantly transmitted to the above-described host device. Accordingly, in a general in-vehicle camera used for driver assistance, the camera cannot be suspended as needed. If the camera is to be suspended, since it takes a certain amount of time for the camera state to change from the suspended state to the resume state (steady state) as described above, it is necessary to ensure that there is no problem with the responsiveness of the start of driver assistance.

[0006] In view of the above points, an object of the present disclosure is to provide a camera control device, a camera control method, and a program that can appropriately switch the power supply of a camera from OFF to ON while reducing the power consumption of the camera.

Means for Solving the Problems

[0007] (1) One aspect of the present disclosure includes a control unit that performs shooting using a camera when a first condition is satisfied. The control unit switches the power supply of the camera from OFF to ON when a second condition different from the first condition is satisfied, and when the second condition is satisfied, it is a time when it is predicted that a scene in which the camera is used will occur. It is a camera control device.

[0008] (2) In the camera control device of (1), the control unit switches the power supply of the camera from ON to OFF when a third condition different from the first condition and the second condition is satisfied, and when the third condition is satisfied, It may be a time when it is predicted that the scene in which the camera is used has ended.

[0009] (3) In the camera control device of (2), the camera and the camera control device are mounted on a vehicle, and a vehicle speed threshold for satisfying the second condition is larger than a vehicle speed threshold for satisfying the first condition, and It may be smaller than the vehicle speed threshold for satisfying the third condition.

[0010] (4) One aspect of the present disclosure includes a first step in which a camera control device performs shooting using a camera when a first condition is satisfied, and a second step in which the camera control device switches the power supply of the camera from OFF to ON when a second condition different from the first condition is satisfied. It is a camera control method, and when the second condition is satisfied, it is a time when it is predicted that a scene in which the camera is used will occur.

[0011] (5) One aspect of the present disclosure is a program for causing a processor to execute a first step of performing imaging using a camera when a first condition is satisfied, and a second step of switching the power of the camera from OFF to ON when a second condition different from the first condition is satisfied, wherein when the second condition is satisfied, it is a time when it is predicted that a scene using the camera will occur.

Effect of the Invention

[0012] According to the present disclosure, it is possible to appropriately switch the power of the camera from OFF to ON while reducing the power consumption of the camera.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Embodiments for Carrying Out the Invention

[0014] Hereinafter, embodiments of the camera control device, camera control method, and program of the present disclosure will be described with reference to the drawings.

[0015] <First Embodiment> FIG. 1 is a diagram showing an example of a vehicle 1 to which a camera control device 18 according to the first embodiment is applied. FIG. 2 is a diagram showing an example of a specific configuration for realizing the vehicle 1 shown in FIG. 1. In the example shown in FIG. 1, the vehicle 1 includes a camera 11, a HMI (Human Machine Interface) 12, a vehicle state sensor 13, a surrounding situation sensor 14, a position information acquisition device 15, a map information acquisition device 16, a navigation device 17, a camera control device 18, a vehicle control device 19, a steering actuator 19A, a braking actuator 19B, and a driving actuator 19C. The camera 11, for example, captures the outside of the vehicle 1 or the like, and transmits a video signal to the camera control device 18, the vehicle control device 19, and the like. In the example shown in FIG. 2, the camera 11 includes a camera 11A that captures the rear of the vehicle 1, a camera 11B that captures the front of the vehicle 1, a camera 11C that captures the left side of the vehicle 1, and a camera 11D that captures the right side of the vehicle 1.

[0016] In the example shown in FIG. 1, the HMI 12 has a function of receiving various operations of the driver of the vehicle 1, and transmits a signal indicating the operation of the driver of the vehicle 1 to the camera control device 18, the vehicle control device 19, and the like. The HMI 12 includes a shift lever used in the first camera usage scene described later, a camera switch (SW) (see FIG. 2) used in the second camera usage scene described later, an automatic display button used to switch ON / OFF of the automatic display mode in the third camera usage scene described later, a multimedia (MM) (see FIG. 2) that receives point registration in the fourth camera usage scene described later, an advanced park switch used in the seventh camera usage scene described later, a steering (and a steering angle sensor), a brake pedal (and a sensor that detects its operation amount), an accelerator pedal (and a sensor that detects its operation amount), and the like. The vehicle state sensor 13 detects the state of the vehicle 1 and transmits the detection result to the camera control device 18, the vehicle control device 19, and the like. The vehicle state sensor 13 includes a shift sensor, a vehicle speed sensor, and the like used in the first camera usage scene and the like.

[0017] The surrounding situation sensor 14 detects targets (such as obstacles, surrounding vehicles, pedestrians, etc.) existing around the vehicle 1, and transmits the detection result to the camera control device 18, the vehicle control device 19, etc. The surrounding situation sensor 14 includes a clearance sonar, etc. used in the fifth camera use scene described later. The position information acquisition device 15 acquires information indicating the position of the vehicle 1. The position information acquisition device 15 includes, for example, a GPS (Global Positioning System) device that measures the position of the vehicle 1. The position information acquisition device 15 may perform well-known self-position estimation processing (localization) to improve the accuracy of the information indicating the position of the vehicle 1. The position information acquisition device 15 transmits the information indicating the position of the vehicle 1 to the navigation device 17, the camera control device 18, the vehicle control device 19, etc. In the example shown in FIG. 2, the position information acquisition device 15 acquires the information indicating the position of the vehicle 1 from the DCM (Data Communication Module).

[0018] In the example shown in FIG. 1, the map information acquisition device 16 acquires map information from the map database and transmits the map information to the navigation device 17, etc. The map database may be stored in a storage device (not shown) mounted on the vehicle 1, or may be stored in a management server outside the vehicle 1. In the example where the map database is stored in a management server outside the vehicle 1, the map information acquisition device 16 acquires the map information from the map database via communication between the vehicle 1 and the management server. The navigation device 17 guides the driver of the vehicle 1 to the destination set by the driver of the vehicle 1. The navigation device 17 calculates a target route to the destination based on the position information of the vehicle 1 acquired by the position information acquisition device 15 and the map information acquired by the map information acquisition device 16, and presents navigation information regarding the target route to the driver of the vehicle 1 via the HMI 12 (MM in the example shown in FIG. 2).

[0019] The vehicle control device 19 is constituted by, for example, a vehicle control ECU (Electronic Control Unit) (see Fig. 2). Based on information (signals) transmitted from, for example, the camera 11, the HMI 12, the vehicle state sensor 13, the surrounding situation sensor 14, etc., the vehicle control device 19 controls the steering actuator 19A, the braking actuator 19B, and the driving actuator 19C. The driving actuator 19C includes, for example, an engine, an EV (electric vehicle) system, a hybrid system, a fuel cell system, etc.

[0020] The camera control device 18 is constituted by a microcomputer including a communication interface (I / F) 181, a memory 182, and a processor 183. The communication interface 181 has an interface circuit for connecting the camera control device 18 to the camera 11, the HMI 12, the vehicle state sensor 13, the surrounding situation sensor 14, the position information acquisition device 15, the map information acquisition device 16, the navigation device 17, the vehicle control device 19, etc. The memory 182 stores programs and various data used in the processes executed by the processor 183. The processor 183 has functions as an acquisition unit 3A, a determination unit 3B, and a control unit 3C. The acquisition unit 3A acquires a video signal from the camera 11. Also, the acquisition unit 3A acquires signals indicating operations of the driver of the vehicle 1 received by the HMI 12 (for example, shift lever operation, camera switch operation (operation requesting display of the video captured by the camera 11), automatic display button operation for switching ON / OFF of the automatic display mode, point registration operation, advanced park switch operation (operation for causing the vehicle control device 19 to control the steering actuator 19A, the braking actuator 19B, and the driving actuator 19C to perform automatic parking without the driver of the vehicle 1 having to perform steering operation, brake pedal operation, and accelerator pedal operation), etc.). Further, the acquisition unit 3A acquires detection results of the vehicle state sensor 13 (for example, shift position (R position, P position, etc.), vehicle speed, etc.), detection results of the surrounding situation sensor 14 (for example, information indicating the presence or absence of pedestrians behind the vehicle 1), etc. The determination unit 3B executes determination as to whether or not the operating conditions (first conditions) of the first camera usage scene are satisfied. The control unit 3C controls the camera 11 based on the result of the determination executed by the determination unit 3B and the like.

[0021] In the first camera usage scene, when the driver of the vehicle 1 performs a shift lever operation to move the shift position to the R position while the drive actuator 19C (engine switch in the case of an engine) is in the ON state (power switch in the case of an EV system, a hybrid system, or a fuel cell system), a screen of a back guide monitor including an image of the rear of the vehicle 1 captured by the camera 11A or the like is displayed by the HMI 12 (MM in the example shown in FIG. 2). In the first camera usage scene, the determination unit 3B executes determination as to whether or not the operating conditions (first conditions) of the camera 11 in the first camera usage scene are satisfied, that is, determination as to whether or not the shift lever is in the R position. When the operating conditions of the camera 11 in the first camera usage scene are satisfied, the control unit 3C performs imaging using the camera 11. In the example shown in FIG. 2, the control unit 3C activates an application for displaying the image captured by the camera 11 on the MM, and transmits the image captured by the camera 11 to the MM via the video display system. Further, the determination unit 3B executes determination as to whether or not the resume conditions (second conditions) of the camera 11 in the first camera usage scene are satisfied, specifically, determination as to whether or not the vehicle speed of the vehicle 1 is less than, for example, 5 km / h. When the resume conditions of the camera 11 in the first camera usage scene are satisfied, the control unit 3C switches the power of the camera 11 from OFF to ON. When the resume conditions of the camera 11 in the first camera usage scene are satisfied, it is the time when the first camera usage scene is predicted to occur. Furthermore, the determination unit 3B determines whether or not the suspension condition (third condition) of the camera 11 in the first camera usage scene is satisfied. Specifically, it determines whether or not the vehicle speed of the vehicle 1 is, for example, 10 km / h or more. When the suspension condition of the camera 11 in the first camera usage scene is satisfied, the control unit 3C switches the power supply of the camera 11 from ON to OFF. When the suspension condition of the camera 11 in the first camera usage scene is satisfied, it is the time when it is predicted that the first camera usage scene will no longer exist.

[0022] FIG. 3 is a diagram for explaining an example of the relationship between the change over time of the vehicle speed of the vehicle 1 and the determination result of the determination unit 3B. In the example shown in FIG. 3, since the vehicle speed of the vehicle 1 is 10 km / h or more during the period before time t1, the determination unit 3B determines that the suspension condition of the camera 11 in the first camera usage scene is satisfied, and the control unit 3C switches the power supply of the camera 11 from ON to OFF. During the period from time t1 to t2, since the vehicle speed of the vehicle 1 is 5 to 10 km / h, although the determination unit 3B determines that the suspension condition of the camera 11 in the first camera usage scene is not satisfied, it also determines that the resume condition of the camera 11 in the first camera usage scene is not satisfied, and the control unit 3C maintains the power supply of the camera 11 in the OFF state. During the period from time t2 to t3, since the vehicle speed of the vehicle 1 is less than 5 km / h, the determination unit 3B determines that the resume condition of the camera 11 in the first camera usage scene is satisfied, and the control unit 3C switches the power supply of the camera 11 from OFF to ON. During the period from time t3 to t4, since the vehicle speed of the vehicle 1 is 5 to 10 km / h, although the determination unit 3B determines that the resume condition of the camera 11 in the first camera usage scene is not satisfied, it also determines that the suspension condition of the camera 11 in the first camera usage scene is not satisfied, and the control unit 3C maintains the power supply of the camera 11 in the ON state. During the period from time t4 to t5, since the vehicle speed of the vehicle 1 is 10 km / h or more, the determination unit 3B determines that the suspension condition of the camera 11 in the first camera usage scene is satisfied, and the control unit 3C switches the power supply of the camera 11 from ON to OFF.

[0023] During the period from time t5 to t6, the same determination and control as during the period from time t1 to t2 are performed. During the period from time t6 to t7, the same determination and control as during the period from time t2 to t3 are performed. During the period from time t7 to t8, the same determination and control as during the period from time t3 to t4 are performed. During the period from time t8 to t9, the same determination and control as during the period from time t4 to t5 are performed. During the period from time t9 to t10, since the vehicle speed of the vehicle 1 is 5 to 10 km / h, although the determination unit 3B determines that the suspension condition of the camera 11 in the first camera usage scene is not satisfied, it also determines that the resume condition of the camera 11 in the first camera usage scene is not satisfied, and the power supply of the camera 11 is maintained in the OFF state by the control unit 3C. During the period from time t10 to t11, the same determination and control as during the period from time t4 to t5 are performed. During the period from time t11 to t12, the same determination and control as during the period from time t1 to t2 are performed. During the period from time t12 to t13, the same determination and control as during the period from time t2 to t3 are performed. During the period from time t13 to t14, the same determination and control as during the period from time t3 to t4 are performed. During the period after time t14, the same determination and control as during the period from time t4 to t5 are performed. In the example shown in FIG. 3, since the shift lever is not placed in the R position, the determination unit 3B continues to determine that the operating condition of the camera 11 in the first camera usage scene is not satisfied, and the control unit 3C does not perform shooting using the camera 11. Also, in the example shown in FIG. 3, since hysteresis is provided, it is possible to suppress the frequent switching between the ON state and the OFF state of the power supply of the camera 11.

[0024] In the example shown in FIG. 1, the determination unit 3B determines whether the operating condition of the second camera usage scene is satisfied. In the second camera usage scene, when the driver of vehicle 1 presses the camera switch with the engine switch (or power switch) in the ON state, according to the position of the shift lever, the video display system (see Figure 2) displays a video such as a panoramic view generated by synthesizing the videos captured by cameras 11A to 11D on the MM (see Figure 2). In the second camera usage scene, the determination unit 3B determines whether the operating conditions of camera 11 in the second camera usage scene are satisfied. Specifically, it determines whether the camera switch is pressed, the shift lever is in a position other than the R position, and the vehicle speed of vehicle 1 is, for example, 12 (20) km / h or less. When the operating conditions of camera 11 in the second camera usage scene are satisfied, the control unit 3C performs shooting using camera 11. In addition, the determination unit 3B determines whether the resume conditions of camera 11 in the second camera usage scene are satisfied. Specifically, it determines whether the vehicle speed of vehicle 1 is, for example, less than 25 km / h. When the resume conditions of camera 11 in the second camera usage scene are satisfied, the control unit 3C switches the power of camera 11 from OFF to ON. When the resume conditions of camera 11 in the second camera usage scene are satisfied, it is when it is predicted that the second camera usage scene will occur. Furthermore, the determination unit 3B determines whether the suspension conditions of camera 11 in the second camera usage scene are satisfied. Specifically, it determines whether the vehicle speed of vehicle 1 is, for example, 30 km / h or more. When the suspension conditions of camera 11 in the second camera usage scene are satisfied, the control unit 3C switches the power of camera 11 from ON to OFF. When the suspension conditions of camera 11 in the second camera usage scene are satisfied, it is when it is predicted that the second camera usage scene will end. In the second camera usage scene, the vehicle speed threshold (25 km / h) for satisfying the resume conditions is greater than the vehicle speed threshold (12 (20) km / h) for satisfying the operating conditions and less than the vehicle speed threshold (30 km / h) for satisfying the suspension conditions.

[0025] In addition, the determination unit 3B determines whether the operating conditions of the third camera usage scene are satisfied. In the third camera usage scene, when the driver of vehicle 1 touches the automatic display button and the automatic display mode is ON, images such as a panoramic view are automatically displayed on the MM (see Figure 2) according to the position of the shift lever and the vehicle speed of vehicle 1. In the third camera usage scene, the determination unit 3B determines whether the operating conditions of camera 11 in the third camera usage scene are satisfied. Specifically, it determines whether the automatic display mode is ON, and whether the vehicle speed of vehicle 1 has changed (decelerated) from over 10 km / h to 10 km / h or less, and whether the shift lever is in a position other than the P and R positions. When the operating conditions of camera 11 in the third camera usage scene are satisfied, the control unit 3C uses camera 11 to perform shooting. In addition, the determination unit 3B determines whether the resume conditions of camera 11 in the third camera usage scene are satisfied. Specifically, it determines whether the automatic display mode is ON and whether the vehicle speed of vehicle 1 is less than, for example, 15 km / h. When the resume conditions of camera 11 in the third camera usage scene are satisfied, the control unit 3C switches the power of camera 11 from OFF to ON. When the resume conditions of camera 11 in the third camera usage scene are satisfied, it is when it is predicted that the third camera usage scene will occur. Furthermore, the determination unit 3B determines whether the suspension conditions of camera 11 in the third camera usage scene are satisfied. Specifically, it determines whether the automatic display mode is OFF or whether the vehicle speed of vehicle 1 is, for example, 20 km / h or more. When the suspension conditions of camera 11 in the third camera usage scene are satisfied, the control unit 3C switches the power of camera 11 from ON to OFF. When the suspension conditions of camera 11 in the third camera usage scene are satisfied, it is when it is predicted that the third camera usage scene will no longer occur. In the third camera usage scene, the vehicle speed threshold (15 km / h) for satisfying the resume conditions is greater than the vehicle speed threshold (10 km / h) for satisfying the operating conditions and less than the vehicle speed threshold (20 km / h) for satisfying the suspension conditions.

[0026] Furthermore, the determination unit 3B determines whether or not the operating conditions of the fourth camera usage scene are satisfied. In the fourth camera usage scene, in conjunction with the information indicating the position of the vehicle 1 acquired by the position information acquisition device 15, when the position of the vehicle 1 reaches the vicinity of a point that has been registered in advance (point registration) using the point registration switch, an image such as a panoramic view is automatically displayed on the MM (see FIG. 2). In the fourth camera usage scene, the determination unit 3B determines whether or not the operating conditions of the camera 11 in the fourth camera usage scene are satisfied. Specifically, it determines whether the vehicle 1 is located within the area (registered point area) near the registered point, and whether the vehicle speed of the vehicle 1 is, for example, 10 km / h or less, and whether the shift lever is in a position other than the P and R positions. When the operating conditions of the camera 11 in the fourth camera usage scene are satisfied, the control unit 3C performs shooting using the camera 11. In addition, the determination unit 3B determines whether or not the resume conditions of the camera 11 in the fourth camera usage scene are satisfied. Specifically, it determines whether point registration has been performed, whether the vehicle 1 is located near the registered point area, and whether the vehicle speed of the vehicle 1 is, for example, less than 15 km / h. When the resume conditions of the camera 11 in the fourth camera usage scene are satisfied, the control unit 3C switches the power of the camera 11 from OFF to ON. When the resume conditions of the camera 11 in the fourth camera usage scene are satisfied, it is the time when it is predicted that the fourth camera usage scene will occur. Furthermore, the determination unit 3B determines whether or not the suspension conditions of the camera 11 in the fourth camera usage scene are satisfied. Specifically, it determines whether point registration has not been performed (for example, the registered point has been deleted), whether the vehicle 1 is located at a position farther from the registered point than near the registered point area, or whether the vehicle speed of the vehicle 1 is, for example, 20 km / h or more. When the suspension conditions of the camera 11 in the fourth camera usage scene are satisfied, the control unit 3C switches the power of the camera 11 from ON to OFF. When the suspension conditions of the camera 11 in the fourth camera usage scene are satisfied, it is the time when it is predicted that the fourth camera usage scene will no longer occur. In the fourth camera usage scene, the vehicle speed threshold (15 km / h) for satisfying the resume condition is greater than the vehicle speed threshold (10 km / h) for satisfying the operation condition and less than the vehicle speed threshold (20 km / h) for satisfying the suspension condition.

[0027] Further, the determination unit 3B determines whether the operation condition of the fifth camera usage scene is satisfied. In the fifth camera usage scene, in conjunction with the detection of an obstacle by the clearance sonar, the display of the distance to the obstacle is performed on the panoramic view monitor screen or the like. In the fifth camera usage scene, the determination unit 3B determines whether the operation condition of the camera 11 in the fifth camera usage scene is satisfied. Specifically, it determines whether the vehicle speed of the vehicle 1 is, for example, 10 km / h or less, and whether the shift lever is in a position other than the P and R positions, and whether an obstacle is detected by the clearance sonar. When the operation condition of the camera 11 in the fifth camera usage scene is satisfied, the control unit 3C performs shooting using the camera 11. Further, the determination unit 3B determines whether the resume condition of the camera 11 in the fifth camera usage scene is satisfied. Specifically, it determines whether the clearance sonar is in an operating state (ON state) capable of detecting an obstacle and whether the vehicle speed of the vehicle 1 is, for example, less than 15 km / h. When the resume condition of the camera 11 in the fifth camera usage scene is satisfied, the control unit 3C switches the power of the camera 11 from OFF to ON. When the resume condition of the camera 11 in the fifth camera usage scene is satisfied, it is the time when it is predicted that the fifth camera usage scene will occur. Furthermore, the determination unit 3B determines whether or not the suspension conditions of the camera 11 in the fifth camera usage scene are satisfied. Specifically, it determines whether the clearance sonar is in a non-operating state (OFF state) where it cannot detect an obstacle, or whether the vehicle speed of the vehicle 1 is, for example, 20 km / h or more. When the suspension conditions of the camera 11 in the fifth camera usage scene are satisfied, the control unit 3C switches the power of the camera 11 from ON to OFF. When the suspension conditions of the camera 11 in the fifth camera usage scene are satisfied, it is predicted that it is no longer the fifth camera usage scene. In the fifth camera usage scene, the vehicle speed threshold (15 km / h) for satisfying the resume condition is greater than the vehicle speed threshold (10 km / h) for satisfying the operating condition and less than the vehicle speed threshold (20 km / h) for satisfying the suspension condition. In the first to fifth camera usage scenes, the video captured by the camera 11 is used for video display by, for example, a video display system (see FIG. 2), MM (see FIG. 2), etc.

[0028] Furthermore, the determination unit 3B determines whether or not the operating conditions of the sixth camera usage scene are satisfied. In the sixth camera usage scene, when a rear pedestrian of the vehicle 1 is detected by the camera 11, the rear pedestrian is automatically displayed on the MM (see FIG. 2) screen. In the sixth camera usage scene, the determination unit 3B determines whether or not the operating conditions of the camera 11 in the sixth camera usage scene are satisfied. Specifically, it determines whether the vehicle speed of the vehicle 1 is, for example, 15 km / h or less, whether the shift lever is in the R position, and whether a rear pedestrian is detected by the camera 11. When the operating conditions of the camera 11 in the sixth camera usage scene are satisfied, the control unit 3C performs shooting using the camera 11. Further, the determination unit 3B determines whether or not the resume conditions of the camera 11 in the sixth camera usage scene are satisfied. Specifically, it determines whether the camera 11 is in a state where it can detect a rear pedestrian (for example, a state where the parking support brake can be activated (ON state)), and whether the vehicle speed of the vehicle 1 is less than, for example, 20 km / h. When the resume conditions of the camera 11 in the sixth camera usage scene are satisfied, the control unit 3C switches the power of the camera 11 from OFF to ON. When the resume conditions of the camera 11 in the sixth camera usage scene are satisfied, it is the time when it is predicted that the sixth camera usage scene will occur. Furthermore, the determination unit 3B determines whether or not the suspension conditions of the camera 11 in the sixth camera usage scene are satisfied. Specifically, it determines whether the camera 11 is in a state where it cannot detect a rear pedestrian (for example, a state where the parking support brake cannot be activated (OFF state)), or whether the vehicle speed of the vehicle 1 is 25 km / h or more, for example. When the suspension conditions of the camera 11 in the sixth camera usage scene are satisfied, the control unit 3C switches the power of the camera 11 from ON to OFF. When the suspension conditions of the camera 11 in the sixth camera usage scene are satisfied, it is the time when it is predicted that the sixth camera usage scene will no longer occur. In the sixth camera usage scene, the vehicle speed threshold (20 km / h) for satisfying the resume conditions is greater than the vehicle speed threshold (15 km / h) for satisfying the operation conditions, and less than the vehicle speed threshold (25 km / h) for satisfying the suspension conditions.

[0029] Also, the determination unit 3B determines whether or not the operation conditions of the seventh camera usage scene are satisfied. In the seventh camera usage scene, images taken by the camera 11 when the automatic parking of the vehicle 1 called advanced park is executed by the vehicle control device 19 are displayed on the MM (see FIG. 2) screen. In the seventh camera usage scene, the determination unit 3B determines whether the operating conditions of the camera 11 in the seventh camera usage scene are satisfied. Specifically, it determines whether the vehicle speed of the vehicle 1 is, for example, 15 km / h or less, and whether the advanced park switch (the switch to start automatic parking) has been pressed (that is, whether the advanced park function is in the ON state). When the operating conditions of the camera 11 in the seventh camera usage scene are satisfied, the control unit 3C performs shooting using the camera 11. Also, the determination unit 3B determines whether the resume conditions of the camera 11 in the seventh camera usage scene are satisfied. Specifically, it determines whether it is in a state where the advanced park function can be turned on (that is, a state where the advanced park function is not in the OFF state), and whether the vehicle speed of the vehicle 1 is, for example, less than 25 km / h. When the resume conditions of the camera 11 in the seventh camera usage scene are satisfied, the control unit 3C switches the power of the camera 11 from OFF to ON. When the resume conditions of the camera 11 in the seventh camera usage scene are satisfied, it is the time when it is predicted that the seventh camera usage scene will occur. Furthermore, the determination unit 3B determines whether the suspension conditions of the camera 11 in the seventh camera usage scene are satisfied. Specifically, it determines whether, for example, the advanced park function has been turned off by pressing the advanced park switch again during the execution of automatic parking, or whether the vehicle speed of the vehicle 1 is, for example, 30 km / h or more. When the suspension conditions of the camera 11 in the seventh camera usage scene are satisfied, the control unit 3C switches the power of the camera 11 from ON to OFF. When the suspension conditions of the camera 11 in the seventh camera usage scene are satisfied, it is the time when it is predicted that it is no longer the seventh camera usage scene. In the seventh camera usage scene, the vehicle speed threshold (25 km / h) for satisfying the resume conditions is greater than the vehicle speed threshold (15 km / h) for satisfying the operating conditions, and less than the vehicle speed threshold (30 km / h) for satisfying the suspension conditions. In the sixth to seventh camera usage scenes, the video captured by the camera 11 is used, for example, for image recognition by a recognition and detection system (see Figure 2).

[0030] Specifically, in the example shown in FIG. 1, when any of the resume conditions of the camera 11 in the first to seventh camera usage scenes is satisfied, the control unit 3C switches the power of the camera 11 from OFF to ON. Also, when all of the suspend conditions of the camera 11 in the first to seventh camera usage scenes are satisfied, the control unit 3C switches the power of the camera 11 from ON to OFF. In the example shown in FIG. 1, since the resume conditions of the camera 11 in the first to seventh camera usage scenes are set, the transition time to the first to seventh camera usage scenes can be made equal to the case where the camera 11 is always driven.

[0031] FIG. 4 is a flowchart for explaining an example of the processing executed by the processor 183 of the camera control device 18 according to the first embodiment. In the example shown in FIG. 4, in step S10, the control unit 3C turns on the power of the camera 11. In step S11, the control unit 3C executes the initial setting of the camera 11. In step S12, the control unit 3C prepares for the video output of the camera 11. In step S13, the control unit 3C starts the video transmission of the camera 11.

[0032] In steps S14 and S20, predictions regarding the camera usage scene (prediction of becoming the camera usage scene and prediction of no longer being the camera usage scene) are made. Specifically, in step S14, the determination unit 3B determines whether or not the resume condition (second condition) of the camera 11 in the camera usage scene is satisfied. That is, the determination unit 3B predicts whether or not the camera usage scene will occur. If YES, the process proceeds to step S15, and if NO, the process proceeds to step S20.

[0033] In steps S15 to S18, the camera 11 is in the resume state. Specifically, in step S15, the control unit 3C turns on the power of the camera 11. Specifically, if the power of the camera 11 is in the ON state immediately before the execution of step S15, then in step S15, the control unit 3C continues the ON state of the power of the camera 11. If the power of the camera 11 is in the OFF state immediately before the execution of step S15, then in step S15, the control unit 3C switches the power of the camera 11 from OFF to ON. In step S16, the determination unit 3B determines whether the operating conditions (first condition) of the camera 11 in the camera usage scene are satisfied. If YES, the process proceeds to step S17; if NO, the process proceeds to step S18. In step S17, the control unit 3C activates the application of the camera 11 or maintains the operating state of the application of the camera 11. In step S18, the control unit 3C stops the application of the camera 11 or maintains the stopped state of the application of the camera 11. In step S19, the determination unit 3B determines whether to end the process shown in FIG. 4. If YES (for example, when the engine switch (or power switch) is turned off), the process shown in FIG. 4 ends; if NO, the process returns to step S14.

[0034] In step S20, the determination unit 3B determines whether the suspension conditions (third condition) of the camera 11 in the camera usage scene are satisfied. That is, the determination unit 3B predicts whether the camera usage scene has ended. If YES, the process proceeds to step S22; if NO, the process proceeds to step S21. In step S21, the camera 11 is in a transient state, and in steps S22 to S23, the camera 11 is in a suspended state. Specifically, in step S22, the control unit 3C turns off the power of the camera 11. Specifically, if the power of the camera 11 is in the OFF state immediately before the execution of step S22, the control unit 3C continues the OFF state of the power of the camera 11 in step S22. If the power of the camera 11 is in the ON state immediately before the execution of step S22, the control unit 3C switches the power of the camera 11 from ON to OFF in step S22. In step S18, the control unit 3C stops the application of the camera 11 or maintains the stopped state of the application of the camera 11.

[0035] That is, in the example shown in FIG. 4, after the application of the camera 11 is stopped in step S18, if it is determined in step S14 that the resume condition of the camera 11 in the camera usage scene is satisfied, before it is determined in step S16 that the operation condition of the camera 11 in the camera usage scene is satisfied, the power of the camera 11 is switched from OFF to ON (in advance) in step S15. Therefore, the transition time to the camera usage scene can be made equal to the case where the camera 11 is constantly driven. That is, the power of the camera 11 can be appropriately switched from OFF to ON while reducing the power consumption of the camera 11.

[0036] <Second Embodiment> The vehicle 1 to which the camera control device 18 of the second embodiment is applied is configured in the same manner as the vehicle 1 to which the camera control device 18 of the first embodiment described above is applied, except for the points described later.

[0037] As described above, the vehicle 1 to which the camera control device 18 of the first embodiment is applied has a function of using the camera 11 in all of the first to seventh camera usage scenes. On the other hand, the vehicle 1 to which the camera control device 18 of the second embodiment is applied has a function of using the camera 11 in one to six of the first to seventh camera usage scenes.

[0038] <Third Embodiment> The camera control device 18 and the camera 11 of the third embodiment are configured in the same manner as the camera control device 18 and the camera 11 of the first embodiment described above, except for the points described later.

[0039] As described above, the camera control device 18 and the camera 11 of the first embodiment are mounted on the vehicle 1. On the other hand, the camera control device 18 and the camera 11 of the third embodiment are not mounted on the vehicle 1. The camera control device 18 and the camera 11 of the third embodiment are applicable to, for example, an ATM (Automatic Teller Machine) or the like. In an example of the camera control device 18 and the camera 11 of the third embodiment, for example, when the camera 11 is mounted on the ATM main body and an ATM user enters the angle of view of the camera 11, it corresponds to the time when the operating conditions of the camera 11 in the camera usage scene are satisfied. When a human sensor outside the automatic door at the entrance of the room where the ATM is installed detects an ATM user who is about to enter the room, it corresponds to the time when the resume conditions of the camera 11 in the camera usage scene are satisfied. When a human sensor inside the automatic door at the entrance of the room where the ATM is installed detects an ATM user who is about to leave the room, it corresponds to the time when the suspend conditions of the camera 11 in the camera usage scene are satisfied. In another example of the camera control device 18 and the camera 11 of the third embodiment, the camera 11 may be mounted on something other than the ATM main body.

[0040] As described above, embodiments of the camera control device, camera control method, and program of the present disclosure have been described with reference to the drawings. However, the camera control device, camera control method, and program of the present disclosure are not limited to the above-described embodiments, and appropriate changes can be made without departing from the spirit of the present disclosure. The configurations of the respective examples of the above-described embodiments may be combined as appropriate. In each of the examples of the above-described embodiments, the processing performed in the camera control device 18 (ECU) has been described as software processing performed by executing a program. However, the processing performed in the camera control device 18 may be processing performed by hardware. Alternatively, the processing performed in the camera control device 18 may be processing that combines both software and hardware. Further, a program (a program that realizes the functions of the processor 183 of the camera control device 18) stored in the memory 182 of the camera control device 18 may be recorded, provided, distributed, etc. on a computer-readable storage medium such as a semiconductor memory, a magnetic recording medium, an optical recording medium, or the like.

Explanation of Reference Numerals

[0041] 1…Vehicle, 11…Camera, 12…HMI, 13…Vehicle state sensor, 14…Surrounding situation sensor, 15…Position information acquisition device, 16…Map information acquisition device, 17…Navigation device, 18…Camera control device, 181…Communication interface, 182…Memory, 183…Processor, 3A…Acquisition unit, 3B…Determination unit, 3C…Control unit, 19…Vehicle control device, 19A…Steering actuator, 19B…Brake actuator, 19C…Drive actuator

Claims

1. A control unit that performs shooting using a camera when a first condition is satisfied, The control unit switches the power of the camera from OFF to ON when a second condition different from the first condition is satisfied, A camera control device, wherein when the second condition is satisfied, it is a time when it is predicted that a scene in which the camera is used will occur.

2. The control unit switches the power of the camera from ON to OFF when a third condition different from the first condition and the second condition is satisfied, The camera control device according to claim 1, wherein when the third condition is satisfied, it is a time when it is predicted that the scene in which the camera is used has ended.

3. The camera and the camera control device are mounted on a vehicle, The vehicle speed threshold for satisfying the second condition is greater than the vehicle speed threshold for satisfying the first condition and less than the vehicle speed threshold for satisfying the third condition. The camera control device according to claim 2.

4. A first step in which a camera control device performs shooting using a camera when a first condition is satisfied; A second step in which the camera control device switches the power of the camera from OFF to ON when a second condition different from the first condition is satisfied, and A camera control method, wherein when the second condition is satisfied, it is a time when it is predicted that a scene in which the camera is used will occur.

5. A program for causing a processor to execute a first step of performing shooting using a camera when a first condition is satisfied, and a second step of switching the power of the camera from OFF to ON when a second condition different from the first condition is satisfied, wherein when the second condition is satisfied, it is a time when it is predicted that a scene in which the camera is used will occur.

Images