Image data control device

Abstract

An image data control device 1 according to the present disclosure comprises an image data generation unit 11 that receives light and generates image data, a processing unit 21 that processes the image data, a determination unit 41 that determines whether the image data is to be transmitted to the processing unit, and a transmission unit 42 that transmits the image data to the processing unit. When the determination unit determines that the image data is to be transmitted to the processing unit, the transmission unit transmits the image data to the processing unit. When the determination unit determines that the image data is not to be transmitted to the processing unit, the transmission unit transmits alternative image data instead of the image data to the processing unit.

Description

Image data control device CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is based on Japanese Application No. 2023-081591 filed on May 17, 2023, the contents of which are incorporated herein by reference.

[0002] The present disclosure relates to an image data control device that controls the transmission of image data.

[0003] In recent years, vehicles have been considered to be equipped with a function for capturing images of the interior of the vehicle cabin using an onboard camera and recording the obtained image data. When capturing images of the interior of the vehicle cabin, it is necessary to protect the privacy of the person being captured. For example, Patent Document 1 discloses a technology in which an image capture start signal is output when the driver operates a manual switch. With this technology, images of the interior of the vehicle cabin are not captured unless the driver operates the manual switch, so that unlimited capture of images of the interior of the vehicle cabin can be avoided and privacy can be protected.

[0004] Japanese Patent Application Laid-Open No. 2002-197560

[0005] According to the technology of Patent Document 1, a system for capturing images of the interior of a vehicle can be turned on and off by manually operating a switch. However, in order to turn the system back on after it has been turned off and return it to a state where it can capture images, various processes are required, such as initialization of the imager that generates image data, the bus that transmits the image data, the microprocessor that is the main processor, etc. Therefore, there is a problem in that it is not possible to immediately resume capturing images of the interior of the vehicle.

[0006] As described above, the technology of Patent Document 1 can protect privacy by turning off the system that captures images inside the vehicle cabin, but there is a problem in that when it is desired to resume image capture by the system, the resumption of image capture is delayed. For example, a technology has been considered that automatically switches the system from an off state to an on state when triggered by a sudden start or stop of the vehicle, or an impact of a predetermined strength or greater being applied to the vehicle. Since this technology is primarily designed for the purpose of preserving evidence, there is a need to enable the system to resume image capture more quickly.

[0007] The present disclosure provides an image data control device that can protect privacy without stopping image capture.

[0008] In one aspect of the present disclosure, an image data control device includes an image data generation unit that receives light and generates image data, a processing unit that processes the image data, a judgment unit that determines whether to transmit the image data to the processing unit, and a transmission unit that transmits the image data to the processing unit, wherein the transmission unit transmits the image data to the processing unit if the judgment unit determines that the image data should be transmitted to the processing unit, and transmits alternative image data to the processing unit in place of the image data if the judgment unit determines that the image data should not be transmitted to the processing unit.

[0009] According to the image data control device of the present disclosure, even if the image data generation process by the image data generation unit is not stopped, if the judgment unit determines that the image data will not be transmitted to the processing unit, it is possible to prevent the image data from being processed by the processing unit, thereby protecting privacy.

[0010] The above and other objects, features, and advantages of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which Fig. 1 is a block diagram schematically illustrating an example configuration of an image data control device according to a first embodiment of the present disclosure, Fig. 2 is a diagram illustrating conditions for switching modes in the image data control device according to the first embodiment of the present disclosure, Fig. 3 is a flowchart schematically illustrating an example control by the image data control device according to the first embodiment of the present disclosure, Fig. 4 is a block diagram schematically illustrating an example configuration of an image data control device according to a second embodiment of the present disclosure, Fig. 5 is a block diagram schematically illustrating an example configuration of an image data control device according to a third embodiment of the present disclosure, Fig. 6 is a block diagram schematically illustrating an example configuration of an image data control device according to a fourth embodiment of the present disclosure, Fig. 7 is a block diagram schematically illustrating an example configuration of an image data control device according to a fifth embodiment of the present disclosure, Fig. 8 is a block diagram schematically illustrating an example configuration of an image data control device according to a sixth embodiment of the present disclosure, Fig. 9 is a block diagram schematically illustrating an example configuration of an image data control device according to a seventh embodiment of the present disclosure, and Fig. 10 is a diagram illustrating conditions for switching modes in an image data control device according to a modified embodiment of the present disclosure.

[0011] Hereinafter, a number of embodiments of the image data control device of the present disclosure will be described with reference to the drawings. Note that substantially the same elements in the number of embodiments will be given the same reference numerals, and the description thereof will be omitted.

[0012] (First embodiment) The image data control device 1 illustrated in Fig. 1 is a device mounted on a moving body such as a vehicle, and includes multiple, in this case, two, circuit boards 10 and 20. The circuit board 10 is, for example, a camera circuit board that handles image capture processing using a camera, and includes an imager 11, a serializer 12, a camera driver 13, and an illumination unit 14. The circuit board 20 is, for example, an ECU (Electronic Control Unit) circuit board that mainly controls the entire image data control device 1, and includes an MPU (Micro Processing Unit) 21, a deserializer 22, a power supply filter 23, and an illumination driver 24. Note that the circuit board 10 may be a board other than the camera circuit board. The circuit board 20 may be a board other than the ECU circuit board.

[0013] The imager 11 is an example of an image data generating unit, and is configured to receive light from the outside world and generate image data. The imager 11 is primarily a camera sensor, but is configured to be able to generate image data by receiving light from the outside world by working in cooperation with an onboard camera 11C mounted on the vehicle. In this case, the onboard camera 11C is positioned so that it can primarily capture images of the interior of the vehicle. Therefore, by working in cooperation with the onboard camera 11C, the imager 11 can generate image data that reflects the situation inside the vehicle's interior. The image data generated by the imager 11 is parallel data. The imager 11 transmits the generated image data to the serializer 12 via the bus 31.

[0014] The serializer 12 is an example of a conversion unit, and converts the image data transmitted from the imager 11 from parallel data to serial data. The serializer 12 transmits the image data converted into serial data to the deserializer 22 via the bus 32. The camera driver 13 controls the power supply to the in-vehicle camera 11C, the lighting unit 14, etc., and the operation of each unit.

[0015] The illumination unit 14 is an example of a light-emitting unit, and by emitting light, it increases the amount of light received by the vehicle-mounted camera 11C that cooperates with the imager 11. In this case, the illumination unit 14 is equipped with a light-emitting diode that emits near-infrared light. This light-emitting diode basically emits near-infrared light, but also emits a small amount of visible light whose wavelength is close to that of near-infrared light. Therefore, the user can visually confirm that the illumination unit 14 is emitting light.

[0016] The MPU 21 is an example of a processing unit, and is configured to be able to process image data transmitted from the imager 11. The MPU 21 can perform well-known processes on the image data transmitted from the imager 11, such as recognition processing, recording processing, storage processing, external transmission processing, and image analysis processing.

[0017] The deserializer 22 converts the image data transmitted from the serializer 12 from serial data to parallel data. The deserializer 22 transmits the image data converted into parallel data to the MPU 21 via the bus 33. The buses 31, 32, and 33 form a transmission path 34 for various data from the imager 11 to the MPU 21. The image data control device 1 is configured to transmit parallel data within the board 10 and the board 20, and to transmit serial data between the board 10 and the board 20.

[0018] The power supply filter 23 removes noise from the power supply line that supplies power to the image data control device 1. The lighting driver 24 controls the power supply to the lighting unit 14 and the operation of the lighting unit 14.

[0019] The MPU 21 executes the image data control program to virtually realize the determination processing unit 41 and the transmission processing unit 42 by software. The determination processing unit 41 and the transmission processing unit 42 may be realized by hardware or a combination of software and hardware.

[0020] The determination processing unit 41 is an example of a determination unit and is capable of executing a determination process to determine whether or not to transmit image data generated by the imager 11 to the MPU 21. The transmission processing unit 42 is an example of a transmission unit. When the determination processing unit 41 determines to transmit the image data to the MPU 21, the transmission processing unit 42 transmits an image data transmission command signal to the imager 11 via the transmission path 34. The image data transmission command signal is a signal that commands the image data generated by the imager 11 to be transmitted to the MPU 21 as is. When the determination processing unit 41 determines not to transmit the image data to the MPU 21, the transmission processing unit 42 transmits a substitute image data transmission command signal to the imager 11 via the transmission path 34. The substitute image data transmission command signal is a signal that commands the MPU 21 to transmit substitute image data that replaces the image data generated by the imager 11.

[0021] The image data control device 1 further includes an alternative image data generation processor 43 that generates alternative image data. In this case, the alternative image data generation processor 43 is provided as hardware in part of the imager 11. The alternative image data generation processor 43 may be realized by software, or may be realized by a combination of software and hardware.

[0022] The substitute image data generated by the substitute image data generation processing unit 43 may be, for example, data of a black image where the entire surface is black, data of a predetermined color image where the entire surface is a predetermined color, data of a predetermined pattern image where the entire surface is a predetermined pattern such as vertical or horizontal stripes, or data of an inspection image to be displayed on a screen when inspecting various devices. In other words, the substitute image data may be data of an image that is different from the image data generated by the imager 11, i.e., image data that reflects the status inside the vehicle cabin.

[0023] When the imager 11 receives an image data transmission command signal from the MPU 21, it transmits the generated image data as is to the MPU 21 without generating substitute image data by the substitute image data generation processing unit 43. Note that when the imager 11 receives an image data transmission command signal from the MPU 21, it may be configured such that, even though it generates substitute image data by the substitute image data generation processing unit 43, it does not transmit the substitute image data to the MPU 21, but transmits the generated image data as is to the MPU 21.

[0024] When the imager 11 receives an alternative image data transmission command signal from the MPU 21, the alternative image data generation processing unit 43 generates alternative image data and transmits the generated alternative image data as is to the MPU 21. At this time, the imager 11 continues generating image data, but does not transmit the generated image data to the MPU 21.

[0025] The illumination unit 14 emits light when the determination processing unit 41 determines that the image data should be transmitted to the MPU 21. The illumination unit 14 does not emit light when the determination processing unit 41 determines that the image data should not be transmitted to the MPU 21.

[0026] More specifically, when the determination processing unit 41 determines that the image data should be transmitted to the MPU 21, the MPU 21 transmits a light emission start command signal to the illumination driver 24 via a transmission path (not shown). The light emission start command signal is a signal that commands the illumination unit 14 to start a light emission operation. When the illumination driver 24 receives the light emission start command signal from the MPU 21, it starts the light emission operation of the illumination unit 14.

[0027] When the determination processing unit 41 determines not to transmit the image data to the MPU 21, the MPU 21 transmits a light emission stop command signal to the illumination driver 24 via a transmission path (not shown). The light emission stop command signal is a signal that commands the illumination unit 14 to stop light emission. When the illumination driver 24 receives the light emission stop command signal from the MPU 21, it stops the light emission operation of the illumination unit 14.

[0028] The image data control device 1 has a camera imaging function and an alarm issuing function. The camera imaging function is realized by cooperation between the on-board camera 11C, the imager 11, the serializer 12, the deserializer 22, and the MPU 21. The camera imaging function can be switched between a standard on state, an alternative on state, and an off state. In the standard on state, the image data generated by the imager 11 is transmitted to the MPU 21 as is. In the alternative on state, the alternative image data generated by the alternative image data generation processing unit 43 is transmitted to the MPU 21 instead of the image data generated by the imager 11. In the off state, neither the image data generated by the imager 11 nor the alternative image data generated by the alternative image data generation processing unit 43 is transmitted to the MPU 21.

[0029] The alarm issuance function issues a predetermined alarm when the camera capture function detects a predetermined unsuitable driving state or a predetermined inability to drive. Examples of unsuitable driving states include the driver looking away, closing their eyes, or feeling drowsy. Examples of inability to drive include the driver's poor posture due to a myocardial infarction or stroke, or the driver being immobile or rigid.

[0030] The alarm issuance function can be realized by various means, such as optical means, auditory means, tactile means, and olfactory means. The alarm issuance by optical means can be realized, for example, by light emission by the above-mentioned illumination unit 14, display by a meter (not shown), or screen display by a navigation device (not shown). The alarm issuance by auditory means can be realized, for example, by sound output by a sound output device such as a speaker (not shown). The alarm issuance by tactile means can be realized, for example, by vibration of the seat or steering wheel by a vibration device (not shown), force feedback detected by a force sensor (not shown), air blown by an air conditioner fan (not shown), or air blown by automatically opening a vehicle window. The alarm issuance by olfactory means can be realized, for example, by blowing a scent by an air conditioner fan (not shown). The alarm issuance function can be realized, for example, by at least one of optical means, auditory means, tactile means, and olfactory means, or by a combination of two or more of these means.

[0031] A DMS-OFF indicator (not shown) is provided in a vehicle equipped with the image data control device 1. The DMS-OFF indicator indicates whether or not a driver monitoring system (DMS) by the image data control device 1 has been switched to an off state based on human intention. When the DMS-OFF indicator is switched to a display state, it indicates that the driver monitoring system by the image data control device 1 has been switched to an off state based on human intention.

[0032] 2, the image data control device 1 is configured to be switchable between a plurality of operation modes, in this case, an ignition-off mode, a standby mode, an active mode, and a pseudo-off mode. In the ignition-off mode, the camera imaging function is off, the alarm issuance function is off, and the DMS-OFF indicator is not displayed.

[0033] When the vehicle ignition switch is switched from the ignition-off mode to the on state, the image data control device 1 transitions to either the standby mode or the pseudo-off mode. The default operation mode, either the standby mode or the pseudo-off mode, to be transitioned to when the vehicle ignition switch is switched from the off state to the on state may be set, for example, at the dealership's initial setup, with the permission of the vehicle user. In another example, the image data control device 1 may be configured to store the operation mode at the end of a ride, i.e., when the vehicle ignition switch is switched from the on state to the off state. If the stored operation mode is the standby mode or the pseudo-off mode, the default operation mode the next time the vehicle is driven may be set to the stored operation mode. When the system operation by the image data control device 1 is permitted when the vehicle ignition switch is turned on, the standby mode may be set as the default operation mode. When the system operation by the image data control device 1 is not permitted when the vehicle ignition switch is turned on, the pseudo-off mode may be set as the default operation mode. The default operating mode may be set, for example, by displaying a notice on the screen of a navigation device (not shown) that the default operating mode is to be set, and by pressing an approval button displayed on the screen, or by other methods.

[0034] In standby mode, the camera imaging function is in the standard ON state, the alarm issuance function is in the OFF state, and the DMS-OFF indicator is not displayed. In standby mode, since the camera imaging function is in the standard ON state, the image data generated by the imager 11 is transmitted to the MPU 21 as is, and light emission from the illumination unit 14 continues. In this standby mode, image data generated in an environment where a sufficient amount of light is received can be transmitted to the MPU 21 for processing. However, since the alarm issuance function is in the OFF state, even if the MPU 21 detects a predetermined inappropriate driving state or a predetermined inoperable state, a predetermined alarm will not be issued.

[0035] In the active mode, the camera imaging function is in the standard on state, the alarm issuance function is in the on state, and the DMS-OFF indicator is not displayed. In the active mode, since the camera imaging function is in the standard on state, the image data generated by the imager 11 is transmitted to the MPU 21 as is, and light emission from the illumination unit 14 continues. In this active mode, image data generated in an environment where a sufficient amount of light is received can be transmitted to the MPU 21 for processing. In addition, since the alarm issuance function is in the on state, when the MPU 21 detects a predetermined inappropriate driving state or a predetermined inoperable state, a predetermined alarm is issued.

[0036] In the pseudo-off mode, the camera imaging function is in the substitute-on state, the alarm function is in the off state, and the DMS-OFF indicator is in the on state. In the pseudo-off mode, since the camera imaging function is in the substitute-on state, instead of the image data generated by the imager 11, substitute image data generated by the substitute image data generation processing unit 43 is transmitted to the MPU 21, and light emission from the illumination unit 14 is stopped. In this pseudo-off mode, the imager 11 continues to be in the on state, i.e., the state in which image data is generated by the imager 11 continues, but substitute image data is transmitted to the MPU 21 instead of the image data. Therefore, it is possible to prevent the image data generated by the imager 11 from being processed by the MPU 21. Furthermore, since the DMS-OFF indicator is in the on state, it is possible to indicate that the driver monitoring system by the image data control device 1 has been switched off based on the driver's intention.

[0037] According to the image data control device 1, an alarm is not issued in either the standby mode or the pseudo-off mode, so it is difficult to distinguish in appearance which operation mode the image data control device 1 is operating in. Therefore, in the present disclosure, the DMS-OFF indicator is configured to be in a non-display state in the standby mode and to be in a display state in the pseudo-off mode. This makes it possible to easily distinguish whether the image data control device 1 is in the standby mode or the pseudo-off mode based on the display / non-display state of the DMS-OFF indicator.

[0038] Switching from standby mode to active mode can be performed based on the fulfillment of a predetermined condition, in this case, at least one of the first condition, second condition, third condition, fourth condition, fifth condition, and sixth condition.

[0039] The first condition can also be defined as an acceleration-type vehicle speed condition, which is a condition in which the speed of the vehicle equipped with the data control device 1 has accelerated to a predetermined speed or higher. When the first condition is met, the data control device 1 switches the operation mode from standby mode to active mode. The first condition is an example of a condition in which the data control device 1 forcibly or automatically switches from standby mode to active mode.

[0040] The second condition is, for example, a condition that a driver or passenger of the vehicle directly inputs a switching operation from standby mode to active mode to the image data control device 1. When the second condition is met, the data control device 1 switches the operation mode from standby mode to active mode. The second condition is an example of a condition when switching from standby mode to active mode is performed manually.

[0041] The image data control device 1 is provided with an operation unit (not shown) that can be manually operated by the driver or passenger of the vehicle. By operating this operation unit, the driver or passenger of the vehicle can input various operations, such as switching from standby mode to active mode.

[0042] The third condition is, for example, a condition in which an operations manager who manages the operation of multiple vehicles including a vehicle equipped with the image data control device 1 remotely inputs a switching operation from standby mode to active mode to the image data control device 1. When the third condition is met, the data control device 1 switches the operating mode from standby mode to active mode. When the third condition is met, the data control device 1 switches the operating mode from standby mode to active mode. The third condition is also an example of a condition in which switching from standby mode to active mode is performed manually.

[0043] The image data control device 1 is assumed to have a receiving unit (not shown) that can receive various signals from a terminal operated by the operations manager. Various types of operation information input by the operations manager at the terminal, such as operation information instructing switching from standby mode to active mode, are received by the receiving unit of the image data control device 1. The image data control device 1 can perform various operations, such as switching operation modes, based on the received operation information.

[0044] The fourth condition is, for example, a condition that a predetermined near-miss situation has occurred. When the fourth condition is met, the data control device 1 switches the operation mode from the standby mode to the active mode. The predetermined near-miss situation is, for example, a state in which a sudden change has occurred in the vehicle operation or vehicle behavior, such as a sudden start, a sudden stop, or abrupt steering of the vehicle; a state in which a sudden change has occurred in the detection value of the vehicle's acceleration sensor; a state in which a sudden change has occurred in the detection value of various devices that monitor the periphery of the vehicle; or a state in which an object that has suddenly approached the vehicle is detected. Examples of devices that monitor the periphery of the vehicle include well-known in-vehicle cameras, laser devices, radar devices, and proximity detection devices. The fourth condition is an example of a condition in which the image data control device 1 forcibly or automatically switches from the standby mode to the active mode.

[0045] The fifth condition is, for example, a condition that a collision with the vehicle has occurred. When the fifth condition is met, the data control device 1 switches the operation mode from standby mode to active mode. Whether a collision with the vehicle has occurred can be determined, for example, based on a sudden change in the detection value of the vehicle's acceleration sensor, or detection by the vehicle's impact sensor that an impact of a predetermined strength or greater has been applied. The fifth condition is also an example of a condition when the image data control device 1 forcibly or automatically switches from standby mode to active mode.

[0046] The sixth condition is, for example, a condition that a predetermined setting has been made in a predetermined function installed in the vehicle. When the sixth condition is met, the data control device 1 switches the operation mode from standby mode to active mode. The predetermined function related to the vehicle is, for example, an advanced driving assistance function such as a so-called ADAS (Advanced Driving Assistant System) function. The predetermined setting in the ADAS function is, for example, when level 2, which specifies driver-driven autonomous driving, is set, or when level 3, which specifies computer-driven autonomous driving, is set. The sixth condition is also an example of a condition when the image data control device 1 forcibly or automatically switches from standby mode to active mode.

[0047] The sixth condition may be set as a condition including manual switching from the standby mode to the active mode in response to a direct operation by the driver or passenger of the vehicle or a remote operation by an operations manager. The sixth condition may be set as a condition including both manual mode switching and forced or automatic mode switching by the image data control device 1.

[0048] Switching from active mode to standby mode can be performed based on the satisfaction of a predetermined condition, in this case, at least one of the seventh, eighth, ninth, and tenth conditions.

[0049] The seventh condition can also be defined as a deceleration type vehicle speed condition, which is a condition in which the speed of the vehicle equipped with the data control device 1 is decelerated to a speed lower than a predetermined speed. When the seventh condition is met, the data control device 1 switches the operation mode from the active mode to the standby mode. The seventh condition is an example of a condition in which the data control device 1 forcibly or automatically switches from the active mode to the standby mode.

[0050] The eighth condition is, for example, a condition in which the driver or passenger of the vehicle directly inputs a switching operation from active mode to standby mode to the image data control device 1. When the eighth condition is met, the data control device 1 switches the operation mode from active mode to standby mode. The eighth condition is an example of a condition in which switching from active mode to standby mode is performed manually. Note that the switching operation from active mode to standby mode can be input via the above-mentioned operation unit (not shown).

[0051] The ninth condition is, for example, a condition in which an operations manager who manages the operation of multiple vehicles including a vehicle equipped with the image data control device 1 remotely inputs a switching operation from active mode to standby mode to the image data control device 1. When the ninth condition is met, the data control device 1 switches the operating mode from active mode to standby mode. The ninth condition is also an example of a condition when switching from active mode to standby mode is performed manually. Note that operation information instructing the switching from active mode to standby mode can be acquired via the above-mentioned receiving unit (not shown).

[0052] The tenth condition is that a predetermined time has elapsed when the image data control device 1 has forcibly or automatically switched from the standby mode to the active mode based on the satisfaction of at least one of the fourth and fifth conditions described above. When the tenth condition is satisfied, the image data control device 1 switches the operating mode from the active mode to the standby mode. The tenth condition is an example of a condition when the image data control device 1 forcibly or automatically switches from the active mode to the standby mode.

[0053] The occurrence of a near miss or a vehicle collision is a temporary event that will be resolved after a certain amount of time has passed. Therefore, according to the tenth condition, when the standby mode is switched to the active mode in response to the occurrence of a near miss or a vehicle collision, the active mode is automatically returned to the standby mode after a predetermined time has passed. This makes it possible to avoid the active mode continuing even though the temporary near miss or collision has been resolved.

[0054] Switching from the standby mode or the active mode to the pseudo-off mode can be performed based on the establishment of a predetermined condition, in this case, at least one of the eleventh and twelfth conditions.

[0055] The eleventh condition is, for example, a condition in which a driver or passenger of the vehicle directly inputs a switching operation from standby mode or active mode to pseudo-off mode to the image data control device 1. When the eleventh condition is met, the data control device 1 switches the operation mode from standby mode or active mode to pseudo-off mode. The eleventh condition is an example of a condition in which switching from standby mode or active mode to pseudo-off mode is performed manually. Note that the switching operation from standby mode or active mode to pseudo-off mode can be input via the above-mentioned operation unit (not shown).

[0056] The twelfth condition is, for example, a condition in which an operations manager who manages the operation of multiple vehicles including a vehicle equipped with the image data control device 1 remotely inputs a switching operation from standby mode or active mode to pseudo-off mode to the image data control device 1. When the twelfth condition is met, the data control device 1 switches the operating mode from standby mode or active mode to pseudo-off mode. The twelfth condition is also an example of a condition when switching from standby mode or active mode to pseudo-off mode is performed manually. Note that operation information instructing the switching from standby mode or active mode to pseudo-off mode can be acquired via the above-mentioned receiving unit (not shown).

[0057] The pseudo-off mode can be switched to the standby mode based on the establishment of a predetermined condition, in this case, at least one of the thirteenth and fourteenth conditions.

[0058] The thirteenth condition is, for example, a condition in which the driver or passenger of the vehicle directly inputs a switching operation from the pseudo-off mode to the standby mode to the image data control device 1. When the thirteenth condition is met, the data control device 1 switches the operation mode from the pseudo-off mode to the standby mode. The thirteenth condition is an example of a condition in which switching from the pseudo-off mode to the standby mode is performed manually. Note that the switching operation from the pseudo-off mode to the standby mode can be input via the above-mentioned operation unit (not shown).

[0059] The fourteenth condition is, for example, a condition in which an operations manager who manages the operation of multiple vehicles including a vehicle equipped with the image data control device 1 remotely inputs a switching operation from pseudo-off mode to standby mode to the image data control device 1. When the fourteenth condition is met, the data control device 1 switches the operating mode from pseudo-off mode to standby mode. The fourteenth condition is also an example of a condition when switching from pseudo-off mode to standby mode is performed manually. Note that operation information instructing the switching from pseudo-off mode to standby mode can be acquired via the above-mentioned receiving unit (not shown).

[0060] Switching from pseudo-off mode to active mode can be performed based on the fulfillment of a predetermined condition, in this case, at least one of the fifteenth, sixteenth, seventeenth, eighteenth, and nineteenth conditions.

[0061] The fifteenth condition is, for example, a condition in which the driver or passenger of the vehicle directly inputs a switching operation from the pseudo-off mode to the active mode to the image data control device 1. When the fifteenth condition is met, the image data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The fifteenth condition is an example of a condition in which switching from the pseudo-off mode to the active mode is performed manually. Note that the switching operation from the pseudo-off mode to the active mode can be input via the above-mentioned operation unit (not shown).

[0062] The sixteenth condition is, for example, a condition in which an operations manager who manages the operation of multiple vehicles including a vehicle equipped with the image data control device 1 remotely inputs a switching operation from pseudo-off mode to active mode to the image data control device 1. When the sixteenth condition is met, the data control device 1 switches the operating mode from pseudo-off mode to active mode. The sixteenth condition is also an example of a condition for manually switching from pseudo-off mode to active mode. Note that the operation information instructing the switching from pseudo-off mode to active mode can be acquired via the above-mentioned receiving unit (not shown).

[0063] The seventeenth condition is, for example, a condition that a predetermined near-miss situation has occurred. When the seventeenth condition is met, the data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The seventeenth condition is an example of a condition when the image data control device 1 forcibly or automatically switches from the pseudo-off mode to the active mode.

[0064] The eighteenth condition is, for example, a condition that a vehicle collision has occurred. When the eighteenth condition is met, the data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The eighteenth condition is also an example of a condition when the image data control device 1 forcibly or automatically switches from the pseudo-off mode to the active mode.

[0065] The 19th condition is, for example, a condition that a predetermined setting has been made in a predetermined function installed in the vehicle. When the 19th condition is met, the data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The 19th condition is also an example of a condition when the image data control device 1 forcibly or automatically switches from the pseudo-off mode to the active mode.

[0066] The 19th condition may be set as a condition including manual switching from the pseudo-off mode to the active mode in response to a direct operation by the driver or passenger of the vehicle or a remote operation by an operations manager. The 19th condition may be set as a condition including both manual mode switching and forced or automatic mode switching by the image data control device 1.

[0067] A twentieth condition is further provided as a condition for switching the operation mode from the active mode to the pseudo-off mode.

[0068] The 20th condition is that a predetermined time has elapsed when the quasi-off mode has been forcibly or automatically switched to the active mode based on the satisfaction of at least one of the above-mentioned conditions 17 and 18. When the 20th condition is satisfied, the data control device 1 switches the operating mode from the active mode to the quasi-off mode. The 20th condition is an example of a condition when the image data control device 1 forcibly or automatically switches from the active mode to the quasi-off mode.

[0069] According to the 20th condition, when the pseudo-off mode is switched to the active mode in response to the occurrence of a near-miss situation or a collision with the vehicle, the active mode is automatically switched back to the pseudo-off mode after a predetermined time has elapsed. This makes it possible to avoid the active mode continuing even though the temporary near-miss situation or collision situation has been resolved, as with the 10th condition described above.

[0070] 3 shows an example of control by the image data control device 1. Here, an example of operation from a state in which the image data control device 1 is switched to the standby mode or the active mode will be described.

[0071] When the image data control device 1 enters standby mode or active mode (step S1), it starts emitting light from the illumination unit 14 (step S2). The image data control device 1 continues generating image data using the imager 11 (step S3). The image data control device 1 stops generating substitute image data using the substitute image data generation processing unit 43 (step S4). The image data control device 1 transmits the image data generated by the imager 11 to the MPU 21 (step S5).

[0072] The image data control device 1 may operate the image data generation process, i.e., the imaging process (step S3) by the imager 11, and the light emission process, i.e., the illumination process (step S2) by the illumination unit 14 in synchronization with each other, or may operate them asynchronously. In other words, the image data control device 1 may perform the illumination process by the illumination unit 14 in accordance with the clock of the imaging process by the imager 11, or may perform the illumination process by the illumination unit 14 without synchronizing it with the clock of the imaging process by the imager 11. When performing the illumination process by the illumination unit 14 without synchronizing it with the clock of the imaging process by the imager 11, the image data control device 1 may perform the illumination process by the illumination unit 14 at all times, i.e., continuously.

[0073] The image data control device 1 monitors whether predetermined conditions for switching from standby mode or active mode to pseudo-off mode, such as the above-mentioned 11th condition, 12th condition, and 20th condition, are met (steps S6, S7, and S8). If none of the 11th condition, 12th condition, and 20th condition are met ("NO" in all of steps S6, S7, and S8), the image data control device 1 proceeds to step S1. Note that if none of the 11th condition, 12th condition, and 20th condition are met ("NO" in all of steps S6, S7, and S8), the image data control device 1 may proceed to any of steps S2 to S5.

[0074] If any one of the 11th, 12th, and 20th conditions is met ("YES" in any one of steps S6, S7, and S8), the image data control device 1 determines that it is set not to transmit the image data generated by the imager 11 to the MPU 21, and ends the currently active operating mode of either standby mode or active mode, and starts pseudo-off mode (step S9).

[0075] As described above, the 20th condition is a condition for switching the operation mode from the active mode to the pseudo-off mode. Therefore, when the standby mode is started in step S1, the image data control device 1 may omit the process of step S8, that is, the process for determining whether the 20th condition is met.

[0076] When the image data control device 1 starts the pseudo-off mode (step S9), it stops light emission from the illumination unit 14 (step S10). The image data control device 1 continues generating image data using the imager 11 (step S11). That is, the image data control device 1 not only continues image capture processing using the imager 11 in standby mode and active mode, but also continues image capture processing using the imager 11 in pseudo-off mode. However, the image data control device 1 starts generating substitute image data using the substitute image data generation processing unit 43 (step S12). The image data control device 1 transmits the substitute image data generated by the substitute image data generation processing unit 43 to the MPU 21 instead of the image data generated by the imager 11 (step S13).

[0077] The image data control device 1 monitors whether predetermined conditions for switching from the pseudo-off mode to the standby mode or the active mode, such as the above-mentioned 13th, 14th, 15th, 16th, 17th, 18th, and 19th conditions, are met (steps S14, S15, S16, S17, S18, S19, and S20). If none of the 13th, 14th, 15th, 16th, 17th, 18th, and 19th conditions is met ("NO" in all of steps S14, S15, S16, S17, S18, S19, and S20), the image data control device 1 proceeds to step S9. In addition, if none of the conditions 13, 14, 15, 16, 17, 18, and 19 is met ("NO" in any of steps S14, S15, S16, S17, S18, S19, and S20), the image data control device 1 may proceed to any of steps S10 to S13.

[0078] If any one of the conditions 13, 14, 15, 16, 17, 18, and 19 is met ("YES" in any one of steps S14, S15, S16, S17, S18, S19, and S20), the image data control device 1 determines that the image data generated by the imager 11 is set to be transmitted to the MPU 21, terminates the pseudo-off mode, and starts the standby mode or the active mode (step S1).

[0079] At this time, if the 13th condition or the 14th condition is met ("YES" in step S14 or step S15), the image data control device 1 starts the standby mode in step S1. If any one of the 15th condition, 16th condition, 17th condition, 18th condition, and 19th condition is met ("YES" in any one of steps S16, S17, S18, S19, and S20), the image data control device 1 starts the active mode in step S1.

[0080] The image data control device 1 continues to execute the above-mentioned control, for example, from when the ignition switch of the vehicle is turned on until it is turned off. Note that the image data control device 1 may be configured to start a pseudo-off mode as a default state immediately after the ignition switch of the vehicle is turned on, and then switch to a standby mode or an active mode when a predetermined condition is met, and thereafter maintain the standby mode or the active mode until the ignition switch of the vehicle is turned off.

[0081] According to the exemplary configuration of the image data control device 1 disclosed herein, when the determination processing unit 41 determines that the image data should be transmitted to the MPU 21, that is, when the transmission of the image data is permitted, the transmission processing unit 42 transmits the image data generated by the imager 11 as is to the MPU 21. When the determination processing unit 41 determines that the image data should not be transmitted to the MPU 21, that is, when the transmission of the image data is not permitted, the transmission processing unit 42 generates substitute image data in place of the image data generated by the imager 11 using the substitute image data generation processing unit 43 and transmits the generated substitute image data to the MPU 21.

[0082] According to this configuration example, even if the image data generation process, i.e., the image capturing process, by the imager 11 is not stopped, in a predetermined case, in this case, when the image data control device 1 is switched to the pseudo-off mode, it is possible to prevent the image data from being processed by the MPU 21. This makes it possible to prevent the image data reflecting the situation inside the vehicle cabin from being processed indefinitely, and to fully protect privacy.

[0083] According to the configuration example of the present disclosure, even when the image data control device 1 is switched to the pseudo-off mode, the imager 11, the in-vehicle camera 11C, the serializer 12, the deserializer 22, and the MPU 21 are not turned off. Therefore, when the image data control device 1 is switched from the pseudo-off mode to the active mode, the image data generation process, i.e., the imaging process, by the imager 11 can be quickly resumed.

[0084] According to the exemplary configuration of the image data control device 1, a component for generating substitute image data, called the substitute image data generation processor 43, is provided as an independent component that does not share a common function with other components. According to this exemplary configuration, the substitute image data generation processor 43 can concentrate on generating substitute image data, enabling the generation of substitute image data to be performed more reliably and more quickly. Note that the substitute image data generation processor 43 may not be provided as part of the imager 11, but may instead be provided as a circuit independent of various components such as the imager 11, serializer 12, deserializer 22, and MPU 21. This further enhances the independence of the substitute image data generation processor 43.

[0085] In this exemplary configuration of the image data control device 1, the substitute image data generation processing unit 43 is provided in the imager 11. In this exemplary configuration, the imager 11 that generates image data can transmit substitute image data in place of the image data itself. Therefore, although the independence of the substitute image data generation processing unit 43 is somewhat reduced, it is possible to more reliably prevent image data from being erroneously transmitted from the imager 11 when it has been determined that the image data should not be transmitted to the MPU 21.

[0086] According to the configuration example of the image data control device 1, the illumination unit 14 emits light to increase the amount of light received by the vehicle-mounted camera 11C that cooperates with the imager 11. This allows clearer image data to be generated and transmitted to the MPU 21.

[0087] The illumination unit 14 is set to emit light when the determination processing unit 41 determines that the image data should be transmitted to the MPU 21. The illumination unit 14 is set not to emit light when the determination processing unit 41 determines that the image data should not be transmitted to the MPU 21.

[0088] According to this configuration example, the user can easily visually confirm whether or not image data is being transmitted to the MPU 21 based on whether or not light is emitted from the lighting unit 14.

[0089] The illumination unit 14 may be configured not to emit light when the determination processing unit 41 determines that the image data should be transmitted to the MPU 21, and to emit light when the determination processing unit 41 determines that the image data should not be transmitted to the MPU 21. According to this configuration example, it is difficult to increase the amount of light received by the in-vehicle camera 11C that cooperates with the imager 11, but it is possible for the user to visually recognize whether or not the image data is being transmitted to the MPU 21 based on the presence or absence of light emitted from the illumination unit 14.

[0090] The illumination unit 14 may be configured to emit light in different modes depending on whether the determination processing unit 41 has determined to transmit image data to the MPU 21 or not. This configuration example also allows the user to visually recognize whether image data is being transmitted to the MPU 21 based on the difference in the light emission mode from the illumination unit 14. Possible light emission modes from the illumination unit 14 include, for example, a mode in which light is emitted continuously, a mode in which light is emitted intermittently, a mode in which the intensity of light is changed, a mode in which the color of light is changed, a mode in which the wavelength of light is changed, and the like.

[0091] The image data control device 1 may be configured to execute the image data generation process by the imager 11 and the alternative image data generation process by the alternative image data generation processing unit 43 in synchronization, or may be configured to execute them asynchronously.

[0092] 4 has a substitute image data generation processing unit 43 in the MPU 21 instead of the imager 11. In this configuration example, the image data generated by the imager 11 is transmitted to the MPU 21 regardless of whether the determination processing unit 41 determines to transmit the image data to the MPU 21 or not.

[0093] If the determination processing unit 41 determines that the image data should be transmitted to the MPU 21, that is, if the processing of the image data is permitted, the MPU 21 processes the image data transmitted from the imager 11. If the determination processing unit 41 determines that the image data should not be transmitted to the MPU 21, that is, if the processing of the image data is not permitted, the MPU 21 processes the substitute image data generated by the substitute image data generation processing unit 43, rather than the image data transmitted from the imager 11.

[0094] Even with this configuration example, it is possible to prevent image data from being processed by the MPU 21 in certain cases without stopping the image data generation process, i.e., the imaging process, by the imager 11, thereby ensuring sufficient privacy protection.

[0095] In this configuration example, when the determination processing unit 41 determines not to transmit image data to the MPU 21, at least one of the components among the imager 11, the in-vehicle camera 11C, the serializer 12, the deserializer 22, and the MPU 21 may be switched from an ON state to an OFF state. In this configuration example, for example, a component that takes a relatively short time to change from an OFF state to an ON state and has a relatively small impact on the time until the image data generation process, i.e., the image capture process, starts may be preferentially switched from an ON state to an OFF state. This makes it possible to shorten the time until the image capture process that has been stopped starts, and by turning off some of the components, it is possible to reduce power consumption.

[0096] 5 includes a substitute image data generation processing unit 43 not in the imager 11 or the MPU 21, but in the serializer 12 provided on the transmission path 34 between the imager 11 and the MPU 21. In this configuration example, the image data generated by the imager 11 is transmitted to the serializer 12 regardless of whether the determination processing unit 41 determines to transmit the image data to the MPU 21 or not.

[0097] If the determination processing unit 41 determines that the image data should be transmitted to the MPU 21, that is, if processing of the image data is permitted, the serializer 12 transmits the image data transmitted from the imager 11 as is to the MPU 21. If the determination processing unit 41 determines that the image data should not be transmitted to the MPU 21, that is, if processing of the image data is not permitted, the serializer 12 transmits to the MPU 21 the substitute image data generated by the substitute image data generation processing unit 43, rather than the image data transmitted from the imager 11. The serializer 12 can grasp the result of the determination made by the determination processing unit 41, for example, based on a signal transmitted from the MPU 21 via the transmission path 34.

[0098] The MPU 21 processes image data when it is transmitted from the serializer 12. The MPU 21 processes alternative image data when it is transmitted from the serializer 12.

[0099] Even with this configuration example, it is possible to prevent image data from being processed by the MPU 21 in certain cases without stopping the image data generation process, i.e., the imaging process, by the imager 11, thereby ensuring sufficient privacy protection.

[0100] In this configuration example, when the determination processing unit 41 determines not to transmit image data to the MPU 21, at least one of the components of the in-vehicle camera 11C and the imager 11 may be switched from an ON state to an OFF state. Even in this configuration example, for example, a component that takes a relatively short time to change from an OFF state to an ON state and has a relatively small impact on the time until the image data generation process, i.e., the image capture process, starts may be preferentially switched from an ON state to an OFF state. This makes it possible to shorten the time until the image capture process that has been stopped starts, and by turning off some of the components, it is possible to reduce power consumption.

[0101] The image data control device 1 may be configured so that the substitute image data generation processing unit 43 is provided in the deserializer 22 provided on the transmission path 34 between the imager 11 and the MPU 21. Alternatively, the image data control device 1 may be configured so that the substitute image data generation processing unit 43 is provided between the imager 11 and the MPU 21 as an independent component different from the serializer 12 and the deserializer 22.

[0102] (Fourth embodiment) The image data control device 1 illustrated in Fig. 6 further includes a microphone 51. The microphone 51 is an example of a sound data generator and is configured to receive sound and generate sound data. In this case, the microphone 51 is disposed in a position where it can collect sound generated within the vehicle cabin. In the image data control device 1, the MPU 21 is further configured to process the sound data generated by the microphone 51. The determination processing unit 41 is further configured to determine whether or not to transmit the sound data generated by the microphone 51 to the MPU 21. The transmission processing unit 42 is further configured to transmit the sound data generated by the microphone 51 to the MPU 21. Note that the imager 11, serializer 12, MPU 21, deserializer 22, determination processing unit 41, transmission processing unit 42, etc. are not shown in Fig. 6.

[0103] In the image data control device 1, when the determination processing unit 41 determines that the sound data should be transmitted to the MPU 21, that is, when permission to process the sound data is granted, the transmission processing unit 42 transmits the sound data as is to the MPU 21. In the image data control device 1, when the determination processing unit 41 determines that the sound data should not be transmitted to the MPU 21, that is, when permission to process the sound data is denied, the transmission processing unit 42 transmits substitute sound data to the MPU 21 in place of the sound data.

[0104] The image data control device 1 further includes a substitute sound data generation processor 52 that generates substitute sound data. The substitute sound data generation processor 52 is an example of a substitute sound data generator. The substitute sound data generation processor 52 may be included in either one of the components of the MPU 21 or the microphone 51. Alternatively, the substitute sound data generation processor 52 may be included as a component independent of the MPU 21, the microphone 51, etc., in the transmission path from the microphone 51 to the MPU 21. The substitute sound data generation processor 52 may be realized by software, by hardware, or by a combination of software and hardware.

[0105] The substitute sound data generated by the substitute sound data generation processing unit 52 may be, for example, silent data or data of a predetermined sound. In other words, the substitute sound data may be sound data that is different from the sound data generated by the microphone 51, i.e., sound data that reflects the sound generated inside the vehicle cabin.

[0106] The image data generated by the imager 11 is visual information that reflects the situation inside the vehicle cabin. The sound data generated by the microphone 51 is auditory information that reflects the situation inside the vehicle cabin. Both the image data generated by the imager 11 and the sound data generated by the microphone 51 are information that may in some cases violate the privacy of the driver and passengers of the vehicle.

[0107] According to the configuration example of this embodiment, in the image data control device 1 that can prevent image data from being processed in a predetermined case without stopping the image data generation process by the imager 11, it is also possible to prevent sound data from being processed by the MPU 21 in a predetermined case without stopping the sound data generation process by the microphone 51. This makes it possible to fully protect privacy not only from a visual perspective but also from an auditory perspective.

[0108] (Fifth Embodiment) The image data control device 1 illustrated in FIG. 7 further includes sensors 61 and 62. The sensors 61 and 62 are each an example of a situation data generator, and are configured to generate situation data indicating the situation inside the vehicle cabin. The sensor 61 is configured to generate situation data indicating situations that directly relate to people's privacy, such as the pulse, heart rate, and body temperature of the driver and passengers. The sensor 62 is configured to generate situation data indicating situations that do not directly relate to people's privacy, such as the temperature, humidity, carbon dioxide concentration, and illuminance inside the vehicle cabin. Note that the situation data detected by the sensor 62 may be situation data that indirectly relate to people's privacy.

[0109] In the image data control device 1, the MPU 21 is further configured to be able to process situation data generated by the sensors 61 and 62. The determination processing unit 41 is further configured to be able to determine whether or not to transmit the situation data generated by the sensors 61 and 62 to the MPU 21. The transmission processing unit 42 is further configured to be able to transmit the situation data generated by the sensors 61 and 62 to the MPU 21. Note that the imager 11, serializer 12, MPU 21, deserializer 22, determination processing unit 41, transmission processing unit 42, etc. are also omitted from illustration in FIG.

[0110] In the image data control device 1, when the determination processing unit 41 determines that the situation data should be transmitted to the MPU 21, that is, when permission to process the situation data is granted, the transmission processing unit 42 transmits the situation data as is to the MPU 21. In the image data control device 1, when the determination processing unit 41 determines that the situation data should not be transmitted to the MPU 21, that is, when permission to process the situation data is denied, the transmission processing unit 42 transmits substitute situation data to the MPU 21 in place of the situation data.

[0111] The image data control device 1 further includes an alternative situation data generation processor 63 that generates alternative situation data. The alternative situation data generation processor 63 is an example of an alternative situation data generator. The alternative situation data generation processor 63 may be included in either one of the components of the MPU 21 or the sensor 61. Alternatively, the alternative situation data generation processor 63 may be included in either one of the components of the MPU 21 or the sensor 62. Alternatively, the alternative situation data generation processor 63 may be included as a component independent of the MPU 21, the sensors 61, 62, etc., on the transmission path from the sensors 61, 62 to the MPU 21. The alternative situation data generation processor 63 may be realized by software, by hardware, or by a combination of software and hardware.

[0112] The alternative situation data generated by the alternative situation data generation processing unit 63 may be, for example, meaningless dummy data, etc. In other words, the alternative situation data may be data of a situation different from the situation data generated by the sensors 61 and 62, i.e., situation data that directly or indirectly reflects the privacy of people in the vehicle cabin.

[0113] The situation data generated by the sensor 61 is information that directly relates to people's privacy and is highly likely to invade the privacy of the driver and passengers of the vehicle. The situation data generated by the sensor 62 is information that does not directly relate to people's privacy, but in some cases it may invade the privacy of the driver and passengers of the vehicle.

[0114] According to the configuration example of this embodiment, in the image data control device 1 that can prevent image data from being processed in a predetermined case without stopping the generation process of image data by the imager 11, it is also possible to prevent situation data from being processed by the MPU 21 in a predetermined case without stopping the generation process of situation data by the sensors 61 and 62. This makes it possible to sufficiently protect privacy not only from a visual perspective, but also from the perspective of, for example, biological information such as the pulse, heart rate, and body temperature of the driver and passengers, and environmental information such as the temperature, humidity, carbon dioxide concentration, and illuminance in the vehicle cabin surrounding the driver and passengers.

[0115] In addition, the alternative situation data generation processing unit 63 may be configured to generate alternative situation data for situation data from sensor 61 that directly relates to a person's privacy, and not to generate alternative situation data for situation data from sensor 62 that does not directly relate to a person's privacy.

[0116] (Sixth embodiment) The image data control device 1 illustrated in FIG. 8 includes a main imager 11m and a sub-imager 11s. The main imager 11m is an example of a main image data generation unit, and is configured to work in cooperation with the main vehicle-mounted camera 11Cm to receive light from the outside world and generate main image data. The sub-imager 11s is an example of a sub-image data generation unit, and is configured to work in cooperation with the sub-vehicle-mounted camera 11Cs to receive light from the outside world and generate sub-image data. The main vehicle-mounted camera 11Cm is a camera arranged to capture, for example, the driver's seat and passenger seat, which are the front part of the vehicle interior. The sub-vehicle-mounted camera 11Cs is a camera arranged to capture, for example, the rear seat, which is the rear part of the vehicle interior.

[0117] In the image data control device 1, when the determination processing unit 41 determines that the main image data should be transmitted to the MPU 21, that is, when permission to process the image data is granted, the transmission processing unit 42 transmits both the main image data and the sub-image data as is to the MPU 21. In the image data control device 1, when the determination processing unit 41 determines that the main image data should not be transmitted to the MPU 21, that is, when permission to process the image data is denied, the transmission processing unit 42 transmits to the MPU 21 main substitute image data that replaces the main image data and sub-substitute image data that replaces the sub-image data.

[0118] The image data control device 1 includes a main substitute image data generation processor 71 that generates main substitute image data, and a sub substitute image data generation processor 72 that generates sub substitute image data. The main substitute image data generation processor 71 is included in any one of the components of the main imager 11m, the serializer 12, the MPU 21, and the deserializer 22. Alternatively, the main substitute image data generation processor 71 is included as a component independent of the main imager 11m, the serializer 12, the MPU 21, the deserializer 22, etc. The sub substitute image data generation processor 72 is included in any one of the components of the sub-imager 11s, the serializer 12, the MPU 21, and the deserializer 22. Alternatively, the sub substitute image data generation processor 72 is included as a component independent of the sub-imager 11s, the serializer 12, the MPU 21, the deserializer 22, etc. The main substitute image data generation processing unit 71 and the sub substitute image data generation processing unit 72 may be realized by software, by hardware, or by a combination of software and hardware.

[0119] The main substitute image data generated by the main substitute image data generation processor 71 and the sub substitute image data generated by the sub substitute image data generation processor 72 may be, for example, black image data where the entire surface is black, predetermined color image data where the entire surface is a predetermined color, or predetermined pattern image data where the entire surface is a predetermined pattern such as vertical or horizontal stripes. In other words, the main substitute image data may be image data that is different from the main image data generated by the main imager 11m, i.e., image data that reflects the situation inside the vehicle's cabin. The sub substitute image data may be image data that is different from the sub image data generated by the sub imager 11s, i.e., image data that reflects the situation inside the vehicle's cabin.

[0120] The main substitute image data and the sub substitute image data may be data of the same substitute image, or may be data of different substitute images. In other words, the image data control device 1 may be configured to generate, for example, black image data, which is entirely black, as the main substitute image data, and predetermined pattern image data, which is entirely a predetermined pattern, as the sub substitute image data.

[0121] In this embodiment, when image data is transmitted from the main imager 11m, image data is also transmitted from the sub-imager 11s, and when alternative image data is transmitted from the main imager 11m, alternative image data is also transmitted from the sub-imager 11s. According to this configuration example, when a vehicle is equipped with multiple on-board cameras 11Cm, 11Cs, the image capturing processes of the multiple on-board cameras 11Cm, 11Cs can be controlled in conjunction with the operation of one of the on-board cameras, in this case the main on-board camera 11Cm. This prevents, for example, a situation in which an alternative image is transmitted from the on-board camera 11Cm but an image of the interior of the vehicle is transmitted directly from the other on-board cameras 11Cs, thereby further enhancing privacy protection.

[0122] The number of onboard cameras mounted on a vehicle is not limited to two, and may be three or more. The onboard cameras may not have a master-slave relationship, such as a main and a sub, but may all be in an equal relationship. In this case, if one of the onboard cameras is switched to a mode that transmits alternative images, all the other onboard cameras are forcibly switched to a mode that transmits alternative images, thereby further ensuring privacy protection.

[0123] Seventh Embodiment The image data control device 1 illustrated in FIG. 9 includes an alarm issuance function control processing unit 81. The alarm issuance function control processing unit 81 is an example of an alarm issuance function control unit, and is configured to be able to control switching between on and off of the alarm issuance function of the image data control device 1. In the present disclosure, the alarm issuance function control processing unit 81 is provided in the MPU 21. The alarm issuance function control processing unit 81 may be virtually realized by software, may be realized by hardware, or may be realized by a combination of software and hardware. When the MPU 21 receives substitute image data, the alarm issuance function control processing unit 81 switches the alarm issuance function of the image data control device 1 from on to off.

[0124] The signal for switching the alarm function from an ON state to an OFF state can be embedded, for example, in a portion of the substitute image data. The portion for embedding the signal for switching the alarm function from an ON state to an OFF state can be, for example, a brightness information storage portion provided in the first line of the substitute image data, the header portion of the substitute image data, or another portion. The alarm function control processing unit 81 can analyze the substitute image data received by the MPU 21 and switch the alarm function from an ON state to an OFF state if a predetermined condition is met as a result of the analysis processing. The predetermined condition can be, for example, a condition that the frequency of zero brightness is equal to or greater than a threshold value as a result of histogram processing of the substitute image data.

[0125] According to this embodiment, the alarm function can be switched on and off using substitute image data, eliminating the need for a new data communication configuration for switching the alarm function on and off, thereby simplifying the software and hardware configurations related to data communication.

[0126] (Other Embodiments) The present disclosure is not limited to the above-described embodiments, and modifications and extensions may be made as appropriate without departing from the spirit of the present disclosure. For example, the image data control device 1 may be configured by appropriately selecting and combining the above-described embodiments.

[0127] The image data control device 1 may be configured such that the imager 11, the MPU 21, etc. are mounted on a single common board. In this configuration example, the serializer 12 and the deserializer 22 may be unnecessary.

[0128] A condition for switching from the standby mode or the active mode to the pseudo-off mode may further be that a switching operation from the standby mode or the active mode to the pseudo-off mode is input using a predetermined application. The predetermined application may be installed in, for example, a terminal communicably connected to the image data control device 1.

[0129] A condition for switching from standby mode or active mode to pseudo-off mode may further be set when a warning notification urging switching from standby mode or active mode to pseudo-off mode is received from a warning system communicably connected to the image data control device 1. Another condition may also be set as a condition for switching from standby mode or active mode to pseudo-off mode.

[0130] A condition for switching from the pseudo-off mode to the standby mode or the active mode may further be inputting a switching operation from the pseudo-off mode to the standby mode or the active mode using a predetermined application.

[0131] A condition for switching from the pseudo-off mode to the standby mode or the active mode may further be a condition in which a warning notification urging the user to switch from the pseudo-off mode to the standby mode or the active mode is received from a warning system communicably connected to the image data control device 1. Another condition may also be set as a condition for switching from the pseudo-off mode to the standby mode or the active mode.

[0132] It is advisable to provide means for informing the user before using the image data control device 1 that the operation mode of the image data control device 1 may be forcibly switched.

[0133] The vehicle-mounted cameras 11C, 11Cm, and 11Cs may be cameras that receive light other than near-infrared light, and the illumination unit 14 may be a camera that emits light other than near-infrared light.

[0134] 10, the image data control device 1 may be configured to set the camera imaging function to an alternative on state instead of a standard on state in the standby mode. According to this configuration example, the camera imaging function can be set to the alternative on state, i.e., the same state, in both the standby mode and the pseudo-off mode, and the system configuration can be simplified compared to when the camera imaging function is set to different states in both the standby mode and the pseudo-off mode.

[0135] Although the present disclosure has been described with reference to the embodiments, it is understood that the present disclosure is not limited to the embodiments or structures. The present disclosure also encompasses various modifications and modifications within the scope of equivalents. In addition, various combinations and forms, as well as other combinations and forms including only one element, more than one element, or less than one element, are also within the scope and spirit of the present disclosure.

[0136] The controller and the method described herein may be implemented by a special-purpose computer configured with a processor and memory programmed to perform one or more functions embodied in a computer program. Alternatively, the controller and the method described herein may be implemented by a special-purpose computer configured with a processor comprising one or more dedicated hardware logic circuits. Alternatively, the controller and the method described herein may be implemented by one or more special-purpose computers configured with a processor and memory programmed to perform one or more functions in combination with a processor configured with one or more hardware logic circuits. Furthermore, the computer program may be stored in a computer-readable non-transitory tangible storage medium as instructions executed by a computer.

[0137] In addition to the inventions described in the claims, the present disclosure further includes the following inventions.

[0138] [1] An image data control device comprising: an image data generation unit (11) that receives light and generates image data; a processing unit (21) that processes the image data; a judgment unit (41) that judges whether or not to transmit the image data to the processing unit; and a transmission unit (42) that transmits the image data to the processing unit, wherein the transmission unit transmits the image data to the processing unit when the judgment unit judges that the image data should be transmitted to the processing unit, and transmits substitute image data that replaces the image data to the processing unit when the judgment unit judges that the image data should not be transmitted to the processing unit.

[0139] [2] The image data control device according to [1], further comprising an alternative image data generation unit (43) that generates the alternative image data.

[0140] [3] The image data control device according to [2], wherein the alternative image data generation unit is provided in the image data generation unit.

[0141] [4] The image data control device according to [2], wherein the alternative image data generation unit is provided in the processing unit.

[0142] [5] The image data control device according to [2], wherein the alternative image data generation unit is provided between the image data generation unit and the processing unit.

[0143] [6] The image data control device according to [5], further comprising a conversion unit (12) between the image data generation unit and the processing unit that converts the image data from parallel data to serial data, and the alternative image data generation unit is provided in the conversion unit.

[0144] [7] The image data control device according to any one of [1] to [6], wherein the processing unit switches off an alarm function that issues a predetermined alarm when the processing unit receives the substitute image data.

[0145] [8] An image data control device according to any one of [1] to [7], wherein when the judgment unit determines that the image data should not be transmitted to the processing unit, at least one of the image data generation unit and the processing unit is switched to an off state.

[0146] [9] An image data control device according to any one of [1] to [8], further comprising a light-emitting unit (14) that emits light to increase the amount of light received by the image data generation unit, wherein the light-emitting unit emits light when the determination unit determines that the image data should be transmitted to the processing unit, and does not emit light when the determination unit determines that the image data should not be transmitted to the processing unit.

[0147]

[10] An image data control device according to any one of [1] to [9], further comprising a sound data generation unit (51) that receives sound and generates sound data, wherein the processing unit is further capable of processing the sound data, the determination unit is further capable of determining whether or not to transmit the sound data to the processing unit, and the transmission unit is further capable of transmitting the sound data to the processing unit, wherein the transmission unit transmits the sound data to the processing unit when the determination unit determines that the sound data should be transmitted to the processing unit, and transmits substitute sound data to the processing unit in place of the sound data when the determination unit determines that the sound data should not be transmitted to the processing unit.

[0148]

[11] An image data control device as described in any one of [1] to

[10] , further comprising a situation data generation unit (61, 62) that generates situation data indicating the situation inside the vehicle cabin, wherein the processing unit is further capable of processing the situation data, the judgment unit is further capable of determining whether or not to transmit the situation data to the processing unit, and the transmission unit is further capable of transmitting the situation data to the processing unit, wherein the transmission unit transmits the situation data to the processing unit when the judgment unit determines that the situation data should be transmitted to the processing unit, and transmits alternative situation data to the processing unit in place of the situation data when the judgment unit determines that the situation data should not be transmitted to the processing unit.

[0149]

[12] An image data control device according to any one of [1] to

[11] , comprising a main image data generation unit (11m) and a sub image data generation unit (11s) as the image data generation unit, wherein the main image data generation unit generates main image data as the image data, the sub image data generation unit generates sub image data as the image data, and the transmission unit transmits the main image data and the sub image data to the processing unit when the determination unit determines that the main image data should be transmitted to the processing unit, and transmits main alternative image data that replaces the main image data and sub alternative image data that replaces the sub image data to the processing unit when the determination unit determines that the main image data should not be transmitted to the processing unit.

Claims

1. an image data generating unit (11) that receives light and generates image data; a processing unit (21) for processing the image data; a determination unit (41) that determines whether or not the image data is to be transmitted to the processing unit; a transmission unit (42) that transmits the image data to the processing unit; Equipped with The transmission unit When the determination unit determines that the image data should be transmitted to the processing unit, the image data is transmitted to the processing unit; An image data control device that transmits alternative image data to the processing unit in place of the image data when the judgment unit determines not to transmit the image data to the processing unit, and turns on the image data generation unit and the processing unit.

2. 2. The image data control device according to claim 1, further comprising an alternative image data generation unit (43) that generates the alternative image data.

3. 3. The image data control device according to claim 2, wherein the alternative image data generating section is provided in the image data generating section.

4. 3. The image data control device according to claim 2, wherein the alternative image data generating section is provided in the processing section.

5. 3. The image data control device according to claim 2, wherein the alternative image data generation section is provided between the image data generation section and the processing section.

6. a conversion unit (12) for converting the image data from parallel data to serial data is provided between the image data generation unit and the processing unit; 6. The image data control device according to claim 5, wherein the alternative image data generating section is provided in the converting section.

7. The image data control device according to claim 1 , wherein the processing unit switches off an alarm issuing function that issues a predetermined alarm when the processing unit receives the substitute image data.

8. The image data generating unit further includes a light emitting unit (14) that emits light to increase the amount of light received by the image data generating unit, The light emitting unit emitting light when the determination unit determines that the image data should be transmitted to the processing unit; 2. The image data control device according to claim 1, wherein the determining section does not emit light when the determining section determines that the image data should not be transmitted to the processing section.

9. Further provided is a sound data generating unit (51) that receives sound and generates sound data, the processing unit is further capable of processing the sound data; the determination unit is further capable of determining whether or not to transmit the sound data to the processing unit; the transmission unit is further capable of transmitting the sound data to the processing unit, The transmission unit If the determination unit determines that the sound data should be transmitted to the processing unit, the sound data is transmitted to the processing unit; 2. The image data control device according to claim 1, wherein, when the determining section determines that the sound data should not be transmitted to the processing section, substitute sound data in place of the sound data is transmitted to the processing section.

10. The vehicle interior control system further includes a situation data generating unit (61, 62) for generating situation data indicating a situation inside the vehicle interior, The processing unit is further capable of processing the situation data, the determination unit is further capable of determining whether or not to transmit the situation data to the processing unit; the transmission unit is further capable of transmitting the status data to the processing unit, The transmission unit When the determination unit determines that the situation data should be transmitted to the processing unit, the situation data is transmitted to the processing unit; 2. The image data control device according to claim 1, wherein when said determining section determines not to transmit said situation data to said processing section, substitute situation data in place of said situation data is transmitted to said processing section.

11. The image data generating unit includes a main image data generating unit (11m) and a sub image data generating unit (11s), the main image data generation unit generates main image data as the image data, the sub-image data generation unit generates sub-image data as the image data, The transmission unit When the determination unit determines that the main image data should be transmitted to the processing unit, the main image data and the sub-image data are transmitted to the processing unit; 2. The image data control device according to claim 1, wherein when the judgment unit determines not to transmit the main image data to the processing unit, main alternative image data that replaces the main image data and sub alternative image data that replaces the sub image data are transmitted to the processing unit.