Image data control device

Abstract

This image data control device (1) is provided with: an image data generation unit (11) that receives light and generates image data; a processing unit (21) that processes the image data; a determination unit (41) that determines whether or not to transmit the image data to the processing unit; and a transmission unit (42) that transmits the image data to the processing unit, the transmission unit transmitting the image data to the processing unit when the determination unit determines that the image data is transmitted to the processing unit, and transmitting the image data to the processing unit when the determination unit determines that the image data is transmitted to the processing unit. When the determination unit determines that the image data is not to be transmitted to the processing unit, alternative image data, which replaces the image data, is transmitted to the processing unit.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to Japanese Application No. 2023-081591, filed on May 17, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to an image data control device for controlling the transmission of image data. Background Technology

[0004] In recent years, there has been a growing interest in incorporating features in vehicles that can capture images of the interior of the passenger compartment using onboard cameras and record the resulting data. Protecting the privacy of those being photographed is crucial when photographing inside the passenger compartment. For example, Patent Document 1 discloses a technique where the driver manually activates a switch to signal the start of photography. According to this technique, photography inside the passenger compartment is not initiated unless the driver operates the manual switch, thus preventing unrestricted photography of the passenger compartment and protecting privacy.

[0005] Patent Document 1: Japanese Patent Application Publication No. 2002-197560

[0006] According to the technology in Patent Document 1, the system for filming inside the train carriage can be switched on / off by a person operating a manual switch. However, in order to reopen the temporarily shut-down system and restore it to a state where filming can continue, various processes are required, such as initialization processing of the imager that generates image data, the bus that transmits image data, and the microprocessor that becomes the main processing unit. Therefore, there is a problem that filming inside the train carriage cannot be resumed immediately.

[0007] As described above, while privacy can be protected by shutting down the system that films the inside of the vehicle, there is a delay in restarting the system-based filming if one wants to resume filming. For example, a technology that automatically switches the system from a closed state to an open state triggered by factors such as sudden vehicle start-up or stop, or an impact of a specified intensity or greater on the vehicle, is also considered. This technology is primarily designed for evidence preservation, therefore, a faster resumption of system-based filming is required. Summary of the Invention

[0008] This disclosure provides an image data control device that can protect privacy even without stopping the recording.

[0009] In one embodiment of the present disclosure, an image data control device includes an image data generation section that accepts light and generates image data, a processing section that processes the image data, a determination section that determines whether or not to transfer the image data to the processing section, and a transfer section that transfers the image data to the processing section, the transfer section transferring the image data to the processing section when the determination section determines to transfer the image data to the processing section and transferring substitute image data instead of the image data to the processing section when the determination section determines not to transfer the image data to the processing section.

[0010] According to the image data control device of the present disclosure, even if the generation processing of the image data based on the image data generation section is not stopped, it is possible to avoid the processing of the image data by the processing section when the determination section determines not to transfer the image data to the processing section, and it is possible to achieve protection of privacy. BRIEF DESCRIPTION OF DRAWINGS

[0011] The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0012] Figure 1 is a block diagram schematically showing a configuration example of an image data control device of a first embodiment of the present disclosure,

[0013] Figure 2 is a graph illustrating conditions for switching modes in the image data control device of the first embodiment of the present disclosure,

[0014] Figure 3 is a flowchart schematically showing a control example of the image data control device of the first embodiment of the present disclosure,

[0015] Figure 4 is a block diagram schematically showing a configuration example of an image data control device of a second embodiment of the present disclosure,

[0016] Figure 5 is a block diagram schematically showing a configuration example of an image data control device of a third embodiment of the present disclosure,

[0017] Figure 6 is a block diagram schematically showing a configuration example of an image data control device of a fourth embodiment of the present disclosure,

[0018] Figure 7 is a block diagram schematically showing a configuration example of an image data control device of a fifth embodiment of the present disclosure,

[0019] Figure 8 is a block diagram schematically showing a configuration example of an image data control device of a sixth embodiment of the present disclosure,

[0020] Figure 9 is a block diagram schematically showing a configuration example of an image data control apparatus of a seventh embodiment of the present disclosure,

[0021] Figure 10 is a diagram illustrating a condition for switching a mode in an image data control apparatus of a modified embodiment of the present disclosure. DETAILED DESCRIPTION

[0022] Hereinafter, a plurality of embodiments of an image data control apparatus of the present disclosure will be described with reference to the drawings. Further, the same reference numerals are attached to actually the same elements in the plurality of embodiments, and the description thereof will be omitted.

[0023] (First Embodiment)

[0024] Figure 1 The illustrated image data control apparatus 1 is, for example, an apparatus mounted on a mobile body such as a vehicle, and has a plurality of, in this case, two, substrates 10, 20. The substrate 10 is, for example, a camera circuit substrate that undertakes a photographing process of a camera, and has an imager 11, a serializer 12, a camera driver 13, an illumination section 14, and the like. The substrate 20 is, for example, an ECU circuit substrate (ECU: Electronic Control Unit) that undertakes control of the entire image data control apparatus 1, and has an MPU 21 (MPU: Micro Processing Unit), a deserializer 22, a power filter 23, an illumination driver 24, and the like. Further, the substrate 10 can be a substrate other than the camera circuit substrate. The substrate 20 can be a substrate other than the ECU circuit substrate.

[0025] The imager 11 is one example of an image data generation section, and is configured to be able to generate image data by accepting light from the outside. Further, the imager 11, although mainly a camera sensor, is configured to be able to generate image data based on light reception from the outside by cooperating with a vehicle-mounted camera 11C mounted on a vehicle. In this case, the vehicle-mounted camera 11C is mainly disposed at a position capable of photographing the inside of a vehicle cabin. Thus, the imager 11 is able to generate image data reflecting the situation inside the vehicle cabin by cooperating with the vehicle-mounted camera 11C. The image data generated by the imager 11 is parallel data. The imager 11 transmits the generated image data to the serializer 12 via a bus 31.

[0026] The serializer 12 is an example of a conversion section that converts image data transmitted from the imager 11 from parallel data to serial data. The serializer 12 transmits the image data converted to serial data to the deserializer 22 via the bus 32. The camera driver 13 controls, for example, the supply of electric power to the in-vehicle camera 11C, the illumination section 14, and the like, and the operation of each section.

[0027] The illumination section 14 is an example of a light-emitting section that increases the light-receiving amount of the in-vehicle camera 11C in cooperation with the imager 11 by emitting light. In this case, the illumination section 14 is provided with a light-emitting diode that emits near-infrared light. The light-emitting diode basically emits near-infrared light, but also slightly emits visible light having a wavelength close to near-infrared light. Therefore, the user can visually confirm the state of light emission of the illumination section 14.

[0028] The MPU 21 is an example of a processing section that is configured to be able to process image data transmitted from the imager 11. The MPU 21 is able to perform, for example, known processing such as recognition processing, recording processing, saving processing, transmission processing to the outside, image analysis processing, and the like on image data transmitted from the imager 11.

[0029] The deserializer 22 converts image data transmitted from the serializer 12 from serial data to parallel data. The deserializer 22 transmits the image data converted to parallel data to the MPU 21 via the bus 33. The buses 31, 32, 33 construct a transmission path 34 of various data from the imager 11 to the MPU 21. The image data control device 1 is configured to transmit parallel data within the substrate 10 and within the substrate 20, and to transmit serial data between the substrate 10 and the substrate 20.

[0030] The power supply filter 23 removes noise on a power supply line that supplies electric power to the image data control device 1. The illumination driver 24 controls the supply of electric power to the illumination section 14 and the operation of the illumination section 14.

[0031] The MPU 21 virtually realizes the determination processing section 41 and the transmission processing section 42 by software by executing an image data control program. The determination processing section 41 and the transmission processing section 42 can also be realized by hardware, or can be realized by a combination of software and hardware.

[0032] The judging processing section 41 is an example of a judging section and can perform a judging process of judging whether or not to transmit the image data generated by the imager 11 to the MPU 21. The transmission processing section 42 is an example of a transmission section. The transmission processing section 42 transmits an image data transmission command signal to the imager 11 via the transmission path 34 in the case where the judging processing section 41 judges to transmit the image data to the MPU 21. The image data transmission command signal is a signal that commands the image data generated by the imager 11 to be directly transmitted to the MPU 21. The transmission processing section 42 transmits a substitute image data transmission command signal to the imager 11 via the transmission path 34 in the case where the judging processing section 41 judges not to transmit the image data to the MPU 21. The substitute image data transmission command signal is a signal that commands substitute image data that substitutes the image data generated by the imager 11 to be transmitted to the MPU 21.

[0033] The image data control device 1 further has a substitute image data generation processing section 43 that generates substitute image data. In this case, the substitute image data generation processing section 43 is provided as a part of the imager 11 as hardware. The substitute image data generation processing section 43 can also be realized by software, or by a combination of software and hardware.

[0034] The substitute image data generated by the substitute image data generation processing section 43 can be, for example, data of a black image in which the entire surface is black, data of a prescribed color image in which the entire surface is a prescribed color, data of a prescribed pattern image in which the entire surface is a prescribed pattern such as vertical stripes or horizontal stripes, or data of an inspection image that is displayed on a screen at the time of inspection of various devices. In other words, the substitute image data is data of an image that is different from the image data generated by the imager 11, that is, data of an image that reflects the situation inside the vehicle cabin.

[0035] The imager 11, in the case where the image data transmission command signal is received from the MPU 21, does not generate substitute image data by the substitute image data generation processing section 43, but directly transmits the generated image data to the MPU 21. Further, the imager 11 can also be configured so that, in the case where the image data transmission command signal is received from the MPU 21, although substitute image data is generated by the substitute image data generation processing section 43, the substitute image data is not transmitted to the MPU 21, but the generated image data is directly transmitted to the MPU 21.

[0036] The imager 11, in the case where the substitute image data transmission command signal is received from the MPU 21, generates substitute image data by the substitute image data generation processing section 43, and directly transmits the generated substitute image data to the MPU 21. At this time, the imager 11 continues the generation of image data, but does not transmit the generated image data to the MPU 21.

[0037] The illumination section 14 emits light in a case where the judgment processing section 41 judges to transmit the image data to the MPU 21. The illumination section 14 does not emit light in a case where the judgment processing section 41 judges not to transmit the image data to the MPU 21.

[0038] More specifically, the MPU 21 transmits a light emission start command signal to the illumination driver 24 via a transmission path not shown in a case where the judgment processing section 41 judges to transmit the image data to the MPU 21. The light emission start command signal is a signal that commands the illumination section 14 to start a light emission operation. The illumination driver 24 starts the light emission operation of the illumination section 14 if the light emission start command signal is received from the MPU 21.

[0039] The MPU 21 transmits a light emission stop command signal to the illumination driver 24 via a transmission path not shown in a case where the judgment processing section 41 judges not to transmit the image data to the MPU 21. The light emission stop command signal is a signal that commands the illumination section 14 to stop the light emission operation. The illumination driver 24 stops the light emission operation of the illumination section 14 if the light emission stop command signal is received from the MPU 21.

[0040] The image data control device 1 has a camera shooting function and an alarm issuing function. The camera shooting function is realized by cooperation of the in-vehicle camera 11C, the imager 11, the serializer 12, the deserializer 22, and the MPU 21. The camera shooting function can be switched to a standard type ON state, a substitute type ON state, and an OFF state. In the standard type ON state, the image data generated by the imager 11 is directly transmitted to the MPU 21. In the substitute type ON state, the substitute image data generated by the substitute image data generation processing section 43 is transmitted to the MPU 21 instead of the image data generated by the imager 11. In the OFF state, neither the image data generated by the imager 11 nor the substitute image data generated by the substitute image data generation processing section 43 is transmitted to the MPU 21.

[0041] The alarm issuing function is a function of issuing a predetermined alarm in a case where a predetermined driving unsuitable state or a predetermined driving impossible state is detected by the camera shooting function. The driving unsuitable state is, for example, a state in which the driver is looking aside, a state in which the driver is closing his eyes, a state in which the driver is drowsy, or the like. The driving impossible state is, for example, a state in which the posture of the driver collapses due to myocardial infarction or stroke, a state in which the immobility or stiffness of the driver is confirmed, or the like.

[0042] The alarm issuing function can be implemented through various methods, such as optical, auditory, tactile, and olfactory methods. For example, an optical alarm issuing method can be implemented through the illumination of the aforementioned lighting unit 14, the display of an instrument panel (not shown), or the screen display of a navigation device (not shown). For example, an auditory alarm issuing method can be implemented through the sound output of a sound output device such as a speaker (not shown). For example, a tactile alarm issuing method can be implemented through the vibration of a seat or steering wheel (not shown), the feedback of force detected by a force sensor (not shown), the airflow of an air conditioner fan (not shown), or the airflow of automatically opening vehicle windows. For example, an olfactory alarm issuing method can be implemented through the airflow of a fragrance from an air conditioner fan (not shown). For example, the alarm issuing function can be implemented through at least one of the optical, auditory, tactile, and olfactory methods, or by combining two or more methods.

[0043] The vehicle equipped with the image data control device 1 has a DMS-OFF indicator (not shown). The DMS-OFF indicator indicates whether the driver monitoring system (DMS) based on the image data control device 1 is switched off based on human intention. When the DMS-OFF indicator is switched to the display state, it indicates that the driver monitoring system based on the image data control device 1 is switched off based on human intention.

[0044] like Figure 2 As illustrated, the image data control device 1 is configured to switch between multiple operating modes, including ignition off mode, standby mode, active mode, and pseudo-off mode. In ignition off mode, the camera shooting function is off, the alarm issuing function is off, and the DMS-OFF indicator is not displayed.

[0045] The image data control device 1 moves to either one of the standby mode and the pseudo-off mode if the ignition switch of the vehicle is switched from the off state to the on state. For example, the default operation mode to which the vehicle user or the like is permitted to move when the ignition switch of the vehicle is switched from the off state to the on state can be set to be either one of the standby mode and the pseudo-off mode at the time of initial setting by a dealer or the like. In another example, the image data control device 1 can be configured to store the operation mode at the time when the ride is finished, that is, at the time when the ignition switch of the vehicle is switched from the on state to the off state, and to set the default operation mode at the next ride to the stored operation mode if the stored operation mode is either one of the standby mode and the pseudo-off mode. In a case where the operation of the system based on the image data control device 1 is permitted in response to the on of the ignition switch of the vehicle, the standby mode can be set as the default operation mode. In a case where the operation of the system based on the image data control device 1 is not permitted in response to the on of the ignition switch of the vehicle, the pseudo-off mode can be set as the default operation mode. For the setting of the default operation mode, for example, the gist of setting the default operation mode can be informed on the screen of the navigation device which is not shown, and the setting can be made based on the pressing of an agreement button displayed on the screen, or the setting can be made by another method.

[0046] In the standby mode, the camera shooting function is in the standard open state, the alarm issuing function is in the off state, and the DMS-OFF indicator is in the non-display state. In the standby mode, since the camera shooting function is in the standard open state, the image data generated by the imager 11 is directly transmitted to the MPU 21, and the emission from the illumination section 14 continues. According to this standby mode, it is possible to transmit the image data generated in an environment in which sufficient light amount is ensured to the MPU 21 to be processed. However, since the alarm issuing function is in the off state, even if the prescribed driving unsuitability state or the prescribed un-drivable state is detected by the MPU 21, the prescribed alarm is not issued.

[0047] In the active mode, the camera shooting function is in the standard open state, the alarm issuing function is in the on state, and the DMS-OFF indicator is in the non-display state. In the active mode, since the camera shooting function is in the standard open state, the image data generated by the imager 11 is directly transmitted to the MPU 21, and the emission from the illumination section 14 continues. According to this active mode, it is possible to transmit the image data generated in an environment in which sufficient light amount is ensured to the MPU 21 to be processed. In addition, since the alarm issuing function is in the on state, if the prescribed driving unsuitability state or the prescribed un-drivable state is detected by the MPU 21, the prescribed alarm is issued.

[0048] In the pseudo-off mode, the camera shooting function is in the alternative on state, the alarm issuance function is in the off state, and the DMS-OFF indicator is in the display state. In the pseudo-off mode, since the camera shooting function is in the alternative on state, the substitute image data generated by the substitute imager 11 is transmitted to the MPU 21 instead of the image data generated by the substitute image data generation processing section 43, and the light emission from the illuminating section 14 is stopped. According to this pseudo-off mode, although the on state of the imager 11, that is, the state in which the image data is generated by the imager 11 is continued, the substitute image data is transmitted to the MPU 21 instead of the image data. Therefore, it is possible to avoid the processing of the image data generated by the imager 11 by the MPU 21. In addition, since the DMS-OFF indicator is in the display state, it is possible to show that the driver monitoring system based on the image data control device 1 is switched to the off state based on the intention of the person.

[0049] According to the image data control device 1, the alarm issuance is not performed in either of the standby mode and the pseudo-off mode. Therefore, it is difficult to distinguish which of the standby mode and the pseudo-off mode the image data control device 1 is operated in from the appearance. Therefore, in the present disclosure, the DMS-OFF indicator is made to be in the non-display state in the standby mode and is made to be in the display state in the pseudo-off mode. Thus, it is possible to easily distinguish which of the standby mode and the pseudo-off mode the image data control device 1 is switched to based on the display / non-display state of the DMS-OFF indicator.

[0050] The switching from the standby mode to the active mode can be performed based on the prescribed condition, that is, at least any one of the first condition, the second condition, the third condition, the fourth condition, the fifth condition, and the sixth condition is satisfied.

[0051] The first condition can also be defined as an acceleration type vehicle speed condition, which is a condition in which the speed of the vehicle on which the image data control device 1 is mounted is accelerated to a prescribed speed or more. If the first condition is satisfied, the image data control device 1 switches the operation mode from the standby mode to the active mode. The first condition is one example of the condition in the case where the image data control device 1 forcibly or automatically switches from the standby mode to the active mode.

[0052] The second condition is, for example, a condition in which the driver or the occupant of the vehicle directly inputs a switching operation from the standby mode to the active mode to the image data control device 1. If the second condition is satisfied, the image data control device 1 switches the operation mode from the standby mode to the active mode. The second condition is one example of the condition in the case where the switching from the standby mode to the active mode is performed by a person.

[0053] Further, the image data control device 1 has an unillustrated operation section which can be operated by the driver or the occupant of the vehicle by hand. The driver or the occupant of the vehicle can input various operations such as a switching operation from the standby mode to the active mode, for example, by operating the operation section.

[0054] The third condition is, for example, a condition in which a running manager who manages the running of a plurality of vehicles including the vehicle on which the image data control device 1 is mounted remotely inputs a switching operation from the standby mode to the active mode to the image data control device 1. If the third condition is satisfied, the data control device 1 switches the operation mode from the standby mode to the active mode. If the third condition is satisfied, the data control device 1 switches the operation mode from the standby mode to the active mode. The third condition is also an example of a condition in a case where the switching from the standby mode to the active mode is performed manually.

[0055] Further, the image data control device 1 has an unillustrated reception section which can receive various signals and the like from a terminal operated by the running manager. The image data control device 1 receives various operation information inputted in the terminal by the running manager through the reception section, for example, operation information which instructs the switching from the standby mode to the active mode. The image data control device 1 can perform various operations such as the switching processing of the operation mode based on the received operation information.

[0056] The fourth condition is, for example, a condition in which a prescribed hazard state occurs. If the fourth condition is satisfied, the data control device 1 switches the operation mode from the standby mode to the active mode. The prescribed hazard state is, for example, a state in which a sudden start, a sudden stop, a sudden turn, or the like of the vehicle occurs, a state in which a detected value of an acceleration sensor of the vehicle sharply changes, a state in which a detected value of a device of the like which monitors the periphery of the vehicle sharply changes, a state in which an object which sharply approaches the vehicle is detected, or the like. The device which monitors the periphery of the vehicle is, for example, a publicly known on-vehicle camera, a laser device, a radar device, a proximity detection device, or the like. The fourth condition is an example of a condition in a case where the switching from the standby mode to the active mode is forcibly or automatically performed by the image data control device 1.

[0057] The fifth condition is, for example, a condition in which a collision against the vehicle occurs. If the fifth condition is satisfied, the data control device 1 switches the operation mode from the standby mode to the active mode. Whether or not the collision against the vehicle occurs can be determined, for example, based on whether or not a detected value of an acceleration sensor of the vehicle sharply changes, whether or not an impact of a prescribed intensity or more is detected by an impact sensor of the vehicle, or the like. The fifth condition is also an example of a condition in a case where the switching from the standby mode to the active mode is forcibly or automatically performed by the image data control device 1.

[0058] The sixth condition is, for example, a condition in which a prescribed setting is made in a prescribed function mounted on the vehicle. If the sixth condition is satisfied, the data control device 1 switches the operation mode from the standby mode to the active mode. The prescribed function related to the vehicle is, for example, a so-called ADAS function (Advanced Driving Assistant System) or the like, an advanced driving assistance function, or the like. The prescribed setting in the ADAS function is, for example, a case where a level 2 that prescribes automatic driving based on the driver's subject is set, a case where a level 3 that prescribes automatic driving based on a computer's subject is set, or the like. The sixth condition is also an example of a condition in a case where the switching from the standby mode to the active mode is made by the image data control device 1 forcibly or automatically.

[0059] Further, the sixth condition can be set, for example, as a condition including a case where the switching from the standby mode to the active mode is made artificially based on a direct operation of the driver or the occupant of the vehicle or a remote operation of the operation manager. The sixth condition can be set as a condition including both a case where the mode switching is made artificially and a case where the mode switching is made by the image data control device 1 forcibly or automatically.

[0060] The switching from the active mode to the standby mode can be made based on the prescribed condition in a case where at least any one of the seventh condition, the eighth condition, the ninth condition, and the tenth condition is satisfied.

[0061] The seventh condition can also be defined as a deceleration-type vehicle speed condition, which is a condition in which the speed of the vehicle on which the data control device 1 is mounted is decelerated to a speed lower than a prescribed speed. If the seventh condition is satisfied, the data control device 1 switches the operation mode from the active mode to the standby mode. The seventh condition is an example of a condition in a case where the switching from the active mode to the standby mode is made by the data control device 1 forcibly or automatically.

[0062] The eighth condition is, for example, a condition in which the driver or the occupant of the vehicle directly inputs a switching operation from the active mode to the standby mode in the image data control device 1. If the eighth condition is satisfied, the data control device 1 switches the operation mode from the active mode to the standby mode. The eighth condition is an example of a condition in a case where the switching from the active mode to the standby mode is made artificially. Further, the switching operation from the active mode to the standby mode can be input via the above-described not-illustrated operation section.

[0063] The ninth condition is, for example, a condition in which an operation for switching from the active mode to the standby mode is remotely input to the image data control device 1 by an operation manager who manages the operation of a plurality of vehicles including the vehicle on which the image data control device 1 is mounted. If the ninth condition is satisfied, the data control device 1 switches the operation mode from the active mode to the standby mode. The ninth condition is also an example of a condition in a case where the switching from the active mode to the standby mode is performed manually. Further, the operation information indicating the switching from the active mode to the standby mode can be acquired via the above-described unillustrated reception section.

[0064] The tenth condition is a condition in which a predetermined time elapses in a case where the active mode is forcibly or automatically switched from the standby mode based on at least either one of the above-described fourth condition and fifth condition being satisfied. If the tenth condition is satisfied, the data control device 1 switches the operation mode from the active mode to the standby mode. The tenth condition is an example of a condition in a case where the switching from the active mode to the standby mode is forcibly or automatically performed by the image data control device 1.

[0065] The generation of the trouble state or the generation of the collision against the vehicle is only a temporary phenomenon, and is eliminated if a certain period of time elapses. Therefore, according to the tenth condition, in a case where the active mode is switched from the standby mode in response to the generation of the trouble state or the generation of the collision against the vehicle, the active mode is automatically returned to the standby mode after the elapse of the predetermined time. Thus, it is possible to avoid a case where the active mode continues despite the elimination of the temporarily generated trouble state or collision state.

[0066] The switching from the standby mode or the active mode to the pseudo-off mode can be performed based on at least either one of the eleventh condition and the twelfth condition being satisfied in a case where a predetermined condition is satisfied.

[0067] The eleventh condition is, for example, a condition in which a switching operation from the standby mode or the active mode to the pseudo-off mode is directly input in the image data control device 1 by the driver or occupant of the vehicle. If the eleventh condition is satisfied, the data control device 1 switches the operation mode from the standby mode or the active mode to the pseudo-off mode. The eleventh condition is an example of a condition in a case where the switching from the standby mode or the active mode to the pseudo-off mode is performed manually. Further, the switching operation from the standby mode or the active mode to the pseudo-off mode can be input via the above-described unillustrated operation section.

[0068] The twelfth condition is, for example, a condition in which an operation for switching from the standby mode or the active mode to the pseudo-off mode is remotely input to the image data control device 1 by an operation manager who manages the operation of a plurality of vehicles including the vehicle on which the image data control device 1 is mounted. If the twelfth condition is satisfied, the data control device 1 switches the operation mode from the standby mode or the active mode to the pseudo-off mode. The twelfth condition is also an example of a condition in a case where the switching from the standby mode or the active mode to the pseudo-off mode is performed manually. Furthermore, operation information indicating the switching from the standby mode or the active mode to the pseudo-off mode can be acquired via the above-described unillustrated reception section.

[0069] The switching from the pseudo-off mode to the standby mode can be performed based on a prescribed condition, in this case, based on at least any one of the thirteenth condition, the fourteenth condition being satisfied.

[0070] The thirteenth condition is, for example, a condition in which an operation for switching from the pseudo-off mode to the standby mode is directly input to the image data control device 1 by the driver or the passenger of the vehicle. If the thirteenth condition is satisfied, the data control device 1 switches the operation mode from the pseudo-off mode to the standby mode. The thirteenth condition is an example of a condition in a case where the switching from the pseudo-off mode to the standby mode is performed manually. Furthermore, the switching operation from the pseudo-off mode to the standby mode can be input via the above-described unillustrated operation section.

[0071] The fourteenth condition is, for example, a condition in which an operation for switching from the pseudo-off mode to the standby mode is remotely input to the image data control device 1 by an operation manager who manages the operation of a plurality of vehicles including the vehicle on which the image data control device 1 is mounted. If the fourteenth condition is satisfied, the data control device 1 switches the operation mode from the pseudo-off mode to the standby mode. The fourteenth condition is also an example of a condition in a case where the switching from the pseudo-off mode to the standby mode is performed manually. Furthermore, operation information indicating the switching from the pseudo-off mode to the standby mode can be acquired via the above-described unillustrated reception section.

[0072] The switching from the pseudo-off mode to the active mode can be performed based on a prescribed condition, in this case, based on at least any one of the fifteenth condition, the sixteenth condition, the seventeenth condition, the eighteenth condition, the nineteenth condition being satisfied.

[0073] The fifteenth condition is, for example, a condition in which an operation for switching from the pseudo-off mode to the active mode is directly input to the image data control device 1 by the driver or the passenger of the vehicle. If the fifteenth condition is satisfied, the data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The fifteenth condition is an example of a condition in a case where the switching from the pseudo-off mode to the active mode is performed manually. Furthermore, the switching operation from the pseudo-off mode to the active mode can be input via the above-described unillustrated operation section.

[0074] The sixteenth condition is, for example, a condition in which an operation for switching from the pseudo-off mode to the active mode is remotely input to the image data control device 1 by an operation manager who manages the operation of a plurality of vehicles including the vehicle on which the image data control device 1 is mounted. If the sixteenth condition is satisfied, the data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The sixteenth condition is also an example of a condition in a case where the switching from the pseudo-off mode to the active mode is performed manually. Further, the operation information indicating the switching from the pseudo-off mode to the active mode can be acquired via the above-described not-illustrated reception section.

[0075] The seventeenth condition is, for example, a condition in which a prescribed trouble state occurs. If the seventeenth condition is satisfied, the data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The seventeenth condition is an example of a condition in a case where the switching from the pseudo-off mode to the active mode is performed by the image data control device 1 forcibly or automatically.

[0076] The eighteenth condition is, for example, a condition in which a collision with a vehicle occurs. If the eighteenth condition is satisfied, the data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The eighteenth condition is also an example of a condition in a case where the switching from the pseudo-off mode to the active mode is performed by the image data control device 1 forcibly or automatically.

[0077] The nineteenth condition is, for example, a condition in which a prescribed setting is performed in a prescribed function mounted on the vehicle. If the nineteenth condition is satisfied, the data control device 1 switches the operation mode from the pseudo-off mode to the active mode. The nineteenth condition is also an example of a condition in a case where the switching from the pseudo-off mode to the active mode is performed by the image data control device 1 forcibly or automatically.

[0078] Further, the nineteenth condition can be set as a condition including a case where the switching from the pseudo-off mode to the active mode is performed manually according to a direct operation of a driver or an occupant of the vehicle or a remote operation of the operation manager. The nineteenth condition can be set as a condition including both a case where the mode is switched manually and a case where the mode is switched by the image data control device 1 forcibly or automatically.

[0079] A twentieth condition is further provided as the above-described condition for switching the operation mode from the active mode to the pseudo-off mode.

[0080] The twentieth condition is a condition in which a predetermined time elapses in a case where the active mode is switched from the pseudo-off mode forcibly or automatically based on at least any one of the seventeenth condition and the eighteenth condition described above. If the twentieth condition is satisfied, the data control device 1 switches the operation mode from the active mode to the pseudo-off mode. The twentieth condition is one example of a condition in a case where the switching from the active mode to the pseudo-off mode is performed forcibly or automatically by the image data control device 1.

[0081] According to the twentieth condition, in a case where the active mode is switched from the pseudo-off mode based on the generation of the hidden trouble state or the generation of the collision to the vehicle, the active mode is automatically returned to the pseudo-off mode after the elapse of a predetermined time. Thus, as with the tenth condition described above, it is possible to avoid a case where the active mode continues despite the elimination of the temporarily generated hidden trouble state or collision state.

[0082] In Figure 3 One example of control in the image data control device 1 is shown in FIG. 10. Here, an example of an operation from the state in which the image data control device 1 is switched to the standby mode or the active mode will be described.

[0083] The image data control device 1 starts the emission from the illuminating section 14 if the standby mode or the active mode is started (step S1). The image data control device 1 continues the generation of the image data based on the imager 11 (step S3). The image data control device 1 stops the generation of the substitute image data based on the substitute image data generation processing section 43 (step S4). The image data control device 1 transmits the image data generated by the imager 11 to the MPU 21 (step S5).

[0084] The image data control device 1 can operate the generation processing of the image data based on the imager 11, that is, the photographing processing (step S3), and the emission processing of the illuminating section 14, that is, the illuminating processing (step S2) in synchronization, or can operate them asynchronously. In other words, the image data control device 1 can perform the illuminating processing of the illuminating section 14 in accordance with the clock of the photographing processing of the imager 11, or can perform the illuminating processing of the illuminating section 14 without in accordance with the clock of the photographing processing of the imager 11. In a case where the illuminating processing of the illuminating section 14 is performed without in accordance with the clock of the photographing processing of the imager 11, the image data control device 1 can perform the illuminating processing of the illuminating section 14 always, that is, continuously.

[0085] The image data control device 1 monitors whether a prescribed condition for performing the switching from the standby mode or the active mode to the pseudo-off mode, for example, the above-described eleventh condition, the twelfth condition, the twentieth condition is established (steps S6, S7, S8). The image data control device 1 moves to the step S1 in a case where none of the eleventh condition, the twelfth condition, the twentieth condition is established (NO in any of the steps S6, S7, S8). Further, the image data control device 1 can move to any one of the steps S2 to S5 in a case where none of the eleventh condition, the twelfth condition, the twentieth condition is established (NO in any of the steps S6, S7, S8).

[0086] The image data control device 1 judges that the transmission of the image data generated by the imager 11 to the MPU 21 is not set in a case where any one of the eleventh condition, the twelfth condition, the twentieth condition is established (YES in any of the steps S6, S7, S8), ends the active mode and the standby mode in which the active mode is being executed, and starts the pseudo-off mode (step S9).

[0087] Further, the twentieth condition is, as described above, a condition for switching the active mode to the pseudo-off mode. Therefore, the image data control device 1 can omit the processing of the step S8, that is, the processing of judging whether the twentieth condition is established or not, in a case where the standby mode is started in the step S1.

[0088] The image data control device 1 stops the emission of light from the illuminating section 14 if the pseudo-off mode is started (step S9). The image data control device 1 continues the generation of the image data based on the imager 11 (step Sll). In other words, the image data control device 1 continues the imaging processing of the imager 11 not only in the standby mode and the active mode but also in the pseudo-off mode. However, the image data control device 1 starts the generation of the substitute image data based on the substitute image data generation processing section 43 (step S12). The image data control device 1 transmits the substitute image data generated by the substitute image data generation processing section 43 to the MPU 21 instead of the image data generated by the imager 11 (step S13).

[0089] The image data control device 1 monitors whether or not the prescribed conditions for performing the switching from the pseudo-off mode to the standby mode or the active mode, such as the thirteenth condition, the fourteenth condition, the fifteenth condition, the sixteenth condition, the seventeenth condition, the eighteenth condition, the nineteenth condition described above, are satisfied (steps S14, S15, S16, S17, S18, S19, S20). The image data control device 1 moves to step S9 in a case where none of the thirteenth condition, the fourteenth condition, the fifteenth condition, the sixteenth condition, the seventeenth condition, the eighteenth condition, the nineteenth condition is satisfied (NO in any of steps S14, S15, S16, S17, S18, S19, S20). Further, the image data control device 1 can also move to any one of steps S10 to S13 in a case where none of the thirteenth condition, the fourteenth condition, the fifteenth condition, the sixteenth condition, the seventeenth condition, the eighteenth condition, the nineteenth condition is satisfied (NO in any of steps S14, S15, S16, S17, S18, S19, S20).

[0090] The image data control device 1 determines that the image data generated by the imager 11 is to be transmitted to the MPU 21, ends the pseudo-off mode, and starts the standby mode or the active mode in step S1 in a case where any one of the thirteenth condition, the fourteenth condition, the fifteenth condition, the sixteenth condition, the seventeenth condition, the eighteenth condition, the nineteenth condition is satisfied (YES in any of steps S14, S15, S16, S17, S18, S19, S20).

[0091] At this time, the image data control device 1 starts the standby mode in step S1 in a case where the thirteenth condition or the fourteenth condition is satisfied (YES in step S14 or step S15). The image data control device 1 starts the active mode in step S1 in a case where any one of the fifteenth condition, the sixteenth condition, the seventeenth condition, the eighteenth condition, the nineteenth condition is satisfied (YES in any of steps S16, S17, S18, S19, S20).

[0092] The image data control device 1 continuously performs the control described above from the time when the ignition switch of the vehicle is turned on until the ignition switch is turned off, for example. Further, the image data control device 1 can also be configured to start the pseudo-off mode in a default state immediately after the ignition switch of the vehicle is turned on, thereafter, switch to the standby mode or the active mode if the prescribed conditions are satisfied, and thereafter, maintain the standby mode or the active mode until the ignition switch of the vehicle is turned off, for example.

[0093] According to the configuration example of the image data control device 1 of the present disclosure, the transmission processing section 42 directly transmits the image data generated by the imager 11 to the MPU 21 in a case where the judgment processing section 41 judges to transmit the image data to the MPU 21, that is, in a case where the transmission of the image data is permitted. The transmission processing section 42 generates, by the substitute image data generation processing section 43, substitute image data instead of the image data generated by the imager 11 and transmits the substitute image data to the MPU 21 in a case where the judgment processing section 41 judges not to transmit the image data to the MPU 21, that is, in a case where the transmission of the image data is not permitted.

[0094] According to the configuration example, even if the generation processing of the image data based on the imager 11, that is, the photographing processing is not stopped, it is possible to avoid the processing of the image data by the MPU 21 in a prescribed case, that is, in a case where the image data control device 1 is switched to the pseudo-off mode. Thereby, it is possible to avoid the unlimited processing of the image data reflecting the situation inside the vehicle cabin, and it is possible to sufficiently achieve the protection of privacy.

[0095] According to the configuration example of the present disclosure, even in a case where the image data control device 1 is switched to the pseudo-off mode, the imager 11, the in-vehicle camera 11C, the serializer 12, the deserializer 22, and the MPU 21 are not turned off. Therefore, in a case where the image data control device 1 is switched from the pseudo-off mode to the active mode, it is possible to promptly restart the generation processing of the image data based on the imager 11, that is, the photographing processing.

[0096] According to the configuration example of the image data control device 1, the substitute image data generation processing section 43, which is a configuration element for generating substitute image data, is provided as an independent configuration element without being used in common with other configuration elements. According to the configuration example, the substitute image data generation processing section 43 can be concentrated on the generation of substitute image data, and the generation of substitute image data can be performed more reliably and more promptly. Further, the substitute image data generation processing section 43 can be provided as a circuit independent of the imager 11, the serializer 12, the deserializer 22, the MPU 21, and the like, without being provided as a part of the imager 11, for example. Thereby, the independence of the substitute image data generation processing section 43 can be further improved.

[0097] According to the configuration example of the image data control device 1, the substitute image data generation processing section 43 is provided in the imager 11. According to the configuration example, it is possible to transmit substitute image data instead of the image data from the imager 11 which generates the image data. Therefore, although the independence of the substitute image data generation processing section 43 is slightly reduced, it is possible to more reliably suppress the erroneous transmission of the image data from the imager 11 in a case where it is judged not to transmit the image data to the MPU 21.

[0098] According to the configuration example of the image data control device 1, the illuminating section 14 increases the light receiving amount of the in-vehicle camera 11C in cooperation with the imager 11 by emitting light. Thereby, it is possible to generate clearer image data and transmit to the MPU 21.

[0099] The illuminating section 14 is configured to emit light in a case where the judgment processing section 41 judges to transmit the image data to the MPU 21. The illuminating section 14 is configured to not emit light in a case where the judgment processing section 41 judges not to transmit the image data to the MPU 21.

[0100] According to this configuration example, the user can visually easily confirm whether or not the image data is transmitted to the MPU 21 based on the presence or absence of the light emission from the illuminating section 14.

[0101] Further, the illuminating section 14 can also be configured to not emit light in a case where the judgment processing section 41 judges to transmit the image data to the MPU 21, and to emit light in a case where the judgment processing section 41 judges not to transmit the image data to the MPU 21. According to this configuration example, although it is not easy to increase the light receiving amount of the in-vehicle camera 11C in cooperation with the imager 11, it is possible to cause the user to visually recognize whether or not the image data is transmitted to the MPU 21 based on the presence or absence of the light emission from the illuminating section 14.

[0102] The illuminating section 14 can also be configured to make the light emission manner different in a case where the judgment processing section 41 judges to transmit the image data to the MPU 21 and in a case where it judges not to transmit the image data. According to this configuration example, it is also possible to cause the user to visually recognize whether or not the image data is transmitted to the MPU 21 based on the difference in the light emission manner from the illuminating section 14. As the light emission manner from the illuminating section 14, for example, a manner of continuously emitting light, a manner of intermittently emitting light, a manner of changing the intensity of light, a manner of changing the color of light, a manner of changing the wavelength of light, and the like are considered.

[0103] The image data control device 1 can be configured to execute the generation processing of the image data based on the imager 11 in synchronization with the generation processing of the substitute image data based on the substitute image data generation processing section 43, or can be configured not to execute them in synchronization.

[0104] (Second Embodiment)

[0105] Figure 4 The illustrated image data control device 1 is provided with the substitute image data generation processing section 43 in the MPU 21, not in the imager 11. In this configuration example, the image data generated by the imager 11 is transmitted to the MPU 21 in both a case where the judgment processing section 41 judges to transmit the image data to the MPU 21 and in a case where it judges not to transmit the image data.

[0106] The MPU 21 processes the image data transmitted from the imager 11 in the case where the judgment processing section 41 judges that the image data is to be transmitted to the MPU 21, that is, in the case where the processing of the image data is permitted. The MPU 21 does not process the image data transmitted from the imager 11 in the case where the judgment processing section 41 judges that the image data is not to be transmitted to the MPU 21, that is, in the case where the processing of the image data is not permitted, but processes the substitute image data generated by the substitute image data generation processing section 43.

[0107] According to this configuration example, even if the generation processing of the image data based on the imager 11, that is, the photographing processing is not stopped, it is possible to avoid the processing of the image data by the MPU 21 in a prescribed case, and it is possible to sufficiently achieve the protection of privacy.

[0108] In this configuration example, it is also possible to configure such that, in the case where the judgment processing section 41 judges that the image data is not to be transmitted to the MPU 21, at least any one of the configuration elements of the imager 11, the vehicle-mounted camera 11C, the serializer 12, the deserializer 22, and the MPU 21 is switched from the ON state to the OFF state. In this configuration example, it is also possible to switch from the ON state to the OFF state for the configuration element for which the time until the ON state is assumed is short, for example, and for which the influence on the time until the generation processing of the image data, that is, the photographing processing is started is less. Thereby, it is possible to shorten the time until the photographing processing that has been stopped is started, and it is possible to suppress the amount of power consumption by turning OFF a part of the configuration elements.

[0109] (Third Embodiment)

[0110] Figure 5 The illustrated image data control apparatus 1 does not have the substitute image data generation processing section 43 in the imager 11 or the MPU 21, but has the substitute image data generation processing section 43 in the serializer 12 provided on the transmission path 34 between the imager 11 and the MPU 21. In this configuration example, the image data generated by the imager 11 is transmitted to the serializer 12 regardless of whether the judgment processing section 41 judges that the image data is to be transmitted to the MPU 21 or judges that the image data is not to be transmitted.

[0111] The serializer 12 transmits the image data transmitted from the imager 11 to the MPU 21 in a case where the judgment processing section 41 judges that the image data is to be transmitted to the MPU 21, that is, in a case where the processing of the image data is permitted. The serializer 12 does not transmit the image data transmitted from the imager 11 to the MPU 21 in a case where the judgment processing section 41 judges that the image data is not to be transmitted to the MPU 21, that is, in a case where the processing of the image data is not permitted, but transmits the substitute image data generated by the substitute image data generation processing section 43 to the MPU 21. Further, the serializer 12 can grasp the result of the judgment of the judgment processing section 41, for example, on the basis of a signal transmitted from the MPU 21 via the transmission path 34.

[0112] The MPU 21 processes the image data in a case where the image data is transmitted from the serializer 12. The MPU 21 processes the substitute image data in a case where the substitute image data is transmitted from the serializer 12.

[0113] According to this configuration example, even if the generation processing of the image data based on the imager 11, that is, the photographing processing is not stopped, it is possible to avoid the processing of the image data by the MPU 21 in a prescribed case, and it is possible to sufficiently achieve the protection of privacy.

[0114] In this configuration example, it is also possible to configure such that, in a case where the judgment processing section 41 judges that the image data is not to be transmitted to the MPU 21, at least either one of the vehicle-mounted camera 11C and the imager 11 is switched from the ON state to the OFF state. In this configuration example, it is also possible to, for example, give priority to a configuration element for which the time until the ON state becomes the OFF state is short and for which the influence on the time until the generation processing of the image data, that is, the photographing processing is started is small, and to switch from the ON state to the OFF state. Thereby, it is possible to shorten the time until the photographing processing that has been stopped is started, and it is possible to suppress the amount of power consumption by turning off a part of the configuration elements.

[0115] Further, the image data control apparatus 1 can be configured to have the substitute image data generation processing section 43 in the deserializer 22 provided on the transmission path 34 between the imager 11 and the MPU 21. Alternatively, the image data control apparatus 1 can be configured to have the substitute image data generation processing section 43 as a separate configuration element different from the serializer 12 and the deserializer 22 between the imager 11 and the MPU 21.

[0116] (Fourth Embodiment)

[0117] Figure 6The illustrated image data control apparatus 1 further has a microphone 51. The microphone 51 is one example of a sound data generation section and is configured to be able to accept sound and generate sound data. In this case, the microphone 51 is disposed at a position at which sound generated in the passenger compartment of the vehicle can be collected. In the image data control apparatus 1, the MPU 21 is configured to be able to further process the sound data generated by the microphone 51. The determination processing section 41 is configured to be able to further determine whether or not to transmit the sound data generated by the microphone 51 to the MPU 21. The transmission processing section 42 is configured to be able to further transmit the sound data generated by the microphone 51 to the MPU 21. Further, in the image data control apparatus 1, the MPU 21 is configured to be able to further process the sound data generated by the microphone 51. The determination processing section 41 is configured to be able to further determine whether or not to transmit the sound data generated by the microphone 51 to the MPU 21. The transmission processing section 42 is configured to be able to further transmit the sound data generated by the microphone 51 to the MPU 21. Figure 6 In the image data control apparatus 1, the transmission processing section 42 transmits the sound data generated by the microphone 51 to the MPU 21 in a case where the determination processing section 41 determines to transmit the sound data to the MPU 21, that is, in a case where the processing of the sound data is permitted. In the image data control apparatus 1, the transmission processing section 42 transmits substitute sound data instead of the sound data to the MPU 21 in a case where the determination processing section 41 determines not to transmit the sound data to the MPU 21, that is, in a case where the processing of the sound data is not permitted.

[0118] In the image data control apparatus 1, the transmission processing section 42 transmits the sound data generated by the microphone 51 to the MPU 21 in a case where the determination processing section 41 determines to transmit the sound data to the MPU 21, that is, in a case where the processing of the sound data is permitted. In the image data control apparatus 1, the transmission processing section 42 transmits substitute sound data instead of the sound data to the MPU 21 in a case where the determination processing section 41 determines not to transmit the sound data to the MPU 21, that is, in a case where the processing of the sound data is not permitted.

[0119] The image data control apparatus 1 further has a substitute sound data generation processing section 52 that generates substitute sound data. The substitute sound data generation processing section 52 is one example of a substitute sound data generation section. The substitute sound data generation processing section 52 can be provided in any one of the constituent elements of the MPU 21 and the microphone 51. Alternatively, the substitute sound data generation processing section 52 can be provided as a constituent element independent of the MPU 21, the microphone 51, and the like on the transmission path from the microphone 51 to the MPU 21. The substitute sound data generation processing section 52 can be implemented by software, by hardware, or by a combination of software and hardware.

[0120] The substitute sound data generated by the substitute sound data generation processing section 52 can be, for example, data of no sound or data of a predetermined sound. In other words, the substitute sound data can be data of a sound different from the sound data generated by the microphone 51, that is, data of a sound that does not reflect the sound generated in the passenger compartment of the vehicle.

[0121] The image data generated by the imager 11 is visual information reflecting the situation inside the vehicle cabin. The sound data generated by the microphone 51 is auditory information reflecting the situation inside the vehicle cabin. Both the image data generated by the imager 11 and the sound data generated by the microphone 51 are information that, depending on the situation, can invade the privacy of the driver or occupant of the vehicle.

[0122] According to the configuration example of this embodiment, in the image data control device 1 that can avoid processing of the image data based on the image data generated by the imager 11 in a prescribed situation even if the generation processing of the image data is not stopped, processing of the sound data by the MPU 21 can be avoided in a prescribed situation even if the generation processing of the sound data by the microphone 51 is not stopped. Thus, protection of privacy can be sufficiently achieved not only from the visual point of view but also from the auditory point of view.

[0123] (Fifth Embodiment)

[0124] Figure 7 The illustrated image data control device 1 further includes sensors 61, 62. The sensors 61, 62 are each an example of a situation data generation section configured to be able to generate situation data representing the situation inside the vehicle cabin. The sensor 61 is configured to be able to generate situation data representing a situation directly related to the privacy of a person, such as the pulse, heartbeat, body temperature, or the like of the driver or occupant. The sensor 62 is configured to be able to generate situation data representing a situation not directly related to the privacy of a person, such as the temperature, humidity, carbon dioxide concentration, illuminance, or the like inside the vehicle cabin. Further, the situation data detected by the sensor 62 can be situation data indirectly related to the privacy of a person.

[0125] In the image data control device 1, the MPU 21 is configured to be able to further process the situation data generated by the sensors 61, 62. The judgment processing section 41 is configured to be able to further judge whether or not to transmit the situation data generated by the sensors 61, 62 to the MPU 21. The transmission processing section 42 is configured to be able to further transmit the situation data generated by the sensors 61, 62 to the MPU 21. Further, in the image data control device 1, Figure 7 In the image data control device 1, the MPU 21 is configured to be able to further process the situation data generated by the sensors 61, 62. The judgment processing section 41 is configured to be able to further judge whether or not to transmit the situation data generated by the sensors 61, 62 to the MPU 21. The transmission processing section 42 is configured to be able to further transmit the situation data generated by the sensors 61, 62 to the MPU 21. Further, in the image data control device 1,

[0126] In the image data control device 1, the transmission processing section 42 transmits the situation data to the MPU 21 directly in a case where the judgment processing section 41 judges that the situation data is to be transmitted to the MPU 21, that is, in a case where the processing of the situation data is permitted. In the image data control device 1, the transmission processing section 42 transmits substitute situation data instead of the situation data to the MPU 21 in a case where the judgment processing section 41 judges that the situation data is not to be transmitted to the MPU 21, that is, in a case where the processing of the situation data is not permitted.

[0127] The image data control device 1 further has a substitute situation data generation processing section 63 that generates substitute situation data. The substitute situation data generation processing section 63 is one example of a substitute situation data generation section. The substitute situation data generation processing section 63 can be provided in any one of the constituent elements of the MPU 21, the sensor 61. Alternatively, the substitute situation data generation processing section 63 can be provided in any one of the constituent elements of the MPU 21, the sensor 62. Alternatively, the substitute situation data generation processing section 63 can be provided as a constituent element independent of the MPU 21, the sensors 61, 62, and the like on the transmission path from the sensors 61, 62 to the MPU 21. The substitute situation data generation processing section 63 can be implemented by software, by hardware, or by a combination of software and hardware.

[0128] The substitute situation data generated by the substitute situation data generation processing section 63 is, for example, dummy data that has no meaning, and the like. In other words, the substitute situation data is data of a situation different from the situation data generated by the sensors 61, 62, that is, directly or indirectly reflects the privacy of the person in the vehicle cabin.

[0129] The situation data generated by the sensor 61 is information directly related to the privacy of the person, and there is a high concern that the privacy of the driver or the occupant of the vehicle is infringed. The situation data generated by the sensor 62 is information not directly related to the privacy of the person, but depending on the situation, there is a concern that the privacy of the driver or the occupant of the vehicle is infringed.

[0130] According to the configuration example of the embodiment, in the image data control device 1 that can avoid the processing of the image data based on the image data generated by the imager 11 in a prescribed case even if the generation processing of the image data is not stopped, the processing of the situation data by the MPU 21 can be avoided in a prescribed case even if the generation processing of the situation data based on the sensors 61, 62 is not stopped. Thereby, the protection of the privacy can be sufficiently achieved not only from the viewpoint of vision, for example, from the viewpoint of the information of the living organism such as the pulse, the heartbeat, the body temperature, and the like of the driver or the occupant, and the information of the environment such as the temperature, the humidity, the carbon dioxide concentration, the illuminance, and the like in the vehicle cabin around the driver or the occupant.

[0131] Further, instead of the substitute condition data generating processing section 63, substitute condition data can be generated for condition data of the sensor 61 directly related to the privacy of the person, and no substitute condition data can be generated for condition data of the sensor 62 not directly related to the privacy of the person.

[0132] (Sixth Embodiment)

[0133] Figure 8 The illustrated image data control apparatus 1 is provided with a main imager 11m and a sub imager 11s. The main imager 11m is one example of a main image data generating section configured to be able to cooperate with a main vehicle-mounted camera 11Cm, accept light from the outside, and generate main image data. The sub imager 11s is one example of a sub image data generating section configured to be able to cooperate with a sub vehicle-mounted camera 11Cs, accept light from the outside, and generate sub image data. The main vehicle-mounted camera 11Cm is, for example, a camera configured to be able to capture a driver's seat and a front passenger's seat as a front portion inside a vehicle cabin of a vehicle. The sub vehicle-mounted camera 11Cs is, for example, a camera configured to be able to capture a rear seat as a rear portion inside the vehicle cabin of the vehicle.

[0134] In the image data control apparatus 1, the transmission processing section 42 directly transmits both the main image data and the sub image data to the MPU 21 in a case where the judgment processing section 41 judges to transmit the main image data to the MPU 21, that is, in a case where processing of the image data is permitted. In the image data control apparatus 1, the transmission processing section 42 transmits main substitute image data instead of the main image data and sub substitute image data instead of the sub image data to the MPU 21 in a case where the judgment processing section 41 judges not to transmit the main image data to the MPU 21, that is, in a case where processing of the image data is not permitted.

[0135] The image data control device 1 is provided with a main substitute image data generating processing section 71 that generates main substitute image data, and a sub substitute image data generating processing section 72 that generates sub substitute image data. The main substitute image data generating processing section 71 is provided in any one of the constituent elements of the main imager 11m, the serializer 12, the MPU 21, and the deserializer 22. Alternatively, the main substitute image data generating processing section 71 is provided as a constituent element independent of the main imager 11m, the serializer 12, the MPU 21, and the deserializer 22. The sub substitute image data generating processing section 72 is provided in any one of the constituent elements of the sub imager 11s, the serializer 12, the MPU 21, and the deserializer 22. Alternatively, the sub substitute image data generating processing section 72 is provided as a constituent element independent of the sub imager 11s, the serializer 12, the MPU 21, and the deserializer 22. The main substitute image data generating processing section 71 and the sub substitute image data generating processing section 72 can be realized by software, by hardware, or by a combination of software and hardware.

[0136] The main substitute image data generated by the main substitute image data generating processing section 71 and the sub substitute image data generated by the sub substitute image data generating processing section 72 can be, for example, data of a black image in which the entire surface is black, data of a prescribed color image in which the entire surface is a prescribed color, or data of a prescribed pattern image in which the entire surface is a prescribed pattern such as vertical stripes or horizontal stripes. In other words, the main substitute image data can be data of an image that is different from the main image data generated by the main imager 11m, that is, image data that reflects the situation inside the vehicle cabin. The sub substitute image data can be data of an image that is different from the sub image data generated by the sub imager 11s, that is, image data that reflects the situation inside the vehicle cabin.

[0137] The main substitute image data and the sub substitute image data can be data of the same substitute image, or data of different substitute images. In other words, the image data control device 1 can be configured to generate, for example, data of a black image in which the entire surface is black as the main substitute image data, and generate data of a prescribed pattern image in which the entire surface is a prescribed pattern as the sub substitute image data.

[0138] This embodiment is an embodiment in which image data is transmitted from the sub imager 11s also in a case where image data is transmitted from the main imager 11m, and in which substitute image data is transmitted from the sub imager 11s also in a case where substitute image data is transmitted from the main imager 11m. According to this configuration example, in a case where a plurality of vehicle-mounted cameras 11Cm, 11Cs are mounted on a vehicle, the photographing processing of these plurality of vehicle-mounted cameras 11Cm, 11Cs can be controlled in linkage with the operation of one of the vehicle-mounted cameras, in this case, the main vehicle-mounted camera 11Cm. Therefore, for example, it is possible to avoid a situation in which substitute image data is transmitted from the vehicle-mounted camera 11Cm, but image within the vehicle cabin is directly transmitted from the other vehicle-mounted camera 11Cs, and it is possible to more fully achieve protection of privacy.

[0139] Further, the number of vehicle-mounted cameras mounted on a vehicle is not limited to two, and can be three or more. The plurality of vehicle-mounted cameras can not be in a master-slave relationship of a main and a sub, but can be in an equal relationship in which all of the vehicle-mounted cameras are equal. In this case, if one of the plurality of vehicle-mounted cameras is switched to the mode of transmitting substitute image, then the other vehicle-mounted cameras are all forced to be switched to the mode of transmitting substitute image, and thus it is possible to more fully achieve protection of privacy.

[0140] (Seventh Embodiment)

[0141] Figure 9 The illustrated image data control device 1 is provided with an alarm issuance function control processing section 81. The alarm issuance function control processing section 81 is one example of an alarm issuance function control section, and is configured to be able to control switching of the on state and the off state of the alarm issuance function provided in the image data control device 1. In the present disclosure, the alarm issuance function control processing section 81 is provided in the MPU 21. The alarm issuance function control processing section 81 can be implemented virtually by software, can be implemented by hardware, or can be implemented by a combination of software and hardware. If the MPU 21 receives substitute image data, the alarm issuance function control processing section 81 switches the alarm issuance function provided in the image data control device 1 from the on state to the off state.

[0142] The signal to switch the alarm release function from the on state to the off state can be embedded in a portion of the substitute image data, for example. The portion in which the signal to switch the alarm release function from the on state to the off state is embedded can be, for example, a luminance information storage portion or the like provided in the first line in the substitute image data, a header portion of the substitute image data, or another portion. The alarm release function control processing section 81 can also perform a parsing process on the substitute image data accepted by the MPU 21, and switch the alarm release function from the on state to the off state if the result of the parsing process satisfies a prescribed condition. As the prescribed condition, for example, a condition in which the result of a histogram process performed on the substitute image data is such that the number of times the luminance is zero is above a threshold value or the like can be set.

[0143] According to this embodiment, the on state and the off state of the alarm release function can be switched using the substitute image data, and no new data communication-related configuration for switching the on state and the off state of the alarm release function needs to be provided. Thus, simplification of the software configuration and the hardware configuration of the data communication can be achieved.

[0144] (Other Embodiments)

[0145] Furthermore, the present disclosure is not limited to the above-described embodiments, and can be appropriately modified, expanded, or the like without departing from the spirit thereof. For example, the image data control device 1 can be configured to appropriately select and combine the above-described embodiments.

[0146] The image data control device 1 can also be configured to mount the imager 11, the MPU 21, or the like on one common substrate. In the case of this configuration example, the serializer 12 and the deserializer 22 can not be needed.

[0147] It can also be further added that a case in which a prescribed application program has input a switching operation from the standby mode or the active mode to the pseudo-off mode is added as a condition for switching from the standby mode or the active mode to the pseudo-off mode. The prescribed application program is installed in a terminal connected to the image data control device 1 in a communicable manner, for example.

[0148] It can also be further added that a case in which a warning system connected to the image data control device 1 in a communicable manner has received a warning notification urging a switching operation from the standby mode or the active mode to the pseudo-off mode is added as a condition for switching from the standby mode or the active mode to the pseudo-off mode. Other conditions can also be further set as conditions for switching from the standby mode or the active mode to the pseudo-off mode.

[0149] It is also possible to further add the condition that the specified application input has switched from pseudo-off mode to standby mode or active mode, as a condition for switching from pseudo-off mode to standby mode or active mode.

[0150] It is also possible to further add a situation where a warning notification urging a switch from the pseudo-off mode to the standby mode or the active mode is received from a warning system that is communicatively connected to the image data control device 1, as a condition for switching from the pseudo-off mode to the standby mode or the active mode. Other conditions can also be further set as conditions for switching from the pseudo-off mode to the standby mode or the active mode.

[0151] It may have means, for example, to report to the user before the use of the image data control device 1 that there may be a situation that would force a switch of the image data control device 1's operating mode.

[0152] The vehicle-mounted cameras 11C, 11Cm, and 11Cs can also be cameras that receive light other than near-infrared light. The illumination unit 14 can also emit light other than near-infrared light.

[0153] like Figure 10 As illustrated, the image data control device 1 can also be configured to, in standby mode, not set the camera shooting function to the standard on state but to the alternative on state. According to this configuration, regardless of whether it is standby mode or pseudo-off mode, the camera shooting function can be set to the alternative on state, i.e., the same state. Compared to the case where the camera shooting function is set to different states in the two operation modes, this simplifies the system configuration.

[0154] Furthermore, although this disclosure has been described with reference to embodiments, it should be understood that this disclosure is not limited to those embodiments or structures. This disclosure also includes various modifications and variations within the same scope. In addition, various combinations and methods, and even other combinations and methods containing only one element, more or fewer elements, are also included in the scope and spirit of this disclosure.

[0155] In addition, the control section and the method thereof according to the present disclosure can be realized by a special computer provided by a processor programmed to execute one or more functions and a memory. Alternatively, the control section and the method thereof according to the present disclosure can be realized by a special computer provided by a processor composed of one or more special hardware logic circuits. Alternatively, the control section and the method thereof according to the present disclosure can be realized by one or more special computers composed of a combination of a processor programmed to execute one or more functions and a memory and a processor composed of one or more hardware logic circuits. In addition, the computer program can be stored as instructions executed by a computer in a non-transitory tangible storage medium readable by a computer.

[0156] The present disclosure includes the following inventions in addition to the invention described in the claims.

[0157] [1] An image data control apparatus comprising:

[0158] an image data generation section (11) that accepts light and generates image data;

[0159] a processing section (21) that processes the image data;

[0160] a determination section (41) that determines whether or not to transfer the image data to the processing section; and

[0161] a transfer section (42) that transfers the image data to the processing section,

[0162] the transfer section transfers the image data to the processing section when the determination section determines to transfer the image data to the processing section, and transfers substitute image data instead of the image data to the processing section when the determination section determines not to transfer the image data to the processing section.

[0163] [2] The image data control apparatus according to [1], further comprising:

[0164] a substitute image data generation section (43) that generates the substitute image data.

[0165] [3] The image data control apparatus according to [2],

[0166] the substitute image data generation section is provided in the image data generation section.

[0167] [4] The image data control apparatus according to [2],

[0168] the substitute image data generation section is provided in the processing section.

[0169] [5] The image data control device according to [2],

[0170] The image data generation section is provided between the image data generation section and the processing section.

[0171] [6] The image data control device according to [5],

[0172] The conversion section (12) that converts the image data from parallel data to serial data is provided between the image data generation section and the processing section,

[0173] The image data generation section is provided in the conversion section.

[0174] [7] The image data control device according to any one of [1] to [6],

[0175] The processing section switches the alarm issuance function that issues a prescribed alarm to an off state if the substitute image data is accepted.

[0176] [8] The image data control device according to any one of [1] to [7],

[0177] If the judgment section judges not to transmit the image data to the processing section, at least either one of the image data generation section and the processing section is switched to an off state.

[0178] [9] The image data control device according to any one of [1] to [8], further comprising:

[0179] The light emission section (14) emits light to increase the light reception amount of the image data generation section,

[0180] The light emission section emits light if the judgment section judges to transmit the image data to the processing section, and does not emit light if the judgment section judges not to transmit the image data to the processing section.

[0181]

[10] The image data control device according to any one of [1] to [9], further comprising:

[0182] The sound data generation section (51) that accepts sound and generates sound data,

[0183] The processing section is also capable of processing the sound data,

[0184] The judgment section is also capable of judging whether or not to transmit the sound data to the processing section,

[0185] The transmission section is also capable of transmitting the sound data to the processing section,

[0186] The transmission section transmits the sound data to the processing section when the judgment section judges to transmit the sound data to the processing section, and transmits substitute sound data instead of the sound data to the processing section when the judgment section judges not to transmit the sound data to the processing section.

[0187]

[11] The image data control device according to any one of [1] to

[10] , further comprising:

[0188] a situation data generating section (61, 62) that generates situation data indicating a situation in a vehicle cabin,

[0189] the processing section is further capable of processing the situation data,

[0190] the judgment section is further capable of judging whether or not to transmit the situation data to the processing section,

[0191] the transmission section is further capable of transmitting the situation data to the processing section,

[0192] the transmission section transmits the situation data to the processing section when the judgment section judges to transmit the situation data to the processing section, and transmits substitute situation data instead of the situation data to the processing section when the judgment section judges not to transmit the situation data to the processing section.

[0193]

[12] The image data control device according to any one of [1] to

[11] ,

[0194] the image data generating section includes a main image data generating section (11m) and a sub image data generating section (11s),

[0195] the main image data generating section generates main image data as the image data,

[0196] the sub image data generating section generates sub image data as the image data,

[0197] the transmission section transmits the main image data and the sub image data to the processing section when the judgment section judges to transmit the main image data to the processing section, and transmits main substitute image data instead of the main image data and sub substitute image data instead of the sub image data to the processing section when the judgment section judges not to transmit the main image data to the processing section.

Claims

1. An image data control device, wherein, Possessing: An image data generating section (11) that accepts light and generates image data; A processing section (21) that processes the image data; A judging section (41) that judges whether or not to transfer the image data to the processing section; And A transfer section (42) that transfers the image data to the processing section, The transfer section transfers the image data to the processing section in the case where the judging section judges to transfer the image data to the processing section, and the transfer section transfers substitute image data instead of the image data to the processing section in the case where the judging section judges not to transfer the image data to the processing section.

2. The image data control apparatus according to claim 1, wherein Further possessing: A substitute image data generating section (43) that generates the substitute image data.

3. The image data control device according to claim 2, wherein The substitute image data generating section is possessed in the image data generating section.

4. The image data control device according to claim 2, wherein The substitute image data generating section is possessed in the processing section.

5. The image data control device according to claim 2, wherein The substitute image data generating section is possessed between the image data generating section and the processing section.

6. The image data control device according to claim 5, wherein A conversion section (12) that converts the image data from parallel data to serial data is possessed between the image data generating section and the processing section, The substitute image data generating section is possessed in the conversion section.

7. The image data control device according to claim 1, wherein The processing section switches an alarm issue function that issues a prescribed alarm to an off state if the substitute image data is accepted.

8. The image data control device according to claim 1, wherein At least either one of the image data generating section and the processing section is switched to an off state in the case where the judging section judges not to transfer the image data to the processing section.

9. The image data control apparatus according to claim 1, wherein Further possessing: A light emitting section (14) that emits light to increase the light acceptance amount of the image data generating section, The light emitting section emits light in the case where the judging section judges to transfer the image data to the processing section, and does not emit light in the case where the judging section judges not to transfer the image data to the processing section.

10. The image data control apparatus according to claim 1, wherein Further possessing: A sound data generating section (51) that accepts sound and generates sound data, The processing section is also capable of processing the sound data, The judging section is also capable of judging whether or not to transfer the sound data to the processing section, The transfer section is also capable of transferring the sound data to the processing section, The transfer section transfers the sound data to the processing section in the case where the judging section judges to transfer the sound data to the processing section, and the transfer section transfers substitute sound data instead of the sound data to the processing section in the case where the judging section judges not to transfer the sound data to the processing section.

11. The image data control apparatus according to claim 1, wherein Further possessing: A situation data generating section (61, 62) that generates situation data that indicates a situation in a vehicle cabin, The processing section is also capable of processing the situation data, The judging section can further judge whether or not to transmit the condition data to the processing section, The transmitting section can further transmit the condition data to the processing section, The transmitting section transmits the condition data to the processing section when the judging section judges to transmit the condition data to the processing section, and transmits substitute condition data instead of the condition data to the processing section when the judging section judges not to transmit the condition data to the processing section.

12. The image data control apparatus according to claim 1, wherein the image data generating section includes a main image data generating section (11m) and a sub image data generating section (11s), the main image data generating section generates main image data as the image data, the sub image data generating section generates sub image data as the image data, the transmitting section transmits the main image data and the sub image data to the processing section when the judging section judges to transmit the main image data to the processing section, and transmits main substitute image data instead of the main image data and sub substitute image data instead of the sub image data to the processing section when the judging section judges not to transmit the main image data to the processing section.

Images