Imaging device for a vehicle

Abstract

The present application relates to an imaging device for a vehicle. The imaging device can include: a pixel of a plurality of pixels, the pixel configured to generate image data of a captured image; an encryption processing unit configured to output an encrypted image based on a portion of the captured image; and an image output unit configured to output one frame of the captured image and the encrypted image in a format, the format including: a frame start; a packet header; a first area for the one frame of the captured image; a second area for the encrypted image; a packet trailer; and a frame end, wherein the first area is disposed between the packet header and the packet trailer, and the second area is disposed between the packet header and the packet trailer.

Description

[0001] This application is a divisional application of patent application No. 201880038092.9 for which the filing date is June 1, 2018, and the title of which is "Signal processing device, signal processing method, and program". TECHNICAL FIELD

[0002] The present technology relates to a signal processing device, a signal processing method, and a program, and more particularly, to a signal processing device, a signal processing method, and a program for reducing a processing load while ensuring safety. BACKGROUND

[0003] In recent years, the number of cars equipped with a safety function using an in-vehicle camera is increasing, and a movement to realize automatic driving in several years is active.

[0004] In automatic driving of a car, since an output image obtained by a camera is analyzed, and an accelerator, a brake, and the like are controlled based on the analysis result, the correctness of the output image of the camera is required.

[0005] Therefore, the in-vehicle camera is required to have not only functional safety that checks whether the camera itself is operating correctly, but also safety of the output image, that is, a security function that prevents malicious acts such as replacement of the camera and tampering of the output image.

[0006] In detail, the in-vehicle camera needs to ensure the safety of each frame of the output image. This is because if the output image is tampered, for example, a malicious accident can occur.

[0007] For example, in the field of monitoring cameras, as a technique related to the safety function of an image, a technique has been proposed that generates a signature for certifying the presence / absence of tampering using part or all of video data obtained by shooting, and outputs the signature together with the video data (for example, see Patent Literature 1).

[0008] Bibliographic details

[0009] Patent Literature

[0010] Patent Literature 1: Japanese Patent Application Laid-Open No. 2017-41841 SUMMARY

[0011] Problems to be Solved by the Invention

[0012] However, it is difficult to ensure the safety of the image output at low cost, that is, with a small processing amount using the above-described technique.

[0013] For example, the security of the output image can be ensured by encrypting the output image itself, various signals for control, and the like using the existing technology. Likewise, the technology described in Patent Literature 1 can ensure the security of the video data by generating a signature using all the video data.

[0014] However, in this case, since the region to be encrypted or marked is large, a high load processing is required in the camera and the subsequent block of the camera to ensure the security of the output image, that is, the security.

[0015] For example, the security of the output image can be ensured by encrypting the output image itself, various signals for control, and the like using the existing technology. In particular, when considering a vehicle-mounted camera, the analysis processing of the output image of the camera and the control related to driving such as acceleration and braking based on the analysis result are performed in the subsequent block of the camera, and thus the processing load in the subsequent block of the camera is inherently high.

[0016] Since such a high load processing causes an increase in power consumption, a vehicle-mounted camera produced with a housing is disadvantageous in terms of size and power consumption.

[0017] Further, in the technology described in Patent Literature 1, the processing load caused by generating a signature can be reduced using a predetermined region of the video data, but doing so makes it difficult to ensure sufficient security, and in particular, in this case, if the region to be signed of the video data is leaked, since the region to be signed is always the same region, even if the part of the video data that does not need to be signed is tampered with, the tampering cannot be detected.

[0018] In view of such a situation, the present technology is implemented, which can enable reduction of the processing load while ensuring security.

[0019] Solution to the problem

[0020] The signal processing device according to a first aspect of the present technology includes a control unit configured to acquire designation information indicating a designated portion to be encrypted in output data, and an encryption processing unit configured to encrypt the designated portion indicated by the designation information in the output data using a key, wherein the designated portion indicated by the designation information varies over time.

[0021] The signal processing method or program according to a first aspect of the present technology includes the steps of acquiring designation information indicating a designated portion to be encrypted in output data, and encrypting the designated portion indicated by the designation information in the output data using a key, wherein the designated portion indicated by the designation information varies over time.

[0022] In the first aspect of the present technology, specified information indicating a specified portion to be encrypted in output data is acquired, and the specified portion indicated by the specified information in the output data is encrypted using a key. Furthermore, the specified portion indicated by the specified information changes over time.

[0023] The signal processing apparatus according to the second aspect of the present technology includes a control unit configured to generate specified information indicating a specified portion to be encrypted in acquired data while changing the specified portion over time, a communication unit configured to transmit the specified information, and an acquisition unit configured to acquire encrypted data obtained by encrypting the specified portion indicated by the specified information in the acquired data and the acquired data.

[0024] The signal processing method or program according to the second aspect of the present technology includes the steps of generating specified information indicating a specified portion to be encrypted in acquired data while changing the specified portion over time, transmitting the specified information, and acquiring encrypted data obtained by encrypting the specified portion indicated by the specified information in the acquired data and the acquired data.

[0025] In the second aspect of the present technology, specified information indicating a specified portion to be encrypted in acquired data is generated while changing the specified portion over time, the specified information is transmitted, and encrypted data obtained by encrypting the specified portion indicated by the specified information in the acquired data and the acquired data are acquired.

[0026] Effects of the Invention

[0027] According to the first and second aspects of the present technology, it is possible to ensure security while reducing processing load.

[0028] Note that the effects described here are not necessarily limiting, and any effect described in this disclosure can be shown. BRIEF DESCRIPTION OF DRAWINGS

[0029] Figure 1 is a schematic diagram describing a configuration example of a vehicle.

[0030] Figure 2 is a schematic diagram describing a configuration example of an image processing system.

[0031] Figure 3 is a schematic diagram describing an alternative of an image sensor.

[0032] Figure 4 is a schematic diagram describing tampering of a captured image.

[0033] Figure 5 is a schematic diagram illustrating a configuration example of an image sensor.

[0034] Figure 6 is a schematic diagram illustrating a configuration example of a vehicle control unit.

[0035] Figure 7 is a flowchart describing a response process and a connection sensor authentication process.

[0036] Figure 8 is a flowchart describing an image output process.

[0037] Figure 9 is a schematic diagram describing embedding of an encrypted image.

[0038] Figure 10 is a flowchart describing an image acquisition process.

[0039] Figure 11 is a schematic diagram illustrating a configuration example of a computer. DETAILED DESCRIPTION

[0040] Hereinafter, an embodiment to which the present technology is applied will be described with reference to the drawings.

[0041] <First Embodiment>

[0042] <Configuration Example of Image Processing System>

[0043] The present technology enables reduction of processing load while ensuring security by encrypting a harmonic region of a captured image of an in-vehicle camera and outputting encrypted data to a subsequent stage of the camera, and changing a region to be encrypted over time.

[0044] That is, the present technology can reduce processing load of the camera and the subsequent stage of the camera by encrypting only a partial region of a captured image.

[0045] Further, security (security) can be ensured by changing a region to be encrypted over time (that is, by setting an arbitrary region as a region to be encrypted in each frame of a captured image).

[0046] For example, in a case where a region to be encrypted in each frame of a captured image is changed at random, a malicious third party cannot specify a region to be encrypted, and thus cannot falsify a captured image. Therefore, sufficient security can be ensured with a small amount of processing (that is, low processing load).

[0047] At this time, even if a region to be encrypted in a certain frame is specified by a malicious third party, a region to be encrypted in the next frame has already been changed. Therefore, unlike a case where the same region is always set as a region to be encrypted, sufficient security can be ensured.

[0048] In addition to the in-vehicle camera and the in-vehicle system using the in-vehicle camera, such the present technology can be applied to a camera mounted on a moving body (for example, a motorcycle, a bicycle, an electric wheelchair, a personal mobility, an airplane, a ship, a train, or a robot), a system using such a camera, and the like.

[0049] Further, in the present technology, the data to be secured (that is, the data to be detected for tampering) is not limited to image data, and the data can be arbitrary data such as sound data and various measurement data.

[0050] Even in this case, only the designated portion of the target data to be secured to be encrypted is required to be encrypted, while the designated portion of the target data is changed over time, and the encrypted data obtained by the encryption and the target data are output. Specifically, in the case where the target data is sound data, for example, only a predetermined sound portion (range) in the sound data is required to be designated as the designated portion to be encrypted, and the sound portion is changed over time. Here, the number of the designated portions of the target data can be one or more.

[0051] Note that, hereinafter, a case where the present technology is applied to an image processing system including an in-vehicle camera will be described as a specific example. In this case, the image data of the captured image obtained by capturing corresponds to the above-described object data to be secured, the partial region of the captured image to be encrypted corresponds to the above-described designated portion, and the encrypted image obtained by encrypting the partial region of the captured image corresponds to the above-described encrypted data.

[0052] Hereinafter, a more specific embodiment will be described.

[0053] Figure 1 is a schematic view illustrating a configuration example of an embodiment of a vehicle including an image processing system to which the present technology is applied.

[0054] Figure 1 The vehicle 11 shown in FIG. 1 is an automobile, and a plurality of in-vehicle cameras are mounted on the vehicle 11 to support front sensing, surround view sensing, and the like. That is, for example, the vehicle 11 is provided with in-vehicle cameras 21-1 to 21-4 for capturing images for control relating to driving of the vehicle 11.

[0055] Here, the camera 21-1 is a camera for obtaining a captured image of a region R11-1 of the front of the vehicle 11 as an object.

[0056] Further, the camera 21-2 is a camera for obtaining a captured image of a region R11-2 of the left side of the vehicle 11 as an object, and the camera 21-3 is a camera for obtaining a captured image of a region R11-3 of the right side of the vehicle 11 as an object.

[0057] Further, the camera 21-4 is a camera for obtaining a captured image of a region R11-4 which is a rear of the vehicle 11 as a subject.

[0058] Note that hereinafter, the cameras 21-1 to 21-4 are also simply referred to as cameras 21 unless the cameras 21-1 to 21-4 need to be distinguished from each other in particular.

[0059] The captured images obtained by the cameras 21 are supplied to, for example, a vehicle control unit 22 arranged at the center of the vehicle 11, and used for control concerning driving of the vehicle 11.

[0060] The vehicle control unit 22 includes, for example, an advanced driver assistance system (ADAS) chip or the like, performs image analysis on the captured images supplied from the cameras 21, and performs control concerning driving (for example, steering, accelerator, and brake) of the vehicle 11 based on a result of the image analysis.

[0061] In the vehicle 11, the system including the cameras 21 and the vehicle control unit 22 is an image processing system, and in more detail, the image processing system is configured as shown in Figure 2 Note that in Figure 2 , portions corresponding to Figure 1 are denoted by the same reference numerals, and the description thereof is omitted as appropriate.

[0062] Figure 2 The image processing system shown in

[0063] Here, the imaging device includes, for example, the lens 51 and the image sensor 52 corresponding to one camera 21 shown in Figure 1 . Therefore, in more detail, the image processing system is equipped with four cameras 21 each including the lens 51 and the image sensor 52. For the sake of simplicity, Figure 2 only the lens 51 and the image sensor 52 corresponding to one camera 21 are shown.

[0064] The lens 51 includes one or a plurality of optical lenses, collects light incident from a subject, and guides the light to an imaging surface of the image sensor 52.

[0065] The image sensor 52 includes, for example, a complementary metal-oxide semiconductor (CMOS) image sensor or the like, and operates in accordance with control information provided from the vehicle control unit 22 through the input / output unit 53 and the input / output unit 54. For example, the image sensor 52 receives light incident through the lens 51 and photoelectrically converts the light to take a captured image, and provides image data of the obtained captured image to the input / output unit 53. Note that the captured image can be a still image or a moving image. Here, the captured image is assumed to be a moving image.

[0066] The input / output unit 53 and the input / output unit 54 are communication interfaces (I / F) for long distance communication in the vehicle 11, such as a serializer or a deserializer or the like, and perform communication between the image sensor 52 and the vehicle control unit 22.

[0067] For example, the input / output unit 53 converts image data of a captured image and various information provided from the image sensor 52 from parallel data to serial data, and provides the serial data to the input / output unit 54. The input / output unit 54 converts the image data and various information provided from the input / output unit 53 from serial data to parallel data, and provides the parallel data to the vehicle control unit 22.

[0068] Similarly, for example, the input / output unit 54 converts various information provided from the vehicle control unit 22 from parallel data to serial data, and provides the serial data to the input / output unit 53. The input / output unit 53 converts the various information provided from the input / output unit 54 from serial data to parallel data, and provides the parallel data to the image sensor 52.

[0069] In the image processing system shown in Figure 2 , the image sensor 52 takes a captured image in accordance with control of the vehicle control unit 22, and provides the captured image obtained by the taking to the vehicle control unit 22. Then, the vehicle control unit 22 performs control relating to driving of the vehicle 11 based on the captured image obtained by the image sensor 52.

[0070] As described above, the image processing system performs control relating to driving of the vehicle 11, and thus needs to prevent accidents or the like due to tampering or fraud by a malicious third party. That is, it is necessary to ensure safety (security).

[0071] Specifically, as shown in Figure 3 , for example, it is necessary to prevent removal and replacement of the camera 21 including the image sensor 52 originally considered to be connected to the vehicle control unit 22 with a camera including another unauthorized image sensor DC11.

[0072] That is, it is necessary to confirm that the image sensor 52 and the vehicle control unit 22 are connected in a correct combination, to prevent replacement with an unauthorized image sensor DC 11.

[0073] This is because, for example, if the legitimate image sensor 52 is replaced with an unauthorized image sensor, or the like, for example, a cheap counterfeit product, it cannot be ensured that the safety of the captured image provided to the vehicle control unit 22.

[0074] For example, if the legitimate image sensor 52 is replaced with an unauthorized image sensor DC 11, even if the vehicle control unit 22 provides control information and attempts to perform a photographing setting, or the like, the image sensor DC 11 does not operate as instructed by the vehicle control unit 22, and it cannot be ensured that the safety of the captured image. In that case, the control related to driving cannot be properly performed, and there is a possibility that an accident will occur.

[0075] Therefore, in the image processing system, the image sensor 52 and the vehicle control unit 22 store a common secret key (that is, the same secret key) in advance, and the vehicle control unit 22 authenticates the image sensor 52 using the secret key. In other words, authentication processing using a common secret key is performed between the image sensor 52 (an output source (acquisition source) of a captured image) and the vehicle control unit 22 (an output destination of a captured image).

[0076] Although details will be described below, by exchanging authentication messages encrypted with a secret key between the vehicle control unit 22 and the image sensor 52 at the time of authentication, it is authenticated whether a correct image sensor 52 is connected to the vehicle control unit 22. In a case where an unauthorized image sensor DC 11 is connected to the vehicle control unit 22, authentication is not properly performed. Therefore, disconnection of a correct image sensor 52 can be detected (sensed) by the authentication processing.

[0077] By this authentication processing, it is confirmed that the image sensor 52 and the vehicle control unit 22 are connected in a correct combination, and replacement with an unauthorized image sensor DC 11 can be prevented. As a result, the safety of the image sensor 52 can be ensured.

[0078] In particular, the image processing system authenticates the image sensor 52 at the time of activation of the camera 21. By the authentication, it is possible to prevent the occurrence of an accident due to replacement of the camera 21, or the like, at the start (beginning) of driving of the vehicle 11.

[0079] Further, in order to ensure safety (security), the image processing system determines whether or not the captured image itself provided to the vehicle control unit 22 is tampered with and correct, thereby constructing a secure (safe) channel between the image sensor 52 and the vehicle control unit 22.

[0080] For example, in a case where an unauthorized device DV11 is inserted between the image sensor 52 and the vehicle control unit 22 in violation of the authorization, as shown in FIG. 8. Figure 4

[0081] In the example shown in FIG. 9, an unauthorized device is not inserted between the vehicle control unit 22 and the image sensor 52 in the communication path in which the transfer of the control information (e.g., the photographing setting) is performed, and the vehicle control unit 22 can control the image sensor 52 as intended. Figure 4

[0082] However, in a case where the unauthorized device DV11 is inserted between the image sensor 52 and the vehicle control unit 22 in the communication path in which the captured image is provided, the unauthorized device DV11 can falsify the captured image output from the image sensor 52 and provide the captured image to the vehicle control unit 22.

[0083] When the unauthorized device DV11 is inserted in this manner, there is a possibility that the captured image is intentionally falsified by a malicious third party, resulting in an accident.

[0084] Therefore, the image processing system uses the secret key stored in the image sensor 52 and the vehicle control unit 22 described above to secure the data of each frame of the captured image. That is, the falsification of the captured image is sensed to secure safety.

[0085] Specifically, the image sensor 52 encrypts, for each frame of the captured image, an image of a portion of an encryption region (a region on the captured image designated by the vehicle control unit 22) using the stored secret key, and outputs the resulting encrypted image to the vehicle control unit 22.

[0086] The vehicle control unit 22 compares the encrypted image obtained by encrypting an image of a portion of the encryption region of the captured image provided to the image sensor 52 using the stored secret key with the encrypted image provided to the image sensor 52, and senses that the captured image has been falsified. By this processing, the safety of each frame of the captured image can be secured.

[0087] The image processing system needs to perform the processing of sensing the falsification of the captured image for each frame, but the image processing system encrypts only a partial region of the captured image (i.e., only the encryption region), and thus the processing load in the image sensor 52 and the vehicle control unit 22 can be reduced.

[0088] Further, if the encryption region, which is the processing target to be sensed for falsification, is narrow (small), the safety of the captured image decreases. The image processing system changes the encryption region over time for each frame, for example, and thus the sufficient safety of the captured image is secured.

[0089] ​​The encrypted region is designated by the vehicle control unit 22. The vehicle control unit 22 can randomly change, for each frame, for example, the position and size of the encrypted region on the captured image, and the number of encrypted regions.

[0090] By randomly changing the encrypted region for each frame, it is difficult for a third party who attempts to tamper with the captured image to definitely determine the encrypted region for each frame. Furthermore, even if the encrypted region in a certain frame is designated by a malicious third party, since the position and size of the encrypted region have already changed in the next frame, it is difficult to tamper with the captured image so as not to be sensed by the vehicle control unit 22.

[0091] Accordingly, the image processing system changes the encrypted region over time, thereby reducing the processing load of the image sensor 52 and the vehicle control unit 22 while ensuring the security of the captured image. That is, according to the image processing system, it is possible to construct a robust image channel (i.e., a secure image channel) at low cost, and it is possible to ensure sufficient security.

[0092] Furthermore, only the image processing system is required to store the secret key and encrypt the partial region of the captured image. Therefore, no large additional cost, such as providing a new module to the image sensor 52 side or the vehicle control unit 22 side or adding a large load of processing, is required. Furthermore, even if the control information exchanged between the image sensor 52 and the vehicle control unit 22 is not encrypted, only the secret key needs to be ensured. Therefore, it is possible to ensure sufficient security at low cost.

[0093] <Configuration Example of Image Sensor>

[0094] Next, a more specific configuration example of the image sensor 52 and the vehicle control unit 22 shown in Figure 2 will be described.

[0095] Figure 5 is a schematic diagram showing a more specific configuration example of the image sensor 52.

[0096] Figure 5 The image sensor 52 shown in

[0097] The control unit 81 communicates with the vehicle control unit 22 via the input / output unit 53 and the input / output unit 54, and controls the overall operation of the image sensor 52. For example, the control unit 81 communicates with the vehicle control unit 22 and obtains (receives) encrypted region designation information indicating the encrypted region from the vehicle control unit 22.

[0098] Furthermore, the control unit 81 includes a storage unit 101 and a decryption unit 102.

[0099] The storage unit 101 stores a secret key provided in advance. Note that, hereinafter, the secret key stored in the storage unit 101 is also considered as the secret key KYC.

[0100] The decryption unit 102 decrypts, using the secret key KYC stored in the storage unit 101, predetermined information such as encrypted encrypted region designation information received by the control unit 81 from the vehicle control unit 22.

[0101] The pixel array unit 82 includes a pixel array in which a plurality of pixels are arranged in a row direction and a column direction, each of which receives light incident from an object and photoelectrically converts the light to generate image data of a captured image in accordance with the control of the control unit 81. That is, a captured image is captured. The pixel array unit 82 supplies the captured image obtained by the capturing to the signal processing unit 83.

[0102] The signal processing unit 83 applies predetermined processing such as gain adjustment and white balance adjustment to the captured image supplied from the pixel array unit 82 in accordance with the control of the control unit 81, and supplies the captured image to the encryption processing unit 84 and the image output unit 85.

[0103] The encryption processing unit 84 encrypts, using the secret key KYC supplied from the control unit 81, an image of a portion of an encrypted region in the captured image supplied from the signal processing unit 83 in accordance with the control of the control unit 81, and supplies the resulting encrypted image to the image output unit 85.

[0104] The image output unit 85 embeds the encrypted image supplied from the encryption processing unit 84 in a last portion of data for one frame of the captured image supplied from the signal processing unit 83, and transmits the captured image in which the encrypted image is embedded to the vehicle control unit 22 via the input / output unit 53 and the input / output unit 54.

[0105] <Configuration example of vehicle control unit>

[0106] Further, for example, as shown in Figure 6 The vehicle control unit 22 is configured.

[0107] Figure 6 The vehicle control unit 22 shown in FIG. 8 includes an image input unit 141, a storage 142, a recording unit 143, a control unit 144, a communication unit 145, and a bus 146. In the vehicle control unit 22, the image input unit 141 to the communication unit 145 are connected to each other via the bus 146.

[0108] The image input unit 141 receives the captured image with the embedded encrypted image, which has been transmitted from the image output unit 85 of the image sensor 52, via the input / output unit 54 and the input / output unit 53, and outputs the captured image to the storage 142 or the like. That is, the image input unit 141 functions as an acquisition unit that acquires the encrypted image and the captured image from the image sensor 52.

[0109] The storage 142 includes a volatile storage, and temporarily records various images and information supplied from the image input unit 141, the control unit 144, or the like. The recording unit 143 includes a non-volatile recording unit, and records various images, information, programs, or the like supplied from the control unit 144 or the like, and supplies the recorded images and information to the control unit 144 or the like as necessary.

[0110] The control unit 144 controls the operation of the entire vehicle control unit 22. The control unit 144 includes a storage unit 161, an authentication processing unit 162, a setting unit 163, an encryption processing unit 164, and an image processing unit 165.

[0111] The storage unit 161 stores in advance the secret key identical to the secret key KYC stored in the storage unit 101 of the image sensor 52. Note that, hereinafter, the secret key stored in the storage unit 161 is also referred to as the secret key KYA.

[0112] The authentication processing unit 162 performs an authentication process of authenticating the image sensor 52 using the secret key KYA stored in the storage unit 161. The setting unit 163 performs a setting regarding the operation of the image sensor 52, such as a setting at the time of capturing the captured image.

[0113] The encryption processing unit 164 encrypts various information and images using the secret key KYA stored in the storage unit 161. For example, the encryption processing unit 164 encrypts the image of a part of the encrypted region in the captured image received by the image input unit 141 to generate the encrypted image.

[0114] The image processing unit 165 performs a control regarding the driving of the vehicle 11 based on the captured image received by the image input unit 141. For example, the image processing unit 165 detects an obstacle or the like from the captured image, generates a control signal for stopping the vehicle 11 from advancing according to the detection result, and outputs the control signal to a brake device or the like.

[0115] The communication unit 145 communicates with the control unit 81 of the image sensor 52 via the input / output unit 54 and the input / output unit 53, and exchanges various information.

[0116] <Explanation of the response process and connection sensor authentication process>

[0117] Next, the specific operation of the image processing system will be described.

[0118] First, the processing performed when the activation of the camera 21 is given in the instruction will be described.

[0119] When the activation of the camera 21 is given in the instruction, the authentication processing unit 162 of the vehicle control unit 22, which is the output destination of the captured image, and the control unit 81 of the image sensor 52, which is the output source (acquisition source) of the captured image, start the authentication processing using the common secret key. That is, the connection sensor authentication processing is performed by the vehicle control unit 22, and the response processing is performed by the image sensor 52, so as to authenticate the image sensor 52.

[0120] Hereinafter, the response processing by the image sensor 52 and the connection sensor authentication processing by the vehicle control unit 22 will be described with reference to the flowchart of Figure 7

[0121] In step S11, the image sensor 52 is powered on, and power is supplied to each unit of the image sensor 52.

[0122] Then, in the vehicle control unit 22, in step S41, the control unit 144 controls the communication unit 145 to communicate with the image sensor 52.

[0123] That is, for example, the control unit 144 generates a response request that certifies whether the camera 21 (that is, the image sensor 52) is connected or not and provides the response request to the communication unit 145, and the communication unit 145 transmits the response request provided from the control unit 144 to the image sensor 52.

[0124] The response request transmitted (output) from the communication unit 145 is provided to the control unit 81 of the image sensor 52 via the input / output unit 54 and the input / output unit 53.

[0125] Then, in the image sensor 52, in step S12, the control unit 81 receives the response request transmitted from the communication unit 145 via the input / output unit 53 and the input / output unit 54, and responds according to the response request.

[0126] That is, the control unit 81 generates response information indicating that the response request has been received, and transmits the response information to the communication unit 145 of the vehicle control 22 via the input / output unit 53 and the input / output unit 54. When the communication unit 145 receives the response information transmitted from the control unit 81, the communication unit 145 provides the response information to the control unit 144 via the bus 146. Thus, the control unit 144 can recognize that the vehicle control unit 22 is connected with the image sensor 52 and can properly communicate with the image sensor 52.​

[0127] Further, in the vehicle control unit 22, in step S42, the authentication processing unit 162 of the control unit 144 generates an authentication message with respect to the image sensor 52. For example, the authentication message is a random number generated by the authentication processing unit 162 or the like.

[0128] In step S43, the encryption processing unit 164 encrypts the authentication message generated in the process in step S42 using the secret key KYA stored in the storage unit 161, and provides the resulting encrypted message to the communication unit 145 via the bus 146.

[0129] In step S44, the communication unit 145 transmits the encrypted message provided from the encryption processing unit 164 to the image sensor 52. The encrypted message transmitted by the communication unit 145 is provided to the control unit 81 of the image sensor 52 via the input / output unit 54 and the input / output unit 53.

[0130] Then, in the image sensor 52, in step S13, the control unit 81 receives the encrypted message transmitted by the communication unit 145.

[0131] Then, in step S14, the decryption unit 102 decrypts the encrypted message received in step S13 using the secret key KYC stored in the storage unit 101.

[0132] In step S15, the control unit 81 transmits the decrypted information obtained by decrypting the encrypted message in step S14 to the communication unit 145 of the vehicle control unit 22 via the input / output unit 53 and the input / output unit 54, and the response processing ends.

[0133] If the secret key KYC and the secret key KYA are the same, the decrypted information obtained by decrypting the encrypted message should be the same as the authentication message generated in step S42. By comparing the authentication message and the decrypted information, the vehicle control unit 22 can verify that the image sensor 52 is a legitimate image sensor that stores the predetermined secret key KYC. That is, authentication as to whether the image sensor 52 is a sensor can be performed.

[0134] When the decrypted information is transmitted in step S15, in the vehicle control unit 22, in step S45, the communication unit 145 receives the decrypted message transmitted from the control unit 81 of the image sensor 52, and provides the received decrypted message to the control unit 144 via the bus 146.

[0135] In step S46, the authentication processing unit 162 compares the authentication message generated in step S42 with the decrypted message received in step S45.

[0136] By the processing of steps S42 to S46 and the processing of steps S13 to S15, authentication processing for performing authentication using the secret key held on both sides by a secret key encryption method (public key encryption method), such as Cipher Block Chaining (CBC) mode of the Advanced Encryption Standard (AES), a Data Encryption Standard (DES) method, or the like, has been performed. Note that the encryption method in the authentication processing is not limited to the AES method or the DES method, and can be any other method as long as the method is a secret key encryption method.

[0137] In step S47, the authentication processing unit 162 determines whether or not the image sensor 52 connected to the vehicle control unit 22 has been authenticated as a correct sensor based on the comparison result in step S46.

[0138] For example, in a case where the decrypted message matches the authentication message generated in step S42, it is determined that the image sensor 52 has been authenticated as a correct sensor.

[0139] In a case where it is determined in step S47 that the image sensor 52 has been authenticated, the connection sensor authentication processing ends, and thereafter, control concerning the driving of the vehicle 11 is performed based on the captured image output from the image sensor 52. That is, the image acquisition processing described below is performed.

[0140] On the other hand, in a case where it is determined in step S47 that the image sensor 52 has not been authenticated as a correct sensor, the control unit 144 reactivates the image sensor 52, and the connection sensor authentication processing ends.

[0141] That is, the control unit 144 generates control information giving an instruction to reactivate the image sensor 52 (i.e., the camera 21), and transmits the control information to the image sensor 52 through the communication unit 145. The control unit 81 of the image sensor 52 receives the control information giving the instruction to reactivate, which is transmitted from the communication unit 145, via the input / output unit 53 and the input / output unit 54, and performs reactivation in accordance with the received control information.

[0142] In a case where the image sensor 52 receives the control information giving the instruction to reactivate from the vehicle control unit 22 after step S15 in the response processing, the image sensor performs reactivation in accordance with the control information and re-executes the response processing. Further, the vehicle control unit 22 also re-executes the connection sensor authentication processing in response to the reactivation of the image sensor 52.

[0143] At this time, when the authentication result indicating that the image sensor 52 is a correct sensor cannot be obtained even if the reactivation is performed the predetermined number of times, the control unit 144 can output a notification or the like to the outside that an image sensor not authorized is connected in order to stop the subsequent processing.

[0144] As described above, the image sensor 52 and the vehicle control unit 22 perform authentication by exchanging authentication messages using the secret key KYC and the secret key KYA common to each other. By doing so, it is possible to prevent replacement with an image sensor not authorized and to ensure security. In particular, by performing the authentication processing at the activation of the camera 21 (the image sensor 52), it is possible to prevent the occurrence of an accident at the start of the vehicle 11.

[0145] <Description of image output processing>

[0146] When the connection sensor authentication processing and the response processing as described above are performed and the image sensor 52 is authenticated, thereafter, the image output processing in which the image sensor 52 performs photographing and outputs a photographed image, and the image acquisition processing in which the vehicle control unit 22 acquires the photographed image output from the image sensor 52 and performs control relating to driving are performed.

[0147] First, the image output processing performed by the image sensor 52 will be described with reference to the flowchart of Figure 8

[0148] In step S81, the control unit 81 receives the initial setting information transmitted from the vehicle control unit 22 via the input / output unit 53 and the input / output unit 54.

[0149] Here, the initial setting information is information indicating the initial setting at the time of photographing a photographed image. Specifically, for example, the initial setting information is information relating to the photographed image such as information, etc., for example, the frame rate of the photographed image at the time of photographing and the size of the photographed image.

[0150] In step S82, the control unit 81 performs the initial setting at the time of photographing a photographed image based on the initial setting information received in step S81. That is, the control unit 81 determines the size, the frame rate, etc. of the photographed image based on the initial setting information.

[0151] In step S83, the control unit 81 activates each unit of the image sensor 52. Then, in step S84, the pixel array unit 82 photographs a photographed image.

[0152] That is, the control unit 81 controls the operation of the pixel array unit 82 in accordance with the initial setting, and the pixel array unit 82 performs photographing and supplies the resulting photographed image (i.e., image data of the photographed image) to the signal processing unit 83 in accordance with the control of the control unit 81. ​

[0153] At the time of imaging, the pixel array unit 82 receives light incident from the subject via the lens 51 and photoelectrically converts the light to obtain an imaged image. Further, the signal processing unit 83 applies predetermined processing such as gain adjustment and white balance adjustment to the imaged image supplied from the pixel array unit 82 according to the control of the control unit 81, and supplies the imaged image to the encryption processing unit 84 and the image output unit 85.

[0154] In step S85, the control unit 81 determines whether to change (update) the encryption region of the imaged image. For example, in the case where the vehicle control unit 22 changes the encryption region, the encryption region specifying information indicating the encryption region after the change is transmitted from the communication unit 145 of the vehicle control unit 22 to the control unit 81 at an appropriate timing. Therefore, in the case where the encryption region specifying information is transmitted from the communication unit 145, the control unit 81 determines to change the encryption region in step S85.

[0155] In the case where the control unit 81 determines not to change the encryption region in step S85, the processing of steps S86 to S88 is not executed, and the processing thereafter proceeds to step S89.

[0156] In contrast, in the case where the control unit 81 determines to change the encryption region in step S85, the control unit 81 receives the encryption region specifying information transmitted from the communication unit 145 via the input / output unit 53 and the input / output unit 54 in step S86. That is, the control unit 81 obtains the encryption region specifying information from the vehicle control unit 22. Here, the encryption region specifying information transmitted from the vehicle control unit 22 is information encrypted with the secret key KYA.

[0157] In step S87, the decryption unit 102 decrypts the encryption region specifying information received in step S86 using the secret key KYC saved in the storage unit 101.

[0158] Further, the control unit 81 supplies the encryption region specifying information after decryption to the encryption processing unit 84 and gives an instruction to change the encryption region. Further, the control unit 81 supplies the secret key KY saved in the storage unit 101 to the encryption processing unit 84 together with the encryption region specifying information.

[0159] In step S88, the encryption processing unit 84 changes (updates) the encryption region based on the encryption region specifying information supplied from the control unit 81, and the processing proceeds to step S89. That is, the encryption processing unit 84 changes the encryption region to be encrypted on the imaged image to the region indicated by the re-supplied encryption region specifying information. Note that the number of the encryption regions indicated by the encryption region specifying information can be one or more.

[0160] When the processing in step S88 has been executed or it is determined in step S85 that the encrypted region is not to be changed, the processing in step S89 is executed.

[0161] That is, in step S89, the encryption processing unit 84 encrypts the image of the portion of the encrypted region in the captured image supplied from the signal processing unit 83 using the secret key KYC supplied from the control unit 81, and supplies the resulting encrypted image to the image output unit 85.

[0162] Thus, the portion of the encrypted region indicated by the encrypted region designation information is encrypted from the image data of the captured image that is the output data output from the image sensor 52 to the vehicle control unit 22 (i.e., the image data of the captured image of the object for which security is to be ensured (the object for which tampering is to be detected)), and an encrypted image is generated.

[0163] In step S90, the image output unit 85 embeds the encrypted image supplied from the encryption processing unit 84 in the captured image supplied from the signal processing unit 83.

[0164] For example, assume that the captured image is output from the image output unit 85 in the format shown in FIG. 9 in accordance with each frame. In the example shown in FIG. 9, the data from the frame start (FS) to the frame end (FE) is the data of one frame of the captured image that is a moving image, and the data is saved in a packet and output. Figure 9 Figure 9 In the example shown in FIG. 9, the data from the frame start (FS) to the frame end (FE) is the data of one frame of the captured image that is a moving image, and the data is saved in a packet and output.

[0165] That is, in the present example, the region R51 for storing the image data of one frame of the captured image and the region R52 for embedding data are provided between the packet header (PH) and the packet footer (PF).

[0166] Here, the region R51 is a region for storing the image data of one frame of the captured image obtained by capturing, and the region R52 after the region R51 is a region for storing the image data of the encrypted image. That is, the region R52 is a region in which the encrypted image is embedded. In particular, in the present example, the region R52, which is a free region in which arbitrary data other than the image data of the captured image can be stored, is used as the region in which the encrypted image is embedded.

[0167] Therefore, in the present example, the image data of one frame of the captured image is stored and output in several packets in which the packet header and the packet footer are added. Similarly, the encrypted image is also stored and output in packets in which the packet header and the packet footer are added.

[0168] ​For example, in a case where the region R53 on the captured image is an encryption region of this frame, the encryption processing unit 84 encrypts the image of a part of the region R53 in the captured image using the secret key KYC, thereby generating an encrypted image. Then, the image output unit 85 embeds the encrypted image obtained by the encryption in a part of the region R52 of the captured image. That is, the image data of the encrypted image is added after the image data of one frame of the captured image.

[0169] By embedding the encrypted image in the last part of the image data of one frame of the captured image (in the part in which the data is embedded) in this way, the vehicle control unit 22 is able to obtain the encrypted image of the frame together with the image data of one frame of the captured image. Therefore, the vehicle control unit 22 can immediately detect the presence or absence of tampering of the captured image.

[0170] Note that here, an example in which one region R53 on the captured image is an encryption region has been described. However, when there are a plurality of encryption regions on one frame of the captured image, the images of the respective encryption regions are encrypted, and a plurality of encrypted images respectively corresponding to the plurality of encryption regions are generated.

[0171] Referring back to the description of the flowchart in Figure 8 In step S91, the image output unit 85 outputs the captured image in which the encrypted image is embedded. That is, in step S91, the captured image and the encrypted image are output.

[0172] In other words, the image output unit 85 transmits the captured image in which the encrypted image is embedded to the image input unit 141 of the vehicle control unit 22 via the input / output unit 53 and the input / output unit 54.

[0173] The processing of steps S84 to S91 is performed for each frame of the captured image.

[0174] In step S92, the control unit 81 determines whether or not to terminate the processing of capturing and outputting the captured image. For example, in a case where an instruction to terminate the capturing of the captured image is given by the vehicle control unit 22 or the like, it is determined that the processing will be terminated.

[0175] In a case where it is determined in step S92 that the processing has not been terminated, the processing returns to step S84 and the above-described processing is repeatedly performed.

[0176] On the other hand, in a case where it is determined in step S92 that the processing is to be terminated, the image output processing is terminated.

[0177] As described above, the image sensor 52 captures a captured image, encrypts an image of an encryption region of the captured image, and outputs the captured image and the encrypted image. By encrypting a partial region of the captured image, which is referred to as an encryption region, in this way to generate an encrypted image, it is possible to reduce the processing load of the image sensor 52 and the vehicle control unit 22 while ensuring security.

[0178] In particular, the image sensor 52 encrypts, for each frame, an image of an encryption region specified by the encryption region specification information that changes over time, and thus it is possible to ensure sufficient security even if only a part of the captured image is encrypted.

[0179] <Explanation of Image Acquisition Processing>

[0180] Next, the image acquisition processing performed by the vehicle control unit 22 when the image output processing described with reference to Figure 8 is executed by the image sensor 52 will be described. That is, the image acquisition processing performed by the vehicle control unit 22 will be described below with reference to the flowchart of Figure 10 .

[0181] In step S131, the setting unit 163 generates initial setting information, and supplies the generated initial setting information to the communication unit 145 via the bus 146. Note that the initial setting information can be encrypted or not particularly encrypted.

[0182] In step S132, the communication unit 145 transmits the initial setting information supplied from the setting unit 163 to the control unit 81 of the image sensor 52 via the input / output unit 54 and the input / output unit 53. In step S81 of the image output processing described with reference to Figure 8 , the initial setting information transmitted in this way is received by the control unit 81.

[0183] Further, in the case where the setting of the capturing of the captured image during the capturing is changed (for example, the setting of white balance, brightness, and the like), it is possible to change not only the initial setting of the capturing but also the setting of the capturing by performing similar processing.

[0184] In this case, the setting unit 163 generates setting information indicating the setting of the changed capturing, and the communication unit 145 transmits the setting information. Then, in the image sensor 52, the control unit 81 receives the setting information, and controls the pixel array unit 82 and the signal processing unit 83 in accordance with the received setting information so that these units operate in accordance with the setting.

[0185] In step S133, the control unit 144 determines whether or not the encryption region is changed.

[0186] For example, in a case where the encrypted region is changed (updated) for each frame of the captured image, the change of the encrypted region is determined at the time when the processing of one frame ends.

[0187] Note that the encrypted region can be changed for every plurality of frames in addition to being changed for each frame of the captured image. Further, the encrypted region can be changed at fixed intervals or can be changed at an indefinite period (i.e., at a random time).

[0188] In a case where it is determined in step S133 that the encrypted region is not changed, the processing of steps S134 to S136 is not performed, and the processing thereafter proceeds to step S137.

[0189] On the other hand, in a case where it is determined in step S133 that the encrypted region is changed, the control unit 144 generates, in step S134, encrypted region specifying information indicating the new encrypted region after the change.

[0190] For example, the control unit 144 determines the encrypted region at each frame (time) so that the position and size of the encrypted region and the number of encrypted regions are randomly changed for each frame, and generates encrypted region specifying information indicating the determined encrypted region.

[0191] By changing the encrypted region of each frame over time in such a manner so that the encrypted region is smaller than the entire region of one frame of the captured image so as to reduce the processing load, and so that the encrypted region is less likely to be made explicit, it is possible to ensure sufficient security.

[0192] In particular, by determining the size and number of encrypted regions in accordance with the processing capacity of the vehicle control unit 22 (i.e., the control unit 144), the control unit 144 can ensure the maximum security within the processable range in real time.

[0193] Further, for example, in a case where there is an important security object on the captured image, the region including the object can be set as the encrypted region.

[0194] Specifically, assume that the image processing unit 165 of the control unit 144 detects another vehicle traveling in front of the vehicle 11 from the captured image, and controls the traveling speed or the like of the vehicle 11 based on the detection result so as not to collide with the other vehicle.

[0195] In this case, by setting the region including the other vehicle (more specifically, the region to include the other vehicle) in the captured image as the encrypted region, tampering with the region including at least the other vehicle as the object in the captured image can be certainly sensed. Therefore, the vehicle control unit 22 can appropriately control the traveling speed or the like so as not to collide with the other vehicle, and can ensure sufficient security even with a small processing load.

[0196] For example, in order to completely ensure the security of a captured image of one frame, the entire captured image needs to be set as an encrypted region. However, as in the example described above, by setting a region of a necessary object or the like (for example, a region in which another vehicle is captured as an object) as an encrypted region, the security of at least a necessary region on a captured image can be ensured even if the encrypted region is a region of several lines of the captured image.

[0197] In step S135, the encryption processing unit 164 encrypts the encrypted region designation information generated in step S134 using the secret key KYA stored in the storage unit 161, and supplies the encrypted encrypted region designation information to the communication unit 145 via the bus 146.

[0198] By encrypting the encrypted region designation information in this way, leakage of the encrypted region can be prevented and the security can be improved. That is, the security level can be maintained.

[0199] Note that here, an example has been described in which the secret key KYA is used to encrypt the encrypted region designation information designating the encrypted region of the image of the captured image for encryption. However, when there is a parameter other than the encrypted region designation information that is transmitted from the vehicle control unit 22 to the image sensor 52 to encrypt the image of the encrypted region of the captured image, this parameter is also encrypted using the secret key KYA.

[0200] In step S136, the communication unit 145 transmits the encrypted encrypted region designation information that has been supplied from the encryption processing unit 164 of the control unit 144 to the control unit 81 of the image sensor 52 via the input / output unit 54 and the input / output unit 53.

[0201] Therefore, in the step S86 of the image output processing described above, the encrypted region designation information transmitted in the processing of step S136 is received. Figure 8

[0202] In the case where the processing of step S136 has been performed or in the case where it is determined in step S133 that the encrypted region is not changed, the processing of step S137 is performed.

[0203] That is, in step S137, the image input unit 141 obtains, via the input / output unit 54 and the input / output unit 53, the captured image in which the encrypted image has been embedded that has been output from the image output unit 85 of the image sensor 52. In other words, the image input unit 141 receives the captured image transmitted by the image output unit 85. Thus, the captured image that is the obtained data obtained from the image sensor 52 and the encrypted image embedded in the captured image are obtained.

[0204] ​Here, the captured image output in step S91 in the image output processing described with reference to the drawing is obtained in step S137.

[0205] The image input unit 141 appropriately supplies the received captured image to the storage 142 and stores the captured image in the storage 142, or supplies the captured image to the control unit 144. Here, for the sake of simplifying the description, it is assumed that the received captured image is supplied from the image input unit 141 to the control unit 144 via the bus 146.

[0206] In step S138, the encryption processing unit 164 encrypts the image of the encrypted region indicated by the encrypted region specification information generated in step S134 using the secret key KYA held in the storage unit 161, from among the captured image supplied from the image input unit 141. Thereby, an encrypted image encrypted using the secret key KYA is obtained.

[0207] In step S139, the control unit 144 compares the encrypted image embedded in the captured image obtained in step S137 and the encrypted image generated in the processing in step S138. These encrypted images are images obtained by encrypting the image of the same region on the captured image using the same secret key. Therefore, if the captured image is not tampered with from when output from the image output unit 85 to when received in the image input unit 141, these two encrypted images should match.

[0208] In step S140, the control unit 144 determines whether or not tampering of the captured image has been detected based on the result of the comparison in step S139.

[0209] For example, in a case where the two encrypted images do not match, that is, the encrypted image embedded in the captured image and the encrypted image generated in step S138 are not the same in the processing in step S139, it is determined that tampering of the captured image has been detected.

[0210] In a case where it is determined in step S140 that tampering has been detected, the processing in step S141 and the processing thereafter proceed to step S142 without being executed. In this case, for example, the control unit 144 outputs a notification or the like indicating that tampering (falsification) of the captured image has been detected to the outside, and appropriately executes processing of stopping automatic driving of the vehicle 11 or the like.

[0211] On the other hand, in a case where it is determined in step S140 that tampering has not been detected, the image processing unit 165 executes predetermined image processing based on the captured image supplied from the image input unit 141 in step S141.

[0212] For example, the image processing unit 165 performs image analysis and the like on the captured image as image processing to detect a vehicle, a pedestrian, and the like in front from the captured image, generates driving control information for controlling driving of the vehicle 11 in accordance with a detection result, and outputs the driving control information to an engine, a brake device, and the like.

[0213] The processing of steps S133 to S141 is executed for each frame of the captured image. By executing the processing of steps S133 to S141 for each frame of the captured image, safety of all frames of the captured image can be ensured. When the processing of step S141 is executed, the processing proceeds to step S142.

[0214] In a case where the processing in step S141 has been executed or in a case where it is determined in step S140 that tampering has been detected, the control unit 144 determines whether or not to terminate the processing of obtaining the captured image and controlling the control relating to driving in step S142.

[0215] For example, in a case where it is determined in step S140 that tampering has been detected, in a case where termination of the processing is given in an instruction from the outside (for example, termination of capturing of the captured image when the vehicle 11 is stopped), and the like, termination of the processing is determined.

[0216] In a case where it is determined in step S142 that the processing is not terminated, the processing returns to step S133 and the above-described processing is repeatedly executed.

[0217] On the other hand, in a case where it is determined in step S142 that the processing is to be terminated, the image acquisition processing is terminated. In this case, for example, the control unit 144 notifies the image sensor 52 of termination of the processing via the communication unit 145.

[0218] As described above, the vehicle control unit 22 obtains the captured image from the image sensor 52, compares the encrypted image generated from the obtained captured image with the encrypted image embedded in the captured image, and detects tampering of the captured image.

[0219] Thus, tampering of the captured image can be prevented and safety can be ensured. At this time, by encrypting a partial region of the captured image as an encrypted region to generate the encrypted image, it is possible to reduce a processing load of the image sensor 52 and the vehicle control unit 22 while ensuring safety.

[0220] In particular, by changing the position, size, and the like of the encryption region over time, it is possible to reduce the processing load of the image sensor 52 and the vehicle control unit 22 while ensuring sufficient security. Initially, the vehicle control unit 22 performs image processing (for example, step S141) with a high processing load, and also requires the image sensor 52 to have a low power consumption. Therefore, it is important to reduce the processing load that ensures the security of the captured image in the image sensor 52 and the vehicle control unit 22.

[0221] Note that the above example is given on the assumption that the secret key KYC and the secret key KYA are written in the storage unit 101 and the storage unit 161 in a secure state. However, there are cases where these secret keys cannot be stored in a secure state.

[0222] However, in this case, it is possible to ensure sufficient security by dynamically updating the secret keys, although the security level is somewhat reduced.

[0223] Specifically, for example, only the communication unit 145 of the vehicle control unit 22 is required to transmit the secret key KYC to the control unit 81 of the image sensor 52 via the input / output unit 54 and the input / output unit 53 at an appropriate time. The control unit 81 can perform the above processing using the secret key KYC by providing the secret key KYC received from the communication unit 145 to the storage unit 101 and storing the secret key KYC in the storage unit 101.

[0224] As described above, for example, when the secret key KYC is transmitted from the vehicle control unit 22 to the image sensor 52, the secret key KYC is updated for each frame of the captured image and is transmitted from the vehicle control unit 22 to the image sensor 52 for each frame as appropriate, so that the security can be further improved.

[0225] <Configuration example of computer>

[0226] Incidentally, the above series of processing can be executed by hardware or software. In the case where the series of processing is executed by software, a program constituting the software is installed in a computer. Here, examples of the computer include a computer incorporated in a dedicated hardware, a general-purpose personal computer capable of executing various functions by installing various programs, and the like.

[0227] Figure 11 is a block diagram of a configuration example of hardware of a computer that executes the above series of processing by a program.

[0228] In the computer, a central processing unit (CPU) 501, a read only memory (ROM) 502, and a random access memory (RAM) 503 are connected to each other through a bus 504.

[0229] Further, an input / output interface 505 is connected to the bus 504. An input unit 506, an output unit 507, a recording unit 508, a communication unit 509, and a drive 510 are connected to the input / output interface 505.

[0230] The input unit 506 includes a keyboard, a mouse, a microphone, an imaging element, and the like. The output unit 507 includes a display, a speaker, and the like. The recording unit 508 includes a hard disk, a nonvolatile memory, and the like. The communication unit 509 includes a network interface and the like. The drive 510 drives a removable recording medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0231] In the computer configured as described above, for example, the CPU 501 loads a program recorded in the recording unit 508 into the RAM 503 via the input / output interface 505 and the bus 504 and executes the program, thereby executing the series of processes described above.

[0232] The program executed by the computer (CPU 501) can be recorded on the removable recording medium 511 as a package medium, for example, and can be provided. Further, the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0233] In the computer, the program can be installed in the recording unit 508 via the input / output interface 505 by attaching the removable recording medium 511 to the drive 510. Further, the program can be received by the communication unit 509 via a wired or wireless transmission medium and installed in the recording unit 508. In addition to the above method, the program can be pre-installed in the ROM 502 or the recording unit 508.

[0234] Note that the program executed by the computer can be a program processed in time series according to the order described in this specification, or can be a program executed in parallel or at necessary time (for example, when called).

[0235] Further, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present technology.

[0236] For example, in the present technology, a configuration in which one function is cooperatively shared and processed by a plurality of devices via a network can be employed.

[0237] Further, the steps described in the flowcharts described above can be executed by one device or in a shared manner by a plurality of devices.

[0238] Further, in a case where a plurality of processes are included in one step, the plurality of processes included in one step can be executed by one device or shared and executed by a plurality of devices.

[0239] Further, the present technology can be configured as follows.

[0240] (1) A signal processing device including:

[0241] a control unit configured to acquire designation information indicating a designated portion to be encrypted in output data; and

[0242] an encryption processing unit configured to encrypt the designated portion indicated by the designation information in the output data using a key,

[0243] wherein the designated portion indicated by the designation information changes over time.

[0244] (2) The signal processing device according to (1), further including:

[0245] an output unit configured to output encrypted data obtained by the encryption and the output data.

[0246] (3) The signal processing device according to (2), wherein

[0247] the control unit performs an authentication process using the key with an output destination of the encrypted data and the output data.

[0248] (4) The signal processing device according to (3), wherein

[0249] the control unit performs the authentication process when the signal processing device is activated.

[0250] (5) The signal processing device according to any one of (1) to (4), wherein

[0251] the control unit acquires the encrypted designation information and decrypts the encrypted designation information using the key.

[0252] (6) The signal processing device according to any one of (1) to (5), wherein

[0253] the encryption processing unit encrypts a plurality of the designated portions indicated by the designation information in the output data.

[0254] (7) The signal processing device according to any one of (1) to (6), wherein

[0255] the output data is image data.

[0256] (8) A signal processing method including the steps of:

[0257] acquiring designation information indicating a designated portion to be encrypted in output data; and

[0258] encrypts the specified portion indicated by the specified information in the output data using a key,

[0259] wherein the specified portion indicated by the specified information changes over time.

[0260] (9) A program that causes a computer to execute a process including the steps of:

[0261] obtaining specified information indicating a specified portion to be encrypted in output data; and

[0262] encrypting the specified portion indicated by the specified information in the output data using a key,

[0263] wherein the specified portion indicated by the specified information changes over time.

[0264] (10) A signal processing apparatus including:

[0265] a control unit configured to generate specified information indicating a specified portion to be encrypted in obtained data while changing the specified portion over time;

[0266] a communication unit configured to transmit the specified information; and

[0267] an obtaining unit configured to obtain encrypted data obtained by encrypting the specified portion indicated by the specified information in the obtained data and the obtained data.

[0268] (11) The signal processing apparatus according to (10), further including:

[0269] an encryption processing unit configured to encrypt the specified portion in the obtained data using a key,

[0270] wherein the control unit compares the encrypted data obtained by the obtaining unit with encrypted data obtained by the encryption processing unit.

[0271] (12) The signal processing apparatus according to (11), wherein

[0272] the encryption processing unit encrypts the specified information using the key, and

[0273] the communication unit transmits the specified information encrypted by the encryption processing unit.

[0274] (13) The signal processing apparatus according to (11) or (12), further including:

[0275] authentication processing unit configured to perform authentication processing using the key with the acquisition source of the obtained data and the encrypted data.

[0276] (14) The signal processing device according to (13), wherein

[0277] The authentication processing unit performs the authentication processing when the acquisition source is activated.

[0278] (15) The signal processing device according to any one of (10) to (14), wherein

[0279] The control unit generates the designation information indicating a plurality of the designated portions.

[0280] (16) The signal processing device according to any one of (10) to (15), wherein

[0281] The obtained data is image data.

[0282] (17) A signal processing method comprising the steps of:

[0283] generating designation information indicating a designated portion to be encrypted in acquired data, while changing the designated portion over time;

[0284] transmitting the designation information; and

[0285] acquiring encrypted data obtained by encrypting the designated portion indicated by the designation information in the obtained data and the obtained data.

[0286] (18) A program causing a computer to execute a process comprising the steps of:

[0287] generating designation information indicating a designated portion to be encrypted in acquired data, while changing the designated portion over time;

[0288] transmitting the designation information; and

[0289] acquiring encrypted data obtained by encrypting the designated portion indicated by the designation information in the obtained data and the obtained data.

[0290] List of Reference Signs

[0291] 11 vehicle

[0292] 21-1 to 21-4 and 21 camera

[0293] 22 vehicle control unit

[0294] 52 image sensor

[0295] 81 control unit

[0296] 82 pixel array unit

[0297] 84 encryption processing unit

[0298] 85 image output unit

[0299] 101 storage unit

[0300] 102 decryption unit

[0301] 141 image input unit

[0302] 144 control unit

[0303] 145 communication unit

[0304] 161 storage unit

[0305] 162 authentication processing unit

[0306] 163 setting unit

[0307] 164 encryption processing unit

[0308] 165 image processing unit

Claims

1. An imaging device for a vehicle, the imaging device comprising: a pixel of a plurality of pixels, the pixel configured to generate image data of a captured image; an encryption processing unit configured to output an encrypted image based on a portion of the captured image; an image output unit configured to output a frame of the captured image and the encrypted image in a format, the format including: a start of frame; a header; a first area for the frame of the captured image; a second area for the encrypted image; a trailer; and an end of frame, wherein the first area is disposed between the header and the trailer, and the second area is disposed between the header and the trailer.

2. The imaging apparatus of claim 1, wherein, the second area is after the first area.

3. The imaging apparatus of claim 1, wherein, the portion of the captured image extends along a column direction of the plurality of pixels.

4. The imaging apparatus of claim 1, wherein, the encryption processing unit generates the encrypted image by encrypting a portion of an encryption area in the portion of the captured image.

5. The imaging apparatus of claim 4, wherein, the portion of the captured image includes a plurality of encryption areas.

6. The imaging apparatus of claim 4, wherein, the encryption areas of the portion of the captured image change at fixed intervals.

7. The imaging apparatus of claim 4, wherein, the encryption areas of the portion of the captured image change at random times.

8. The imaging apparatus according to claim 6 or 7, wherein a vehicle control unit of the vehicle changes the encryption areas, and generates encryption area specification information representing new encryption areas after the change.

9. The imaging apparatus of claim 8, wherein, the vehicle control unit changes a position, a size, and / or a number of the encryption areas.

10. The imaging apparatus of claim 8, wherein, the vehicle control unit transmits the encryption area specification information to the imaging device, and receives the encrypted image and the captured image from the image output unit of the imaging device.

11. The imaging apparatus of claim 1, wherein, the portion of the captured image includes an area including an important safety object.

12. The imaging apparatus of claim 4, wherein, the area including the important safety object is set as the encryption area.

13. The imaging apparatus according to claim 11 or 12, wherein the important safety object is a vehicle.

Images