Transmission system

Abstract

A transmission system 100 and a transmission method by the transmission system 100 according to the present disclosure simultaneously transmit pixel data corresponding to each of a plurality of pixels of an imaging unit 31 in parallel to a network 900, receive the pixel data from the network 900, and generate image data composed of at least some of the plurality of pixels from the received pixel data.

Description

Transmission System

[0001] The present disclosure relates to a technique for transmitting information captured by a terminal.

[0002] With the technological development and widespread use of devices equipped with cameras (smartphones, IoT devices), various solutions using cameras are becoming widespread (safety and security through surveillance cameras, person and object recognition, industrial applications, etc.).

[0003] Conventionally, such cameras convert optical information collected by an optical system into electrical information using an image sensor based on a CMOS / CCD (Complementary Metal Oxide Semiconductor / Charge Coupled Device) or the like, and then convert this into image information using an image processor. Generally, the output of the image sensor and image processor is a parallel signal output, but when outputting image information from an external interface, a parallel-to-serial (P / S) conversion is performed in a processing section at a previous stage to shape the data format.

[0004] Here, in the configuration of a camera transmission system using an integrated camera including a conventional image processor, there was a problem that the power consumption and physical size of the image processor were large, which limited the installation location and usage patterns (see Non-Patent Documents 1 and 2).

[0005] Ogasawara et al., "300 Frames Per Second Progressive Scan HDTV High-Speed ​​Camera," Journal of the Institute of Visual Media, Vol. 60, No. 3, pp. 358-365, 2006. OMNIVISION and Silicon Line Partner to Provide the First Optical Fiber Endoscope Cables for 4K MIPI D-PHY Video”, [online], April 6, 2022, Internet <URL: https: / / www.ovt.com / press-releases / omnivision-and-silicon-line-partner-to-provide-the-first-optical-fiber-endoscope-cables-for-4k-mipi-d-phy-video / >

[0006] In view of the above-mentioned problems, the present disclosure aims to provide a transmission system and a transmission method that are not limited in terms of installation location or usage pattern.

[0007] In order to achieve the above object, the transmission system and transmission method disclosed herein employ a technique in which pixel data corresponding to each of a plurality of pixels is transmitted and received over a network, and image data consisting of at least a portion of the plurality of pixels is generated from the received pixel data.

[0008] Specifically, the transmission system of the present disclosure simultaneously transmits pixel data corresponding to each of a plurality of pixels of an imaging unit in parallel to a network, receives the pixel data from the network, and generates image data consisting of at least a portion of the plurality of pixels from the received pixel data.

[0009] The transmission system may further include: a camera unit having the photographing unit and transmitting the pixel data to the network by any one of wavelength division multiplexing transmission, transmission using a multi-core optical fiber, and multimode transmission; and an image data processing unit receiving the pixel data from the network and generating the image data from the received pixel data.

[0010] In addition, in the transmission system, the image data processing unit may include a plurality of processor processing units, and may select at least one of the plurality of processor processing units in accordance with the received pixel data to generate the image data.

[0011] Specifically, the transmission method of the present disclosure includes simultaneously transmitting pixel data corresponding to each of a plurality of pixels of an imaging unit in parallel to a network, receiving the pixel data from the network, and generating image data consisting of at least a portion of the plurality of pixels from the received pixel data.

[0012] The camera unit and image data processing unit according to the present disclosure can also be realized by a computer and a program, and the program can be recorded on a recording medium or provided via a network. The program according to the present disclosure is a program for causing a computer to realize each function provided in the camera unit and image data processing unit according to the present disclosure, and is a program for causing a computer to execute each procedure provided in the method executed by the camera unit and image data processing unit according to the present disclosure.

[0013] The above disclosures can be combined as much as possible.

[0014] According to the present disclosure, it is possible to provide a transmission system and a transmission method that are not limited in terms of installation location or usage pattern.

[0015] FIG. 1 is a diagram illustrating an overview of a transmission system according to a first embodiment of the present disclosure. FIG. 2 is a diagram illustrating a configuration of a transmission system according to a first embodiment of the present disclosure. FIG. 3 is a diagram illustrating a table showing the correspondence between electrical signal lanes and optical signal wavelengths. FIG. 4 is a diagram illustrating a configuration of a modified example of a transmission system according to the first embodiment of the present disclosure. FIG. 5 is a diagram illustrating a configuration of a modified example of a transmission system according to the first embodiment of the present disclosure. FIG. 6 is a diagram illustrating a configuration of a transmission system according to a second embodiment of the present disclosure. FIG. 7 is a table showing the correspondence between electrical signal lanes and cores. FIG. 8 is a diagram illustrating a configuration of a modified example of a transmission system according to the second embodiment of the present disclosure. FIG. 9 is a diagram illustrating a configuration of a modified example of a transmission system according to the second embodiment of the present disclosure. FIG. 10 is a diagram illustrating a configuration of a transmission system according to a third embodiment of the present disclosure. FIG. 11 is a table showing the correspondence between electrical signal lanes and modes. FIG. 12 is a diagram illustrating a configuration of a modified example of a transmission system according to the third embodiment of the present disclosure. FIG. 13 is a diagram illustrating a configuration of a modified example of a transmission system according to the third embodiment of the present disclosure. FIG. 14 is a diagram illustrating the configuration of a related camera.

[0016] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. Note that the present disclosure is not limited to the embodiments shown below. These implementation examples are merely illustrative, and the present disclosure can be implemented in various forms with various modifications and improvements based on the knowledge of those skilled in the art. Note that components with the same reference numerals in this specification and drawings indicate the same components.

[0017] (First Embodiment) A transmission system 100 according to a first embodiment of the present disclosure will be described with reference to Fig. 1 to Fig. 3. First, the basic configuration of the transmission system 100 will be described with reference to Fig. 1. As shown in Fig. 1, the transmission system 100 mainly includes a camera unit 300 and an image data processing unit 500. The camera unit 300, which includes an image capturing unit 31, and the image data processing unit 500 are connected via a network 900.

[0018] Specifically, the transmission system 100 and the transmission method using the transmission system 100 of the present disclosure simultaneously transmit pixel data corresponding to each of the multiple pixels of the imaging unit 31 in parallel to the network 900, receive the pixel data from the network 900, and generate image data consisting of at least a portion of the multiple pixels from the received pixel data.

[0019] The camera unit 300 mainly includes an imaging unit 31 having a plurality of pixels, and an image sensor unit 32. Although Fig. 1 shows an example in which the image sensor unit 32 includes a PD (Photo Diode), a CMOS (Complementary Metal Oxide Semiconductor / Charge Coupled Device) circuit, a CDS (Correlated Double Sampling), and an ADC (Analog-to-digital converter), the configuration of the image sensor unit 32 is arbitrary, and the image sensor unit 32 may have other configurations or additional configurations.

[0020] The camera unit 300 performs E / O (Electrical signal / Optical signal) conversion on the output from the image sensor unit 32 and sends the converted data to the network 900. The image data processing unit 500 performs O / E (Optical signal / Electrical signal) conversion on the pixel data from the camera unit 300 using its internal or external functions and performs processing. FIG. 1 shows that the image data processing unit 500 performs image processing with priority on image quality, image processing with priority on delay, and AI processing. However, the scope of the present disclosure is not limited to this, and the image data processing unit 500 can perform various types of processing.

[0021] A more detailed configuration of the transmission system 100 according to the first embodiment of the present disclosure will be described with reference to FIGS. 2 and 3 . The transmission system 100 mainly includes a camera unit 300, an image data processing unit 500, and an optical fiber transmission unit 700 connecting the camera unit 300 and the image data processing unit 500. In the transmission system 100, the image processor function, which is a dominant factor in power consumption and size, is separated from the camera unit 300 and placed in a data center (image data processing unit 500) on the network. Data transfer from the camera unit 300 to the image data processing unit 500 is performed via the optical fiber transmission unit 700. FIG. 2 shows a basic configuration in which the camera unit 300 and the image data processing unit 500 are one-to-one connected. However, the scope of the present disclosure is not limited to data transfer via optical transmission using the optical fiber transmission unit 700; data transfer via other transmission modes is also within the scope of the present disclosure. Data transfer via a combination of optical transmission and other transmission modes is also within the scope of the present disclosure.

[0022] The present disclosure also includes a case where multiple camera units and multiple image data processing units are connected via an optical fiber network. The scope of the present disclosure is not limited to the case shown in Fig. 2, and one image data processing unit may correspond to multiple camera units, or one camera unit may correspond to multiple image data processing units.

[0023] The camera unit 300 includes a photographing unit 31, an image sensor unit 32, and a parallel signal WDM (Wavelength Division Multiplexing) batch optical transmitter 35. The photographing unit 31 is an optical system including a lens and the like, and collects optical information.

[0024] The image sensor unit 32 includes an image sensor processing unit 33 and an analog / digital conversion unit 34. The image sensor unit 32 is, for example, an image sensor based on a CMOS / CCD (Complementary Metal Oxide Semiconductor / Charge Coupled Device). The image sensor unit 32 converts the optical information collected by the photographing unit 31 into electrical information. The image sensor unit 32 outputs parallel electrical data signals.

[0025] The parallel signal WDM bulk optical transmitter 35 assigns optical signal wavelengths to the parallel electrical data signals from the image sensor unit 32 for each electrical signal lane as shown in FIG. 3 . The parallel signal WDM bulk optical transmitter 35 then transmits a WDM signal that bundles these optical signals (pixel data) to the image data processing unit 500 via the optical fiber transmission unit 700. In other words, the parallel signal WDM bulk optical transmitter 35 simultaneously transmits pixel data corresponding to each of the multiple pixels of the imaging unit 31 in parallel to the network 900. In particular, in this embodiment, the camera unit 300 transmits pixel data by wavelength division multiplexing. FIG. 2 shows an example in which optical signal wavelengths λ1...λx are assigned to x electrical signals d1...dx.

[0026] The image data processing unit 500 is configured to generate image data (image information) based on pixel data from the camera unit 300. However, the image data processing unit 500 may also generate image data composed of at least a portion of the multiple pixels of the photographing unit 31 from the received pixel data. The image data processing unit 500 includes a parallel signal WDM bulk optical receiving unit 51, a lane delay control unit 52, a processor processing unit 53, and a processing setting unit 54. The parallel signal WDM bulk optical receiving unit 51 receives the WDM signal from the parallel signal WDM bulk optical transmitting unit 35 and demodulates it into a parallel electrical data signal.

[0027] The lane delay control unit 52 controls the delay for each parallel lane and inputs the data to the processor processing unit 53. The processor processing unit 53 is configured to perform various processes. Specifically, the processor processing unit 53 generates image data from pixel data demodulated into parallel electrical data signals. The functions of the processor processing unit 53 can be customized according to a pre-set application (human detection, dark place photography, etc.). It is optional whether or not to provide the lane delay control unit 52, and the pixel data demodulated into parallel electrical data signals may be input directly from the parallel signal WDM batch optical receiving unit 51 to the processor processing unit 53.

[0028] The processing setting unit 54 is configured to optimize the settings of the processor processing unit 53 for the captured image. In this embodiment, the processing setting unit 54 includes a captured image learning unit 55. The captured image learning unit 55 is configured to perform machine learning based on, for example, the processing results up to the immediately preceding time. The settings of the processor processing unit 53 are optimized based on the results of the machine learning by the captured image learning unit 55. However, the scope of the present disclosure is not limited to optimizing the settings of the processor processing unit 53 by the captured image learning unit 55, and it is possible to optimize the processing of the processor processing unit 53 by any method.

[0029] (Comparison with Related Configurations) Next, the effects of the transmission system 100 in the first embodiment will be described while comparing it with the configuration of a related camera 300A shown in FIG.

[0030] The camera 300A includes an image processor 30A, a lens 31A, an image sensor 32A, a parallel-to-serial converter 35A, and an external interface 36A. The image sensor 32A includes a photodiode (PD), a CMOS / CCD circuit, a correlated double sampling (CDS), and an analog-to-digital converter (ADC). As described above, the camera 300A includes an image processor 30A specialized for image processing. However, such a signal processing circuit has the problem of being larger in size and consuming more power than the image sensor 32A.

[0031] Furthermore, Non-Patent Document 1 discloses a configuration in which video captured by a camera is processed in a video processing unit (CCU: Communication Control Unit) connected via a cable (see FIG. 7 in Non-Patent Document 1). In particular, Non-Patent Document 1 is specialized for the high-definition standard, and therefore video processing is performed in a signal processing unit (DSP: Digital Signal Processor) implemented in the video processing unit. However, since higher definition video generally requires larger circuit scale and power consumption, miniaturizing the entire system has been an issue.

[0032] In contrast, in the first embodiment, the above problem is solved by consolidating the image processor functions in an image data processing unit 500 (such as a data center) at a higher level in the network, and transmitting the information generated by the image sensor unit 32 over long distances via an optical fiber transmission unit 700 between the camera unit 300 and the image data processing unit 500. In other words, according to the above embodiment, it is possible to achieve power saving and miniaturization of the camera as a whole.

[0033] Furthermore, according to the above embodiment, the processing setting section 54 can optimize the settings of the processor processing section 53 that performs image processing.

[0034] (Modification of First Embodiment) A transmission system 101 according to a modification of the first embodiment will be described with reference to Fig. 4. The transmission system 101 according to this modification includes an image data processing unit 501 instead of the image data processing unit 500.

[0035] The image data processing unit 501 includes three processor processing units 53A, 53B, and 53X, a data allocation unit 56, and an allocation control unit 57. Each processor processing unit basically has the same functions as the processor processing unit 53 according to the first embodiment, and is configured to specialize in a specific process.

[0036] Specifically, the image data processing unit 501 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data to generate image data. In particular, in this modification, the parallel electrical data signals are distributed by the data distribution unit 56 and the distribution control unit 57.

[0037] The data allocation unit 56 allocates pixel data to one of the three processor processing units 53A, 53B, and 53X. That is, in this embodiment, in order to process the data signal in a processor processing unit appropriate for the application (person detection, dark place photography, etc.), the data allocation unit 56 is used to allocate the pixel data string to a specified processor processing unit. Note that the pixel data demodulated into parallel electrical data signals may be input directly from the parallel signal WDM batch optical receiver 51 to the three processor processing units 53A, 53B, and 53X without going through the lane delay control unit 52. The number of processor processing units is arbitrary and is not limited to three.

[0038] The allocation control unit 57 controls the allocation of pixel data by the data allocation unit 56. In this embodiment, the captured image learning unit 55 incorporated in the allocation control unit 57 is configured to select a processor processing unit that is optimal for processing predetermined pixel data. Specifically, the captured image learning unit 55 is configured to perform machine learning based on the processing results up to the immediately preceding time. The selection of the processor processing unit by the data allocation unit 56 is optimized based on the results of the machine learning by the captured image learning unit 55.

[0039] Furthermore, the allocation control unit 57 is configured to optimize the settings of each processor processing unit for the captured image. Specifically, the captured image learning unit 55 of the allocation control unit 57 is configured to perform machine learning based on, for example, the processing results up to the immediately preceding time. The settings of each processor processing unit are optimized based on the results of the machine learning of the captured image learning unit 55. Specifically, the captured image learning unit 55 of the allocation control unit 57 is configured to perform machine learning based on, for example, the processing results up to the immediately preceding time. The settings of each processor processing unit are optimized based on the results of the machine learning of the captured image learning unit 55.

[0040] However, it is optional whether or not to provide the captured image learning unit 55 in the allocation control unit 57. If the captured image learning unit 55 is not provided, the allocation control unit 57 may be controlled by an external instruction. Furthermore, the scope of the present disclosure is not limited to selecting a processor processing unit that is optimal for processing pixel data using these methods, and it is possible to select a processor processing unit using any method.

[0041] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the allocation control unit 57 can optimize the settings of the processor processing units that perform image processing. Furthermore, the allocation control unit 57 can input data to the processor processing unit that is best suited for the processing.

[0042] (Another Modification of the First Embodiment) A transmission system 102 according to another modification of the first embodiment will be described with reference to Fig. 5. The transmission system 102 according to this modification includes an image data processing unit 502 instead of the image data processing unit 500. The image data processing unit 502 includes three parallel signal WDM batch optical receiving units 51A, 51B, and 51X, three lane delay control units 52A, 52B, and 52X, three processor processing units 53A, 53B, and 53X, an optical signal selecting unit 61, and an optical signal selecting unit control unit 62.

[0043] Specifically, the image data processing unit 502 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the parallel optical signals are distributed by the optical signal selection unit 61 and the optical signal selection unit control unit 62.

[0044] The optical signal selection unit 61 selects and distributes the pixel data (optical signal) string from the parallel signal WDM bulk optical transmitter 35 to the three parallel signal WDM bulk optical receivers 51A, 51B, and 51X. That is, in this embodiment, when the image data processing unit 502 receives pixel data, the pixel data is selected and distributed so that a processor processing unit suitable for processing each pixel data performs the processing.

[0045] Each of the three lane delay control units 52A, 52B, and 52X performs delay control for each parallel lane, similar to the lane delay control unit 52, and inputs data to the corresponding processor processing unit. However, whether or not to provide the three lane delay control units 52A, 52B, and 52X is optional, and pixel data demodulated into parallel electrical data signals may be input directly from the three parallel signal WDM batch optical receiving units 51A, 51B, and 51X to the three processor processing units 53A, 53B, and 53X.

[0046] The optical signal selection unit control unit 62 controls the selection of pixel data by the optical signal selection unit 61. In this embodiment, the captured image learning unit 55 incorporated in the optical signal selection unit control unit 62 is configured to select the optimal optical receiving unit. Specifically, the captured image learning unit 55 is configured to perform machine learning based on the processing results up to the immediately preceding time. The selection of the optical receiving unit by the optical signal selection unit control unit 62 is optimized based on the results of the machine learning by the captured image learning unit 55.

[0047] Furthermore, the optical signal selection unit control unit 62 is configured to optimize the settings of each processor processing unit for the captured image. Specifically, the captured image learning unit 55 of the optical signal selection unit control unit 62 is configured to perform machine learning based on the processing results up to the immediately preceding time. The settings of each processor processing unit are optimized based on the results of the machine learning by the captured image learning unit 55.

[0048] However, whether or not the captured image learning unit 55 is provided in the optical signal selection unit control unit 62 is optional. If the captured image learning unit 55 is not provided, the optical signal selection unit control unit 62 may be controlled by an external instruction. Furthermore, the scope of the present disclosure is not limited to selecting an optical receiving unit that is optimal for processing pixel data using these methods, and an optical receiving unit can be selected using any method. Note that the number of optical receiving units, control units, and processor processing units is not limited to three.

[0049] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the optical signal selection control unit 62 can optimize the settings of the processor processing unit that performs image processing. Furthermore, the optical signal selection control unit 62A can select the optimal optical receiving unit. This allows data to be input to the processor processing unit that is best suited for processing.

[0050] Second Embodiment A transmission system 103 according to a second embodiment of the present disclosure will be described with reference to Figs. 6 and 7 . The transmission system 103 mainly includes a camera unit 303, an image data processing unit 503, and a multi-core optical fiber transmission unit 703 that connects the camera unit 303 and the image data processing unit 503. In the transmission system 103, the image processor function, which is a dominant factor in power consumption / size, is also separated from the camera unit 303 and placed in a data sensor (image data processing unit 503) on the network. Data transfer from the camera unit 303 to the image data processing unit 503 is performed via the multi-core optical fiber transmission unit 703. Fig. 6 shows a basic configuration in which the camera unit 303 and the image data processing unit 503 are connected one-to-one.

[0051] The camera unit 303 is provided with a multi-core compatible optical transmitter 36 instead of the parallel signal WDM batch optical transmitter 35 in the camera unit 300 according to the first embodiment. As shown in FIG. 7 , the multi-core compatible optical transmitter 36 converts parallel electrical data signals from the image sensor unit 32 into optical signals and assigns them to each core of the multi-core optical fiber transmission unit 703 for each electrical signal lane. The multi-core compatible optical transmitter 36 then transmits these optical signals (pixel data) to the image data processing unit 503 via the multi-core optical fiber transmission unit 703. In other words, the multi-core compatible optical transmitter 36 simultaneously transmits pixel data corresponding to each of the multiple pixels of the imaging unit 31 in parallel to the network 900. In particular, in this embodiment, the camera unit 303 transmits pixel data using a multi-core optical fiber. FIG. 7 shows an example in which cores c1...cx are assigned to x electrical signals d1...dx.

[0052] The image data processing unit 503 is configured to generate image data (image information) based on pixel data from the camera unit 303. However, the image data processing unit 503 may also generate image data composed of at least a portion of the multiple pixels of the photographing unit 31 from the received pixel data.

[0053] The image data processing unit 503 is provided with a multi-core compatible optical receiving unit 81 instead of the parallel signal WDM batch optical transmitter 51 in the image data processing unit 500 according to the first embodiment. The multi-core compatible optical receiving unit 81 receives the optical signal from the multi-core compatible optical transmitter 36 and demodulates it into a parallel electrical data signal.

[0054] The other functional units of the camera unit 303 and the image data processing unit 503 are similar to those of the camera unit 300 and the image data processing unit 500 according to the first embodiment, and therefore a description thereof will be omitted.

[0055] Also in the second embodiment, the functions of the image processor are consolidated in an image data processing unit 503 (such as a data center) at a higher level in the network, and the information generated by the image sensor unit 32 is transmitted over long distances via a multi-core optical fiber transmission unit 703 between the camera unit 303 and the image data processing unit 503, thereby making it possible to reduce the power consumption and size of the camera as a whole.

[0056] Furthermore, the processing setting section 54 can optimize the settings of the processor processing section 53 that performs image processing.

[0057] (Modification of Second Embodiment) A transmission system 104 according to a modification of the second embodiment will be described with reference to Fig. 8. The transmission system 104 according to this modification includes an image data processing unit 504 instead of the image data processing unit 503.

[0058] In addition, the image data processing unit 503 is equipped with three processor processing units 53A, 53B, and 53X, a data allocation unit 56, and an allocation control unit 57, similar to the image data processing unit 501 (see Figure 4) according to the modified example of the first embodiment.

[0059] Specifically, the image data processing unit 504 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the parallel electrical data signals are distributed by the data distribution unit 56 and the distribution control unit 57.

[0060] This modification also allows for power saving and miniaturization of the camera as a whole. Furthermore, this modification also allows the allocation control unit 57 to optimize the settings of the processor processing units that perform image processing. Furthermore, the allocation control unit 57 allows data to be input to a processor processing unit that is suitable for the processing.

[0061] Another Modification of the Second Embodiment A transmission system 105 according to another modification of the second embodiment will be described with reference to Fig. 9. The transmission system 105 according to this modification includes an image data processing unit 505 instead of the image data processing unit 503.

[0062] The image data processing unit 505 includes three multi-core compatible optical receiving units 81A, 81B, and 81X. The image data processing unit 505 also includes three lane delay control units 52A, 52B, and 52X, three processor processing units 53A, 53B, and 53X, an optical signal selection unit 61, and an optical signal selection unit control unit 62, similar to the image data processing unit 502 (see FIG. 5 ) according to another modified example of the first embodiment.

[0063] Specifically, the image data processing unit 505 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the parallel optical signals are distributed by the optical signal selection unit 61 and the optical signal selection unit control unit 62.

[0064] Specifically, in this modification, the optical signal selector 61 distributes the pixel data (optical signal) sequence from the multi-core compatible optical transmitter 36 to three multi-core compatible optical receivers 81A, 81B, and 81X.

[0065] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the optical signal selection control unit 62 can optimize the settings of the processor processing unit that performs image processing. Furthermore, the optical signal selection control unit 62A can select the optimal optical receiving unit. This allows data to be input to the processor processing unit that is best suited for processing.

[0066] (Third Embodiment) A transmission system 106 according to a third embodiment of the present disclosure will be described with reference to Figures 10 and 11. The transmission system 106 mainly includes a camera unit 306, an image data processing unit 506, and a multimode optical fiber transmission unit 706 that connects the camera unit 306 and the image data processing unit 506. In the transmission system 106, the image processor function, which is a dominant factor in power consumption / size, is also separated from the camera unit 306 and placed in a data center (image data processing unit 506) on the network. Data transfer from the camera unit 306 to the image data processing unit 506 is performed via the multimode optical fiber transmission unit 706. Figure 10 shows a basic configuration in which the camera unit 306 and the image data processing unit 506 are connected one-to-one.

[0067] The camera unit 306 is provided with a multimode-compatible optical transmitter 37. The multimode-compatible optical transmitter 37 converts parallel electrical data signals from the image sensor unit 32 into optical signals and assigns them to each mode of the multimode optical fiber transmission unit 706 for each electrical signal lane. The multimode-compatible optical transmitter 37 then transmits these optical signals (pixel data) to the image data processing unit 506 via the multimode optical fiber transmission unit 706. In other words, the multimode-compatible optical transmitter 37 simultaneously transmits pixel data corresponding to each of the multiple pixels of the imaging unit 31 in parallel to the network 900. In particular, in this embodiment, the camera unit 306 transmits pixel data in multiple modes. FIG. 11 shows an example in which modes m1...mx are assigned to x electrical signals d1...dx.

[0068] The image data processing unit 506 is configured to generate image data (image information) based on pixel data from the camera unit 306. However, the image data processing unit 506 may also generate image data composed of at least a portion of the multiple pixels of the photographing unit 31 from the received pixel data.

[0069] The image data processing unit 506 is provided with a multimode optical receiving unit 91. The multimode optical receiving unit 91 receives the optical signal from the multimode optical transmitting unit 37 and demodulates it into a parallel electrical data signal.

[0070] The other functional units of the camera unit 306 and the image data processing unit 506 are similar to those of the camera unit 300 and the image data processing unit 500 according to the first embodiment, and therefore, a description thereof will be omitted.

[0071] Also in the third embodiment, the functions of the image processor are consolidated in an image data processing unit 506 (such as a data center) at a higher level in the network, and the information generated by the image sensor unit 32 is transmitted over long distances via a multimode optical fiber transmission unit 706 between the camera unit 306 and the image data processing unit 506, thereby making it possible to reduce the power consumption and size of the camera as a whole.

[0072] Furthermore, the processing setting section 54 can optimize the settings of the processor processing section 53 that performs image processing.

[0073] (Modification of Third Embodiment) A transmission system 107 according to a modification of the third embodiment will be described with reference to Fig. 12. The transmission system 107 according to this modification includes an image data processing unit 507 instead of the image data processing unit 506.

[0074] In addition, the image data processing unit 503 is equipped with three processor processing units 53A, 53B, and 53X, a data allocation unit 56, and an allocation control unit 57, similar to the image data processing unit 501 (see Figure 4) according to the modified example of the first embodiment.

[0075] Specifically, the image data processing unit 507 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the data distribution unit 56 and the distribution control unit 57 distribute the parallel electrical data signals.

[0076] This modification also allows for power saving and miniaturization of the camera as a whole. Furthermore, this modification also allows the allocation control unit 57 to optimize the settings of the processor processing units that perform image processing. Furthermore, the allocation control unit 57 allows data to be input to a processor processing unit that is suitable for the processing.

[0077] Another Modification of the Third Embodiment A transmission system 108 according to another modification of the third embodiment will be described with reference to Fig. 13. The transmission system 108 according to this modification includes an image data processing unit 508 instead of the image data processing unit 506.

[0078] The image data processing unit 508 includes three multimode-compatible optical receiving units 91A, 91B, and 91X. The image data processing unit 508 also includes three lane delay control units 52A, 52B, and 52X, three processor processing units 53A, 53B, and 53X, an optical signal selection unit 61, and an optical signal selection unit control unit 62, similar to the image data processing unit 502 (see FIG. 5 ) according to another modified example of the first embodiment.

[0079] Specifically, the image data processing unit 508 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the parallel optical signals are distributed by the optical signal selection unit 61 and the optical signal selection unit control unit 62.

[0080] In this modification, the optical signal selector 61 distributes the pixel data (optical signal) sequence from the multi-core compatible optical transmitter 36 to three multi-mode compatible optical receivers 91A, 91B, and 91X.

[0081] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the optical signal selection control unit 62 can optimize the settings of the processor processing unit that performs image processing. Furthermore, the optical signal selection control unit 62A can select the optimal optical receiving unit. This allows data to be input to the processor processing unit that is best suited for processing.

[0082] (Application of the Transmission System of the Present Disclosure) Currently, camera IFs (Interfaces), which are the output destinations of CMOS (Complementary Metal-Oxide-Semiconductor) image sensors, are often de facto standards for MIPI (Mobile Industry Processor Interface). The need to extend such camera IFs has already become apparent in in-vehicle systems, and there is a possibility that further extension technologies will be required. The transmission system of the present disclosure can meet such needs.

[0083] The transmission system of the present disclosure can also be applied to technologies such as SLVS-EC (Scalable Low Voltage Signaling with Embedded Clock, registered trademark), GVIF (Gigabit Video Interface), and GMSL (Gigabit Multimedia Serial Link).Furthermore, the transmission system of the present disclosure can also be applied to technologies for miniaturizing and power-saving cameras by converting MIPI into a SerDes (serializer / deserializer) and transmitting it over optical fiber.

[0084] The camera unit and image data processing unit according to the present disclosure can also be realized by a computer and a program, and the program can be recorded on a recording medium or provided via a network. The program according to the present disclosure is a program for causing a computer to realize each function provided in the camera unit and image data processing unit according to the present disclosure, and is a program for causing a computer to execute each procedure provided in the method executed by the camera unit and image data processing unit according to the present disclosure.

[0085] The transmission system of the present disclosure can be applied to the information and communications industry.

[0086] 31: Imaging unit 32: Image sensor unit 33: Image sensor processing unit 34: Analog / digital conversion unit 35: Parallel signal WDM bulk optical transmitter unit 36: Multi-core compatible optical transmitter unit 37: Multi-mode compatible optical transmitter unit 51, 51A, 51B, 51X: Parallel signal WDM bulk optical receiver unit 52, 52A, 52B, 52X: Lane delay control unit 53, 53A, 53B, 53X: Processor processing unit 54: Processing setting unit 55: Captured image learning unit 56: Data distribution unit 57: Distribution control unit 61: Optical signal selection unit 62: Optical signal selection unit control unit 81, 81A, 81B, 81X: Multi-core compatible optical receiver unit 91, 91A, 91B, 91X: Multi-mode compatible optical receiver unit 100, 101, 102, 103, 104, 105, 106, 107, 108: Transmission system 300, 300, 306: Camera unit 500, 501, 502, 503, 504, 505, 506, 507, 508: Image data processing unit 700: Optical fiber transmission unit 703: Multi-core optical fiber transmission unit 706: Multi-mode optical fiber transmission unit 30A: Image processor 31A: Lens 32A: Image sensor 35A: Parallel / serial conversion unit 36A: External interface 300A: Camera

Claims

1. A transmission system that simultaneously transmits pixel data corresponding to each of a plurality of pixels of an imaging unit in parallel to a network, receives the pixel data from the network, and generates image data consisting of at least a portion of the plurality of pixels from the received pixel data.

2. The transmission system according to claim 1, comprising: a camera unit having the photographing unit and transmitting the pixel data to the network by any of wavelength division multiplexing transmission, transmission using a multi-core optical fiber, and multimode transmission; and an image data processing unit receiving the pixel data from the network and generating the image data from the received pixel data.

3. The transmission system according to claim 2, wherein the image data processing unit comprises a plurality of processor processing units, and selects at least one of the plurality of processor processing units in accordance with the received pixel data to generate the image data.

4. A transmission method comprising: simultaneously transmitting pixel data corresponding to each of a plurality of pixels of an imaging unit in parallel to a network; receiving the pixel data from the network; and generating image data consisting of at least a portion of the plurality of pixels from the received pixel data.

Images