Transmission system

Abstract

A transmission system 100 and a transmission method carried out by the transmission system 100 according to the present disclosure are such that a camera control signal for controlling an imaging unit 31 is transmitted to a network 900, and the imaging unit captures an image of an object to be imaged in accordance with the control signal received from the network 900 and transmits pixel data corresponding to each of a plurality of pixels of the imaging unit 31 simultaneously in parallel to the network 900.

Description

Transmission System

[0001] The present disclosure relates to a technique for transmitting information captured by a terminal.

[0002] With the technological development and widespread use of devices equipped with cameras (smartphones, IoT devices), various solutions using cameras are becoming widespread (safety and security through surveillance cameras, person and object recognition, industrial applications, etc.).

[0003] Conventionally, such cameras convert optical information collected by an optical system into electrical information using an image sensor based on a CMOS / CCD (Complementary Metal Oxide Semiconductor / Charge Coupled Device) or the like, and then convert this into image information using an image processor. Generally, the output of the image sensor and image processor is a parallel signal output, but when outputting image information from an external interface, a parallel-to-serial (P / S) conversion is performed in a processing section at a previous stage to shape the data format.

[0004] However, in a configuration where some of the camera functions in a conventional configuration are implemented in a data center on a network, there is a problem in that it is difficult to control the camera located remotely.

[0005] Ogasawara et al., "300 Frames Per Second Progressive Scan HDTV High-Speed ​​Camera," Journal of the Institute of Visual Media, Vol. 60, No. 3, pp. 358-365, 2006. OMNIVISION and Silicon Line Partner to Provide the First Optical Fiber Endoscope Cables for 4K MIPI D-PHY Video”, [online], April 6, 2022, Internet <URL: https: / / www.ovt.com / press-releases / omnivision-and-silicon-line-partner-to-provide-the-first-optical-fiber-endoscope-cables-for-4k-mipi-d-phy-video / >

[0006] In view of the above-mentioned problems, an object of the present disclosure is to provide a transmission system and a transmission method that enable remote control of a camera.

[0007] In order to achieve the above object, the transmission system and transmission method of the present disclosure employ a technique of exchanging control signals for controlling an image capture unit via a network.

[0008] Specifically, the transmission system of the present disclosure transmits a control signal for controlling an imaging unit to a network, the imaging unit captures an image of an object in accordance with the control signal received from the network, and pixel data corresponding to each of the multiple pixels of the imaging unit is simultaneously transmitted in parallel to the network.

[0009] The transmission system further comprises: a camera unit having the photographing unit and transmitting the pixel data to the network by any of wavelength division multiplexing transmission, transmission using a multi-core optical fiber, and multimode transmission; and an image data processing unit receiving the pixel data from the network and generating image data from the received pixel data, wherein the pixel data and the control signal may have different wavelengths, allocation cores, or allocation modes.

[0010] In addition, in the transmission system, the image data processing unit may include a plurality of processor processing units, and may select at least one of the plurality of processor processing units in accordance with the received pixel data to generate the image data.

[0011] Specifically, the transmission method of the present disclosure transmits a control signal for controlling an imaging unit to a network, the imaging unit photographs an object in accordance with the control signal received from the network, and pixel data corresponding to each of the multiple pixels of the imaging unit is simultaneously transmitted in parallel to the network.

[0012] The camera unit and image data processing unit according to the present disclosure can also be realized by a computer and a program, and the program can be recorded on a recording medium or provided via a network. The program according to the present disclosure is a program for causing a computer to realize each function provided in the camera unit and image data processing unit according to the present disclosure, and is a program for causing a computer to execute each procedure provided in the method executed by the camera unit and image data processing unit according to the present disclosure.

[0013] The above disclosures can be combined as much as possible.

[0014] According to the present disclosure, it is possible to provide a transmission system and a transmission method that enable remote control of a camera.

[0015] 1 is a diagram illustrating an overview of a transmission system according to an embodiment of the present disclosure. FIG. 1 is a diagram illustrating a configuration of a camera unit according to a first embodiment of the present disclosure. FIG. 2 is a diagram illustrating a configuration of an image data processing unit according to a first embodiment of the present disclosure. FIG. 3 is a table illustrating the relationship between electrical signal lanes and optical signal wavelengths. FIG. 4 is a diagram illustrating a configuration of a modified example of an image data processing unit according to the first embodiment of the present disclosure. FIG. 5 is a diagram illustrating a configuration of a camera unit according to a second embodiment of the present disclosure. FIG. 6 is a diagram illustrating a configuration of an image data processing unit according to a second embodiment of the present disclosure. FIG. 7 is a table illustrating the relationship between electrical signal lanes and cores. FIG. 8 is a diagram illustrating a configuration of a modified example of an image data processing unit according to the second embodiment of the present disclosure. FIG. 9 is a diagram illustrating a configuration of a camera unit according to a third embodiment of the present disclosure. FIG. 10 is a diagram illustrating a configuration of an image data processing unit according to a third embodiment of the present disclosure. FIG. 11 is a table illustrating the relationship between electrical signal lanes and modes. FIG. 12 is a diagram illustrating a configuration of a modified example of an image data processing unit according to the third embodiment of the present disclosure.

[0016] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. Note that the present disclosure is not limited to the embodiments shown below. These implementation examples are merely illustrative, and the present disclosure can be implemented in various forms with various modifications and improvements based on the knowledge of those skilled in the art. Note that components with the same reference numerals in this specification and drawings indicate the same components.

[0017] (First Embodiment) A transmission system 100 according to a first embodiment of the present disclosure will be described with reference to Fig. 1 to Fig. 4. First, the basic configuration of the transmission system 100 will be described with reference to Fig. 1. As shown in Fig. 1, the transmission system 100 mainly includes a camera unit 300 including an imaging unit 31, and an image data processing unit 500. The camera unit 300 and the image data processing unit 500 are connected via a network 900.

[0018] Specifically, the transmission system 100 and the transmission method using the transmission system 100 of the present disclosure transmit a camera control signal for controlling the photographing unit 31 to the network 900, the photographing unit photographs the subject in accordance with the control signal received from the network 900, and pixel data corresponding to each of the multiple pixels of the photographing unit 31 is simultaneously transmitted in parallel to the network 900.

[0019] The camera unit 300 mainly includes an imaging unit 31 having a plurality of pixels, and an image sensor unit 32. Although Fig. 1 shows an example in which the image sensor unit 32 includes a PD (Photo Diode), a CMOS (Complementary Metal Oxide Semiconductor / Charge Coupled Device) circuit, a CDS (Correlated Double Sampling), and an ADC (Analog-to-digital converter), the configuration of the image sensor unit 32 is arbitrary, and the image sensor unit 32 may have other configurations or additional configurations.

[0020] The camera unit 300 performs E / O (Electrical signal / Optical signal) conversion on the output from the image sensor unit 32 and sends the converted data to the network 900. The image data processing unit 500 performs O / E (Optical signal / Electrical signal) conversion on the pixel data from the camera unit 300 using its internal or external functions and performs processing. FIG. 1 shows that the image data processing unit 500 performs image processing with priority on image quality, image processing with priority on delay, and AI processing. However, the scope of the present disclosure is not limited to this, and the image data processing unit 500 can perform various types of processing.

[0021] Furthermore, the image data processing unit 500 sends a camera control signal to the camera unit 300. The camera unit 300 controls various functions based on the camera control signal.

[0022] In the transmission system 100, the image processor function, which is a dominant factor in power consumption / size, is separated from the camera unit 300 and placed in a data center (image data processing unit 500) on the network. Fig. 1 shows a basic configuration in which the camera unit 300 and the image data processing unit 500 are in a one-to-one relationship.

[0023] The present disclosure also includes a case where multiple camera units and multiple image data processing units are connected via an optical fiber network. The scope of the present disclosure is not limited to the case shown in Fig. 1, and one image data processing unit may correspond to multiple camera units, or multiple image data processing units may correspond to one camera unit.

[0024] A more detailed configuration of the camera unit 300 according to the first embodiment of the present disclosure will be described with reference to FIG. 2 . The camera unit 300 controls various functions based on a camera control signal from the image data processing unit 500. The camera unit 300 includes an imaging unit 31, an image sensor unit 32, a parallel signal WDM batch optical transmitter 35, an optical signal multiplexing / demultiplexing unit 30, a camera control signal receiver 37, and a camera control instruction unit 38. In this embodiment, data transfer from the camera unit 300 to the image data processing unit 500 is performed via an optical fiber transmission unit 700. However, the scope of the present disclosure is not limited to data transfer via optical transmission using the optical fiber transmission unit 700, and data transfer via other transmission modes is also included in the scope of the present disclosure. Furthermore, data transfer via a combination of optical transmission and other transmission modes is also included in the scope of the present disclosure.

[0025] The camera unit 300 includes a photographing unit 31, an image sensor unit 32, and a parallel signal WDM (Wavelength Division Multiplexing) batch optical transmitter 35. The photographing unit 31 is an optical system including a lens and the like, and collects optical information.

[0026] The image sensor unit 32 includes an image sensor processing unit 33 and an analog / digital conversion unit 34. The image sensor unit 32 is, for example, an image sensor based on a CMOS / CCD (Complementary Metal Oxide Semiconductor / Charge Coupled Device). The image sensor unit 32 converts the optical information collected by the photographing unit 31 into electrical information. The image sensor unit 32 outputs parallel electrical data signals.

[0027] The parallel signal WDM bulk optical transmitter 35 assigns optical signal wavelengths to the parallel electrical data signals from the image sensor unit 32 for each electrical signal lane, as shown in FIG. 4 . The parallel signal WDM bulk optical transmitter 35 then transmits a WDM signal that bundles these optical signals (pixel data) to the image data processing unit 500 via the optical fiber transmission unit 700. In other words, the parallel signal WDM bulk optical transmitter 35 simultaneously transmits pixel data corresponding to each of the multiple pixels of the imaging unit 31 in parallel to the network 900. In particular, in this embodiment, the camera unit 300 transmits pixel data by wavelength division multiplexing. FIG. 4 shows an example in which optical signal wavelengths λ1...λx are assigned to x electrical signals d1...dx.

[0028] The optical signal multiplexing / demultiplexing unit 30 has the function of combining multiple optical signals into a single optical fiber, or conversely, dividing the signals. In particular, in this embodiment, the optical signal multiplexing / demultiplexing unit 30 is configured to combine pixel data from the parallel signal WDM batch optical transmitter 35 and transmit the combined data to the optical fiber transmitter 700, and to transmit a camera control signal from the image data processor 500 to the camera control optical signal receiver 37. In this embodiment, in order to ensure wavelength selectivity between the pixel data and the camera control signal, the optical signal wavelength assignments for the parallel electrical signals output from the image sensor unit 32 and the camera control signal are set to different wavelengths (wavelengths λ1 to λx of the pixel data ≠ wavelength λz of the camera control signal).

[0029] The camera control optical signal receiving unit 37 receives a camera control signal via the optical signal multiplexing / demultiplexing unit 30. The camera control optical signal receiving unit 37 transmits the received camera control signal to the camera control instruction unit 38. The camera control instruction unit 38 optimizes the settings of various setting parameters in the camera unit 300, such as the optical system of the photographing unit 31, based on the camera control signal. The photographing unit 31 photographs the subject in accordance with the camera control signal.

[0030] A more detailed configuration of the image data processing unit 500 according to the first embodiment of the present disclosure will be described with reference to FIG. 3 . The image data processing unit 500 transmits a camera control signal for controlling the photographing unit 31 to the network 900. The image data processing unit 500 is also configured to generate image data (image information) based on pixel data from the camera unit 100. However, the image data processing unit 500 may also generate image data composed of at least a portion of the multiple pixels of the photographing unit 31 from the received pixel data. The image data processing unit 500 includes an optical signal multiplexing / demultiplexing unit 50, a camera control instruction unit 71, a camera control optical transmitter 72, a parallel signal WDM batch optical receiver 51, a lane delay control unit 52, a processor processing unit 53, and a processing setting unit 54.

[0031] The camera control instruction unit 71 generates a camera control signal for controlling the camera unit 300. Specifically, the camera control instruction unit 71 generates the camera control signal based on an external control instruction or a preset control instruction. The camera control light transmission unit 72 transmits the generated camera control signal to the optical fiber transmission unit 700 via the optical signal multiplexing / demultiplexing unit 50.

[0032] The optical signal multiplexing / demultiplexing unit 50 has the function of integrating a large number of optical signals into a single optical fiber, or conversely, splitting the signals. In particular, in this embodiment, the optical signal multiplexing / demultiplexing unit 50 is configured to split pixel data from the camera unit 300 and transmit the split data to the parallel signal WDM batch optical receiver 51, and to transmit camera control signals from the camera control optical transmitter 72 to the optical fiber transmitter 700.

[0033] The parallel signal WDM bulk optical receiver 51 receives pixel data from the parallel signal WDM bulk optical transmitter 35 of the camera unit 300 via the optical fiber transmission unit 700. The parallel signal WDM bulk optical receiver 51 demodulates the received signals from optical signals to parallel electrical data signals.

[0034] The lane delay control unit 52 controls the delay for each parallel lane and inputs the data to the processor processing unit 53. The processor processing unit 53 is configured to perform various processes. Specifically, the processor processing unit 53 generates image data from pixel data demodulated into parallel electrical data signals. The functions of the processor processing unit 53 can be customized according to a pre-set application (human detection, dark place photography, etc.). It is optional whether or not to provide the lane delay control unit 52, and the pixel data demodulated into parallel electrical data signals may be input directly from the parallel signal WDM batch optical receiving unit 51 to the processor processing unit 53.

[0035] The processing setting unit 54 is configured to optimize the settings of the processor processing unit 53 for the captured image. In this embodiment, the processing setting unit 54 includes a captured image learning unit 55. The captured image learning unit 55 is configured to perform machine learning based on, for example, the processing results up to the immediately preceding time. The settings of the processor processing unit 53 are optimized based on the results of the machine learning by the captured image learning unit 55. However, the scope of the present disclosure is not limited to optimizing the settings of the processor processing unit 53 by the captured image learning unit 55, and it is possible to optimize the processing of the processor processing unit 53 by any method.

[0036] (Comparison with Related Configurations) Next, the effects of the transmission system 100 in the first embodiment will be described while comparing it with the configuration of a related camera 300A shown in FIG.

[0037] The camera 300A includes an image processor 30A, a lens 31A, an image sensor 32A, a parallel-to-serial converter 35A, and an external interface 36A. The image sensor 32A includes a photodiode (PD), a CMOS / CCD circuit, a correlated double sampling (CDS), and an analog-to-digital converter (ADC). As described above, the camera 300A includes an image processor 30A specialized for image processing. However, such a signal processing circuit has the problem of being larger in size and consuming more power than the image sensor 32A.

[0038] Furthermore, Non-Patent Document 1 discloses a configuration in which video captured by a camera is processed in a video processing unit (CCU: Communication Control Unit) connected via a cable (see FIG. 7 in Non-Patent Document 1). In particular, Non-Patent Document 1 is specialized for the high-definition standard, and therefore video processing is performed in a signal processing unit (DSP: Digital Signal Processor) implemented in the video processing unit. However, since higher definition video generally requires larger circuit scale and power consumption, miniaturizing the entire system has been an issue.

[0039] In contrast, in the first embodiment, the above problem is solved by consolidating the image processor functions in an image data processing unit 500 (such as a data center) at a higher level in the network, and transmitting the information generated by the image sensor unit 32 over long distances via an optical fiber transmission unit 700 between the camera unit 300 and the image data processing unit 500. In other words, according to the above embodiment, it is possible to achieve power saving and miniaturization of the camera as a whole. Furthermore, according to the above embodiment, it is possible to optimize the settings of the processor processing unit 53 that performs image processing using the processing setting unit 54.

[0040] On the other hand, conventionally, cameras that capture images at high frame rates, such as high-speed cameras, are specialized for video capture capabilities and therefore do not have a network interface like those found in general cameras, and are configured to control the camera from a control unit connected via an optical cable, etc. In such cases, since shooting is limited to within the range where the optical cable attached to the high-speed camera system can be connected, there has been a problem in that it is difficult to control the camera from a remote location (see Figure 1 of Non-Patent Document 1).

[0041] In contrast, according to the above embodiment, in a configuration in which the image sensor and image processor are separated, camera control signals are exchanged via the optical fiber transmission unit 700, making it possible to remotely control the camera and reflect specified settings.

[0042] (Modification of First Embodiment) The configuration of an image data processing unit 501 according to a modification of the first embodiment will be described with reference to Fig. 5. The image data processing unit 501 includes, similarly to the image data processing unit 500, a camera control instruction unit 71, a camera control optical transmitter 72, an optical signal multiplexer / demultiplexer 50, a parallel signal WDM batch optical receiver 51, and a lane delay controller 52.

[0043] The image data processing unit 501 also includes three processor processing units 53A, 53B, and 53X, a data allocation unit 56, an allocation control unit 57, and a shooting setting determination unit 73. Each processor processing unit basically has the same functions as the processor processing unit 53 according to the first embodiment, and is configured to specialize in specific processing.

[0044] Specifically, the image data processing unit 501 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data to generate image data. In particular, in this modification, the parallel electrical data signals are distributed by the data distribution unit 56 and the distribution control unit 57.

[0045] The data distribution unit 56 distributes pixel data to one of the three processor processing units 53A, 53B, and 53X. That is, in this embodiment, in order to process the data signal in a processor processing unit appropriate for the application (person detection, dark place photography, etc.), the data distribution unit 56 is used to distribute the pixel data string to a specified processor processing unit. Note that the pixel data may be input as serial data directly from the parallel signal WDM batch optical receiver 51 to the three processor processing units 53A, 53B, and 53X without going through the lane delay control unit 52. Furthermore, the number of processor processing units is arbitrary and is not limited to three.

[0046] The allocation control unit 57 controls the allocation of pixel data by the data allocation unit 56. In this embodiment, the captured image learning unit 55 incorporated in the allocation control unit 57 is configured to select a processor processing unit that is optimal for processing predetermined pixel data. Specifically, the captured image learning unit 55 is configured to perform machine learning based on the processing results up to the immediately preceding time. The selection of the processor processing unit by the data allocation unit 56 is optimized based on the results of the machine learning by the captured image learning unit 55.

[0047] Furthermore, the allocation control unit 57 is configured to optimize the settings of each processor processing unit for the captured image. Specifically, the captured image learning unit 55 of the allocation control unit 57 is configured to perform machine learning based on, for example, the processing results up to the immediately preceding time. The settings of each processor processing unit are optimized based on the results of the machine learning of the captured image learning unit 55. Specifically, the captured image learning unit 55 of the allocation control unit 57 is configured to perform machine learning based on, for example, the processing results up to the immediately preceding time. The settings of each processor processing unit are optimized based on the results of the machine learning of the captured image learning unit 55.

[0048] However, whether or not the allocation control unit 57 is provided with the captured image learning unit 55 is optional. If the captured image learning unit 55 is not provided, the allocation control unit 57 may be controlled by an external instruction. Furthermore, the scope of the present disclosure is not limited to selecting the optimal processor processing unit for processing pixel data or optimizing the settings of each processor processing unit using the above-mentioned method. It is possible to select the optimal processor processing unit or optimize the settings of each processor processing unit using any method.

[0049] The shooting setting determination unit 73 determines whether or not the shooting settings need to be changed and the extent of the change, depending on the processing result of the processor processing unit, etc. For example, the shooting setting determination unit 73 may determine whether or not the shooting settings need to be changed and the extent of the change, depending on the captured image, etc.

[0050] In this embodiment, the camera control instruction unit 71 generates a camera control signal in accordance with control instructions from outside, control instructions set in advance, and also the judgment result (camera control setting) of the shooting setting judgment unit 73 for the captured image, etc.

[0051] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the allocation control unit 57 allows data to be input to a processor processing unit suitable for processing. Furthermore, the settings of the processor processing unit that performs image processing can be optimized.

[0052] In a configuration in which the image sensor and image processor are separated, camera control signals are exchanged via the optical fiber transmission unit 700, making it possible to remotely control the camera unit 300 and reflect specified settings.

[0053] Another Modification of the First Embodiment The configuration of an image data processing unit 502 according to another modification of the first embodiment will be described with reference to Fig. 6. The image data processing unit 502 includes a camera control instruction unit 71, a camera control light transmission unit 72, a shooting setting determination unit 73, and an optical signal multiplexing / demultiplexing unit 50, similar to the image data processing unit 501.

[0054] The image data processing unit 502 includes three parallel signal WDM bulk optical receiving units 51A, 51B, and 51X, three lane delay control units 52A, 52B, and 52X, three processor processing units 53A, 53B, and 53X, an optical signal selection unit 61, and an optical signal selection unit control unit 62.

[0055] Specifically, the image data processing unit 502 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the parallel optical signals are distributed by the optical signal selection unit 61 and the optical signal selection unit control unit 62.

[0056] The optical signal selection unit 61 selects and distributes the pixel data (optical signal) string received from the parallel signal WDM bulk optical transmitter 35 via the optical signal multiplexer / demultiplexer 50 to the three parallel signal WDM bulk optical receivers 51A, 51B, and 51X. That is, in this embodiment, when the image data processing unit 502 receives pixel data, the pixel data is selected and distributed so that a processor processing unit suitable for processing each pixel data performs processing.

[0057] The optical signal selection unit control unit 62 controls the selection of pixel data by the optical signal selection unit 61. In this embodiment, the captured image learning unit 55 incorporated in the optical signal selection unit control unit 62 is configured to select the optimal optical receiving unit. Specifically, the captured image learning unit 55 is configured to perform machine learning based on the processing results up to the immediately preceding time. The selection of the optical receiving unit by the optical signal selection unit control unit 62 is optimized based on the results of the machine learning by the captured image learning unit 55.

[0058] Furthermore, the optical signal selection unit control unit 62 is configured to optimize the settings of each processor processing unit for the captured image. Specifically, the captured image learning unit 55 of the optical signal selection unit control unit 62 is configured to perform machine learning based on the processing results up to the immediately preceding time. The settings of each processor processing unit are optimized based on the results of the machine learning by the captured image learning unit 55.

[0059] However, it is optional whether or not to provide the captured image learning unit 55 in the light signal selection unit control unit 62. If the captured image learning unit 55 is not provided, the light signal selection unit control unit 62 may be controlled by an external instruction.

[0060] Furthermore, the scope of the present disclosure is not limited to selecting an optimal processor processing unit for processing pixel data or optimizing the settings of each processor processing unit using the above-mentioned method, but rather it is possible to select an optimal processor processing unit or optimize the settings of each processor processing unit using any method.

[0061] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the optical signal selection unit control unit 62 allows data to be input to a processor unit suitable for processing. Furthermore, the settings of the processor unit that performs image processing can be optimized.

[0062] In a configuration in which the image sensor and image processor are separated, camera control signals are exchanged via the optical fiber transmission unit 700, making it possible to remotely control the camera unit 300 and reflect specified settings.

[0063] Second Embodiment A transmission system according to a second embodiment of the present disclosure will be described with reference to Figs. 7 to 9 . The transmission system according to the second embodiment mainly includes a camera unit 301, an image data processing unit 503, and a multi-core optical fiber transmission unit 701 that connects the camera unit 301 and the image data processing unit 503. In the transmission system according to the second embodiment, the image processor function, which is a dominant factor in power consumption / size, is also separated from the camera unit 301 and placed in a data center on the network (the image data processing unit 503). Data transfer from the camera unit 301 to the image data processing unit 503 is performed via the multi-core optical fiber transmission unit 701. Figs. 7 and 8 show a basic configuration in which the camera unit 301 and the image data processing unit 503 are connected one-to-one.

[0064] The camera unit 301 is provided with a multi-core compatible optical transmitter 41 instead of the parallel signal WDM batch optical transmitter 35 in the camera unit 300 according to the first embodiment. Also, the camera unit 301 is provided with a core coupling / separating unit 40 instead of the optical signal multiplexing / demultiplexing unit 30 in the camera unit 300 according to the first embodiment.

[0065] 9 , the multi-core-compatible optical transmitting unit 41 converts parallel electrical data signals from the image sensor unit 32 into optical signals and assigns them to each core of the multi-core optical fiber transmission unit 701 for each electrical signal lane. Then, the multi-core-compatible optical transmitting unit 41 transmits these optical signals (pixel data) to the image data processing unit 503 via the multi-core optical fiber transmission unit 701. In other words, the multi-core-compatible optical transmitting unit 41 simultaneously transmits pixel data corresponding to each of the multiple pixels of the imaging unit 31 in parallel to the network 900. In particular, in this embodiment, the camera unit 301 transmits pixel data using a multi-core optical fiber. FIG. 9 shows an example in which cores c1...cx are assigned to x electrical signals d1...dx.

[0066] The core coupling / separation unit 40 has a function of coupling a large number of optical signals between cores of the multi-core optical fiber, or conversely separating them. In particular, in this embodiment, the core coupling / separation unit 40 is configured to transmit pixel data from the multi-core compatible optical transmission unit 41 to the multi-core optical fiber transmission unit 701, and to transmit a camera control signal from the image data processing unit 503 to the camera control optical signal receiving unit 37. In this embodiment, in order to ensure selectivity between the pixel data and the camera control signal, core allocation for the parallel electrical data signal output from the image sensor unit 32 and core allocation for the camera control signal are set to different cores (the camera control signal core cz ≠ the image data transmission cores c1 to cx).

[0067] The image data processing unit 503 is configured to generate image data (image information) based on pixel data from the camera unit 301. However, the image data processing unit 503 may also generate image data composed of at least a portion of the multiple pixels of the photographing unit 31 from the received pixel data.

[0068] The image data processing unit 503 is provided with a multi-core compatible optical receiving unit 81 instead of the parallel signal WDM batch optical receiving unit 51 in the image data processing unit 500 according to the first embodiment. Also, the image data processing unit 503 is provided with a core coupling / separating unit 80 instead of the optical signal multiplexing / demultiplexing unit 50 in the image data processing unit 500 according to the first embodiment.

[0069] The multi-core compatible optical receiving unit 81 receives the optical signal from the multi-core compatible optical transmitting unit 41 and demodulates it into a parallel electrical data signal.

[0070] The core coupling / separation unit 80 has a function of coupling a large number of optical signals between cores of the multi-core optical fiber, or conversely separating them. In particular, in this embodiment, the core coupling / separation unit 80 is configured to transmit pixel data from the camera unit 301 to the multi-core compatible optical transmitting unit 81, and to transmit a camera control signal from the camera control optical transmitting unit 72 to the multi-core optical fiber transmitting unit 701.

[0071] The camera unit 301 and the image data processing unit 503 have the same functions as the camera unit 300 and the image data processing unit 500 according to the first embodiment, and therefore their explanations will be omitted.

[0072] According to the second embodiment, the functions of the image processor are consolidated in the image data processing unit 503 (such as a data center) at a higher level in the network, and information generated by the image sensor unit 32 can be transmitted over long distances via the multi-core optical fiber transmission unit 701 between the camera unit 301 and the image data processing unit 503. In other words, according to the second embodiment, it is possible to achieve power saving and miniaturization of the camera as a whole. Furthermore, according to the second embodiment, it is possible to optimize the settings of the processor processing unit 53 that performs image processing using the processing setting unit 54.

[0073] According to the second embodiment, in a configuration in which the image sensor and the image processor are separated, camera control signals are exchanged via the multi-core optical fiber transmission unit 701, thereby enabling remote control of the camera unit 300 and reflecting predetermined settings.

[0074] (Modification of Second Embodiment) The configuration of an image data processing unit 504 according to a modification of the second embodiment will be described with reference to Fig. 10. The image data processing unit 504 includes three processor processing units 53A, 53B, and 53X, a data allocation unit 56, an allocation control unit 57, and a shooting setting determination unit 73, similar to the image data processing unit 501 according to the modification of the first embodiment (see Fig. 5).

[0075] Specifically, the image data processing unit 504 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the parallel electrical data signals are distributed by the data distribution unit 56 and the distribution control unit 57.

[0076] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the allocation control unit 57 allows data to be input to a processor processing unit suitable for processing. Furthermore, the settings of the processor processing unit that performs image processing can be optimized.

[0077] In a configuration in which the image sensor and image processor are separated, camera control signals are exchanged via the multi-core optical fiber transmission unit 701, making it possible to remotely control the camera unit 301 and reflect specified settings.

[0078] (Another Modification of the Second Embodiment) The configuration of an image data processing unit 505 according to another modification of the second embodiment will be described with reference to Fig. 11. The image data processing unit 505 includes three multi-core compatible optical receiving units 81A, 81B, and 81X. The image data processing unit 505 also includes three lane delay control units 52A, 52B, and 52X, three processor processing units 53A, 53B, and 53X, an optical signal selection unit 61, and an optical signal selection unit control unit 62, similar to the image data processing unit 502 according to another modification of the first embodiment (see Fig. 6).

[0079] Specifically, the image data processing unit 505 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the parallel optical signals are distributed by the optical signal selection unit 61 and the optical signal selection unit control unit 62.

[0080] Specifically, in this modification, the optical signal selector 61 distributes the pixel data (optical signal) sequence from the multi-core compatible optical transmitter 41 to three multi-core compatible optical receivers 81A, 81B, and 81X.

[0081] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the optical signal selection unit control unit 62 allows data to be input to a processor unit suitable for processing. Furthermore, the settings of the processor unit that performs image processing can be optimized.

[0082] In a configuration in which the image sensor and image processor are separated, camera control signals are exchanged via the multi-core optical fiber transmission unit 701, making it possible to remotely control the camera unit 301 and reflect specified settings.

[0083] (Third Embodiment) A transmission system according to a third embodiment of the present disclosure will be described with reference to Figs. 12 to 14. The transmission system according to the third embodiment mainly includes a camera unit 302, an image data processing unit 506, and a multimode optical fiber transmission unit 702 that connects the camera unit 302 and the image data processing unit 506. In the transmission system according to the third embodiment, the image processor function, which is a dominant factor in power consumption / size, is also separated from the camera unit 302 and placed in a data center on the network (the image data processing unit 506). Data transfer from the camera unit 302 to the image data processing unit 506 is performed via the multimode optical fiber transmission unit 702. Figs. 12 and 13 show a basic configuration in which the camera unit 302 and the image data processing unit 506 are connected one-to-one.

[0084] The camera unit 302 is provided with a multimode compatible optical transmitter 43 instead of the parallel signal WDM batch optical transmitter 35 in the camera unit 300 according to the first embodiment. Also, the camera unit 301 is provided with a mode coupling / separating unit 42 instead of the optical signal multiplexing / demultiplexing unit 30 in the camera unit 300 according to the first embodiment.

[0085] As shown in Figure 14, the multimode-compatible optical transmitter 43 converts parallel electrical data signals from the image sensor unit 32 into optical signals and assigns them to each mode of the multimode optical fiber transmission unit 702 for each electrical signal lane. The multimode-compatible optical transmitter 43 then transmits these optical signals (pixel data) to the image data processing unit 506 via the multimode optical fiber transmission unit 703. In other words, the multimode-compatible optical transmitter 43 simultaneously transmits pixel data corresponding to each of the multiple pixels of the imaging unit 31 in parallel to the network 900. In particular, in this embodiment, the camera unit 302 transmits pixel data in multiple modes. Figure 14 shows an example in which modes m1...mx are assigned to x electrical signals d1...dx.

[0086] The mode coupling / separation unit 42 has the function of coupling or separating a large number of optical signals between modes of the multimode optical fiber. In particular, in this embodiment, the mode coupling / separation unit 42 is configured to transmit pixel data from the multimode-compatible optical transmitter 43 to the multimode optical fiber transmitter 702, and to transmit camera control signals from the image data processor 506 to the camera control optical signal receiver 37. In this embodiment, to ensure selectivity between pixel data and camera control signals, different modes are set for the mode assignment to the parallel electrical data signals output from the image sensor unit 32 and the mode assignment to the camera control signals (camera control signal mode mz ≠ image data transmission modes m1 to mx).

[0087] The image data processing unit 506 is configured to generate image data (image information) based on pixel data from the camera unit 302. However, the image data processing unit 506 may also generate image data composed of at least a portion of the multiple pixels of the photographing unit 31 from the received pixel data.

[0088] The image data processing unit 506 is provided with a multimode compatible optical receiving unit 83 instead of the parallel signal WDM batch optical receiving unit 51 in the image data processing unit 500 according to the first embodiment. Also, the image data processing unit 506 is provided with a mode coupling / separating unit 82 instead of the optical signal multiplexing / demultiplexing unit 50 in the image data processing unit 500 according to the first embodiment.

[0089] The multimode optical receiver 83 receives the optical signal from the multimode optical transmitter 43 and demodulates it into a parallel electrical data signal.

[0090] The mode coupling / separation unit 82 has the function of coupling or separating a large number of optical signals between modes of the multimode optical fiber. In particular, in this embodiment, it is configured to transmit pixel data from the camera unit 302 to the multimode-compatible optical transmission unit 83 and to transmit camera control signals from the camera control optical transmission unit 72 to the multimode optical fiber transmission unit 702.

[0091] The camera unit 302 and the image data processing unit 506 and other functional units are similar to the camera unit 300 and the image data processing unit 500 according to the first embodiment, and therefore a description thereof will be omitted.

[0092] According to the third embodiment, the functions of the image processor are consolidated in the image data processing unit 506 (such as a data center) at a higher level in the network, and information generated by the image sensor unit 32 can be transmitted over long distances via the multimode optical fiber transmission unit 702 between the camera unit 302 and the image data processing unit 506. In other words, according to the third embodiment, it is possible to achieve power saving and miniaturization of the camera as a whole. Furthermore, according to the third embodiment, it is possible to optimize the settings of the processor processing unit 53 that performs image processing using the processing setting unit 54.

[0093] According to the third embodiment, in a configuration in which the image sensor and the image processor are separated, camera control signals are exchanged via the multimode optical fiber transmission unit 702, making it possible to remotely control the camera unit 302 and reflect predetermined settings.

[0094] (Modification of Third Embodiment) The configuration of an image data processing unit 507 according to a modification of the third embodiment will be described with reference to Fig. 15. The image data processing unit 507 includes three processor processing units 53A, 53B, and 53X, a data allocation unit 56, an allocation control unit 57, and a shooting setting determination unit 73, similar to the image data processing unit 501 according to the modification of the first embodiment (see Fig. 5).

[0095] Specifically, the image data processing unit 507 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the data distribution unit 56 and the distribution control unit 57 distribute the parallel electrical data signals.

[0096] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the allocation control unit 57 allows data to be input to a processor processing unit suitable for processing. Furthermore, the settings of the processor processing unit that performs image processing can be optimized.

[0097] In a configuration in which the image sensor and image processor are separated, camera control signals are exchanged via the multimode optical fiber transmission unit 702, making it possible to remotely control the camera unit 302 and reflect specified settings.

[0098] (Another Modification of the Third Embodiment) The configuration of an image data processing unit 508 according to another modification of the third embodiment will be described with reference to Fig. 16. The image data processing unit 508 includes three multimode-compatible optical receiving units 83A, 83B, and 83X. The image data processing unit 508 also includes three lane delay control units 52A, 52B, and 52X, three processor processing units 53A, 53B, and 53X, an optical signal selection unit 61, and an optical signal selection unit control unit 62, similar to the image data processing unit 502 according to another modification of the first embodiment (see Fig. 6).

[0099] Specifically, the image data processing unit 508 selects at least one of the three processor processing units 53A, 53B, and 53X in accordance with the received pixel data, and generates image data. In particular, in this modification, the parallel optical signals are distributed by the optical signal selection unit 61 and the optical signal selection unit control unit 62.

[0100] Specifically, in this modification, the optical signal selector 61 distributes the pixel data (optical signal) sequence from the multimode optical transmitter 43 to three multimode optical receivers 83A, 83B, and 83X.

[0101] This modification also contributes to power saving and miniaturization of the camera as a whole. Furthermore, the optical signal selection unit control unit 62 allows data to be input to a processor unit suitable for processing. Furthermore, the settings of the processor unit that performs image processing can be optimized.

[0102] In a configuration in which the image sensor and image processor are separated, camera control signals are exchanged via the multimode optical fiber transmission unit 702, making it possible to remotely control the camera unit 302 and reflect specified settings.

[0103] (Application of the Transmission System of the Present Disclosure) Currently, camera IFs (Interfaces), which are the output destinations of CMOS (Complementary Metal-Oxide-Semiconductor) image sensors, are often de facto standards for MIPI (Mobile Industry Processor Interface). The need to extend such camera IFs has already become apparent in in-vehicle systems, and there is a possibility that further extension technologies will be required. The transmission system of the present disclosure can meet such needs.

[0104] The transmission system of the present disclosure can also be applied to technologies such as SLVS-EC (Scalable Low Voltage Signaling with Embedded Clock, registered trademark), GVIF (Gigabit Video Interface), and GMSL (Gigabit Multimedia Serial Link).Furthermore, the transmission system of the present disclosure can also be applied to technologies for miniaturizing and power-saving cameras by converting MIPI into a SerDes (serializer / deserializer) and transmitting it over optical fiber.

[0105] The camera unit and image data processing unit according to the present disclosure can also be realized by a computer and a program, and the program can be recorded on a recording medium or provided via a network. The program according to the present disclosure is a program for causing a computer to realize each function provided in the camera unit and image data processing unit according to the present disclosure, and is a program for causing a computer to execute each procedure provided in the method executed by the camera unit and image data processing unit according to the present disclosure.

[0106] The transmission system of the present disclosure can be applied to the information and communications industry.

[0107] 30: Optical signal multiplexing / demultiplexing unit 31: Photography unit 32: Image sensor unit 33: Image sensor processing unit 34: Analog / digital conversion unit 35: Parallel signal WDM batch optical transmission unit 37: Camera control optical signal receiving unit 38: Camera control instruction unit 40: Core coupling / demultiplexing unit 41: Multi-core compatible optical transmission unit 42: Mode coupling / demultiplexing unit 43: Multi-mode compatible optical transmission unit 50: Optical signal multiplexing / demultiplexing unit 51, 51A, 51B, 51X: Parallel signal WDM batch optical reception unit 52, 52A, 52B, 52X: Lane delay control unit 53, 53A, 53B, 53X: Processor processing unit 54: Processing setting unit 55: Captured image learning unit 56: Data distribution unit 57: Distribution control unit 61: Optical signal selection unit 62: Optical signal selection unit control unit 71: Camera control instruction unit 72: Camera control optical transmission unit 73: Shooting setting determination unit 80: Core coupling / separation unit 81, 81A, 81B, 81X: Multi-core compatible optical receiving unit 82: Mode coupling / separation unit 83, 83A, 83B, 83X: Multi-mode compatible optical receiving unit 100: Transmission system 300, 301, 302: Camera unit 500, 501, 502, 503, 504, 505, 506, 507, 508: Image data processing unit 700: Optical fiber transmission unit 701: Multi-core optical fiber transmission unit 702: Multi-mode optical fiber transmission unit 900: Network 30A: Image processor 31A: Lens 32A: Image sensor 35A: Parallel / serial conversion unit 36A: External interface 300A: Camera

Claims

1. A transmission system comprising: a control signal for controlling an image capturing unit is transmitted to a network; the image capturing unit captures an image of a subject in accordance with the control signal received from the network; and pixel data corresponding to each of a plurality of pixels of the image capturing unit is transmitted to the network simultaneously in parallel.

2. The transmission system according to claim 1, comprising: a camera unit having the photographing unit and transmitting the pixel data to the network by either wavelength division multiplexing transmission, transmission using a multi-core optical fiber, or multimode transmission; and an image data processing unit receiving the pixel data from the network and generating image data from the received pixel data, wherein the pixel data and the control signal differ in wavelength, allocation core, or allocation mode.

3. The transmission system according to claim 2, wherein the image data processing unit comprises a plurality of processor processing units, and selects at least one of the plurality of processor processing units in accordance with the received pixel data to generate the image data.

4. A transmission method comprising: transmitting a control signal for controlling an imaging unit to a network; the imaging unit photographing an object in accordance with the control signal received from the network; and simultaneously transmitting pixel data corresponding to each of a plurality of pixels of the imaging unit in parallel to the network.

Images