Transmitting device and communication system

Abstract

A transmitter according to the present disclosure comprises: a data generation unit capable of generating image data including, as image information, pixel value information obtained by image pickup pixels and control information; and a transmission unit capable of transmitting the image data.

Description

[Technical field]

[0001] The present disclosure relates to a transmission device for transmitting image data. ,oh The present invention also relates to a communication system for transmitting and receiving image data. [Background technology]

[0002] Some communication systems transmit and receive image data. Patent Document 1 discloses a communication system that generates a packet having a header including control information and a payload including one line of image data, and transmits and receives image data using the packet. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-120158 A Summary of the Invention

[0004] In a communication system, it is desirable to be able to easily check whether communication is being performed correctly.

[0005] A transmitting device that can check whether communication is being performed correctly Place It is desirable to provide a communication system for

[0006] A transmission device according to an embodiment of the present disclosure includes a data generation unit and a transmission unit. In the first mode, It is possible to generate image data that includes pixel value information obtained by the imaging pixels and control information as image information of the effective pixel area. In the second mode, the image data including the pixel value information as image information of the pixel value information and the control information can be generated. The transmission unit is configured to be able to transmit the image data.

[0008] A communication system according to an embodiment of the present disclosure includes a transmitting device and a receiving device. The transmitting device includes a data generating unit and a transmitting unit. The data generating unit includes: In the first mode,It is possible to generate image data that includes pixel value information obtained by the imaging pixels and control information as image information of the effective pixel area. In the second mode, image data including pixel value information as image information out of pixel value information and control information can be generated. The transmitting unit is configured to be capable of transmitting image data. The receiving device has a receiving unit and an analyzing unit. The receiving unit is configured to be capable of receiving image data transmitted from the transmitting device. The analyzing unit is configured to be capable of performing an analyzing process based on control information included in the image data.

[0010] A transmitting device according to an embodiment of the present disclosure Place In the communication system, image data is generated and transmitted. The image data includes pixel value information obtained by the imaging pixels and control information as image information of the effective pixel region. [Brief description of the drawings]

[0012] [Figure 1] 1 is a block diagram illustrating a configuration example of a communication system according to an embodiment of the present disclosure. [Diagram 2] 2 is an explanatory diagram illustrating an example of a transmission format in the communication system shown in FIG. [Diagram 3] FIG. 11 is an explanatory diagram illustrating an example of a packet configuration in a normal mode. [Figure 4] FIG. 11 is an explanatory diagram illustrating an example of a packet configuration in a test mode. [Diagram 5] 2 is a block diagram illustrating an example of the configuration of the imaging device illustrated in FIG. 1. [Figure 6] 2 is a block diagram illustrating a configuration example of the processing device illustrated in FIG. 1. [Figure 7] 11 is an explanatory diagram illustrating an example of an area in an image area where header information is arranged. FIG. [Figure 8] FIG. 13 is a block diagram illustrating an example of the configuration of an imaging device according to a modified example. [Figure 9] FIG. 13 is an explanatory diagram illustrating an example of a configuration of a packet according to a modified example. [Figure 10] FIG. 13 is a block diagram illustrating a configuration example of a communication system according to another modified example. [Figure 11]11 is a block diagram illustrating an example of the configuration of the processing device illustrated in FIG. 10. [Figure 12] FIG. 13 is a block diagram illustrating a configuration example of a communication system according to another modified example. [Figure 13] 13 is a block diagram illustrating an example of the configuration of the imaging device illustrated in FIG. 12. [Figure 14] 13 is a block diagram illustrating an example of the configuration of the processing device illustrated in FIG. 12. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

[0014] [Configuration example] 1 shows an example of a configuration of a communication system (communication system 1) according to an embodiment. The communication system 1 is configured to transmit and receive image data. The communication system 1 includes an imaging device 10 and a processing device 20. The imaging device 10 and the processing device 20 are provided in an electronic device such as a digital camera or a mobile phone, and transmit and receive image data within the electronic device.

[0015] The imaging device 10 is configured using, for example, a complementary metal oxide semiconductor (CMOS) image sensor and configured to perform an imaging operation. The imaging device 10 has an imaging section 11 and a transmission section 12.

[0016] The imaging unit 11 is configured to generate image data by performing an imaging operation. The imaging unit 11 has a plurality of imaging pixels. Each imaging pixel converts light received through a lens into an electrical signal (pixel value information) by photoelectric conversion. In this manner, the imaging unit 11 is configured to generate image data.

[0017] The transmission unit 12 is configured to transmit the image data supplied from the imaging unit 11 to the processing device 20. Specifically, the transmission unit 12 transmits the image data to the processing device 20 using a plurality of transmission lanes L (eight transmission lanes L0 to L7 in this example). In this example, each transmission lane L is configured by a differential transmission path.

[0018] The processing device 20 is configured using, for example, a digital signal processor, and is configured to perform image processing on the image data transmitted from the imaging device 10. The processing device 20 has a receiving unit 21 and an image processing unit 22.

[0019] The receiving unit 21 is configured to receive image data transmitted from the imaging device 10 via a plurality of transmission lanes L.

[0020] The image processing unit 22 is configured to perform various image processing based on the image data received by the receiving unit 21. For example, the image data is RAW data, and the image processing unit 22 is configured to perform various processing such as compression processing of the image data, image display processing, and recording processing of the image data on a recording medium.

[0021] The imaging device 10 has a normal mode MA and a test mode MB. In the normal mode MA, the imaging device 10 generates image data including pixel value information obtained by the imaging pixels of the imaging unit 11 as image information, and transmits this image data to the processing device 20. In the test mode MB, the imaging device 10 generates image data including pixel value information obtained by the imaging pixels of the imaging unit 11 and control information (header information INFH, which will be described later) as image information, and transmits this image data to the processing device 20.

[0022] The transmitter 12 of the imaging device 10 transmits image data by transmitting packets P via each of the eight transmission lanes L0 to L7.

[0023] FIG. 2 shows an example of a transmission format when transmitting image data (frame data F) including one frame of image information using a packet P, where (A) shows the packet P and (B) shows the transmission format.

[0024] As shown in FIG. 2A, the packet P has a header PH, a payload PP, and a footer PF. The header PH, payload PP, and footer PF are arranged in this order in the packet P. The header PH includes control information. The control information of the header PH will be described later. The payload PP includes one line of image information. The footer PF includes control information. In this example, the control information of the footer PF includes, for example, a code (CRC code) for a cyclic redundancy check (CRC) on one line of image information. Although the footer PF is provided in this example, it is not necessary to provide the footer PF. A control code (in this example, a "Start Code") is arranged before the packet P, and a control code (in this example, an "End Code") is arranged after the packet P.

[0025] The transmitter 12 transmits image information contained in the image data area A as shown in FIG. 2B. The image data area A includes an effective pixel area A1, a margin area A2, and dummy areas A3 and A4. The effective pixel area A1 is an image area corresponding to an area in the imaging unit 11 where so-called effective pixels are arranged. The margin area A2 is arranged to the left of the effective pixel area A1. In this example, the number of pixels in the up-down direction (vertical direction) in the margin area A2 is the same as the number of pixels in the up-down direction in the effective pixel area A1. The dummy area A3 is arranged above the effective pixel area A1. In this example, the number of pixels in the left-right direction (horizontal direction) in the dummy area A3 is the same as the sum of the number of pixels in the left-right direction in the effective pixel area A1 and the number of pixels in the left-right direction in the margin area A2. In this example, "Embedded Data" is inserted into the dummy area A3. This "Embedded Data" includes information on the setting values ​​of the imaging operation in the imaging unit 11, such as the shutter speed, the aperture value, and the gain. The dummy area A4 is disposed below the effective pixel area A1. In this example, the number of pixels in the left-right direction (horizontal direction) in the dummy area A4 is the same as the sum of the number of pixels in the left-right direction in the effective pixel area A1 and the number of pixels in the left-right direction in the margin area A2. In this example, "Embedded Data" is inserted into the dummy area A3, but this is not limited thereto, and for example, "Embedded Data" may be inserted into the dummy area A4.

[0026] One packet P contains image information for one line in the image data area A. Thus, the transmitting unit 12 can transmit the image information in the image data area A using packets P in the same number as the number of pixels in the vertical direction in the image data area A. In this way, the communication system 1 transmits one frame of image information line by line. This allows the communication system 1 to transmit additional information such as the header PH and footer PF, and control codes such as "Start Code" and "End Code", during the horizontal blanking period in the imaging operation.

[0027] 3 shows an example of the structure of a packet P in normal mode MA. The packet P has a header PH, a payload PP (payload PPA), and a footer PF.

[0028] The header PH of the packet P includes control information. The control information includes “Frame Start”, “Frame End”, “Line Valid”, “Line Number”, “Reserved”, and “Header ECC”. “Frame Start”, “Frame End”, “Line Valid”, “Line Number”, and “Reserved” constitute control data D.

[0029] "Frame Start" is 1-bit flag information indicating the start of a frame. As shown in Fig. 2, in the header PH of the packet P corresponding to the first line in the image data area A, "Frame Start" is set to "1", and in the header PH of the packet P corresponding to each of the other lines in the image data area A, "Frame Start" is set to "0".

[0030] "Frame End" is 1-bit flag information indicating the end of a frame. As shown in Fig. 2, in the header PH of the packet P corresponding to the last line in the effective pixel area A1, "Frame End" is set to "1", and in the header PH of the packet P corresponding to each of the other lines in the image data area A, "Frame End" is set to "0".

[0031] "Line Valid" is 1-bit flag information indicating whether one line of image information included in the payload PP is image information in the effective pixel area A1. As shown in Fig. 2, in the header PH of the packet P corresponding to each line in the effective pixel area A1, "Line Valid" is set to "1", and in the header PH of the packet P corresponding to each other line in the image data area A, "Line Valid" is set to "0".

[0032] "Line Number" is 13-bit information indicating which line in the image data area A the image information for one line contained in the payload PP corresponds to.

[0033] "Reserved" is 32 bits of information that can be used to extend functionality.

[0034] The control data D is configured using these "Frame Start," "Frame End," "Line Valid," "Line Number," and "Reserved." The amount of information in this control data D is 6 bytes.

[0035] "Header ECC" is the error correction code (ECC) of this control data D. The amount of information in "Header ECC" is 18 bytes. "Header ECC" includes "CRC". "CRC" is a code (CRC code) for a cyclic redundancy check on the control data D. The amount of information in "CRC" is 2 bytes. In other words, the total amount of information in the control data D and "CRC" is 8 bytes. "Header ECC" further includes two sets of this control data D and CRC code. In this way, the header PH includes three sets of control data D and CRC code.

[0036] The payload PPA includes one line of image information In the normal mode MA, the payload PPA includes pixel value information obtained from the imaging pixels as image information.

[0037] 4 shows an example of the configuration of a packet P in the test mode MB. The packet P has a header PH, a payload PP (payload PPB), and a footer PF.

[0038] The payload PPB includes one line of image information. In this test mode MB, the payload PPB includes pixel value information obtained by the imaging pixels and header information INFH as image information. The header information INFH includes part or all of the information included in the header PH. In this example, the header information INFH includes the same information as the control data D included in the header PH. The header information INFH is arranged in the payload PPB at a position corresponding to the image information of the effective pixel area A1.

[0039] As a result, in the communication system 1, the imaging device 10 in the normal mode MA transmits image data (frame data F) including pixel value information obtained by the imaging pixels as image information to the processing device 20. The image processing unit 22 of the processing device 20 performs image processing based on this image data.

[0040] Furthermore, in the communication system 1, the imaging device 10 transmits image data (frame data F) including pixel value information obtained by imaging pixels and header information INFH as image information to the processing device 20 in the test mode MB. The image processing unit 22 of the processing device 20 performs image processing based on this image data. At that time, the image processing unit 22 is configured to be able to analyze, for example, whether communication is being performed correctly based on the header information INFH included in the image data.

[0041] (Imaging device 10) Fig. 5 shows an example of the configuration of the imaging device 10. Fig. 5 shows the configurations of the application layer LA, link layer LL, and physical layer LP in the imaging device 10.

[0042] The imaging device 10 has, in the application layer LA, a system control unit 111, a frame data generation unit 112, and a register 114. The system control unit 111, the frame data generation unit 112, and the register 114 are realized by the imaging unit 11 in this example.

[0043] The system control unit 111 is configured to control communication in the communication system 1 by supplying various information necessary for communication in the communication system 1, such as information about frame formats, to a LINK-TX protocol management unit 121 (described later) of the transmitting unit 12.

[0044] The frame data generation unit 112 is configured to generate image data (frame data F) based on pixel value information obtained by the imaging pixels of the imaging unit 11. The frame data generation unit 112 has a header information generation unit 113. The header information generation unit 113 is configured to generate header information INFH in the test mode MB.

[0045] In normal mode MA, the frame data generation unit 112 generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11. In test mode MB, the frame data generation unit 112 generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11 and header information INFH generated by the header information generation unit 113. The frame data generation unit 112 generates frame data F by arranging this header information INFH at a position corresponding to the image information in the effective pixel area A1.

[0046] The register 114 stores various setting values ​​related to the transmission of image data, such as information on the number of bits of Pixel to Byte conversion performed in a Pixel to Byte conversion unit 122 (described later) and information on the transmission lane L to be used among a plurality of transmission lanes L. The register 114 also stores information indicating whether the operation mode of the imaging device 10 is a normal mode MA or a test mode MB. The transmission unit 12 performs a transmission process of the frame data F based on the information stored in this register 114.

[0047] The transmitter 12 has, in the link layer LL, a LINK-TX protocol management unit 121, a Pixel to Byte conversion unit 122, a payload ECC insertion unit 123, a packet generation unit 124, and a lane distribution unit 125. The LINK-TX protocol management unit 121 has a state control unit 131, a header generation unit 132, a data insertion unit 133, and a footer generation unit 134.

[0048] The state control unit 131 of the LINK-TX protocol management unit 121 is configured to manage the operation state of the link layer LL in the transmission unit 12 .

[0049] The header generation unit 132 is configured to generate a header PH to be added to the payload PP, and to supply the generated header PH to the packet generation unit 124. Specifically, the header generation unit 132 is configured to generate a header PH including control data D and “Header ECC” which is an error correction code for the control data D, as shown in FIGS.

[0050] The data insertion unit 133 is configured to generate payload stuffing data and lane stuffing data used for stuffing. The payload stuffing data is used when adjusting the amount of data of the payload PP. The lane stuffing data is used when adjusting the amount of data transmitted by the transmission lanes L between the transmission lanes L. The data insertion unit 133 supplies the generated payload stuffing data to the Pixel to Byte conversion unit 122, and also supplies the generated lane stuffing data to the lane distribution unit 125.

[0051] The footer generation unit 134 is configured to generate a footer PF to be added to the payload PP, and to supply the generated footer PF to the packet generation unit 124. Specifically, the footer generation unit 134 is configured to generate a footer PF including a code (CRC code) for a cyclic redundancy check on one line of image information included in the payload PP.

[0052] The pixel to byte conversion unit 122 is configured to perform pixel to byte conversion to convert image information included in the frame data generated by the frame data generation unit 112 into data in units of 1 byte. Image information is expressed in, for example, 8-bit units, 10-bit units, 12-bit units, 14-bit units, 16-bit units, etc. The pixel to byte conversion unit 122 converts such image information into data in units of 1 byte.

[0053] The Pixel to Byte conversion unit 122 also performs a process of adjusting the amount of data to be included in the payload PP, using the payload stuffing data supplied from the data insertion unit 133. In this manner, the Pixel to Byte conversion unit 122 generates the payload PP.

[0054] The payload ECC insertion unit 123 is configured to calculate an error correction code for the payload PP generated by the Pixel to Byte conversion unit 122, insert this error correction code into the payload PP, and supply the payload PP with the error correction code inserted to the packet generation unit 124. Note that the payload ECC insertion unit 123 does not need to insert this error correction code into the payload PP. In this case, the payload ECC insertion unit 123 supplies the payload PP generated by the Pixel to Byte conversion unit 122 to the packet generation unit 124 as is.

[0055] The packet generation unit 124 is configured to generate a packet P by adding a header PH supplied from the header generation unit 132 to the front of the payload PP and adding a footer PF supplied from the footer generation unit 134 to the rear of the payload PP.

[0056] The lane distribution unit 125 is configured to allocate the packets P generated by the packet generation unit 124 to a transmission lane L to be used among the transmission lanes L0 to L7 in a predetermined order. The lane distribution unit 125 also performs a process of adjusting the amount of data transmitted by the transmission lanes L between the transmission lanes L, using lane stuffing data supplied from the data insertion unit 133. The lane distribution unit 125 then supplies the packets P to a transmission processing unit TX corresponding to the allocated transmission lane L among eight transmission processing units TX (described later).

[0057] The transmitting unit 12 has a PHY-TX state control unit 126, a clock generating unit 127, and eight transmission processing units TX (transmission processing units TX0 to TX7) in the physical layer LP. The eight transmission processing units TX are provided corresponding to the eight transmission lanes L, respectively. Each of the eight transmission processing units TX has a control code inserting unit 141, an 8B10B symbol encoder 142, a synchronizing unit 143, and a driver 144.

[0058] The PHY-TX state control unit 126 is configured to control the processing of the eight transmission processing units TX. Specifically, for example, the PHY-TX state control unit 126 is adapted to control the timing of processing in the eight transmission processing units TX.

[0059] The clock generating unit 127 is configured to generate a clock signal and supply the clock signal to the synchronization units 143 of the eight transmission processing units TX.

[0060] In each of the eight transmission processing units TX, the control code insertion unit 141 is configured to insert control codes such as "Idle Code", "Start Code", "End Code", "Pad Code", "Sync Code", "Deskew Code", and "Standby Code" into data including the packet P supplied from the lane distribution unit 125. The "Idle Code" is a control code that is repeatedly used during a period in which the packet P is not transmitted. The "Start Code" is a control code that indicates the start of the packet P, and is added before the packet P as shown in FIG. 2A. The "End Code" is a control code that indicates the end of the packet P, and is added after the packet P as shown in FIG. 2A. The "Pad Code" is a control code that is inserted inside the payload PP to fill the difference between the transmission rate of the data supplied from the imaging unit 11 and the transmission rate of the data transmitted by the transmission unit 12. The "Sync Code" is a control code that is used to realize bit synchronization and symbol synchronization in communication. The "Deskew Code" is a control code used to correct a deviation in the reception timing of data received by the receiving unit 21 via multiple transmission lanes L. The "Standby Code" is a control code used to notify the transmitting unit 12 that the transmitting unit 12 has finished transmitting the packet P and is going into a standby state. The control code insertion unit 141 is configured to insert such a control code into the data including the packet P supplied from the lane distribution unit 125.

[0061] The 8B10B symbol encoder 142 is configured to perform 8B10B conversion based on the data into which the control code has been inserted by the control code inserting unit 141, thereby converting data in 8-bit units into data in 10-bit units.

[0062] The synchronization unit 143 is configured to supply each bit of the 8B10B converted data to the driver 144 based on the clock signal supplied from the clock generation unit 127 .

[0063] The driver 144 is configured to transmit the data supplied from the synchronization unit 143 to the processing device 20 via the transmission lane L corresponding to the transmission processing unit TX including the driver 144 .

[0064] (Processing device 20) Fig. 6 shows an example of the configuration of the processing device 20. Fig. 6 shows the configuration of the application layer LA, link layer LL, and physical layer LP in the processing device 20.

[0065] The processing device 20 has, in the application layer LA, a system control unit 221, a frame data receiving unit 222, an analysis unit 223, and a register 224. In this example, the system control unit 221, the frame data receiving unit 222, the analysis unit 223, and the register 224 are realized by the image processing unit 22.

[0066] The system control unit 221 is configured to control sequences such as a mode change in a LINK-RX protocol management unit 212 (described later) of the receiving unit 21.

[0067] The frame data receiving unit 222 is configured to generate image data (frame data F) including image information for one frame based on the image information of each line supplied from the receiving unit 21. The image processing unit 22 performs various image processing based on this frame data F.

[0068] The analysis unit 223 is configured to analyze whether or not communication is being performed correctly based on the header information INFH included in the frame data F generated by the frame data receiving unit 222 in the test mode MB.

[0069] The register 224 stores various setting values ​​related to the reception of image data, such as the number of bits for Byte to Pixel conversion performed in a Byte to Pixel conversion unit 216 (described later) and information on the transmission lane L to be used among a plurality of transmission lanes L. The receiving unit 21 performs a receiving process of the frame data F based on the information stored in this register 224.

[0070] The receiving unit 21 of the processing device 20 has a PHY-RX state control unit 211 and eight receiving processing units RX (receiving processing units RX0 to RX7) in the physical layer LP. The eight receiving processing units RX are provided corresponding to the eight transmission lanes L, respectively. Each of the eight receiving processing units RX has a receiver 241, a clock generating unit 242, a synchronizing unit 243, a symbol synchronizing unit 244, a 10B8B symbol decoder 245, a skew correcting unit 246, and a control code removing unit 247.

[0071] The PHY-RX state control unit 211 is configured to control the processing of the eight reception processing units RX.

[0072] In each of the eight reception processing sections RX, the receiver 241 is configured to receive data transmitted from the imaging device 10 via the transmission lane L corresponding to the reception processing section RX including that receiver 241.

[0073] The clock generating unit 242 is configured to perform bit synchronization by detecting transitions in the data received by the receiver 241, and to generate a clock signal based on the detection period of the transitions.

[0074] The synchronizing unit 243 is configured to sample the data received by the receiver 241 based on the clock signal generated by the clock generating unit 24. The clock generating unit 242 and the synchronizing unit 243 implement a CDR (Clock and Data Recovery) function.

[0075] The symbol synchronization unit 244 is configured to perform symbol synchronization by detecting a control code included in the data sampled by the synchronization unit 243. Specifically, the symbol synchronization unit 244 can perform symbol synchronization by detecting, for example, a "Start Code", an "End Code", a "Deskew Code", and a "Sync Code".

[0076] The 10B8B symbol decoder 245 is configured to perform 10B8B conversion based on the data symbol-synchronized by the symbol synchronizer 244, thereby converting data in 10-bit units into data in 8-bit units.

[0077] The skew correction unit 246 is configured to detect a "Deskew Code" included in the data that has been subjected to 10B8B conversion, and adjust the timing of the "Deskew Code" to the timing instructed by the PHY-RX state control unit 211, thereby correcting the skew between the transmission lanes L. Specifically, based on the instruction from the PHY-RX state control unit 211, the skew correction unit 246 adjusts the timing of the "Deskew Code" to the latest detection timing among the detection timings of the "Deskew Code" in the eight reception processing units RX, thereby correcting the skew.

[0078] The control code removal unit 247 is configured to remove the control code from the data whose skew has been corrected by the skew correction unit 246, and to supply the portion of the data sandwiched between the “Start Code” and the “End Code” as a packet P to the lane integration unit 213.

[0079] The receiver 21 has, in the link layer LL, a LINK-RX protocol management unit 212, a lane integration unit 213, a packet separation unit 214, a payload error correction unit 215, and a Byte to Pixel conversion unit 216. The LINK-RX protocol management unit 212 has a state control unit 231, a header error correction unit 232, a data removal unit 233, and a footer error detection unit 234.

[0080] The state control unit 231 of the LINK-RX protocol management unit 212 is configured to manage the operation state of the link layer LL in the receiving unit 21 .

[0081] The header error correction unit 232 is configured to obtain three sets of control data D and CRC code based on the header PH separated by the packet separation unit 214, and perform error detection calculation for each set on the control data D. Then, the header error correction unit 232 supplies the control data D relating to the error-free set among the three sets to the register 224, and stores this control data D in the register 224.

[0082] The data removal unit 233 is configured to control the operation of the lane integrating unit 213 so that the lane integrating unit 213 removes lane stuffing data, and to control the operation of the Byte to Pixel conversion unit 216 so that the Byte to Pixel conversion unit 216 removes payload stuffing data.

[0083] The footer error detection unit 234 performs an error detection calculation using the CRC code included in the footer PF separated by the packet separation unit 214, and detects an error in the payload PP based on the calculation result. The footer error detection unit 234 supplies this error detection result to the register 224, and causes the register 224 to store this error detection result.

[0084] The lane integration unit 213 is configured to arrange the multiple packets P supplied from the eight reception processing units RX in the reverse order to the order in which the packets were distributed by the lane distribution unit 125. The lane integration unit 213 also performs a process of removing lane stuffing data based on an instruction from the data removal unit 233. Then, the lane integration unit 213 sequentially supplies the processed packets P to the packet separation unit 214.

[0085] The packet separation unit 214 is configured to separate a header PH, a payload PP, and a footer PF contained in the packet P supplied from the lane integration unit 213. The packet separation unit 214 supplies the header PH to the header error correction unit 232, and supplies the footer PF to the footer error detection unit 234.

[0086] The payload error correction unit 215 is configured to detect an error in the payload PP and correct the detected error by performing an error correction calculation based on the error correction code when an error correction code is inserted in the payload PP separated by the packet separation unit 214. Then, the payload error correction unit 215 supplies the processed payload PP to the Byte to Pixel conversion unit 216. Furthermore, when an error correction code is not inserted in the payload PP, the payload error correction unit 215 supplies the payload PP as it is to the Byte to Pixel conversion unit 216.

[0087] The Byte to Pixel conversion unit 216 is configured to remove payload stuffing data from the payload PP supplied from the payload error correction unit 215, and perform Byte to Pixel conversion to convert the data from which the payload stuffing data has been removed into image information. This Byte to Pixel conversion is the inverse conversion of the Pixel to Byte conversion performed by the Pixel to Byte conversion unit 122 of the transmission unit 12. As a result, image information in, for example, 8-bit units, 10-bit units, 12-bit units, 14-bit units, 16-bit units, etc. is generated.

[0088] In the image processing unit 22, the frame data receiving unit 222 identifies multiple lines of image information corresponding to the valid pixel area A1 from the image information supplied from the Byte to Pixel conversion unit 216 based on the ``Line Valid'' contained in the control data D stored in the register 224, and generates one frame's worth of image data (frame data F) by arranging the image information for each line in an order according to the ``Line Number'' contained in the control data D.

[0089] Here, the imaging device 10 corresponds to a specific example of a "transmitting device" in the present disclosure. The frame data generating unit 112 corresponds to a specific example of a "data generating unit" in the present disclosure. The transmitting unit 12 corresponds to a specific example of a "transmitting unit" in the present disclosure. The frame data F corresponds to a specific example of "image data" in the present disclosure. The header information INFH corresponds to a specific example of "control information" in the present disclosure. The control data D corresponds to a specific example of "control data" in the present disclosure. The test mode MB corresponds to a specific example of a "first mode" in the present disclosure. The normal mode MA corresponds to a specific example of a "second mode" in the present disclosure.

[0090] The processing device 20 corresponds to a specific example of a "receiving device" in the present disclosure. The receiving unit 21 corresponds to a specific example of a "receiving unit" in the present disclosure. The analyzing unit 223 corresponds to a specific example of an "analyzing unit" in the present disclosure.

[0091] [Actions and Actions] Next, the operation and function of the communication system 1 of the present embodiment will be described.

[0092] (Overview of overall operation) First, an overview of the overall operation of the communication system 1 will be described with reference to Fig. 1. The imaging device 10 generates image data by performing an imaging operation. Specifically, in a normal mode MA, the imaging device 10 generates image data (frame data F) including pixel value information obtained by imaging pixels as image information. Also, in a test mode MB, the imaging device 10 generates image data (frame data F) including pixel value information obtained by imaging pixels and header information INFH as image information. Then, the imaging device 10 transmits this image data to the processing device 20 via a plurality of transmission lanes L.

[0093] The processing device 20 receives image data transmitted from the imaging device 10 via the multiple transmission lanes L, and performs various image processing based on the image data. In addition, in the test mode MB, the processing device 20 analyzes whether communication is performed correctly based on the header information INFH included in the image data (frame data F).

[0094] (Details of operation) Next, the operation of the communication system 1 will be described in detail.

[0095] In the imaging device 10 (FIG. 5), in normal mode MA, the frame data generation unit 112 generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11. In addition, in test mode MB, the frame data generation unit 112 generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11 and header information INFH generated by the header information generation unit 113. The frame data generation unit 112 generates frame data F by arranging the header information INFH at a position corresponding to the image information in the effective pixel area A1.

[0096] The pixel to byte conversion unit 122 performs pixel to byte conversion to convert image information included in the frame data generated by the frame data generation unit 112 into data in units of one byte. The pixel to byte conversion unit 122 also performs processing to adjust the amount of data to be included in the payload PP, using payload stuffing data supplied from the data insertion unit 133. In this manner, the pixel to byte conversion unit 122 generates the payload PP.

[0097] The payload ECC insertion unit 123 calculates an error correction code for the payload PP generated by the Pixel to Byte conversion unit 122, inserts this error correction code into the payload PP, and supplies the payload PP with the error correction code inserted therein to the packet generation unit .

[0098] The packet generator 124 generates a packet P by adding the header PH supplied from the header generator 132 to the front of the payload PP and adding the footer PF supplied from the footer generator 134 to the end of the payload PP.

[0099] In the normal mode MA, the packet P is configured as shown in Fig. 3. The payload PPA of this packet P contains pixel value information obtained from the imaging pixels as image information.

[0100] In the test mode MB, the packet P is configured as shown in Fig. 4. The payload PPB of this packet P includes pixel value information obtained by the imaging pixels and header information INFH as image information. The header information INFH is arranged in the payload PPB at a position corresponding to the image information of the effective pixel area A1.

[0101] The lane distribution unit 125 allocates the packets P generated by the packet generation unit 124 to the transmission lanes L to be used among the transmission lanes L0 to L7 in a predetermined order. Furthermore, the lane distribution unit 125 adjusts the amount of data transmitted by the transmission lanes L between the transmission lanes L, using the lane stuffing data supplied from the data insertion unit 133. Then, the lane distribution unit 125 supplies the packets P to the transmission processing unit TX corresponding to the allocated transmission lane L among the eight transmission processing units TX.

[0102] In each of the eight transmission processing units TX, the control code insertion unit 141 inserts control codes such as "Idle Code", "Start Code", "End Code", "Pad Code", "Sync Code", "Deskew Code", and "Standby Code" into the data including the packet P supplied from the lane distribution unit 125. The 8B10B symbol encoder 142 converts 8-bit data into 10-bit data by performing 8B10B conversion based on the data into which the control code has been inserted by the control code insertion unit 141. The synchronization unit 143 supplies each bit of the 8B10B converted data to the driver 144 based on the clock signal supplied from the clock generation unit 127. The driver 144 transmits the data supplied from the synchronization unit 143 to the processing device 20 via the transmission lane L corresponding to the transmission processing unit TX including the driver 144.

[0103] In the processing device 20 (FIG. 6), in each of the eight reception processing units RX, the receiver 241 receives data transmitted from the imaging device 10 via the transmission lane L corresponding to the reception processing unit RX including the receiver 241. The clock generating unit 242 performs bit synchronization by detecting a transition of the data received by the receiver 241, and generates a clock signal based on the detection period of the transition. The synchronization unit 243 samples the data received by the receiver 241 based on the clock signal generated by the clock generating unit 24. The symbol synchronization unit 244 performs symbol synchronization by detecting a control code included in the data sampled by the synchronization unit 243. The 10B8B symbol decoder 245 converts data in 10-bit units to data in 8-bit units by performing 10B8B conversion based on the data symbol-synchronized by the symbol synchronization unit 244. The skew correction unit 246 detects a "Deskew Code" included in the data that has been 10B8B converted, and corrects the skew between the transmission lanes L by adjusting the timing of the "Deskew Code" to the timing instructed by the PHY-RX state control unit 211. The control code removal unit 247 removes the control code from the data whose skew has been corrected by the skew correction unit 246, and supplies the portion of the data sandwiched between the "Start Code" and "End Code" as a packet P to the lane integration unit 213.

[0104] The lane integration unit 213 arranges the multiple packets P supplied from the eight reception processing units RX in the reverse order to the order in which the packets were distributed by the lane distribution unit 125, and removes the lane stuffing data based on an instruction from the data removal unit 233. Then, the lane integration unit 213 sequentially supplies the processed packets P to the packet separation unit 214.

[0105] The packet separation unit 214 separates the packet P supplied from the lane integration unit 213 into a header PH, a payload PP, and a footer PF. Then, the packet separation unit 214 supplies the header PH to a header error correction unit 232, and supplies the footer PF to a footer error detection unit 234.

[0106] The header error correction unit 232 obtains three sets of control data D and CRC code based on the header PH separated by the packet separation unit 214, and performs error detection calculation for each set on the control data D. Then, the header error correction unit 232 supplies the control data D relating to the error-free set among the three sets to the register 224, and stores this control data D in the register 224.

[0107] The footer error detection unit 234 performs an error detection calculation using the CRC code included in the footer PF separated by the packet separation unit 214, and detects an error in the payload PP based on the calculation result. Then, the footer error detection unit 234 supplies this error detection result to the register 224, and causes the register 224 to store this error detection result.

[0108] If an error correction code is inserted in the payload PP separated by the packet separation unit 214, the payload error correction unit 215 performs an error correction calculation based on the error correction code to detect an error in the payload PP and correct the detected error. Then, the payload error correction unit 215 supplies the processed payload PP to the Byte to Pixel conversion unit 216.

[0109] The Byte to Pixel conversion unit 216 removes payload stuffing data from the payload PP supplied from the payload error correction unit 215, and performs Byte to Pixel conversion to convert the data from which the payload stuffing data has been removed into image information.

[0110] In the image processing unit 22, the frame data receiving unit 222 identifies image information of a plurality of lines corresponding to the valid pixel area A1 from the image information supplied from the Byte to Pixel conversion unit 216 based on "Line Valid" included in the control data D stored in the register 224, and generates one frame of image data (frame data F) by arranging the image information of each line in an order according to the "Line Number" included in the control data D. The image processing unit 22 performs various image processing based on this frame data F. Specifically, the image processing unit 22 performs various processing such as compression processing of image data, image display processing, and recording processing of image data on a recording medium.

[0111] In the test mode MB, the analysis section 223 analyzes whether communication is being performed correctly based on the header information INFH included in the frame data F generated by the frame data receiving section 222.

[0112] 7 shows the position of the header information INFH in the image area W indicated by the frame data F generated by the frame data receiving unit 222 in the test mode MB. The image area W corresponds to the effective pixel area A1. In this example, the header information INFH is placed in the left area W1 within the image area W.

[0113] As described above, in the communication system 1, in the test mode MB, the frame data generating section 112 of the imaging device 10 generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging section 11 and header information INFH generated by the header information generating section 113. Then, the transmitting section 12 generates a payload PPB including, as image information, pixel value information obtained by the imaging pixels of the imaging section 11 and the header information INFH. This allows the processing device 20 receiving this frame data F to analyze whether communication is being performed correctly.

[0114] That is, the frame data generating unit 112 of the imaging device 10 generates frame data F including pixel value information obtained by the imaging pixels of the imaging unit 11 as image information, for example, in the normal mode MA. Then, the transmitting unit 12 generates a payload PP based on this frame data F, and generates a packet P by adding a header PH and a footer PF to the payload PP. In the receiving unit 21 of the processing device 20, the packet separating unit 214 separates the header PH, payload PP, and footer PF included in this packet P, and the payload error correcting unit 215 and the Byte to Pixel converting unit 216 continue processing based on this payload PP. Then, the frame data receiving unit 222 generates frame data F based on the image information supplied from the Byte to Pixel converting unit 216 and the control data D stored in the register 224. Since the frame data F generated in this way does not include information about the header PH, it is difficult to analyze whether the receiving process has been performed correctly, for example, based on the frame data F.

[0115] Therefore, the communication system 1 is provided with a test mode MB, in which the frame data generating section 112 of the imaging device 10 generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging section 11 and header information INFH generated by the header information generating section 113. As a result, the frame data F generated by the frame data receiving section 222 of the processing device 20 also includes the header information INFH, and the analyzing section 223 can use this header information INFH to analyze whether the receiving process in the receiving section 21 has been performed correctly.

[0116] [effect] As described above, in this embodiment, in test mode, frame data is generated that contains pixel value information obtained from the imaging pixels and header information as image information, making it possible to analyze whether communication is occurring correctly.

[0117] [Variation 1] In the above embodiment, in the test mode MB, the frame data F is generated including, as image information, pixel value information obtained by the imaging pixels and header information INFH including the same information as the information included in the header PH, but this is not limited to this. Instead, for example, in the test mode MB, the frame data F may be generated including, as image information, pixel value information obtained by the imaging pixels and footer information INFF including the same information as the information included in the footer PF. The communication system 1A according to this modification will be described in detail below.

[0118] The communication system 1A includes an imaging device 10A and a processing device 20A, similar to the communication system 1 (FIG. 1) according to the above embodiment.

[0119] 8 shows an example of the configuration of the imaging device 10A. The imaging device 10A has an imaging section 11A. The imaging section 11A has a frame data generation section 112A. The frame data generation section 112A has a footer information generation section 113A. The footer information generation section 113A is configured to generate footer information INFF in the test mode MB. The footer information INFF includes a part or all of the information included in the footer PF. Specifically, the footer information INFF includes a CRC code for, for example, one line of image information.

[0120] In normal mode MA, the frame data generation unit 112A generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11. In test mode MB, the frame data generation unit 112A generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11 and footer information INFF generated by the footer information generation unit 113A. The frame data generation unit 112A generates frame data F by arranging this footer information INFF at a position corresponding to the image information in the effective pixel area A1.

[0121] 9 shows an example of the configuration of a packet P in test mode MB. The packet P has a header PH, a payload PP (payload PPB), and a footer PF. The payload PPB includes one line of image information. In this test mode MB, the payload PPB includes pixel value information obtained by the imaging pixels and footer information INFF as image information. The footer information INFF is arranged in the payload PPB at a position corresponding to the image information of the effective pixel area A1.

[0122] The processing device 20A has an image processing unit 22A, similar to the processing device 20 (FIGS. 1 and 6) according to the above embodiment. The image processing unit 22A has an analysis unit 223A. In the test mode MB, the analysis unit 223A analyzes whether communication is performed correctly based on the footer information INFF included in the frame data F generated by the frame data receiving unit 222.

[0123] In this example, in the test mode MB, the frame data F including the pixel value information obtained by the imaging pixels and the footer information INFF as image information is generated, but the present invention is not limited to this. For example, in the test mode MB, the frame data F including the pixel value information obtained by the imaging pixels, the header information INFH, and the footer information INFF as image information may be generated. In this case, the payload PPB includes the pixel value information obtained by the imaging pixels, the header information INFH, and the footer information INFF as image information.

[0124] [Variation 2] In the above embodiment, in the test mode MB, frame data F including pixel value information obtained by the imaging pixels and header information INFH as image information is generated, but this is not limited to this, and for example, frame data F including "Embedded Data" included in the dummy area A3 as image information in addition to pixel value information and header information INFH may be generated. In this case, the payload PPB includes pixel value information obtained by the imaging pixels, header information INFH, and "Embedded Data" as image information.

[0125] [Variation 3] In the above embodiment, the header information INFH provided in the payload PP includes the control data D, but is not limited to this. Instead, for example, the header information INFH may include the control data D and “Header ECC”, which is an error correction code for this control data D.

[0126] [Variation 4] In the above embodiment, the normal mode MA and the test mode MB are provided, but the header generating unit 132 of the transmitting unit 12 may generate a header PH including flag information indicating whether the mode is the normal mode MA or the test mode MB. For example, "Reserved" in the control data D of the header PH may include this flag information. This allows, for example, the system control unit 221 of the processing device 20 to know whether the operation mode of the imaging device 10 is the normal mode MA or the test mode MB based on the control data D stored in the register 224.

[0127] However, this is not limited to this. For example, the communication system 1 may be provided with a control line for exchanging control signals in addition to the eight transmission lanes L0 to L7, and the information regarding the operation mode of the imaging device 10 stored in the register 114 may be notified to the processing device 20.

[0128] [Variation 5] In the above embodiment, the normal mode MA and the test mode MB are provided, but the present invention is not limited to this. For example, these operation modes may not be provided, and the frame data generating unit 112 may always generate frame data F including, as image information, pixel value information obtained by the imaging pixels and header information INFH including the same information as that included in the header PH. In this case, the analyzing unit 223 of the processing device 20 can always analyze whether communication is being performed correctly based on the footer information INFF included in the frame data F generated by the frame data receiving unit 222.

[0129] [Variation 6] The receiving unit 21 may also perform a confirmation process to confirm that the header information INFH is correct by comparing the information indicated by the header PH with the header information INFH included in the payload PP and confirming whether the information indicated by the header PH and the header information INFH match. Specifically, the PHY-RX state control unit 211 of the receiving unit 21 may perform this confirmation process, or the LINK-RX protocol management unit 212 may perform this confirmation process.

[0130] [Variation 7] In the above embodiment, the frame data generator 112 generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11 and header information INFH generated by the header information generator 113 in the test mode MB, but this is not limited to this. Alternatively, the frame data generator 112 may obtain header information INFH generated by the header generator 132 of the LINK-TX protocol management unit 121 in the test mode MB, and generate frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11 and this header information INFH.

[0131] Similarly, in the imaging device 10A according to the first modification, the frame data generating unit 112A generates frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11 and footer information INFF generated by the footer information generating unit 113A in the test mode MB, but this is not limited to this. Alternatively, the frame data generating unit 112A may obtain footer information INFF generated by the footer generating unit 134 of the LINK-TX protocol managing unit 121 in the test mode MB, and generate frame data F including, as image information, pixel value information obtained by the imaging pixels of the imaging unit 11 and this footer information INFF.

[0132] [Variation 8] In the above embodiment, the image processing unit 22C of the processing device 20C is provided with the analysis unit 223, and the analysis unit 223 analyzes whether the communication is performed correctly, but the present invention is not limited to this. Instead of this, for example, as in the communication system 1B shown in Figs. 10 and 11, a device other than the processing device may analyze whether the communication is performed correctly. The communication system 1B includes a processing device 20B and an analysis device 30B. The processing device 20B has an image processing unit 22B. As shown in Fig. 11, the image processing unit 22B is obtained by removing the analysis unit 223 from the image processing unit 22 according to the above embodiment. The analysis device 30B is configured to analyze whether the communication is performed correctly based on the header information INFH included in the frame data F generated by the frame data receiving unit 222 of the image processing unit 22B in the test mode MB. The analysis device 30B may be configured using, for example, a personal computer, or may be a dedicated device for analyzing whether the communication is performed correctly.

[0133] [Variation 9] In the above embodiment, the frame data F including, as image information, pixel value information obtained by the imaging pixels and header information INFH including the same information as that included in the header PH is transmitted to the processing device 20, but this is not limited to this. Instead of this, for example, the frame data F including, as image information, pixel value information obtained by the imaging pixels and the header information INFH may be transmitted separately to the processing device 20. The communication system 1C according to this modification will be described in detail below.

[0134] 12 shows an example of the configuration of a communication system 1C. The communication system 1C includes an imaging device 10C and a processing device 20C. The imaging device 10C includes an imaging section 11C and a communication section 13C.

[0135] 13 shows an example of the configuration of an imaging device 10C. The imaging section 11C has a frame data generation section 112C. The frame data generation section 112C generates frame data F including pixel value information obtained by imaging pixels of the imaging section 11 as image information in both normal mode MA and test mode MB. The transmission section 12 transmits image data by transmitting packets P via eight transmission lanes L0 to L7, respectively.

[0136] The communication unit 13C is configured to exchange control signals with the processing device 20C. The communication unit 13C is configured to transmit header information INFH to the processing device 20C in the test mode MB.

[0137] The processing device 20C includes a communication unit 23C and an image processing unit 22C. The communication unit 23C is configured to exchange control signals with the imaging device 10C. The communication unit 23C is configured to receive header information INFH transmitted from the imaging device 10C in the test mode MB.

[0138] 14 shows an example of the configuration of the processing device 20C. The image processing unit 22C has an analysis unit 223C. The analysis unit 223C is configured to analyze whether communication is performed correctly based on the header information INFH received by the communication unit 23C in the test mode MB.

[0139] Here, the imaging device 10C corresponds to a specific example of a "transmitting device" in this disclosure. The frame data generating unit 112C corresponds to a specific example of a "data generating unit" in this disclosure. The communication unit 13C corresponds to a specific example of a "control information transmitting unit" in this disclosure. The processing device 20C corresponds to a specific example of a "receiving device" in this disclosure. The communication unit 23C corresponds to a specific example of a "control information receiving unit" in this disclosure. The processing analysis unit 223C corresponds to a specific example of an "analysis unit" in this disclosure.

[0140] In this example, the communication unit 13C of the imaging device 10C transmits the header information INFH, and the communication unit 23C of the processing device 20C receives the header information INFH, but this is not limited to this. Instead, for example, similar to the case of the communication system 1A described in the above-mentioned modified example 1, the communication unit 13C of the imaging device 10C may transmit the footer information INFF, and the communication unit 23C of the processing device 20C may receive the footer information INFF.

[0141] [Other variations] Also, two or more of these variations may be combined.

[0142] Although the present technology has been described above by giving embodiments and some modified examples, the present technology is not limited to these embodiments and the like, and various modifications are possible.

[0143] For example, in the above embodiment, one transmission unit 12 is provided in the imaging device 10, one reception unit 21 is provided in the processing device 20, and the transmission unit 12 transmits image data to the reception unit 21, but this is not limited to the above. Instead of this, for example, multiple transmission units may be provided in the imaging device, and multiple reception units may be provided in the processing device, and the multiple transmission units may transmit image data to the multiple reception units. The transmission units can transmit image data to the reception units corresponding to the transmission units by using, for example, multiple transmission lanes L.

[0144] In the above embodiment and the like, one imaging device 10 transmits image data to one processing device 20, but this is not limited to this. Instead of this, for example, multiple imaging devices may transmit image data to one processing device.

[0145] It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0146] The present technology can be configured as follows: According to the present technology configured as follows, it is possible to check whether communication is being performed correctly.

[0147] (1) a data generating unit capable of generating image data including pixel value information obtained by imaging pixels and control information as image information; A transmission unit capable of transmitting the image data; A transmitting device comprising: (2) The transmission unit is capable of generating a packet having a header including the control information and a payload including the image information, and is capable of transmitting the image data by transmitting the packet. The transmitting device according to (1) above. (3) the payload includes the image information for one line in the image data, The control information includes information about the image information for one line. The transmitting device according to (2) above. (4) the control information includes control data; The header further includes, in addition to the control data, an error correction code for the control data. A transmitting device as described in (2) or (3). (5) The control information includes control data and an error correction code for the control data. A transmitting device as described in (2) or (3). (6) the transmitting device has a first mode and a second mode; The data generation unit In the first mode, the image data including the pixel value information and the control information as the image information can be generated; In the second mode, the image data including the pixel value information as the image information can be generated. A transmitting device according to any one of (1) to (5). (7) the transmission unit is capable of generating a packet having a header including the control information and a payload including the image data, and is capable of transmitting the image data by transmitting the packet; The control information includes flag information having a first value in the first mode and a second value in the second mode. The transmitting device according to (6) above. (8) The transmission unit is capable of generating a packet having a payload including the image information and a footer including the control information, and is capable of transmitting the image data by transmitting the packet. The transmitting device according to (1) above. (9) the payload includes the image information for one line in the image data, The control information includes an error correction code for the image information for one line. The transmitting device according to (8). (10) The image data represents an image corresponding to an effective pixel area. A transmitting device according to any one of (1) to (9). (11) a receiving unit capable of receiving image data including pixel value information obtained by the imaging pixels and control information as image information; an analysis unit capable of performing an analysis process based on the control information included in the image data; A receiving device comprising: (12) The receiving unit is capable of receiving the image data by receiving a packet having a header including the control information and a payload including the image information. The receiving device according to (11) above. (13) The receiving unit further includes a verifying unit capable of verifying the image data by comparing the control information included in the header with the control information included in the payload. The receiving device according to (12) above. (14) The receiving unit is capable of receiving the image data by receiving a packet having a payload including the image information and a footer including the control information. The receiving device according to (11) above. (15) a transmitting device; Receiving device and Equipped with The transmitting device a data generating unit capable of generating image data including pixel value information obtained by the imaging pixels and control information as image information; A transmission unit capable of transmitting the image data; having The receiving device includes: a receiving unit capable of receiving the image data transmitted from the transmitting device; an analysis unit capable of performing an analysis process based on the control information included in the image data; have Communication systems. (16) a transmitting device; Receiving device and Equipped with The transmitting device a data generating unit capable of generating image data including pixel value information obtained by the imaging pixels as image information; A transmission unit capable of transmitting the image data; a control information transmitting unit capable of transmitting control information; having The receiving device includes: a receiving unit capable of receiving the image data transmitted from the transmitting device; a control information receiving unit capable of receiving the control information transmitted from the transmitting device; an analysis unit capable of performing an analysis process based on the control information; have Communication systems. (17) The transmitting device has a first mode and a second mode; The control information transmission unit is capable of transmitting the control information in the first mode. The communication system according to (16) above. (18) The transmission unit is capable of generating a packet having a header including the control information and a payload including the image information, and is capable of transmitting the image data by transmitting the packet. The communication system according to (16) or (17). (19) The transmission unit is capable of generating a packet having a payload including the image information and a footer including the control information, and is capable of transmitting the image data by transmitting the packet. A communication system according to any one of (16) to (18).

[0148] This application claims priority based on Japanese Patent Application No. 2019-112495, filed on June 18, 2019 in the Japan Patent Office, the entire contents of which are incorporated herein by reference.

[0149] Those skilled in the art will recognize that various modifications, combinations, subcombinations, and variations may occur to those skilled in the art depending on design requirements and other factors, and that such modifications are within the scope of the appended claims and their equivalents.

Claims

1. A data generating unit capable of generating image data including pixel value information obtained by imaging pixels and control information as image information of an effective pixel area in a first mode, and capable of generating the image data including the pixel value information as the image information of the pixel value information and the control information in a second mode; A transmission unit capable of transmitting the image data; A transmitting device comprising:

2. The transmission unit is capable of generating a packet having a header including the control information and a payload including the image information, and is capable of transmitting the image data by transmitting the packet. The transmitting device according to claim 1 .

3. the payload includes one line of image information in the image data, The control information includes information about the image information for one line. The transmitting device according to claim 2.

4. the control information includes control data; The header further includes, in addition to the control data, an error correction code for the control data. The transmitting device according to claim 2.

5. The control information includes control data and an error correction code for the control data. The transmitting device according to claim 2.

6. the transmitting unit is capable of generating a packet having a header including the control information and a payload including the image data, and is capable of transmitting the image data by transmitting the packet; The control information includes flag information having a first value in the first mode and a second value in the second mode. The transmitting device according to claim 1 .

7. The transmission unit is capable of generating a packet having a payload including the image information and a footer including the control information, and is capable of transmitting the image data by transmitting the packet. The transmitting device according to claim 1 .

8. the payload includes one line of image information in the image data, The control information includes an error correction code for the image information for one line. The transmitting device according to claim 7.

9. The image data represents an image corresponding to an effective pixel area. The transmitting device according to claim 1 .

10. A transmitting device; Receiving device and Equipped with The transmitting device a data generating unit capable of generating image data including pixel value information obtained by imaging pixels and control information as image information of an effective pixel region in a first mode, and capable of generating the image data including the pixel value information as the image information of the pixel value information and the control information in a second mode; A transmission unit capable of transmitting the image data; having The receiving device includes: a receiving unit capable of receiving the image data transmitted from the transmitting device; an analysis unit capable of performing an analysis process based on the control information included in the image data; have Communication systems.

Images