Image receiving device and delay time measuring device

Abstract

To provide an image receiving device suitable for grasping a more accurate delay time when image data is transmitted from an image transmitting device to the image receiving device via a network.SOLUTION: A clock generation unit 14 generates a clock including time information based on radio waves received from a satellite 40 for a global navigation satellite system. A communication unit 16 transmits image data on which at least one of first to third clock numbers read from an image memory is superimposed. The first clock number indicates a time when an imaging element 112 generated pixel data for a reference pixel in a frame. The second clock number indicates a time when a write / read control unit 150 wrote the pixel data for the reference pixel into an image memory 15. The third clock number indicates a time when the communication unit 16 transmitted the pixel data for the reference pixel.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an image receiving device and a delay time measuring device. [Background technology]

[0002] An image receiving device receives images via a network from an image transmitting device located at at least one site. The image data is transmitted to the image receiving device, and the image transmitted from the image transmitting device is set in the image receiving device. In this case, the fifth generation mobile communication system (5G) With the practical application of this technology, image data can be transmitted with low latency, making it possible to transmit image data with low latency. The delay due to this is negligible. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-88305 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the delay due to the internal processing in the image transmitting device and the image receiving device is ignored. In addition, image transmission devices are installed at multiple locations, and multiple image transmissions are When transmitting image data from a plurality of image transmitting devices to an image receiving device, The timing of the image displayed on the display device varies due to the processing delay. The image transmission device transmits the image over a network. The internal structure of the image transmitting device and the image receiving device when transmitting image data to the image receiving device It is necessary to understand the delay time, including delays due to sub-processing.

[0005] The present invention transmits image data from an image transmitting device to an image receiving device via a network and aims to provide an image receiving device and a delay time measuring device suitable for grasping a more accurate delay time when doing so.

Means for Solving the Problems

[0006] The present invention receives image data in which at least one of a first clock number, a second clock number, and a third clock number is superimposed, transmitted from an image transmitting device, by a first communication unit. The first clock number is a clock number in a first clock including time information based on radio waves received from a satellite for a global navigation satellite system, generated by a first clock generation unit provided in the image transmitting device, and indicates the time when the imaging element of the camera provided in the image transmitting device generates pixel data of a reference pixel in a frame. The second clock number is the clock number in the first clock and indicates the time when a first write / read control unit provided in the image transmitting device writes the pixel data of the reference pixel into a first image memory. The third clock number is the clock number in the first clock and indicates the time when a second communication unit provided in the image transmitting device transmits the pixel data of the reference pixel, and includes time information based on radio waves received from the satellite for the global navigation satellite system. A second clock generation unit that generates a second clock identical to the first clock, a second image memory that operates according to the second clock and writes and reads the image data based on control by a second write / read control unit, and the second image memory read from image data read from the second image memory ​​​​​​​​​​A display device for displaying the image data, and any one of the first to third clock numbers The clock number, and the time when the first communication unit received the pixel data of the reference pixel The fourth clock number at the second clock, and the second write / read control unit The time when the pixel data of the reference pixel was read from the second image memory, and the second clock The fifth clock number at the clock, and the time when the display device displayed the pixel data of the reference pixel The sixth clock number at the second clock indicating the time, and a delay time measuring unit that measures a delay time indicating a difference from any one of the clock numbers To provide an image receiving device further comprising a delay time measuring unit that measures a delay time indicating a difference from any one of the clock numbers Provide.

[0007] In the image data transmitted from the image transmission device, at least one of a first clock number, a second clock number, and a third clock number is superimposed. The first clock number is generated by a first clock generation unit provided in the image transmission device, and is a clock number in a first clock including time information based on radio waves received from a satellite for a global navigation satellite system. It indicates the time when the pixel element of the camera provided in the image transmission device generated the pixel data of the reference pixel in the frame. The second clock number is the clock number in the first clock, and the first write / read control unit provided in the image transmission device indicates the time when the pixel data of the reference pixel was written to the first image memory. The third clock number is the clock number in the first clock, and the first communication unit provided in the image transmission device indicates the time when the pixel data of the reference pixel was transmitted. The image receiving device that received the image data has a fourth clock number, a fifth clock number, and a sixth clock number Clock number, at least one of the second clock number and the third clock number is superimposed, and the first clock number Is a clock number in a first clock including time information based on radio waves received from a satellite for a global navigation satellite system, which is generated by a first clock generation unit provided in the image transmission device. It indicates the time when the pixel element of the camera provided in the image transmission device generated the pixel data of the reference pixel in the frame. The second clock number Is the clock number in the first clock, and the first write / read control unit provided in the image transmission device Indicates the time when the pixel data of the reference pixel was written to the first image memory. The third clock number Is the clock number in the first clock, and the first communication unit provided in the image transmission device Indicates the time when the pixel data of the reference pixel was transmitted. The image receiving device that received the image data Is a fourth clock number, a fifth clock number, and a sixth clock number Is the clock number in the first clock, and the image transmission device The first communication unit provided indicates the time when the pixel data of the reference pixel was transmitted. The image data The image receiving device that received the image data has a fourth clock number, a fifth clock number, and a sixth clock number Generate at least one of the numbers, and the fourth clock number is the same as the first clock including time information based on radio waves received from the satellite for the global navigation satellite system The clock number in the second clock, which is the same as the first clock including time information based on radio waves received from the satellite for the system The second communication unit included in the image receiving device indicates the time when the pixel data of the reference pixel is received, and the fifth clock number is the clock number in the second clock. The second writing / reading control unit included in the image receiving device writes the image data into the second image memory, and reads the pixel data of the reference pixel from the second image memory The time is indicated, and the sixth clock number is the clock number in the second clock. The display device included in the image receiving device displays the pixel data of the reference pixel read from the second image memory The time is indicated, and by obtaining the difference between any one of the first to third clock numbers and any one of the fourth to sixth clock numbers, the image data generated by the image transmitting device and transmitted to the image receiving device is received by the image receiving device and displayed A delay time measuring device for measuring the delay time when is provided. According to the image receiving device and the delay time measuring device of the present invention, when image data is transmitted from an image transmitting device to an image receiving device via a network, a more accurate delay time can be grasped. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram conceptually showing an image transmission system for transmitting image data from a plurality of image transmitting devices to an image receiving device via a network. EFFECTS OF THE INVENTION

[0008] According to the image receiving device and the delay time measuring device of the present invention, when image data is transmitted from an image transmitting device to an image receiving device via a network, a more accurate delay time can be grasped. BRIEF DESCRIPTION OF THE DRAWINGS

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an image receiving device, a delay time measuring device, a delay time management server, and a timing adjustment method according to one or more embodiments will be described with reference to the accompanying drawings.

[0011] First, using FIG. 1, an image transmission system that transmits image data from a plurality of image transmission devices to an image receiving device via a network will be conceptually described. The image data is moving image data. Note that the image transmission system may transmit audio data in addition to the image data. The processing of transmission and reception of audio data is omitted from the illustration. In FIG. 1, image transmission devices 10A to 10C are arranged at three different locations. An image receiving device 20 is arranged at a location different from the locations where the image transmission devices 10A to 10C are arranged. The image transmission devices 10A to 10C include a camera 11 that captures a subject and a transmission unit 12 that transmits image data generated by the camera 11 capturing the subject. The image data transmitted from the image transmission devices 10A to 10C is transmitted to the image receiving device 20 via the network 30. The network 30 is typically the Internet. The image receiving device 20 includes a receiving unit 21 that receives the image data and a moving image based on the image data.

[0012] In FIG. 1, the image transmission devices 10A to 10C are arranged at three different locations. An image receiving device 20 is arranged at a location different from the locations where the image transmission devices 10A to 10C are arranged. The image transmission devices 10A to 10C include a camera 11 that captures a subject and a transmission unit 12 that transmits image data generated by the camera 11 capturing the subject. The image data transmitted from the image transmission devices 10A to 10C is transmitted to the image receiving device 20 via the network 30. The network 30 is typically the Internet. The image receiving device 20 includes a receiving unit 21 that receives the image data and a moving image based on the image data. The image data transmitted from the image transmission devices 10A to 10C is transmitted to the image receiving device 20 via the network 30. The network 30 is typically the Internet. The image receiving device 20 includes a receiving unit 21 that receives the image data and a moving image based on the image data. The image data transmitted from the image transmission devices 10A to 10C is transmitted to the image receiving device 20 via the network 30. The network 30 is typically the Internet. The image receiving device 20 includes a receiving unit 21 that receives the image data and a moving image based on the image data. The image data transmitted from the image transmission devices 10A to 10C is transmitted to the image receiving device 20 via the network 30. The network 30 is typically the Internet. The image receiving device 20 includes a receiving unit 21 that receives the image data and a moving image based on the image data.

[0013] The image data transmitted from the image transmission devices 10A to 10C is transmitted to the image receiving device 20 via the network 30. The network 30 is typically the Internet. The image receiving device 20 includes a receiving unit 21 that receives the image data and a moving image based on the image data. The network 30 is typically the Internet. The image receiving device 20 includes a receiving unit 21 that receives the image data and a moving image based on the image data. The network 30 is typically the Internet. The image receiving device 20 includes a receiving unit 21 that receives the image data and a moving image based on the image data. It includes a display device 22 for displaying images. The display device 22 may simultaneously display moving images from the image transmission devices 10A to 10C, or may display while switching the moving images from the image transmission devices 10A to 10C. An image transmission device that does not specify any of the image transmission devices 10A to 10C is referred to as an image transmission device 10. It may sometimes display moving images from the image transmission devices 10A to 10C simultaneously, or may display while switching the moving images from the image transmission devices 10A to 10C. An image transmission device that does not specify any of the image transmission devices 10A to 10C is referred to as an image transmission device 10. It may sometimes display moving images from the image transmission devices 10A to 10C simultaneously, or may display while switching the moving images from the image transmission devices 10A to 10C.

[0014] <Specific configuration examples of an image transmission device, an image reception device, and a delay time measurement device> FIG. 2 shows a configuration example of an image transmission device 10 and an image reception device 20 configured to measure the delay time from the time when the camera 11 in the image transmission device 10 starts shooting a moving image to the time when the display device 22 in the image reception device 20 starts displaying the moving image. The image transmission device 10 and the image reception device 20 shown in FIG. 2 are provided with a configuration suitable for grasping the delay time including the delay due to their internal processing. The delay time measurement unit 28 included in the image reception device 20 constitutes a delay time measurement device in one or more embodiments, and measures a more accurate delay time including the delay due to the internal processing in the image transmission device 10 and the image reception device 20 as described later. The image transmission device 10 is an image transmission device in one or more embodiments. The image reception device 20 is an image reception device in one or more embodiments. As shown in FIG. 2, the image transmission device 10 includes, in addition to the camera 11, a GNSS satellite radio wave clock 13, a clock generation unit 14, an image memory 15, and a communication unit 16. The camera 11 has a control unit 111, an imaging element 112, and an image processing circuit 113. The image memory 15 has a write / read As shown in FIG. 2, the image transmission device 10 includes, in addition to the camera 11, a GNSS satellite radio wave clock 13, a clock generation unit 14, an image memory 15, and a communication unit 16. The camera 11 has a control unit 111, an imaging element 112, and an image processing circuit 113. The image memory 15 has a write / read

[0015] The delay time measurement unit 28 included in the image reception device 20 constitutes a delay time measurement device in one or more embodiments, and measures a more accurate delay time including the delay due to the internal processing in the image transmission device 10 and the image reception device 20 as described later. The image transmission device 10 is an image transmission device in one or more embodiments. The image reception device 20 is an image reception device in one or more embodiments. The delay time measurement unit 28 included in the image reception device 20 constitutes a delay time measurement device in one or more embodiments, and measures a more accurate delay time including the delay due to the internal processing in the image transmission device 10 and the image reception device 20 as described later. The image transmission device 10 is an image transmission device in one or more embodiments. The image reception device 20 is an image reception device in one or more embodiments. The delay time measurement unit 28 included in the image reception device 20 constitutes a delay time measurement device in one or more embodiments, and measures a more accurate delay time including the delay due to the internal processing in the image transmission device 10 and the image reception device 20 as described later. The image transmission device 10 is an image transmission device in one or more embodiments. The image reception device 20 is an image reception device in one or more embodiments. The delay time measurement unit 28 included in the image reception device 20 constitutes a delay time measurement device in one or more embodiments, and measures a more accurate delay time including the delay due to the internal processing in the image transmission device 10 and the image reception device 20 as described later. The image transmission device 10 is an image transmission device in one or more embodiments. The image reception device 20 is an image reception device in one or more embodiments. The delay time measurement unit 28 included in the image reception device 20 constitutes a delay time measurement device in one or more embodiments, and measures a more accurate delay time including the delay due to the internal processing in the image transmission device 10 and the image reception device 20 as described later. The image transmission device 10 is an image transmission device in one or more embodiments. The image reception device 20 is an image reception device in one or more embodiments.

[0016] As shown in FIG. 2, the image transmission device 10 includes, in addition to the camera 11, a GNSS satellite radio wave clock 13, a clock generation unit 14, an image memory 15, and a communication unit 16. The camera 11 has a control unit 111, an imaging element 112, and an image processing circuit 113. The image memory 15 has a write / read As shown in FIG. 2, the image transmission device 10 includes, in addition to the camera 11, a GNSS satellite radio wave clock 13, a clock generation unit 14, an image memory 15, and a communication unit 16. The camera 11 has a control unit 111, an imaging element 112, and an image processing circuit 113. The image memory 15 has a write / read As shown in FIG. 2, the image transmission device 10 includes, in addition to the camera 11, a GNSS satellite radio wave clock 13, a clock generation unit 14, an image memory 15, and a communication unit 16. The camera 11 has a control unit 111, an imaging element 112, and an image processing circuit 113. The image memory 15 has a write / read It includes a control unit 150. The communication unit 16 functions as the transmission unit 12 in FIG. 1.

[0017] In addition to the display device 22, the image receiving device 20 includes a GNSS satellite radio clock 23, a clock generation unit 24, a communication unit 25, an image processing circuit 26, an image memory 27, and a delay time measurement unit 28. The display device 22 includes a control unit 221, a drive circuit 222, and a liquid crystal panel 223. The image me mory 27 includes a write / read control unit 270. The communication unit 25 functions as the receiving unit 21 in FIG. 1.

[0018] The GNSS satellite radio clock 13 receives radio waves from a satellite 40 for the Global Navigation Satellite System (GNSS) and outputs a 1PPS signal which is a pulse at 1-second intervals shown in FIG. 3(a) and a 10 MHz clock (hereinafter, 10 MHz clock) shown in FIG. 3(b). GNSS is, for example, GPS (Global Positioning S ystem).

[0019] Based on the input 1PPS signal and 10 MHz clock, the clock generation unit 14 generates a 148.5 MHz clock (hereinafter, 148.5 MHz clock) shown in FIG. 3(c) and supplies it to the camera 11, the image memory 15, and the communication unit 16. For the sake of illustration, the 148.5 MHz clock shown in FIG. 3(c) is shown with the period of one clock being significantly lengthened. Note that in addition to 148.5 MHz, the clock generation unit 14 may generate clocks of other frequencies for video synchronization such as 297 MHz, 74. 25 MHz, 27 MHz, etc.

[0020] The image transmission device 10 includes time information based on radio waves received from a satellite 40 for GNSS.​​​​ It suffices to be provided with a clock generation unit that generates a clock. A 10 MHz clock may be supplied to the camera 11, the image memory 15, and the communication unit 16 so that the camera 11, the image memory 15, and the communication unit 16 operate at 1 0 MHz clock. In this case, the GNSS satellite radio wave clock 13 serves as a clock generation unit that generates a clock including time information. The frequency of the clock supplied to the camera 11, the image memory 1 5, and the communication unit 16 is not limited.

[0021] Assume that the GNSS satellite radio wave clock 13 generates a pulse of the 1PPS signal shown in Fig. 3(a) at time 0:0 0:00 and the next pulse at time 0:00:01. The clock generation unit 14 outputs a 148.5 MHz clock including time information, such as clock numbers 0 to 148.5×10 -6 - 1 based on time 0:00:00 and clock numbers 0 to 148.5×10 -6 -1 based on time 0:00:01.

[0022] The control unit 111 of the camera 11 controls the electronic shutter in the image sensor 112, and the image sensor 112 captures an image of the subject. The control unit 111 may be a central processing unit provided in the camera 11. The image data generated by the image sensor 112 capturing an image of the subject is subjected to various image processes by the image processing circuit 113 and supplied to the image memory 15.

[0023] The image processes in the image processing circuit 113 include at least one or more of defective pixel interpolation processing, black level processing, white balance processing, demosaicing processing, shading correction processing, and compression encoding processing. The image processes in the image processing circuit 113 include at least compression encoding processing. processing.

[0024] The control unit 111 controls the image sensor 112 to release the electronic shutter at a predetermined reference pixel and to obtain pixel data. The clock number of the 148.5MHz clock that indicates the time t0 at which the The reference pixel is controlled so that it is superimposed on the blanking period of the image data. It is preferable that the pixel is the first row and the first pixel. The clock number indicates the time when the camera 11 starts generating image data for each frame. As shown in FIG. 3(c), a time t0 included in the image data output by the camera 11 is As an example, the clock number is assumed to be Cn0, which is clock number 0.

[0025] The write / read control unit 150 writes the image data into the image memory 15. The read control unit 150 writes pixel data of the reference pixel of each frame into the image memory 15. The clock number of the 148.5MHz clock indicating the time t1 is stored as metadata in the image data. The image data superimposed during the blanking period of the image data is written to the image memory 15. As shown in FIG. 3(c), the time t1 included in the image data written in the image memory 15 The clock number indicating the image data written in the image memory 15 is Cn1. In this example, clock numbers Cn0 and Cn1 are superimposed on each other.

[0026] The write / read control unit 150 reads image data stored in the image memory 15 and transmits the image data. The communication unit 16 transmits the image data read from the image memory 15 as packets. The image data is then sent to the image receiving device 20 via the network 30. 16 indicates the clock number of the 148.5 MHz clock at time t2 when transmitting the pixel data of the reference pixel for each frame, which is superimposed as metadata during the blanking period of the image data in the state shown in (c) of FIG. 3. Let the clock number indicating the time t2 when transmitting the pixel data of the reference pixel be Cn2. As a result, the clock number Cn2 indicates the time t2 when the pixel data of the reference pixel was transmitted. Overlap the clock number of the 148.5 MHz clock when transmitting the pixel data of the reference pixel for each frame as metadata during the blanking period of the image data, and packetize the image data. As shown in (c) of FIG. 3, assume that the clock number indicating the time t2 when transmitting the pixel data of the reference pixel is Cn2. Consequently, the clock number Cn2 indicates the time t2 when the pixel data of the reference pixel was transmitted. In the state where it is superimposed as metadata during the blanking period of the image data, the image data is packetized. As shown in (c) of FIG. 3, assume that the clock number indicating the time t2 when transmitting the pixel data of the reference pixel is Cn2. As a result, the clock number Cn2 indicates the time t2 when the pixel data of the reference pixel was transmitted. Overlap the clock number of the 148.5 MHz clock when transmitting the pixel data of the reference pixel for each frame as metadata during the blanking period of the image data, and packetize the image data. As shown in (c) of FIG. 3, assume that the clock number indicating the time t2 when transmitting the pixel data of the reference pixel is Cn2. Consequently, the clock number Cn2 indicates the time t2 when the pixel data of the reference pixel was transmitted. Overlap the clock number of the 148.5 MHz clock when transmitting the pixel data of the reference pixel for each frame as metadata during the blanking period of the image data, and packetize the image data. As shown in (c) of FIG. 3, assume that the clock number indicating the time t2 when transmitting the pixel data of the reference pixel is Cn2. As a result, the clock number Cn2 indicates the time t2 when the pixel data of the reference pixel was transmitted.

[0027] Also, the communication unit 16 adds clock frequency information to the image data and packetizes it in order to transmit to the image receiving device 20 that the camera 11, the image memory 15, and the communication unit 16 are operating at a 148.5 MHz clock. The packet data transmitted from the image transmitting device 10 to the image receiving device 20 via the network 30 includes the image data and the clock frequency information, and the clock numbers Cn0, Cn1, and Cn2 are superimposed on the image data. In order to transmit to the image receiving device 20 that the camera 11, the image memory 15, and the communication unit 16 are operating at a 148.5 MHz clock, the communication unit 16 adds clock frequency information to the image data and packetizes it. The packet data transmitted from the image transmitting device 10 to the image receiving device 20 via the network 30 includes the image data and the clock frequency information, and the clock numbers Cn0, Cn1, and Cn2 are superimposed on the image data. In order to transmit to the image receiving device 20 that the camera 11, the image memory 15, and the communication unit 16 are operating at a 148.5 MHz clock, the communication unit 16 adds clock frequency information to the image data and packetizes it. The packet data transmitted from the image transmitting device 10 to the image receiving device 20 via the network 30 includes the image data and the clock frequency information, and the clock numbers Cn0, Cn1, and Cn2 are superimposed on the image data. In order to transmit to the image receiving device 20 that the camera 11, the image memory 15, and the communication unit 16 are operating at a 148.5 MHz clock, the communication unit 16 adds clock frequency information to the image data and packetizes it. The packet data transmitted from the image transmitting device 10 to the image receiving device 20 via the network 30 includes the image data and the clock frequency information, and the clock numbers Cn0, Cn1, and Cn2 are superimposed on the image data. In order to transmit to the image receiving device 20 that the camera 11, the image memory 15, and the communication unit 16 are operating at a 148.5 MHz clock, the communication unit 16 adds clock frequency information to the image data and packetizes it. The packet data transmitted from the image transmitting device 10 to the image receiving device 20 via the network 30 includes the image data and the clock frequency information, and the clock numbers Cn0, Cn1, and Cn2 are superimposed on the image data.

[0028] The GNSS satellite radio clock 23 in the image receiving device 20 also receives radio waves from the satellite 40 in the same way as the GNSS satellite radio clock 13 and outputs a 1 PPS signal that is a pulse at 1 - second intervals shown in (a) of FIG. 4 and a 10 MHz clock shown in (b) of FIG. 4. The GNSS satellite radio clock 23 in the image receiving device 20 also receives radio waves from the satellite 40 in the same way as the GNSS satellite radio clock 13 and outputs a 1 PPS signal that is a pulse at 1 - second intervals shown in (a) of FIG. 4 and a 10 MHz clock shown in (b) of FIG. 4. The GNSS satellite radio clock 23 in the image receiving device 20 also receives radio waves from the satellite 40 in the same way as the GNSS satellite radio clock 13 and outputs a 1 PPS signal that is a pulse at 1 - second intervals shown in (a) of FIG. 4 and a 10 MHz clock shown in (b) of FIG. 4.

[0029] In FIG. 2, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the GNSS satellite radio clock 23 is the same common satellite 40. However, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 23 may be different. The GNSS satellite radio clocks 13 and 23 receive radio waves from any of the plurality of satellites 40 operated by a single global navigation satellite system. In FIG. 2, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the GNSS satellite radio clock 23 is the same common satellite 40. However, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 23 may be different. The GNSS satellite radio clocks 13 and 23 receive radio waves from any of the plurality of satellites 40 operated by a single global navigation satellite system. In FIG. 2, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the GNSS satellite radio clock 23 is the same common satellite 40. However, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 23 may be different. The GNSS satellite radio clocks 13 and 23 receive radio waves from any of the plurality of satellites 40 operated by a single global navigation satellite system. In FIG. 2, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the GNSS satellite radio clock 23 is the same common satellite 40. However, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 23 may be different. The GNSS satellite radio clocks 13 and 23 receive radio waves from any of the plurality of satellites 40 operated by a single global navigation satellite system. In FIG. 2, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the GNSS satellite radio clock 23 is the same common satellite 40. However, the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 13 and the satellite 40 that transmits the radio waves received by the GNSS satellite radio clock 23 may be different. The GNSS satellite radio clocks 13 and 23 receive radio waves from any of the plurality of satellites 40 operated by a single global navigation satellite system. It may be trusted.

[0030] The communication unit 25 receives packet data including image data and clock frequency information, supplies the clock frequency information to the clock generation unit 24, and supplies the image data to the image processing circuit 26. Since the clock frequency information indicating 148.5 MHz is input to the clock generation unit 24, based on the input 1PPS signal and 10 MHz clock, the 148.5 MHz clock shown in FIG. 4(c) is generated. The 148.5 MHz clock is supplied to the display device 22, the communication unit 25, the image memory 27, and the delay time measurement unit 28.

[0031] The 148.5 MHz clock shown in FIG. 4(c) is the same clock (same phase and same frequency) as the 148.5 MHz clock shown in FIG. 3(c).

[0032] The clock that the clock generation unit 24 supplies to the display device 22, the communication unit 25, the image memory 27, and the delay time measurement unit 28 is, as described above, a 148.5 MHz clock including time information.

[0033] As shown in FIG. 4(c), the communication unit 25 superimposes, as metadata, the clock number of the 148.5 MHz clock indicating the time t3 when the pixel data of the reference pixel of each frame is received from the network 30 during the blanking period of the image data. Assume that the clock number indicating the time t3 when the pixel data of the reference pixel is received is Cn3. Therefore, the clock numbers Cn0, Cn1, Cn2, and Cn3 are superimposed on the image data output from the communication unit 25.

[0034] The image data output from the communication unit 25 is subjected to various image processes by the image processing circuit 26 and supplied to the image memory 27. The image process in the image memory 27 is at least decompression and decoding processes. The image processing circuit 26 supplies the clock numbers Cn0, Cn1, Cn2, Cn3 included in the image data to the delay time measurement unit 28. The write / read control unit 270 writes the image data supplied to the image memory 27 into the image memory 27, reads out the image data stored in the image memory 27, and supplies it to the drive circuit 222 of the display device 22. At this time, the write / read control unit 270 supplies the clock number of the 148.5 MHz clock indicating the time t4 when the pixel data of the reference pixel of each frame is read out to the delay time measurement unit 28. The time t4 is also the time when the pixel data of the reference pixel is supplied to the drive circuit 222. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t4 when the image data is read out from the image memory 27 is Cn4. The image data output from the communication unit 25 is subjected to various image processes by the image processing circuit 26 and supplied to the image memory 27. The image process in the image memory 27 is at least decompression and decoding processes. The image processing circuit 26 supplies the clock numbers Cn0, Cn1, Cn2, Cn3 included in the image data to the delay time measurement unit 28. The image data output from the communication unit 25 is subjected to various image processes by the image processing circuit 26 and supplied to the image memory 27. The image process in the image memory 27 is at least decompression and decoding processes. The image processing circuit 26 supplies the clock numbers Cn0, Cn1, Cn2, Cn3 included in the image data to the delay time measurement unit 28.

[0035] The write / read control unit 270 writes the image data supplied to the image memory 27 into the image memory 27, reads out the image data stored in the image memory 27, and supplies it to the drive circuit 222 of the display device 22. At this time, the write / read control unit 270 supplies the clock number of the 148.5 MHz clock indicating the time t4 when the pixel data of the reference pixel of each frame is read out to the delay time measurement unit 28. The time t4 is also the time when the pixel data of the reference pixel is supplied to the drive circuit 222. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t4 when the image data is read out from the image memory 27 is Cn4. The write / read control unit 270 writes the image data supplied to the image memory 27 into the image memory 27, reads out the image data stored in the image memory 27, and supplies it to the drive circuit 222 of the display device 22. At this time, the write / read control unit 270 supplies the clock number of the 148.5 MHz clock indicating the time t4 when the pixel data of the reference pixel of each frame is read out to the delay time measurement unit 28. The time t4 is also the time when the pixel data of the reference pixel is supplied to the drive circuit 222. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t4 when the image data is read out from the image memory 27 is Cn4. The write / read control unit 270 writes the image data supplied to the image memory 27 into the image memory 27, reads out the image data stored in the image memory 27, and supplies it to the drive circuit 222 of the display device 22. At this time, the write / read control unit 270 supplies the clock number of the 148.5 MHz clock indicating the time t4 when the pixel data of the reference pixel of each frame is read out to the delay time measurement unit 28. The time t4 is also the time when the pixel data of the reference pixel is supplied to the drive circuit 222. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t4 when the image data is read out from the image memory 27 is Cn4. The write / read control unit 270 writes the image data supplied to the image memory 27 into the image memory 27, reads out the image data stored in the image memory 27, and supplies it to the drive circuit 222 of the display device 22. At this time, the write / read control unit 270 supplies the clock number of the 148.5 MHz clock indicating the time t4 when the pixel data of the reference pixel of each frame is read out to the delay time measurement unit 28. The time t4 is also the time when the pixel data of the reference pixel is supplied to the drive circuit 222. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t4 when the image data is read out from the image memory 27 is Cn4. The write / read control unit 270 writes the image data supplied to the image memory 27 into the image memory 27, reads out the image data stored in the image memory 27, and supplies it to the drive circuit 222 of the display device 22. At this time, the write / read control unit 270 supplies the clock number of the 148.5 MHz clock indicating the time t4 when the pixel data of the reference pixel of each frame is read out to the delay time measurement unit 28. The time t4 is also the time when the pixel data of the reference pixel is supplied to the drive circuit 222. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t4 when the image data is read out from the image memory 27 is Cn4. The write / read control unit 270 writes the image data supplied to the image memory 27 into the image memory 27, reads out the image data stored in the image memory 27, and supplies it to the drive circuit 222 of the display device 22. At this time, the write / read control unit 270 supplies the clock number of the 148.5 MHz clock indicating the time t4 when the pixel data of the reference pixel of each frame is read out to the delay time measurement unit 28. The time t4 is also the time when the pixel data of the reference pixel is supplied to the drive circuit 222. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t4 when the image data is read out from the image memory 27 is Cn4. The write / read control unit 270 writes the image data supplied to the image memory 27 into the image memory 27, reads out the image data stored in the image memory 27, and supplies it to the drive circuit 222 of the display device 22. At this time, the write / read control unit 270 supplies the clock number of the 148.5 MHz clock indicating the time t4 when the pixel data of the reference pixel of each frame is read out to the delay time measurement unit 28. The time t4 is also the time when the pixel data of the reference pixel is supplied to the drive circuit 222. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t4 when the image data is read out from the image memory 27 is Cn4.

[0036] The control unit 221 of the display device 22 controls the drive circuit 222 to display the image data supplied to the drive circuit 222 on the liquid crystal panel 223. The control unit 221 may be a central processing unit provided in the display device 22. The control unit 221 supplies the clock number of the 148.5 MHz clock indicating the time t5 when the pixel data of the reference pixel of each frame is displayed on the liquid crystal panel 223 to the delay time measurement unit 28. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t5 when the pixel data of the reference pixel is displayed on the liquid crystal panel 223 is Cn5. The control unit 221 of the display device 22 controls the drive circuit 222 to display the image data supplied to the drive circuit 222 on the liquid crystal panel 223. The control unit 221 may be a central processing unit provided in the display device 22. The control unit 221 supplies the clock number of the 148.5 MHz clock indicating the time t5 when the pixel data of the reference pixel of each frame is displayed on the liquid crystal panel 223 to the delay time measurement unit 28. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t5 when the pixel data of the reference pixel is displayed on the liquid crystal panel 223 is Cn5. The control unit 221 of the display device 22 controls the drive circuit 222 to display the image data supplied to the drive circuit 222 on the liquid crystal panel 223. The control unit 221 may be a central processing unit provided in the display device 22. The control unit 221 supplies the clock number of the 148.5 MHz clock indicating the time t5 when the pixel data of the reference pixel of each frame is displayed on the liquid crystal panel 223 to the delay time measurement unit 28. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t5 when the pixel data of the reference pixel is displayed on the liquid crystal panel 223 is Cn5. The control unit 221 of the display device 22 controls the drive circuit 222 to display the image data supplied to the drive circuit 222 on the liquid crystal panel 223. The control unit 221 may be a central processing unit provided in the display device 22. The control unit 221 supplies the clock number of the 148.5 MHz clock indicating the time t5 when the pixel data of the reference pixel of each frame is displayed on the liquid crystal panel 223 to the delay time measurement unit 28. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t5 when the pixel data of the reference pixel is displayed on the liquid crystal panel 223 is Cn5. The control unit 221 of the display device 22 controls the drive circuit 222 to display the image data supplied to the drive circuit 222 on the liquid crystal panel 223. The control unit 221 may be a central processing unit provided in the display device 22. The control unit 221 supplies the clock number of the 148.5 MHz clock indicating the time t5 when the pixel data of the reference pixel of each frame is displayed on the liquid crystal panel 223 to the delay time measurement unit 28. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t5 when the pixel data of the reference pixel is displayed on the liquid crystal panel 223 is Cn5. The control unit 221 of the display device 22 controls the drive circuit 222 to display the image data supplied to the drive circuit 222 on the liquid crystal panel 223. The control unit 221 may be a central processing unit provided in the display device 22. The control unit 221 supplies the clock number of the 148.5 MHz clock indicating the time t5 when the pixel data of the reference pixel of each frame is displayed on the liquid crystal panel 223 to the delay time measurement unit 28. As shown in Fig. 4(c), it is assumed that the clock number indicating the time t5 when the pixel data of the reference pixel is displayed on the liquid crystal panel 223 is Cn5.

[0037] Note that the display device 22 does not need to operate at a 148.5 MHz clock. The display device 22 The reason for supplying the 148.5 MHz clock is the time t at the 148.5 MHz clock This is to supply the clock number Cn5 indicating 5 to the delay time measurement unit 28.

[0038] When the display device 22 is not a direct-view display device but a projection display device, the liquid crystal pa nel 223 is a liquid crystal display element for a projection display device. The display device 22 may include a display panel other than the liquid crystal panel (display element).

[0039] The delay time measurement unit 28 obtains the delay time between the image transmission device 10 and the image reception device 20 according to the processing shown in the flowcharts of FIGS. 5 to 7, and determines a delay time correction value for correcting the delay due to the delay time.

[0040] In FIG. 5, at step S1, the delay time measurement unit 28 sets the shooting time in the image transmission device 10, and at step S2, sets the display time in the image reception device 20. FIG. 6 shows the detailed processing of step S1. In FIG. 6, at step S11, the delay time measurement unit 28 determines whether the clock number Cn0 (i.e., time t0) exists. If the clock number Cn0 exists (YES), at step S13, the delay time measurement unit 28 sets the time t0 indicated by the clock number Cn0 as the shooting time.

[0041] If the clock number does not exist at step S11 (NO), the delay time measurement unit 28 determines at step S12 whether the clock number Cn1 (i.e., time t1) exists. If the clock number Cn1 exists (YES), at step S14, the delay time measurement unit 28 sets the time t1 indicated by the clock number Cn1 as the shooting time. If the clock number Cn1 exists If not (NO), the delay time measurement unit 28 sets the time t2 indicated by the clock number Cn2 as the shooting time in step S15. is set as the shooting time.

[0042] FIG. 7 shows the detailed processing of step S2. In FIG. 7, the delay time measurement unit 28 determines in step S21 whether the clock number Cn5 (i.e., the time t5) exists. If the clock number Cn5 exists (YES), the delay time measurement unit 28 proceeds to step S23 and sets the time t5 as the display time.

[0043] If the clock number Cn5 does not exist in step S21 (NO), the delay time measurement unit 28 determines in step S22 whether the clock number Cn4 (i.e., the time t4) exists. If the clock number Cn4 exists (YES), the delay time measurement unit 28 proceeds to step S 24 and sets the time t4 as the display time. If the clock number Cn4 does not exist (NO) , the delay time measurement unit 28 sets the time t3 indicated by the clock number Cn3 as the display time in step S25.

[0044] In FIG. 6, the reason for determining whether the clock number Cn0 exists is that the camera 11 may not be configured to superimpose the clock number Cn0 indicating the time t0 when the generation of the image data for each frame starts on the image data. Also, the reason for determining whether the clock number Cn1 exists is that the image memory 15 may not be configured to superimpose the clock number Cn1 indicating the time t1 when writing the image data on the image data. In FIG. 7, the reason for determining whether the clock number Cn5 exists is that the display device 2 may not be configured to superimpose the clock number Cn5 indicating the time t5 on the image data. This is because it may be the case.

[0045] In FIG. 7, the reason for determining whether the clock number Cn5 exists is that the display device 2 When 2 displays the image data on the liquid crystal panel 223, the clock number Cn5 indicating the time t5 may not be configured to be supplied to the time measurement unit 28. Also, the reason for determining whether the clock number Cn4 exists is that the image memory 27 may not be configured to supply the clock number Cn4 indicating the time t4 when the image data is read to the delay time measurement unit 28. This is because there may be a case where it is not configured to supply to the time measurement unit 28. Also, the reason for determining whether the clock number Cn4 exists is that the image memory 27 may not be configured to supply the clock number Cn4 indicating the time t4 when the image data is read to the delay time measurement unit 28. When determining whether the clock number Cn4 exists, it is because the image memory 27 may not be configured to supply the clock number Cn4 indicating the time t4 when the image data is read to the delay time measurement unit 28. This is because there may be a case where it is not configured to supply to the time measurement unit 28. This is because there may be a case where it is not configured to supply to the time measurement unit 28.

[0046] Returning to FIG. 5, the delay time measurement unit 28 calculates the delay time between the image transmission device 10 and the image reception device 20, which is the difference between the shooting time and the display time, in step S3. The delay time measurement unit 28 determines in step S4 whether the shooting time is time t2 and the display time is time t3. If the shooting time is time t2 and the display time is time t3, the time from time t2 to time t3 is the transmission time of the image data by the network 30. Therefore, it does not represent the delay time from when the image transmission device 10 starts generating the image data until the image reception device 20 starts displaying the image data. In step S3, the delay time measurement unit 28 calculates the delay time between the image transmission device 10 and the image reception device 20, which is the difference between the shooting time and the display time. In step S4, the delay time measurement unit 28 determines whether the shooting time is time t2 and the display time is time t3. If the shooting time is time t2 and the display time is time t3, the time from time t2 to time t3 is the transmission time of the image data by the network 30. Therefore, it does not represent the delay time from when the image transmission device 10 starts generating the image data until the image reception device 20 starts displaying the image data. In step S4, the delay time measurement unit 28 determines whether the shooting time is time t2 and the display time is time t3. If the shooting time is time t2 and the display time is time t3, the time from time t2 to time t3 is the transmission time of the image data by the network 30. Therefore, it does not represent the delay time from when the image transmission device 10 starts generating the image data until the image reception device 20 starts displaying the image data. If the shooting time is time t2 and the display time is time t3, the time from time t2 to time t3 is the transmission time of the image data by the network 30. Therefore, it does not represent the delay time from when the image transmission device 10 starts generating the image data until the image reception device 20 starts displaying the image data. If the shooting time is time t2 and the display time is time t3, the time from time t2 to time t3 is the transmission time of the image data by the network 30. Therefore, it does not represent the delay time from when the image transmission device 10 starts generating the image data until the image reception device 20 starts displaying the image data. Therefore, it does not represent the delay time from when the image transmission device 10 starts generating the image data until the image reception device 20 starts displaying the image data. Therefore, it does not represent the delay time from when the image transmission device 10 starts generating the image data until the image reception device 20 starts displaying the image data.

[0047] Therefore, if in step S4 the shooting time is time t2 and the display time is time t3 ( YES), the delay time measurement unit 28 determines in step S5 whether the fixed correction value measured in advance is set in the delay time measurement unit 28. The fixed correction value is the time obtained by adding one or both of the average time from time t0 to time t2 and the average time from time t3 to time t5. The fixed correction value is the time obtained by adding one or both of the average time from time t0 to time t2 and the average time from time t3 to time t5. The fixed correction value is the time obtained by adding one or both of the average time from time t0 to time t2 and the average time from time t3 to time t5. The fixed correction value is the time obtained by adding one or both of the average time from time t0 to time t2 and the average time from time t3 to time t5.

[0048] If the fixed correction value measured in advance is set in step S5 (YES), step S The delay time obtained in step 3 is added to the fixed correction value to determine the delay time correction value. End the process.

[0049] In step S4, if the photographing time is not time t2 and the display time is not time t3 (NO), Or, if the fixed correction value measured in advance is not set in step S5 (NO), the delay In step S7, the time measurement unit 28 directly delays the delay time obtained in step S3. This is then determined as the delay time correction value, and the process is terminated.

[0050] As described above, the image transmission device 10 includes the camera 11, the clock generation unit 14, the image memory 1 The clock generating unit 14 receives a signal from a GNSS satellite 40. A first clock (for example, a 148.5 MHz clock) is generated that contains time information based on the The camera 11 operates according to a first clock, and the image sensor 112 captures an image of a subject. The image memory 15 is driven by the first clock. The image data is written and read under the control of the write / read control unit 150 .

[0051] The communication unit 16 reads out the image from the image memory 15 and outputs a small number of the first to third clock numbers. At least one of the superimposed image data is transmitted. The first to third clock numbers are the clocks. The numbers are Cn0 to Cn2.

[0052] The first clock number is the number of pixels in the frame that the camera 11 captures. The camera 11 superimposes the first clock number onto the image data. If the apparatus is configured to execute a process of: will be sent.

[0053] The second clock number indicates the time when the write / read control unit 150 writes the pixel data of the reference pixel to the image memory 15. If the write / read control unit 150 is configured to execute a process of superimposing the second clock number on the image data, the image data including the second clock number is transmitted. The third clock number indicates the time when the communication unit 16 transmits the pixel data of the reference pixel. If the communication unit 16 is configured to execute a process of superimposing the third clock number on the image data, the image data including the third clock number is transmitted. The image receiving device 20 includes a communication unit 25 that receives image data in which at least one of the first clock number, the second clock number, and the third clock number is superimposed. If the communication unit 25 is the first communication unit, the communication unit 16 is the second communication unit. If the communication unit 16 is the first communication unit, the communication unit 25 is the second communication unit. The first clock number is the clock number in the first clock generated by the clock generation unit 14 (first clock generation unit), and indicates the time when the imaging element 112 of the camera 11 generates the pixel data of the reference pixel in the frame. The second clock number is the clock number in the first clock, and indicates the time when the write / read control unit 150 (first write / read control unit) writes the pixel data of the reference pixel to the image memory 15 (first image memory). The third clock number is the clock number in the first clock, and indicates the time when the communication unit 16 (second communication unit) transmits the pixel data of the reference pixel.

[0054]

[0055]

[0056] ​​​​​​​​​​​​The image receiving device 20 further includes a clock generation unit 24 (second clock generation unit), an image memory 27 (second image memory), a display device 22, and a delay time measurement unit 28. The clock generation unit 24 generates a second clock that is the same as the first clock. The image memory 27 operates according to the second clock, and writes and reads image data based on the control by a write / read control unit 270 (second write / read control unit). The display device 22 displays the image data read from the image memory 27.

[0057] The delay time measurement unit 28 measures a delay time indicating the difference between any one of the clock numbers from the first to the third clock numbers and any one of the clock numbers from the fourth to the sixth clock numbers. The fourth clock number is the clock number at the second clock, and indicates the time when the communication unit 25 receives the pixel data of the reference pixel. The fifth clock number is the clock number at the second clock, and indicates the time when the write / read control unit 270 reads the pixel data of the reference pixel from the image memory 27. The sixth clock number is the clock number at the second clock, and indicates

[0058] the time when the display device 22 displays the pixel data of the reference pixel. When the delay time measurement unit 28 acquires the first clock number (clock number Cn0), it is preferable to measure the delay time using the first clock number. When the delay time measurement unit 28 cannot acquire the first clock number and acquires the second clock number (clock number Cn1), it is preferable to measure the delay time using the second clock number. When the delay It is advisable to measure the delay time using it. The delay time measurement unit 28 acquires the sixth clock number If it fails to do so and acquires the fifth clock number (clock number Cn4), it is advisable to measure the delay time using the fifth clock number .

[0059] The delay time measurement unit 28 is a delay time measurement device of one or more embodiments. As described above , the delay time measurement unit 28 obtains the difference between any one of the first to third clock numbers and any one of the fourth to sixth clock numbers. Thereby, the delay time measurement unit 28 measures the delay time when the image receiving device 20 receives and displays the image data generated by the image transmitting device 10 and transmitted to the image receiving device 20 .

[0060] According to the image transmitting device, the image receiving device, and the delay time measurement device of one or more embodiments , it is possible to grasp a more accurate delay time when transmitting image data from the image transmitting device 10 to the image receiving device 20 via the network 30 .

[0061] <Delay Time Management Server> In FIG. 8, at bases B1 to B3, image transmission / reception devices 120A to 120C are respectively arranged. The image transmission / reception devices 120A to 120C communicate bidirectionally with each other via the network 30 . An image transmission / reception device that does not specify any one of the image transmission / reception devices 120A to 120C is referred to as an image transmission / reception device 120 . The image transmission / reception device 120 has the configurations of both the image transmission device 10 and the image receiving device 20 shown in FIG. 2 .

[0062] As shown in FIG. 8, schematically, the image transmission / reception device 120 includes a camera 11 and a display device 22 , and includes a delay time measurement unit 28, a control unit 122, and a transmission / reception unit 121. Although not shown in FIG. 8, the image transmission / reception device 120 includes a GNSS satellite radio wave clock 13 (or 23) and a clock generation unit 14 (or 24), and a 148.5 MHz clock is supplied to the camera 11 and the display device 22. The transmission / reception unit 121 corresponds to the communication units 16 and 25. The control

[0063] The image transmission device 10 shown in FIG. 2 details the configuration when the image transmission / reception device 120 shown in FIG. 8 operates as an image transmission device. The image reception device 20 shown in FIG. 2 details the configuration when the image transmission / reception device 120 shown in FIG. 8 operates as an image reception device.

[0064] A delay time management server 50 is connected to the network 30. The delay time management server 50 communicates bidirectionally with the image transmission / reception devices 120A to 120C. As shown in FIG. 9, the delay time management server 50 stores the delay time when the image transmission / reception devices 120A to 120C arranged at the bases B1 to B3 are on the transmission side and other image transmission / reception devices 120 are on the reception side. FIG. 9 also shows information indicating which delay time from any of the times t0 to t2 to any of the times t 3 to t5 the delay time is.

[0065] The delay time management server 50 may update the delay time shown in FIG. 9 each time the delay time measurement unit 28 of the image transmission / reception devices 120A to 120C measures the delay time. The delay time management server 50 may update the delay time shown in FIG. 9 each time a predetermined time elapses, based on the measurement by the delay time measurement unit 28. It may be updated to a determined latest delay time. The image transmission / reception device 120 can read the delay time stored in the delay time management server 50.

[0066] As described above, the delay time management server 50 which is one or more delay time management servers is connected to the network 30. At least two image transmission / reception devices 120, i.e., the first and second image transmission / reception devices, are connected to the network 30 so as to communicate with each other bidirectionally. Any two of the image transmission / reception devices 120A to 120C are the first and second image transmission / reception devices.

[0067] The first image transmission / reception device includes a first delay time measurement unit (delay time measurement unit 28) that measures a first delay time when the first image transmission / reception device receives and displays image data generated by the second image transmission / reception device and transmitted to the first image transmission / reception device. The second image transmission / reception device includes a second delay time measurement unit (delay time measurement unit 28) that measures a second delay time when the second image transmission / reception device receives and displays image data generated by the first image transmission / reception device and transmitted to the second image transmission / reception device.

[0068] The delay time management server 50 stores the first delay time transmitted from the first image transmission / reception device via the network 30 and the second delay time transmitted from the second image transmission / reception device via the network 30.

[0069] According to the delay time management server 50 of one or more embodiments, from the image transmission / reception device 120 operating as an image transmission device via the network 30 to the image reception device operating as When transmitting image data to the image transmission / reception device 120, more accurate delay time can be managed. It can be done.

[0070] <Method for Adjusting Timing at the Time of Receiving Image Data> As an example, in FIG. 10, at each of the bases B1 to B3, musical instruments are being played, and the image transmission / reception device 120B at the base B2 where the supervisor of the performance is located receives the image data transmitted from the image transmission / reception devices 120A and 120 C. Consider the case where the musical instrument performance is an example of a predetermined action performed by a person who is the subject. The subject performing the musical instrument is the performer. The camera 11 of the image transmission / reception device 120A photographs the performer at the base B1, and the transmission / reception unit 121 transmits the image data to the image transmission / reception device 120B. The camera 11 of the image transmission / reception device 120C photographs the performer at the base B3, and the transmission / reception unit 121 transmits the image data to the image transmission / reception device 120B. The camera 11 of the image transmission / reception device 120B photographs the performer at the base B2, and the display device

[0071] 22 displays the moving image. The display device 22 of the image transmission / reception device 120B may display the moving images generated by the image transmission / reception devices 120A to 120C simultaneously, or may display the moving images generated by the image transmission / reception devices 120A to 120C while switching them. The image transmission / reception devices 120A to 120C are each provided with a timing instruction unit 29 for giving a signal to start the performance to the performers located at the bases B1 to B3. As shown in FIG. 11, the timing instruction unit 29 has a control unit 291, a clock 292, an operation unit 293, a delay time correction value holding unit 294, and a display unit 295. The clock 292 is a GNSS satellite radio clock 13 (or 2

[0072] The image transmission / reception devices 120A to 120C are each provided with a timing instruction unit 29 for giving a signal to start the performance to the performers located at the bases B1 to B3. As shown in FIG. 11, the timing instruction unit 29 has a control unit 291, a clock 292, an operation unit 293, a delay time correction value holding unit 294, and a display unit 295. The clock 292 is a GNSS satellite radio clock 13 (or 2 ​​​​​​It may also be (3). The display unit 295 may be a liquid crystal panel or an LED. It may be.

[0073] When the timing instruction unit 29 sets the time to start playing to the control unit 291 by the operation unit 293, the control unit 291 monitors the time measured by the clock 292 and is configured to display a signal notifying the timing to start playing on the display unit 295. For example, assuming that the performance starts at 13:00:00 at each of the bases B1 to B3, the above delay time exists until the image data is transmitted from the bases B1 and B3 to the base B2 and displayed on the display device 22. Therefore, the timings of all the performances of the bases B1 to B3 displayed at the base B2 do not match. When the timing instruction unit 29 sets the time to start playing to the control unit 291 by the operation unit 293, the control unit 291 monitors the time measured by the clock 292 and is configured to display a signal notifying the timing to start playing on the display unit 295. For example, assuming that the performance starts at 13:00:00 at each of the bases B1 to B3, the above delay time exists until the image data is transmitted from the bases B1 and B3 to the base B2 and displayed on the display device 22. Therefore, the timings of all the performances of the bases B1 to B3 displayed at the base B2 do not match. When the timing instruction unit 29 sets the time to start playing to the control unit 291 by the operation unit 293, the control unit 291 monitors the time measured by the clock 292 and is configured to display a signal notifying the timing to start playing on the display unit 295. For example, assuming that the performance starts at 13:00:00 at each of the bases B1 to B3, the above delay time exists until the image data is transmitted from the bases B1 and B3 to the base B2 and displayed on the display device 22. Therefore, the timings of all the performances of the bases B1 to B3 displayed at the base B2 do not match. When the timing instruction unit 29 sets the time to start playing to the control unit 291 by the operation unit 293, the control unit 291 monitors the time measured by the clock 292 and is configured to display a signal notifying the timing to start playing on the display unit 295. For example, assuming that the performance starts at 13:00:00 at each of the bases B1 to B3, the above delay time exists until the image data is transmitted from the bases B1 and B3 to the base B2 and displayed on the display device 22. Therefore, the timings of all the performances of the bases B1 to B3 displayed at the base B2 do not match. When the timing instruction unit 29 sets the time to start playing to the control unit 291 by the operation unit 293, the control unit 291 monitors the time measured by the clock 292 and is configured to display a signal notifying the timing to start playing on the display unit 295. For example, assuming that the performance starts at 13:00:00 at each of the bases B1 to B3, the above delay time exists until the image data is transmitted from the bases B1 and B3 to the base B2 and displayed on the display device 22. Therefore, the timings of all the performances of the bases B1 to B3 displayed at the base B2 do not match. When the timing instruction unit 29 sets the time to start playing to the control unit 291 by the operation unit 293, the control unit 291 monitors the time measured by the clock 292 and is configured to display a signal notifying the timing to start playing on the display unit 295. For example, assuming that the performance starts at 13:00:00 at each of the bases B1 to B3, the above delay time exists until the image data is transmitted from the bases B1 and B3 to the base B2 and displayed on the display device 22. Therefore, the timings of all the performances of the bases B1 to B3 displayed at the base B2 do not match. It does not match.

[0074] Therefore, based on the control by the control unit 122, the transmission and reception unit 121 reads the delay time shown in FIG. 9 from the delay time management server 50 and supplies it to the control unit 291 of the timing instruction unit 29. The control unit 291 causes the delay time correction value holding unit 294 to hold a delay time correction value based on the delay time. Here, the case where the delay time is directly used as the delay time correction value is taken as an example. Therefore, based on the control by the control unit 122, the transmission and reception unit 121 reads the delay time shown in FIG. 9 from the delay time management server 50 and supplies it to the control unit 291 of the timing instruction unit 29. The control unit 291 causes the delay time correction value holding unit 294 to hold a delay time correction value based on the delay time. Here, the case where the delay time is directly used as the delay time correction value is taken as an example. Therefore, based on the control by the control unit 122, the transmission and reception unit 121 reads the delay time shown in FIG. 9 from the delay time management server 50 and supplies it to the control unit 291 of the timing instruction unit 29. The control unit 291 causes the delay time correction value holding unit 294 to hold a delay time correction value based on the delay time. Here, the case where the delay time is directly used as the delay time correction value is taken as an example. Therefore, based on the control by the control unit 122, the transmission and reception unit 121 reads the delay time shown in FIG. 9 from the delay time management server 50 and supplies it to the control unit 291 of the timing instruction unit 29. The control unit 291 causes the delay time correction value holding unit 294 to hold a delay time correction value based on the delay time. Here, the case where the delay time is directly used as the delay time correction value is taken as an example.

[0075] In the example shown in FIG. 10, the delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120A holds a delay time of 10.3 ms with the base B1 as the transmission side and the base B2 as the reception side. The delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120C holds a delay time of 10.2 ms with the base B3 as the transmission side and the base B2 as the reception side. In the example shown in FIG. 10, the delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120A holds a delay time of 10.3 ms with the base B1 as the transmission side and the base B2 as the reception side. The delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120C holds a delay time of 10.2 ms with the base B3 as the transmission side and the base B2 as the reception side. In the example shown in FIG. 10, the delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120A holds a delay time of 10.3 ms with the base B1 as the transmission side and the base B2 as the reception side. The delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120C holds a delay time of 10.2 ms with the base B3 as the transmission side and the base B2 as the reception side. In the example shown in FIG. 10, the delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120A holds a delay time of 10.3 ms with the base B1 as the transmission side and the base B2 as the reception side. The delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120C holds a delay time of 10.2 ms with the base B3 as the transmission side and the base B2 as the reception side. Holds.

[0076] The delay time correction value holding unit 294 of the timing instruction unit 29 provided in the image transmission and reception device 120B There is no need to hold the delay time correction value. In FIG. 10, since the delay time is not supplied from the transmission / reception unit 121 to the timing instruction unit 29, the dashed arrow line is shown between the transmission / reception unit 121 and the timing instruction unit 29.

[0077] The control unit 291 of the timing instruction unit 29 included in the image transmission / reception device 120A displays, on the display unit 295, a signal indicating the timing to start the performance at a time 10.3 ms before the delay time from 13:00:00 which is the time to start the performance. The control unit 291 of the timing instruction unit 29 included in the image transmission / reception device 120C displays, on the display unit 295, a signal indicating the timing to start the performance at a time 10.2 ms before the delay time from 13:00:00 which is the time to start the performance. The control unit 291 of the timing instruction unit 29 included in the image transmission / reception device 120C displays, on the display unit 295, a signal indicating the timing to start the performance at a time 10.2 ms before the delay time from 13:00:00 which is the time to start the performance.

[0078] The control unit 291 of the timing instruction unit 29 included in the image transmission / reception device 120B displays, on the display unit 295, a signal indicating the timing to start the performance at 13:00:00 which is the time to start the performance.

[0079] The performers at each of the bases B1 to B3 start the performance in accordance with the signal displayed on the display unit 295 of the timing instruction unit 29 at each of the bases B1 to B3. As a result, the image data displayed on the display device 22 at the base B2 is displayed in a state where the timings of all the performances at the bases B1 to B3 are matched.

[0080] Using the flowchart shown in FIG. 12, the processes executed by the image transmission / reception devices 120A to 120C for matching the reception timing of the image data will be described. In FIG. 12, the control unit 122 of the image transmission / reception device 120B, at step S31, sets the image transmission / reception device 120B as the reference, and at step S32, calculates the delay time between the image transmission / reception device 120B and each of the image transmission / reception devices 120A and 120C. Then, at step S33, it notifies the ​​​​​Set as the reference point. The control unit 12 of the image transmission / reception devices 120A and 120C, which are the transmission-side reference points In step S32, the control unit 2 of the delay time management server 50 acquires the corresponding delay time from the delay time management server 50.

[0081] The control unit 291 of the image transmission / reception devices 120A and 120C sets the delay time as the delay time correction value in the delay time correction value holding unit 294 in step S33. Here, the delay time is directly used as the delay time correction value. The control unit 291 of the image transmission / reception devices 120A to 120C sets the performance start time based on the operation input by the operation unit 293 in step S34. The control unit 122 of the image transmission / reception devices 120A and 120C, which are the transmission-side reference points, sets the time that is earlier than the performance start time by the delay time correction value as the performance start timing in step S

[0082] 351. The control unit 122 of the image transmission / reception device 120B, which is the reference point, sets the performance start time as the performance start timing in step S352 The control unit 122 of the image transmission / reception devices 120A and 120C determines whether the current time has reached the performance start timing in step S361. If the current time has not reached the performance start timing (NO), the control unit 122 repeats the process of step S361. If the current

[0083] time has reached the performance start timing (YES), the control unit 122 transfers the process to step S 371. If not, the control unit 122 repeats the process of step S361. If the current time has reached the performance start timing (YES), the control unit 122 transfers the process to step S 371.

[0084] The control unit 122 of the image transmission / reception device 120B determines whether the current time has reached the performance start timing in step S362. If the current time has not reached the performance start timing (NO), the control unit 122 repeats the process of step S362. If the current time has reached the performance start If the start timing has been reached (YES), the control unit 122 shifts the process to step S372. to cause.

[0085] The control units 122 of the image transmission / reception devices 120A and 120C control to display, on the display unit 295, a signal notifying the start of performance at the performance start timing, and end the process. The control unit 122 of the image transmission / reception device 120B controls to display, on the display unit 295, a signal notifying the start of performance at the performance start timing, and end the process. start timing, and end the process. to end.

[0086] As described above, in the image transmission system shown in FIG. 10, the image transmission device (image transmission / reception device 120A or 120C) arranged at the transmission-side base is provided with the camera 11. The image transmission device transmits the image data generated by the camera 11 capturing a subject performing a predetermined operation to the image reception device (image transmission / reception device 120B) arranged at the reference base via the network 30. transmission device transmits the image data generated by the camera 11 capturing a subject performing a predetermined operation to the image reception device (image transmission / reception device 120B) arranged at the reference base via the network 30. image data to the image reception device (image transmission / reception device 120B) arranged at the reference base via the network 30. reception device 120B).

[0087] The timing adjustment method executed in the image transmission system measures the delay time when the image reception device displays the image data received on the display device 22. The timing adjustment method sets, in the timing instruction unit 29 arranged at the transmission-side base, a delay time correction value based on the delay time. The timing adjustment method causes the timing instruction unit 29 to notify the subject of the timing to start a predetermined operation at a time earlier by the time indicated by the delay time correction value from the time when the subject is instructed to start a predetermined operation. data to the display device 22. The timing adjustment method measures the delay time when the image reception device displays the image data received on the display device 22. The timing adjustment method sets, in the timing instruction unit 29 arranged at the transmission-side base, a delay time correction value based on the delay time. The timing adjustment method causes the timing instruction unit 29 to notify the subject of the timing to start a predetermined operation at a time earlier by the time indicated by the delay time correction value from the time when the subject is instructed to start a predetermined operation. side base, a delay time correction value based on the delay time. to set. start. operation at a time earlier by the time indicated by the delay time correction value from the time when the subject is instructed to start a predetermined operation.

[0088] According to the timing adjustment method of one or more embodiments, between the transmission-side base and the reference base When image data obtained by photographing a subject that performs a predetermined operation individually at is displayed at a reference point it is possible to adjust so as to match the timing of .

[0089] <Method for Adjusting Frame Timing at the Time of Receiving Image Data> Even if the timing of the start of performance is adjusted according to the configuration shown in FIG. 10, the timing of the frames of the image data generated by the image transmission / reception apparatuses 120A to 120C is shifted, and when displaying while switching the moving images generated by the image transmission / reception apparatuses 120A to 120C, image noise may occur. 0A to 120C When the image transmission / reception apparatuses 120A to 120C generate and display moving images while switching, image noise may occur. There may be generated.

[0090] FIG. 13 shows an image transmission / reception apparatus 120 configured to correct a shift in the timing of a frame of image data, and a delay time management server 50 suitable for correcting a shift in the timing of a frame of image data. In FIG. 13, as in FIG. 10, the image transmission / reception apparatus 120B receives the image data transmitted from the image transmission / reception apparatuses 120A and 120C. The image transmission / reception apparatus 120B has a vertical synchronization delay circuit 123. The vertical synchronization delay circuit 123 receives the image data transmitted from the image transmission / reception apparatuses 120A and 120C received by the transmission / reception unit 121 and the image data output from the camera 11. The vertical synchronization signals of the image data transmitted from the image transmission / reception apparatuses 120A and 120C are assumed to be delayed with respect to the vertical synchronization signal of the image data output from the camera 11. The image transmission / reception apparatus 120B has a vertical synchronization delay circuit 123. The vertical synchronization delay circuit 123 receives the image data transmitted from the image transmission / reception apparatuses 120A and 120C received by the transmission / reception unit 121 and the image data output from the camera 11. .

[0091] The image transmission / reception apparatus 120B has a vertical synchronization delay circuit 123. The vertical synchronization delay circuit 123 receives the image data transmitted from the image transmission / reception apparatuses 120A and 120C received by the transmission / reception unit 121 and the image data output from the camera 11. The vertical synchronization delay circuit 123 receives the image data transmitted from the image transmission / reception apparatuses 120A and 120C received by the transmission / reception unit 121 and the image data output from the camera 11. The vertical synchronization signals of the image data transmitted from the image transmission / reception apparatuses 120A and 120C are assumed to be delayed with respect to the vertical synchronization signal of the image data output from the camera 11.

[0092] The vertical synchronization delay circuit 123 delays the vertical synchronization signal of the image data transmitted from the image transmission / reception apparatuses 120A and 120C with respect to the vertical synchronization signal of the image data output from the camera 11. delay​ Delay the vertical synchronization of the image data output from the camera 11 so as to reduce the deviation. The deviation amount of the vertical synchronization signal of the image data transmitted from the image transmission / reception apparatuses 120A and 120C If they are different, the vertical synchronization delay circuit 123 delays the vertical synchronization of the image data with the smaller deviation amount and makes it coincide with the one with the larger deviation amount. The vertical synchronization delay circuit 123 delays the image data from the camera 11 so as to match the deviation amount, thereby matching the vertical synchronization of the three pieces of image data. Match the vertical synchronization.

[0093] The vertical synchronization delay circuit 123 supplies the first delay time of the vertical synchronization signal of the image data transmitted from the image transmission / reception apparatus 120A with respect to the vertical synchronization signal of the image data output from the camera 11, and the second delay time of the vertical synchronization signal of the image data transmitted from the image transmission / reception apparatus 120C to the transmission / reception unit 121. The vertical synchronization delay circuit 123 functions as a vertical synchronization deviation amount measurement unit that measures the first and second delay times. The transmission / reception unit 121 transmits the first and second delay times to the delay time management server 50 via the network 30 based on the control by the control unit 122. Assume that the first delay time is 3.2 ms and the second delay time is 0.3 ms.

[0094] As shown in FIG. 14, the delay time management server 50 stores the delay time obtained by adding the first delay time of 3.2 ms to the delay time of 10.3 ms when the base B1 is the transmission side and the base B2 is the reception side. The delay time management server 50 also stores the delay time obtained by adding the second delay time of 0.3 ms to the delay time of 10.2 ms when the base B3 is the transmission side and the base B2 is the reception side. Assume that the first delay time is 3.2 ms and the second delay time is 0.3 ms.

[0095] As shown in FIG. 14, when the delay time management server 50 sets the base B1 as the transmission side and the base B2 as the reception side, it stores the delay time obtained by adding the first delay time of 3.2 ms to the delay time of 10.3 ms. When the delay time management server 50 sets the base B3 as the transmission side and the base B2 as the reception side, it stores the delay time obtained by adding the second delay time of 0.3 ms to the delay time of 10.2 ms. When the delay time management server 50 sets the base B3 as the transmission side and the base B2 as the reception side, it stores the delay time obtained by adding the second delay time of 0.3 ms to the delay time of 10.2 ms. When the delay time management server 50 sets the base B3 as the transmission side and the base B2 as the reception side, it stores the delay time obtained by adding the second delay time of 0.3 ms to the delay time of 10.2 ms. Store the time.

[0096] Delay time correction values of the timing instruction unit 29 in the image transmission / reception devices 120A and 120C The holding units 294 respectively hold delay times (10.3 + 3.2) ms and (10.2 + 0.3 ) ms as delay time correction values.

[0097] The control unit 291 of the timing instruction unit 29 in the image transmission / reception device 120A starts the performance at a time (10.3 + 3.2) ms before the time when the performance starts, and notifies the display unit 295 of the timing to start the performance by displaying a signal. In the image transmission / reception device 120C The control unit 291 of the timing instruction unit 29 notifies the display unit 295 of the timing to start the performance at a time (10.2 + 0.3 ) ms before the time when the performance starts by displaying a signal. It is displayed on 295.

[0098] As a result, the image data displayed on the display device 22 at the base B2 is not only displayed in a state where the performance timings of all of the bases B1 to B3 match, but also the deviation in the timing of the frames of the image data generated by the image transmission / reception devices 120A to 120C is corrected.

[0099] Over time, with respect to the vertical synchronization signal of the image data output from the camera 11, if the vertical synchronization signal of the image data transmitted from the image transmission / reception device 120A or 120C is deviated the vertical synchronization of the image data output from the camera 11 can be delayed by the vertical synchronization delay circuit 123 so as to reduce the deviation of the vertical synchronization signal.

[0100] Furthermore, with respect to the vertical synchronization signal of the image data output from the camera 11, for the image transmission / reception device ​​The first delay time of the vertical synchronization signal of the image data transmitted from the image transmission device 120A and the second delay time of the vertical synchronization signal of the image data transmitted from the image transmission device 120C are transmitted to the delay time management server 50 and updated to the latest first and second delay times. Therefore, the timing of the frames of the image data generated by the image transmission / reception devices 120A to 120C is always corrected to an optimal state at predetermined intervals. As described above, in the image transmission system shown in FIG. 13, an image transmission device (image transmission / reception device 120A or 120C) including a first camera (camera 11) and an image reception device including a second camera (camera 11) and a display device 22 are connected via a network 30. The image reception device (image transmission / reception device 120B) includes a delay time measurement unit 28 and a vertical synchronization delay circuit 123 that functions as a vertical synchronization deviation amount measurement unit. The delay time measurement unit 28 measures the delay time when the image reception device receives the first image data generated by the first camera and transmitted by the image transmission device to the image reception device and displays it on the display device 22. The vertical synchronization delay circuit 123 measures the vertical synchronization deviation amount indicating the time when the vertical synchronization between the first image data and the second image data generated by the second camera and displayed on the display device 22 is deviated. The delay time management server 50 stores the delay time and the vertical synchronization deviation amount transmitted from the image reception device via the network 30. The image transmission system shown in FIG. 13 is such that the first camera included in the image transmission device arranged at the transmission-side base captures a first subject performing a predetermined operation to generate the first

[0101] As described above, in the image transmission system shown in FIG. 13, via the network 30, an image transmission device (image transmission / reception device 120A or 120C) including a first camera (camera 11) and an image reception device including a second camera (camera 11) and a display device 22 are connected. The image reception device (image transmission / reception device 120B) includes a delay time measurement unit 28 and a vertical synchronization delay circuit 123 that functions as a vertical synchronization deviation amount measurement unit. The delay time measurement unit 28 measures the delay time when the image reception device receives the first image data generated by the first camera and transmitted by the image transmission device to the image reception device and displays it on the display device 22. The vertical synchronization delay circuit 123 measures the vertical synchronization deviation amount indicating the time when the vertical synchronization between the first image data and the second image data generated by the second camera and displayed on the display device 22 is deviated. The delay time management server 50 stores the delay time and the vertical synchronization deviation amount transmitted from the image reception device via the network 30.

[0102] The delay time measurement unit 28 measures the delay time when the image reception device receives the first image data generated by the first camera and transmitted by the image transmission device to the image reception device and displays it on the display device 22. The vertical synchronization delay circuit 123 measures the vertical synchronization deviation amount indicating the time when the vertical synchronization between the first image data and the second image data generated by the second camera and displayed on the display device 22 is deviated. The delay time management server 50 stores the delay time and the vertical synchronization deviation amount transmitted from the image reception device via the network 30. The image transmission system shown in FIG. 13 is such that the first camera included in the image transmission device arranged at the transmission-side base captures a first subject performing a predetermined operation to generate the first image data, and the second camera included in the image transmission device arranged at the transmission-side base captures a second subject performing a predetermined operation to generate the second image data. The first image data and the second image data are transmitted to the image reception device via the network 30.

[0103] The image transmission system shown in FIG. 13 is such that the first camera included in the image transmission device arranged at the transmission-side base captures a first subject performing a predetermined operation to generate the first image data, and the second camera included in the image transmission device arranged at the transmission-side base captures a second subject performing a predetermined operation to generate the second image data. The image data is transmitted to an image receiving device located at a reference site via a network 30. The timing adjustment method performed in the image transmission system is The delay time when the first image data is displayed on the display device 22 is measured.

[0104] The timing adjustment method performed in the image transmission system includes: The second camera of the device captures a second subject performing a predetermined action. and measuring a vertical synchronization deviation amount indicating a time during which vertical synchronization with the second image data generated by the second image data is deviated. The timing adjustment method performed in the image transmission system is a timing adjustment method that uses a timer located at the transmitting site. The delay time based on the delay time obtained by adding the delay time and the vertical synchronization deviation amount is input to the timing instruction unit 29. Set the time correction value.

[0105] The timing adjustment method performed in the image transmission system is performed by the timing instruction unit 29. The delay time correction value is calculated based on the time when the first subject is instructed to start a predetermined action. The timing for starting the specified action is set to be notified to the first subject at a time before the time when the first subject starts the specified action. Figure.

[0106] According to one or more embodiments of the delay time management server, the delay time management server operates as an image transmission device. The image transmitting / receiving device 120 transmits the image to the image receiving device 100 via the network 30. More accurate delay time and vertical synchronization when transmitting image data to the image transmitting / receiving device 120 By using the timing adjustment method according to one or more embodiments, If the image is captured, the subject performing a predetermined action performed separately at the transmitting site and the reference site is Timing, including the timing of frames of image data when the data is displayed at a reference point It can be adjusted to match the "グ".

[0107] The present invention is not limited to one or more of the embodiments described above, and various modifications can be made without departing from the gist of the present invention.

Explanation of Reference Numerals

[0108] 10, 10A to 10C Image transmission device 11 Camera 12 Transmission unit 13, 23 GNSS satellite radio clock 14, 24 Clock generation unit 15, 27 Image memory 16, 25 Communication unit 20 Image reception device 21 Reception unit 22 Display device 26, 113 Image processing circuit 28 Delay time measurement unit 29 Timing instruction unit 30 Network 40 Satellite 50 Delay time management server 111, 122, 221 Control unit 112 Image sensor 120A to 120C Image transceiver 121 Transceiver 123 Vertical synchronization delay circuit (vertical synchronization deviation amount measurement unit) 150, 270 Write / read control unit 222 Drive circuit 223 Liquid crystal panel​

Claims

1. The first clock number, the second clock number, the third clock number, and the a first communication unit for receiving image data on which at least one of the block numbers is superimposed, 、 The first clock number is generated by a first clock generating unit included in the image transmitting device. A first clock including time information based on radio waves received from a satellite for a global navigation satellite system. The image sensor of the camera of the image transmission device is a frame number. The pixel data of the reference pixel in the frame is generated. The second clock number is a clock number in the first clock, and the image A first write / read control unit included in the image transmitting device writes the pixel data of the reference pixel to a first image Indicates the time when the data was written to memory. The third clock number is a clock number in the first clock, and the image a time when a second communication unit included in the image transmitting device transmits pixel data of the reference pixel; time information based on radio waves received from a satellite for the global navigation satellite system; a second clock generating unit that generates a second clock identical to the first clock; The second clock operates, and the second write / read control unit controls the second write / read control unit to read the previous data. a second image memory into which the image data is written and from which the image data is read; a display device that displays the image data read from the second image memory; Any one of the first to third clock numbers and the first communication unit a fourth clock in the second clock indicating the time when the pixel data of the reference pixel is received by the The second write / read control unit writes the pixel data of the reference pixel to the second pixel. a fifth clock number in the second clock indicating the time of readout from the image memory; The second clock indicates a time when the display device displays the pixel data of the reference pixel. and a sixth clock number in the second clock number. A delay time measurement unit for determining The image receiving device further comprises:

2. The image data transmitted from the image transmitting device includes a first clock number, a second clock number, and at least one of the first clock number, the second clock number, and the third clock number is superimposed; The first clock number is generated by a first clock generating unit included in the image transmitting device. A first clock including time information based on radio waves received from a satellite for a global navigation satellite system. The image sensor of the camera of the image transmission device is a frame number. The pixel data of the reference pixel in the frame is generated. The second clock number is a clock number in the first clock, and the image A first write / read control unit included in the image transmitting device writes the pixel data of the reference pixel to a first image Indicates the time when the data was written to memory. The third clock number is a clock number in the first clock, and the image a time when a first communication unit included in an image transmitting device transmits pixel data of the reference pixel; The image receiving device that received the image data receives a fourth clock number, a fifth clock number, , a sixth clock number; The fourth clock number is received from a satellite for the global navigation satellite system. a clock number of a second clock identical to the first clock that includes time information based on the first clock a second communication unit included in the image receiving device receives pixel data of the reference pixel; Shows the time, The fifth clock number is a clock number in the second clock, and the image A second write / read control unit provided in the image receiving device writes the image data to a second image memory. and indicates the time when the pixel data of the reference pixel is read out from the second image memory. The sixth clock number is a clock number in the second clock, and the image A display device provided in the image receiving device displays the image of the reference pixel read from the second image memory. Indicates the time when the raw data was displayed, Any one of the first to third clock numbers and any one of the fourth to sixth clock numbers The difference between the clock numbers and any one of the clock numbers is calculated, The image data generated by the image receiving device and transmitted to the image receiving device is received by the image receiving device. Measure the delay time when Delay time measuring device.

Images