Information processing system, information processing method, and information processing program

Abstract

This invention provides an information processing system, an information processing method, and an information processing program that eliminate the need to install a clock unit and improve the accuracy of the time of photography. [Solution] The information processing system comprises an image generation unit that generates image information from images of subjects captured by a camera unit, a time synchronization information acquisition unit that acquires synchronization signals and time information, a clock correction unit that corrects the system clock using the synchronization signals and time information, a cell clock image generation unit that generates cell clock images representing the time of the system clock based on the color combinations of multiple cells, a composite image generation unit that generates a composite image by combining the cell clock images with the image information, and a time acquisition unit that extracts cell clock images from the composite image and acquires the time of the system clock from the color combinations of the cell clock images.

Description

Technical Field

[0001] The present disclosure relates to an information processing system, an information processing method, and an information processing program.

Background Art

[0002] In general, although cameras are capable of recording the shooting time in image information, in recent years, there has been a demand for more accurately ascertaining the time at which an image was captured by a camera. When the imaging time is recorded in image information based on the time measured by the camera, there is a risk of deviation in the time measured by the camera. In addition, due to delays in internal processing within the camera from when the measured time is read out to when it is recorded as the shooting time in the image information, a discrepancy may occur between the movement of the subject reflected in the image and the time recorded in the image. Even when shooting is performed based on a timecode provided by a control unit external to the camera, processing delays and the like may similarly occur. In response to these issues, a system is disclosed in which a clock unit including a plurality of light emitting units and representing time by a combination of light emission and non-light emission of each of the plurality of light emitting units is installed within the shooting range of a camera, the subject and the installed clock are imaged by the camera, the image of the clock unit is extracted from the generated image information, and the time is acquired from the combination of light emission and non-light emission of the clock unit (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, there have been problems such as that the accurate time cannot be read if the light emitting units are made to display at intervals of 100 microseconds or less and shooting is performed with a general camera, and that adjustment of the arrangement for clear shooting and handling of light intensity and the like when installing the clock unit requires extremely large effort.

[0005] This disclosure provides an information processing system, an information processing method, and an information processing program that eliminate the need to install a clock unit and improve the accuracy of the time of capture. [Means for solving the problem]

[0006] One embodiment of the information processing system includes: an image generation unit that generates image information from an image of a subject captured by a camera unit; a time synchronization information acquisition unit that acquires a synchronization signal and time information; a clock correction unit that acquires a synchronization signal and time information and corrects the system clock using the synchronization signal and time information; a cell clock image generation unit that generates a cell clock image representing the time of the system clock, comprising multiple cells and a combination of the colors of each of the multiple cells; a composite image generation unit that generates a composite image by combining the cell clock image generated by the cell clock image generation unit with the image information generated by the image generation unit; and a time acquisition unit that extracts a cell clock image from the composite image and acquires the time of the system clock from the combination of light emission and non-emission of the cell clock image. [Effects of the Invention]

[0007] According to one embodiment, there is no need to install a clock unit, and the accuracy of the time of shooting can be improved. [Brief explanation of the drawing]

[0008] [Figure 1] This is a schematic diagram showing an example of the information processing system according to this embodiment. [Figure 2] This block diagram shows an example of the configuration and functional parts of the information processing system according to this embodiment. [Figure 3] This is a schematic diagram showing images generated by each component of the information processing system according to this embodiment. [Figure 4] This figure shows an example of the timing of NMEA-formatted time information and 1PPS data output by the time synchronization infrastructure of the information processing system according to this embodiment. [Figure 5] This is a diagram illustrating an example of a cell clock image. [Figure 6] This diagram illustrates an example of time in a cell clock image. Figure 6(a) shows the year, month, day, hour, minute, second, and microseconds; Figure 6(b) shows UNIX® time (UNIXTIME); Figure 6(c) shows the time represented in binary (year, month, day, hour, minute, second); Figure 6(d) shows the time represented in binary (microseconds); and Figure 6(e) shows the time represented by the colors in the cell clock image. [Figure 7] This is a schematic diagram showing an example of the information processing system according to this embodiment for calculating the offset. [Figure 8] This is a schematic diagram showing the images generated by each component of the information processing system according to this embodiment when calculating the offset. [Figure 9] This diagram illustrates the sizes of multiple cells in a cell clock image. [Figure 10] This is a flowchart illustrating the information processing method according to this embodiment. [Modes for carrying out the invention]

[0009] Next, embodiments of the present invention will be described with reference to the drawings. In the drawings of the embodiments, identical or similar parts are denoted by the same or similar reference numerals. However, it should be noted that the drawings are schematic and the relationships with planar dimensions etc. may differ from those in reality. Therefore, specific dimensions should be determined by referring to the following explanation. Furthermore, it goes without saying that there are parts in the drawings where the relationships and ratios of dimensions differ from those of other parts.

[0010] Furthermore, the embodiments are illustrative of apparatus and methods for realizing the technical concept of the present invention, and the technical concept of the present invention does not limit the configuration, arrangement, layout, etc., of each component to those described below. The technical concept of the present invention can be modified in various ways within the technical scope defined by the claims described in the patent claims.

[0011] (First Embodiment) The information processing system according to the present embodiment generates a clock image using a synchronization signal and time information acquired from a time synchronization infrastructure, and combines the image information obtained by photographing with a camera and the clock image to generate a combined image. The information processing system according to the present embodiment extracts the clock image from the generated combined image and acquires the time when the image was captured by the camera.

[0012] FIG. 1 shows an example of the outline of the information processing system according to the present embodiment. As shown in FIG. 1, the information processing system 10 according to the present embodiment includes, as an example, a camera unit 11, a time synchronization infrastructure 12, and an information processing apparatus 13.

[0013] The camera unit 11 photographs a subject (not shown) to generate a captured image. The camera unit 11 is a digital camera including a CCD element, a CMOS image sensor, and the like.

[0014] The time synchronization infrastructure 12 acquires a synchronization signal and time information. The time synchronization infrastructure 12 may be a Global Navigation Satellite System (GNSS) receiver, and may be a device that acquires positioning signals from positioning satellites via GNSS. GNSS is a system that receives satellite signals from satellites to position position information, and examples thereof include GPS (Global Positioning System), GLONASS (Global Navigation Satellite System), Galileo, QZSS (Quasi Zenith Satellite System)

[0015] Although the time synchronization infrastructure 12 that acquires positioning signals from positioning satellites via GNSS is used as the device for acquiring the synchronization signal and time information in the present embodiment, any device may be used as long as it can acquire the synchronization signal and time information. For example, the device for acquiring the synchronization signal and time information may be a time synchronization infrastructure using an atomic clock.

[0016] The information processing device 13 generates shooting information from the captured image generated by the camera unit 11. Further, the information processing device 13 acquires a synchronization signal and time information included in the positioning signal acquired from the positioning signal acquisition unit, corrects the system clock using the synchronization signal and the time information, and generates a cell clock image representing the time of the system clock. Further, the information processing device 13 combines the cell clock image with the image information to generate a combined image.

[0017] The information processing device 13 may be various electronic computers (computing resources) such as a personal computer (PC), a mainframe, a workstation, and a cloud computing system. The information processing device 13 performs mutual communication with each of the camera unit 11 and the time synchronization infrastructure 12. Further, the information processing device 13 stores an information processing program to be described later.

[0018] Figure 2 shows an example of the configuration and functional units of the information processing system shown in Figure 1.

[0019] The information processing device 13 includes a CPU 21 for executing various calculations, a ROM 22 for storing processing programs, a RAM 23 for storing data and the like, a storage unit 24 for storing various data and calculation results, an I / O (Input / Output Interface) 25, and the like.

[0020] The storage unit 24 may store various information and programs including the information processing program according to the present embodiment. An example of the storage unit 24 may be a memory, a solid state drive, a hard disk drive, or the like. Note that the storage unit 24 may be, for example, a storage area on the cloud, a server, or the like.

[0021] The I / O 25 is, for example, a communication interface, a buffer, or the like capable of transmitting and receiving various information to and from devices external to the information processing device 13.

[0022] Furthermore, the block diagram in Figure 2 shows the functional units within the CPU 21. When each functional unit of the CPU 21 is implemented by software, the CPU 21 is implemented by executing instructions of the program, which is the software that implements each function. In detail, the CPU 21 includes an image generation unit 210, a clock correction unit 211, a cell clock image generation unit 212, a composite image generation unit 213, a time acquisition unit 214, and the like.

[0023] The image generation unit 210 generates image information from the captured image of the subject taken by the camera unit 11.

[0024] The clock correction unit 211 acquires the synchronization signal and time information included in the positioning signal acquired from the positioning signal acquisition unit, and corrects the system clock using the synchronization signal and time information.

[0025] The cell clock image generation unit 212 has multiple cells and generates a cell clock image representing the time of the system clock based on the color combination of each of the multiple cells.

[0026] The composite image generation unit 213 generates a composite image by combining the image information generated in the image generation unit with the cell clock image generated in the cell clock image generation unit.

[0027] The time acquisition unit 214 extracts a cell clock image from the composite image and obtains the system clock time from the combination of illuminated and non-illuminated cell clock images.

[0028] The time synchronization board 12 includes a time synchronization information acquisition unit 121 that acquires synchronization signals and time information. In this embodiment, assuming the time synchronization board 12 is a GNSS receiver, the time synchronization information acquisition unit 121 acquires positioning signals including synchronization signals and time information from positioning satellites. The time synchronization board 12 may further include a GNSS antenna, CPU, ROM, RAM, storage unit, I / O, etc., but these are omitted in Figure 2.

[0029] The time synchronization board 12 may output time information in NMEA format and PPS data as a synchronization signal after acquiring a positioning signal from a positioning satellite. NMEA (National Marine Electronics Association) format is one of the data formats output as a positioning result from a GNSS receiver. NMEA format data contains position and time information in text format. PPS (Pulse Per Second) data is a pulse signal output at predetermined intervals. For example, 1PPS indicates that a pulse signal is output once every second.

[0030] In Figures 1 and 2, the information processing device 13 is depicted as a single device, but it is not limited to this. The various functional units of the CPU 21, such as the image generation unit 210, the clock correction unit 211, the cell clock image generation unit 212, and the composite image generation unit 213, may be mounted on hardware that performs specific processing, such as an FPGA, rather than on the information processing device 13, and this hardware may be connected to the information processing device 13.

[0031] Next, we will explain the details of the operation of each component of the information processing system shown in Figure 2. Figure 3 shows the images generated by each component of the information processing system 10.

[0032] When the camera unit 11 captures a subject and generates a captured image, the image generation unit 210 acquires the generated captured image and, if necessary, converts the captured image into a format suitable for processing by the composite image generation unit 213 to generate the image information 31 shown in Figure 3(a). The captured image acquired by the image generation unit 210 is transmitted via HDMI®, USB, etc., and the video format is uncompressed RGB, MJPEG, H.264, etc.

[0033] The time synchronization information acquisition unit 121 of the time synchronization board 12 acquires positioning signals from positioning satellites. As shown in Figure 4, the time synchronization board 12 outputs NMEA format time information and 1PPS data as a synchronization signal. Figure 4 shows an example of the timing of the NMEA format time information and 1PPS data output by the time synchronization board 12. As shown in Figure 4, at time T, the time synchronization board 12 outputs a pulse signal as PPS data and simultaneously outputs NMEA format time information. RMC is a sentence that summarizes positioning information to the minimum extent possible, and in the example shown in Figure 4, the time synchronization board 12 outputs RMC as NMEA format time information. The time of the NMEA format time information output by the time synchronization board 12 at time T simultaneously with the output of the pulse signal is time T. At time T+1 seconds, the time synchronization board 12 outputs a pulse signal and simultaneously outputs NMEA format time information. The time of the time information at this time is time T+1 seconds. The time synchronization board 12 repeats this operation at predetermined intervals, every second in the example shown in Figure 4.

[0034] The clock correction unit 211 receives time information and a synchronization signal at predetermined intervals, receives the time information and the synchronization signal at the first timing, stores the received synchronization signal and the time information in memory, and at the second timing, after a predetermined period following the first timing, receives the time information and the synchronization signal, corrects the time at the second timing to the time stored in memory at the first timing plus a predetermined period. The operation of the clock correction unit 211 will be explained with reference to the example shown in Figure 4, where the first timing is time T and the second timing is time T+1 seconds. In the example shown in Figure 4, the clock correction unit 211 receives a positioning signal every second. The clock correction unit 211 receives the positioning signal at time T and stores the synchronization signal included in the received positioning signal and the time information in memory. Next, when the clock correction unit 211 receives time information and a synchronization signal at time T+1 seconds as a second timing, it corrects the system clock at the second timing to a time obtained by adding a predetermined period of 1 second to the time T received at the first timing, which is stored in memory, i.e., time T+1 seconds.

[0035] The cell clock image generation unit 212 comprises multiple cells and generates a cell clock image representing the time of the system clock based on the color combinations of the multiple cells. An example of a cell clock image 50 generated by the cell clock image generation unit 212 is shown in Figure 5. As shown in Figure 5, the cell clock image 50 comprises multiple cells 51.

[0036] Cell 51 contains a number corresponding to the content (time) to be measured. As an example, the cell clock image generation unit 212 converts the system clock time, expressed as year, month, day, hour, minute, second, and microseconds, into UNIX time (UNIXTIME). UNIX time is calculated based on the elapsed seconds from 00:00:00 AM on January 1, 1970, Coordinated Universal Time (UTC). The cell clock image generation unit 212 can convert the current time (year, month, day, hour, minute, second, microseconds) into UNIX time through various calculations. As another example, the cell clock image generation unit 212 can represent UNIX time in binary. In this case, the cell clock image generation unit 212 represents the year, month, day, hour, minute, second with 32 bits and the microsecond with 20 bits. The cell clock image generation unit 212 can convert UNIX time into time expressed in binary through various calculations. In the case described above, the cell clock image generation unit 212 has a total of 64 (or at least 52) ​​cells 51 arranged in an 8x8 configuration, making it possible to represent the year, month, day, hour, minute, second, and microseconds as a binary time (color of the cell 51). As mentioned above, cell 51 contains a number corresponding to the time, so the number may be changed depending on the number of bits in the time being measured.

[0037] The cell clock image 50 comprises a cell area 111 that shows the year, month, day, hour, minute, and second (date and time), a cell area 112 that shows microseconds, and a cropped symbol area 113 when the cell clock image 50 is cropped from the image 201 (see Figure 5). The cell clock image 50 can be called a cell clock because it represents the time using multiple cells 51. In other words, the cell clock image 50 may be a cell clock that represents the time using the respective colors of the multiple cells 51. The cell clock image 50 can display the year, month, day, hour, minute, second, and the time below the microsecond by combining the colors of the multiple cells 51, and the year, month, day, hour, minute, second and the time below the microsecond may be displayed in the same color scheme. Alternatively, the cell clock image 50 may display at least two of the timing contents of the year, month, day, hour, minute, second, and the time below the microsecond in different color schemes.

[0038] Furthermore, the cell clock image 50 may display the symbols (cells 101) (extracted symbol area 113) used when cutting out (extracting) the cell clock image 50 (multiple cells 101) from the image 201, as described later, in a different color scheme from the year, month, day, hour, minute, and second (cell area 111 indicating the day and time) and the time less than a microsecond (cell area 112 indicating the microsecond) (see Figure 3). The symbols may be indicated, for example, by the illumination of cells 101a located at the four corners of the multiple cells 51. In this case, when the timekeeping unit 100 displays the year, month, day, hour, minute, second, and the time less than a microsecond in red, the symbols (cells 101a) may be indicated by color. Furthermore, in a timekeeping unit 100 with, for example, 64 cells (cells 101) in an 8x8 grid, the shape of the cropped symbol 113 may be changed (such as the arrangement of the 12 cells of the cropped symbol 113) to make it easier to recognize the cell clock image 50 (multiple cells 51) by using the remaining 12 cells (cells 101) after excluding the 52 cells (cells 101) that represent the time.

[0039] Figure 6 is a diagram illustrating an example of the system clock time acquired by the cell clock image generation unit 212. Figure 6(a) shows the year, month, day, hour, minute, second, and microseconds; Figure 6(b) shows the UNIX time (UNIXTIME); Figure 6(c) shows the time represented in binary for the year, month, day, hour, minute, and second; Figure 6(d) shows the time represented in binary for microseconds; and Figure 6(e) shows the time represented by the colors of the cell clock image 50 (multiple cells 51).

[0040] The system clock time acquired by the cell clock image generation unit 212 is, for example, as follows: Specifically, as an example, we will explain the case where the cell clock image generation unit 212 obtains December 31, 2022, 23:59:59.999999 seconds as the system clock time (see Figure 6(a)). In this case, the cell clock image generation unit 212 converts the time shown in Figure 6(a) into UNIX time through various calculations, obtaining 1671407999.999999 as UNIX time (see Figure 6(b)). The cell clock image generation unit 212 converts the UNIX time, specifically the year, month, day, hour, minute, and second (1671407999), into binary using various calculations to obtain the time (binary year, month, day, hour, minute, and second) 01100011100111111010100101111111 (32 bits) (see Figure 6(c)). Similarly, the cell clock image generation unit 212 converts the time 999999, which represents microseconds in UNIX time, into binary through various calculations to obtain the time (binary microseconds) 11110100001000111111 (20 bits) (see Figure 6(d)). The cell clock image generation unit 212 then converts the binary year, month, day, hour, minute, and second shown in Figure 6(c) into "1 Let it be light emission, and "0 With the non-emitting portion, the areas representing the year, month, day, hour, minute, and second of multiple cells 51 are arranged from the upper left (represented by color in order from the most significant bit) (see Figure 6(e)). Similarly, the cell clock image generation unit 212 generates "1" of the binary microseconds in Figure 6(d). Set the background color to "0" Using this as the background color, the areas representing microseconds of multiple cells 51 are arranged from the upper left (represented by color in order from the most significant bit) (see Figure 6(e)). Here, the area of ​​the cell clock image 50 excluding multiple cells 51 is used as the background color. If the background color of the cell clock image 50 is black, then the cell color is "1" of the binary microseconds in Figure 6(d). For example, yellow, red, etc., are colors other than the background color, and "0 The background color is black. The cell clock image generation unit 212 generates a cell clock image 50 representing the time by switching the colors of multiple cells 51 according to the time of the system clock.

[0041] As shown in Figure 3(b), the composite image generation unit 213 generates a composite image 34 by combining the image information 31 generated in the image generation unit 210 with the cell clock image 50 generated in the cell clock image generation unit.

[0042] The time acquisition unit 214 extracts a cell clock image 50 from the composite image 34 shown in Figure 3(c) and acquires the time captured by the camera unit 11 from the color combination of multiple cells 51.

[0043] After the camera unit 11 captures a subject and generates an image, a video transmission delay occurs between the time the image generation unit 210 receives the captured image. When transmitting between the camera unit 11 and the image generation unit 210 using the HDMI method, a transmission delay of approximately 0.1 seconds occurs. In addition, video processing delays occur in the image generation unit 210, the clock correction unit 211, the cell clock image generation unit 212, and the composite image generation unit 213. Due to these delays, a discrepancy occurs between the time of the cell clock image 50 in the composite image 32 and the time when the camera unit 11 captured the subject. To correct this discrepancy, an offset value is calculated using the following procedure, and when the cell clock image generation unit 212 generates the cell clock image, it uses the time obtained by subtracting the offset time from the time of the system clock.

[0044] Figure 7 shows an example of the overview of the information processing system 10 when calculating the offset, and Figure 8 shows images generated by each component of the information processing system 10 when calculating the offset. As shown in Figures 7 and 8, in order to calculate the offset value, first, when the camera unit 11 photographs a subject and generates an image, a second cell clock is installed within the imaging range captured by the camera unit 11, and the camera unit 11 takes a photograph to generate an image. The second cell clock is equipped with multiple second light-emitting units, acquires a second positioning signal from a positioning satellite, and displays the time of the second time information included in the second positioning signal by the combination of light emission and non-emission of each of the multiple second light-emitting units. The second cell clock is installed within the imaging range captured by the camera unit 11 when calculating the offset value.

[0045] While the cell clock image generation unit 212 generates a cell clock image 50 that represents the time using the color of cell 51 based on the time of the system clock, the second cell clock is a device that displays the time using a combination of illumination and non-illumination of each of the multiple second light-emitting units, based on the time of the second time synchronization board 74. Except for the difference that the second cell clock represents the time using a combination of illumination and non-illumination based on the time of the second time synchronization board 74, and the cell clock image 50 represents the time using the color of cell 51 based on the time of the system clock, the methods of displaying the time in the cell clock image 50 and the second cell clock are the same.

[0046] The second time synchronization base 74 may be any device capable of acquiring the second synchronization signal and the second time information, and may be a base that acquires positioning signals from positioning satellites using GNSS, or it may be a time synchronization base that utilizes, for example, an atomic clock.

[0047] Next, the composite image generation unit 213 acquires image information 71 in which the subject and the second cell clock are captured in the same image, and generates a composite image 73 by combining the cell clock image 50 with the acquired image information 71. The information processing system 10 may further include an offset calculation unit, which extracts the second cell clock 72 and the cell clock image 50 from the composite image 73, and acquires the time of the second time information and the time of the system clock from the combination of illumination and non-illumination of the second cell clock 72 and the color combination of the cell clock image 50. The offset is calculated from the time of the second time information and the time of the system clock.

[0048] When the composite image generation unit 213 generates a composite image and the time acquisition unit 214 extracts the cell clock image 50 from the composite image 32 and displays the composite image on the monitor, the cell clock image 50 may not be clear enough to acquire the time due to compression during image transmission or the low resolution of the monitor.

[0049] In contrast, as shown in Figure 9, the shape of each of the multiple cells 51 in the cell clock image 50 is made into a square with sides of at least 5 pixels. The multiple cells 51 in the cell clock image 50 shown in Figure 9 are squares with sides of 5 pixels, and the center of each cell 51 is a square with sides of 3 pixels. By making the shape of the multiple cells 51 in the cell clock image 50 in this way, it becomes possible to distinguish the colors of the multiple cells 51.

[0050] The telemedicine method according to this embodiment will be explained with reference to the flowchart in Figure 10.

[0051] In step S1001, the image generation function generates image information from the captured image of the subject taken by the camera unit (image generation step).

[0052] In step S1002, the time synchronization information acquisition function acquires the synchronization signal and time information (time synchronization information acquisition step).

[0053] In step S1003, the clock correction function acquires the synchronization signal and time information, and corrects the system clock using the synchronization signal and time information (clock correction step).

[0054] In step S1004, the cell clock image generation function generates a cell clock image that represents the time of the system clock, using a combination of colors for each of the multiple cells (cell clock image generation step).

[0055] In step S1005, the composite image generation function generates a composite image by combining the image information generated in the image generation step with the cell clock image generated in the cell clock image generation step (composite image generation step).

[0056] In step S1006, the time acquisition function extracts a cell clock image from the composite image and obtains the system clock time from the combination of illuminated and non-illuminated cell clock images (time acquisition step).

[0057] As stated above, the present invention naturally includes various embodiments and the like that are not described herein. Therefore, the technical scope of the present invention is determined solely by the inventive features relating to the claims that are reasonable based on the above description. [Explanation of Symbols]

[0058] 10 Information Processing Systems 11 Camera Section 12 Time synchronization infrastructure 13 Information Processing Devices 21 CPU 22 ROM 23 RAM 24 Memory section 25 I / O (Input / Output Interface) 210 Image generation unit 211 Clock Correction Section 212 Cell Clock Image Generation Unit 213 Composite Image Generation Unit 214 Time acquisition section 31 Image Information 34 Composite Images 50 Cell Clock Image 51 Multiple Cells 71 Image Information 72. Second Cell Clock 73 Composite Images 74 Second Time Synchronization Platform

Claims

1. An image generation unit generates image information from the image of the subject captured by the camera unit, A time synchronization information acquisition unit that acquires synchronization signals and time information, A clock correction unit that acquires the synchronization signal and the time information, and corrects the system clock using the synchronization signal and the time information, A cell clock image generation unit comprising multiple cells, which generates a cell clock image representing the time of the system clock based on the color combination of each of the multiple cells, A composite image generation unit generates a composite image by combining the image information generated in the image generation unit with the cell clock image generated in the cell clock image generation unit, A time acquisition unit extracts the cell clock image from the composite image and obtains the time of the system clock from the color combination of the cell clock image. An information processing system equipped with the following features.

2. The information processing system according to claim 1, wherein the time synchronization information acquisition unit is a satellite positioning system receiver, acquires positioning signals from positioning satellites, and the synchronization signals and time information are included in the positioning signals.

3. The information processing system according to claim 1, characterized in that the clock correction unit receives the time information and synchronization signal at predetermined intervals, receives the time information and synchronization signal at a first timing and stores the received synchronization signal and time information in memory, and at a second timing where the time information and synchronization signal are received after a predetermined period from the first timing, the time at the second timing is corrected to the time obtained by adding a predetermined period to the time information received at the first timing stored in memory.

4. The cell clock image generation unit corrects the time of the system clock using a pre-calculated time offset, and generates a cell clock image representing the corrected time of the system clock. The time offset is calculated from the second cell clock and the time offset calculation unit. The second cell clock comprises a plurality of second light-emitting units, acquires a second synchronization signal and second time information, displays the time of the second time information included in the second time information by the combination of light emission and non-emission of each of the plurality of second light-emitting units, and is installed within the imaging range captured by the camera unit. The time offset calculation unit is: The image information is obtained in which the subject and the second cell clock are captured in the same image. The second cell clock is extracted from the obtained image information, and the cell clock image is extracted from the composite image. The combination of illumination and non-illumination of the second cell clock, and the combination of illumination and non-illumination of the cell clock image are used to obtain the time of the second time information and the time of the system clock. A time offset is calculated from the time of the second time information and the time of the system clock. The information processing system according to feature 1.

5. The information processing system according to claim 1, characterized in that each of the plurality of light-emitting units is square in shape with sides of at least 5 pixels.

6. Image generation step: Generates image information from the image of the subject captured by the camera unit, A time synchronization information acquisition step that acquires synchronization signals and time information, A clock correction step which involves acquiring the synchronization signal and the time information, and correcting the system clock using the synchronization signal and the time information, A cell clock image generation step, comprising generating a cell clock image that has multiple cells and generates a cell clock image that represents the time of the system clock based on the color combination of each of the multiple cells, A composite image generation step involves combining the image information generated in the image generation step with the cell clock image generated in the cell clock image generation step to generate a composite image, A time acquisition step involves extracting the cell clock image from the composite image and obtaining the time of the system clock from the color combination of the cell clock image. An information processing method comprising the following:

7. On the computer, The camera unit generates image information from captured images of the subject, and A time synchronization information acquisition function that acquires synchronization signals and time information, A clock correction function that acquires the synchronization signal and the time information, and corrects the system clock using the synchronization signal and the time information, A cell clock image generation function that generates a cell clock image representing the time of the system clock by combining the colors of multiple cells, and A composite image generation function that generates a composite image by combining the image information generated in the image generation function with the cell clock image generated in the cell clock image generation function, A time acquisition function that extracts the cell clock image from the composite image and obtains the time of the system clock from the color combination of the cell clock image. An information processing program that makes this possible.

Images