Photographing system

Abstract

To make it possible to perform synchronous photographing at timing closer to timing intended by a photographer.SOLUTION: A photographing system has a first photographing device and a second photographing device. The first photographing device has: first generation means that generates periodic photographing timing synchronized with the second photographing device; first communication means that transmits a trigger signal to the second photographing device on the basis of a photographing instruction; and first photographing control means that controls to perform photographing at photographing timing generated by the first generation means after the transmission of the trigger signal. The second photographing device has: second generation means that generates periodic photographing timing synchronized with the first photographing device; second communication means that receives the trigger signal from the first photographing device; and second photographing control means that controls to perform photographing at photographing timing generated by the second generation means after the reception of the trigger signal.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present disclosure relates to an imaging system, an imaging device, a control method, and a program. [Background technology]

[0002] In recent years, technology that synchronizes multiple devices to operate as a system has been used in many fields. One example is the stadium vision and volumetric studio technology, which use images taken simultaneously by multiple cameras and switch between images from any viewpoint to create a free viewpoint image.

[0003] To obtain high-quality free-viewpoint images, shooting must be precisely synchronized, and Precision Time Protocol (PTP) is used as a technology to achieve time synchronization between the communication terminals that control each camera.

[0004] When multiple cameras are used for synchronous shooting, it is known that a device (sender camera) that triggers the synchronous shooting transmits a signal including time information indicating the timing of the synchronous shooting. The sender camera and a device (receiver camera) that receives the signal including the time information from the sender camera perform synchronous shooting by shooting at the time indicated by the signal.

[0005] Patent document 1 describes a method in which each camera generates a frame synchronization signal based on a timestamp, which is a future time, generated by the sender camera, and then generates image data based on the generated frame synchronization signal, thereby capturing images simultaneously. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2002-247408 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, in the method described in Patent Document 1, in which each camera is daisy-chained via an IEEE1394 interface, the time it takes for a packet to reach the last imaging device increases as the number of imaging devices increases. This causes the future time specified by the timestamp to be later than the timing specified by the photographer. This causes a discrepancy between the timing the photographer intended to capture the image and the timing when the image is actually captured.

[0008] An object of the present disclosure is to enable synchronous shooting at a timing close to that intended by the photographer. [Means for solving the problem]

[0009] The photographing system includes a first photographing device and a second photographing device, the first photographing device having a first generation means for generating periodic photographing timing synchronized with the second photographing device, a first communication means for transmitting a trigger signal to the second photographing device based on a photographing instruction, and a first photographing control means for controlling photographing to be performed at the photographing timing generated by the first generation means after transmitting the trigger signal, and the second photographing device having a second generation means for generating periodic photographing timing synchronized with the first photographing device, a second communication means for receiving the trigger signal from the first photographing device, and a second photographing control means for controlling photographing to be performed at the photographing timing generated by the second generation means after receiving the trigger signal. Effect of the Invention

[0010] According to the present disclosure, synchronous shooting can be performed at a timing close to that intended by the photographer. [Brief description of the drawings]

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Mode for Carrying Out the Invention

[0012] (First Embodiment) The first embodiment will be described below. FIG. 1 is a diagram showing a configuration example of a synchronous shooting system 100 according to the first embodiment. The synchronous shooting system 100 includes a sender camera 101 and a plurality of receiver cameras 102a to 102f. The sender camera 101 is an example of a photographing device. The receiver cameras 102a to 102f are examples of photographing devices.

[0013] The sender camera 101 is held by a photographer and determines the timing of shooting the subject 103. The receiver cameras 102a to 102f perform shooting in synchronization with the sender camera 101. The sender camera 101 and the receiver cameras 102a to 102f are directed at the subject 103.

[0014] The sender camera 101 and the receiver cameras 102a to 102f are synchronized in time via a network. This network is a wireless LAN compliant with the IEEE standard of Wi-Fi (registered trademark), but may be configured by combining a wired LAN, interconnect (Infiniband), industrial Ethernet, etc. Further, this network is not limited to these and may be another type of network.

[0015] The sender camera 101 is a camera held by a photographer and, when receiving a shooting instruction from the photographer, distributes the instruction. In the present embodiment, the sender camera 101 and the receiver cameras 102a to 102f are cameras with the same configuration and are distinguished by their roles. Note that the sender camera 101 and the receiver cameras 102a to 102f may have different configurations. Further, the sender camera 101 may be a communication device such as a smartphone or a personal computer (PC).

[0016] The receiver cameras 102a to 102f are cameras that perform shooting based on the shooting instruction distributed from the sender camera 101. In the present embodiment, the receiver cameras 102a to 102f are cameras with the same configuration as the sender camera 101 and are initially set as receiver cameras.

[0017] Hereinafter, when collectively referring to the sender camera 101 and the receiver cameras 102a to 102f, they shall be generically called "each camera".

[0018] The shooting target 103 is a target to be shot by the sender camera 101 and the receiver cameras 102a to 102f.

[0019] 2 is a block diagram showing an example of the configuration of the sender camera 101. The sender camera 101 has a communication unit 210, a control unit 220, a storage unit 230, a synchronization signal generation unit 240, an image capture control unit 250, an image processing unit 260, an image capture unit 270, and a shutter button 280. Each of the components is controlled by the control unit 220. The components 210 to 260 communicate with each other to exchange various control information, image information, and the like via a system bus. The sender camera 101 is connected to the receiver cameras 102a to 102f via the communication unit 210.

[0020] The communication unit 210 is a communication interface that communicates with the receiver cameras 102a to 102f. The communication interface is configured with MAC and PHY. The communication unit 210 has a communication function and a clock function.

[0021] The communication function is the process shown in step S330 in Fig. 3, and is a function for forming a communication path between each camera in Fig. 1 and transmitting and receiving communication packets according to a communication protocol. In the case of the sender camera 101, a trigger signal that instructs the start of shooting is packetized and transmitted from the communication unit 210. The same fixed value is always used for the trigger signal.

[0022] The clock function is a function used in the process shown in step S340 in Fig. 3. The clock function is synchronized with the internal counter of the synchronization signal generating unit 240 via the bus.

[0023] The control unit 220 is a CPU that controls each component. Examples of control include execution of a time synchronization sequence defined by a time synchronization protocol, decoding of packets received by the communication unit 210, execution of the OS, etc. The control unit 220 sets the time information obtained from the communication unit 210 via the bus in the synchronization signal generation unit 240.

[0024] The storage unit 230 is a main storage device that can be shared and used by each of the components, and is mainly composed of a semiconductor memory such as a DRAM (Dynamic Random Access Memory), etc. The storage unit 230 stores various information handled by each of the components 210-270.

[0025] The synchronization signal generation unit 240 is a unit that receives information from the clock function of the communication unit 210 and generates shooting timing that is the basis of synchronous shooting for the shooting control unit 250. The shooting timing can be PPS or the like that has accurate intervals and ratios. The synchronization signal generation unit 240 has an internal counter for generating shooting timing, and the counter value is updated by notification from the communication unit 210 every time the sequence of Fig. 4 is performed. As a result, the counter values ​​inside the synchronization signal generation unit 240 are aligned between each camera.

[0026] The photographing control unit 250 is a part that drives the photographing unit 270 to photograph based on a photographing instruction from the shutter button 280 or the communication unit 210. The photographing control unit 250 is directly connected to the synchronization signal generating unit 240 via a notification line 290 and receives photographing timing. When the photographing control unit 250 receives a photographing instruction from the shutter button 280, it waits for photographing and drives the photographing unit 270 at the timing notified from the notification line 290.

[0027] The image processing unit 260 is a unit that processes image data sent from the photographing unit 270. The image processing unit 260 performs necessary image processing on the received image data, and outputs the image data to the storage unit 230 via the bus.

[0028] The photographing section 270 is a sensor that performs photographing upon receiving a photographing instruction from the photographing control section 250. The photographing section 270 transmits image data after photographing to the image processing section 260.

[0029] The shutter button 280 is a button that is pressed by the photographer holding the sender camera 101. The photographer communicates the intention of shooting to the synchronous shooting system 100 via the shutter button 280.

[0030] A notification line 290 is a notification line through which the synchronization signal generating unit 240 notifies the shooting control unit 250 of the shooting timing.

[0031] The above is a description of each component in sender camera 101. In this embodiment, receiver cameras 102a to 102f are cameras with the same configuration as sender camera 101, so the operations of each component are basically the same, but the differences will be described below.

[0032] When the communication unit 210 operates as one of the receiver cameras 102a to 102f, it determines whether or not the received communication packet is a trigger signal sent from the sender camera 101. Pattern matching is used as a method of determination. In pattern matching, it is detected whether or not the received communication packet matches a trigger signal pattern stored in advance. If there is a match, the communication unit 210 directly notifies the shooting control unit 250 via the notification line 292.

[0033] The photographing control unit 250 notifies the photographing timing by a notification line 292 instead of the shutter button 280.

[0034] The shutter button 280 is not required since it is not used by the receiver cameras 102a to 102f.

[0035] The notification line 292 is a signal line for notifying the imaging control unit 250 when the communication unit 210 receives a trigger signal.

[0036] 12 is a diagram showing the OSI reference model used in the pattern matching process performed by the communication unit 210. OSI (Open Systems Interconnection) is a network standard established by ISO (International Organization for Standardization) and ITU (International Telecommunication Union). The OSI reference model is a model of the communications used in OSI. Two methods of performing pattern matching using the OSI reference model are described below.

[0037] The layer 1210 is a physical layer / data link layer, and is a communication protocol executed by the MAC and PHY processing of the communication unit 210. When trigger signal information is included in the data portion of the communication protocol used in this layer 1210, it is determined whether the data portion matches a trigger signal pattern pre-stored in the communication unit 210. If they match, the communication unit 210 directly notifies the imaging control unit 250 via a notification line 292.

[0038] The layer 1220 is a network layer / transport layer, and is a TCP / UDP / IP communication protocol executed by the processing of the control unit 220. When trigger signal information is included in the data portion of the communication protocol used in this layer 1220, the control unit 220 determines whether the data portion matches the trigger signal pattern stored in the storage unit 230. If they match, the control unit 220 notifies the imaging control unit 250 via the bus.

[0039] Layer 1230 is a session layer, presentation layer, and application layer, which is a communication protocol of the software executed in each camera. Pattern matching is not performed in this layer 1230.

[0040] In the OSI reference model, processing at a lower layer is faster. By processing received communication packets at the lower layers, Layer 1 and 2, it is possible to reduce the processing time required for preparation for shooting compared to performing software processing at a higher layer.

[0041] Fig. 3 is a flowchart of the initial setting executed by each camera in the synchronous photography system 100 shown in Fig. 1. The flow shows the initial setting of each camera when the synchronous photography system 100 performs synchronous photography.

[0042] Start S310 indicates the starting point of the flowchart in FIG. 3, and indicates a state in which each camera is activated as one of the terminals constituting the synchronous photography system 100 shown in FIG.

[0043] In step S320, the control unit 220 of each camera performs a process of initializing the parameters of each camera. The parameters are the parameters necessary for each camera to perform synchronous shooting in the synchronous shooting system 100 shown in FIG. 1. In the present embodiment, each camera has the same configuration, and which camera becomes the sender camera 101 or the receiver cameras 102a to 102f is determined by the parameters.

[0044] In step S330, the control unit 220 of each camera performs a process of establishing communication between the cameras to form the synchronous shooting system 100 shown in FIG. 1 by means of the communication function of the communication unit 210. Each camera is connected to each other via the communication unit 210 and can perform the exchange of time, data, and control information.

[0045] In step S340, the control unit 220 of each camera performs a process of synchronizing the time of each camera by means of the clock function of the communication unit 210 so that the time synchronization shown in FIG. 4 is performed. Specifically, the sequence shown in FIG. 4 is executed. As a result, the clocks built in the communication units 210 of each camera are in a synchronized state.

[0046] After this process, the communication unit 210 executes the sequence shown in FIG. 4 at a fixed period under the control of the control unit 220. As a result, for each camera, the values of the clock function of the communication unit 210 and the counter inside the synchronization signal generation unit 240 are periodically updated.

[0047] In step S350, the control unit 220 of each camera performs a process of setting the shooting timing by the synchronization signal generation unit 240. The shooting timing is the timing for performing shooting generated by the counter inside the synchronization signal generation unit 240. When the shooting timing is generated inside the synchronization signal generation unit 240, the synchronization signal generation unit 240 outputs a pulse from the notification line 290 to the shooting control unit 250.

[0048] Since the counter values ​​in the synchronization signal generating unit 240 of each camera are the same, synchronized shooting timing is received by the shooting control unit 250 of each camera. The shooting timing is set to a level that is sufficient for communication and is not noticeable to the photographer.

[0049] Stop S360 marks the end of the flow chart of FIG.

[0050] Fig. 4 is a diagram showing a time synchronization sequence executed in each camera of the synchronized shooting system 100 shown in Fig. 1, specifically, showing the process of step S340 shown in Fig. 3. In this embodiment, the time synchronization sequence uses PTP (Precision Time Protocol).

[0051] 4 is executed one-to-one with sender camera 101 as the master and receiver cameras 102a to 102f as the slaves. Here, receiver cameras 102a to 102f that have become slaves will be referred to as receiver cameras 102.

[0052] In step S410, the sender camera 101 first transmits a Sync packet, which is a time synchronization packet.

[0053] Furthermore, in step S411, if the synchronization process of the sender camera 101 is operating in 2-Step, the sender camera 101 transmits a Follow Up packet, which is a time synchronization packet.

[0054] Here, the Sync / Follow Up packets transmitted from the sender camera 101 are transmitted by multicast. The receiver camera 102 receives the Sync / Follow Up packets.

[0055] In step S412, when executing synchronization processing, the receiver camera 102 transmits a Delay Request packet, which is a time synchronization packet, to the sender camera 101. The sender camera 101 receives the Delay Request packet.

[0056] In step S413, the sender camera 101 transmits a Delay Response packet, which is a time synchronization packet, to the receiver camera 102. The receiver camera 102 receives the Delay Response packet.

[0057] Here, time T1 indicates the time when the communication unit 210 of the sender camera 101 transmits a Sync packet. Time T2 indicates the time when the communication unit 210 of the receiver camera 102 receives the Sync packet. Time T3 indicates the time when the communication unit 210 of the receiver camera 102 transmits a Delay Request packet. Time T4 indicates the time when the communication unit 210 of the sender camera 101 receives the Delay Request packet.

[0058] The Follow Up packet stores time T1, and the Delay Response packet stores time T4.

[0059] Furthermore, times T2 and T3 can be obtained by the following procedure: The control unit 220 of the receiver camera 102 latches the internal clock of the communication unit 210 at the timing when the communication unit 210 receives a Sync packet. This allows the control unit 220 to obtain time T2.

[0060] Similarly, with regard to time T3, the control unit 220 latches the internal clock of the communication unit 210 at the timing when a Delay Request packet is transmitted from the communication unit 210 of the receiver camera 102 to the sender camera 101. In this way, the control unit 220 can obtain time T3.

[0061] By executing the above time synchronization sequence, receiver camera 102 can obtain four times T1 to T4. From the information on these four times T1 to T4, the average transmission path delay between sender camera 101 and receiver camera 102 and the time difference between sender camera 101 and receiver camera 102, that is, the time correction amount of receiver camera 102, can be calculated as follows:

[0062] Average path delay = ((T4-T1)-(T3-T2)) / 2 Time correction amount = ((T2-T1)-(T4-T3)) / 2

[0063] Since the time correction amount calculated above is the offset amount of receiver camera 102 with respect to sender camera 101, the advance of the internal counter of synchronization signal generator 240 of receiver camera 102 is adjusted so that this amount becomes 0. This achieves time synchronization between sender camera 101 and receiver camera 102.

[0064] By performing time synchronization in this manner, the counter value of sender camera 101 is synchronized with the counter value of sender camera 101. Synchronization signal generation unit 240 of sender camera 101 generates shooting timing based on the counter of sender camera 101. Synchronization signal generation unit 240 of receiver camera 102 generates shooting timing based on the counter of receiver camera 102. In this way, the shooting timing of sender camera 101 and the shooting timing of receiver camera 102 are synchronized with each other.

[0065] Fig. 5 is a diagram showing the timing of synchronous shooting by each camera in Fig. 1. For the sake of explanation, receiver cameras 102a to 102f only show a portion of receiver cameras 102a to 102c.

[0066] Dashed lines 510-513 indicate the timing at which each camera captures an image. The shooting timing is shared between each camera by steps S340 and S350. Therefore, the dashed lines 510-513 indicate the same timing for each camera. The dashed lines 510-513 are set at intervals that are sufficiently long for the communication time between the sender camera 101 and the receiver cameras 102a-102f.

[0067] The synchronization signal generation unit 240 of the sender camera 101 generates periodic shooting timing synchronized with the receiver camera 102. The synchronization signal generation unit 240 of the receiver camera 102 generates periodic shooting timing synchronized with the sender camera 101.

[0068] Shooting instruction 520 indicates the timing when the shutter button 280 of the sender camera 101 is pressed, i.e., the timing when a shooting instruction is received. The shutter button 280 notifies the shooting control unit 250 that it has been pressed. The shooting control unit 250 is set to shoot at the next shooting timing (dashed line 512) notified by the synchronization signal generation unit 240.

[0069] Transmission trigger signal 530 indicates a trigger signal transmitted from sender camera 101 to receiver cameras 102a to 102f. When shooting instruction 520 is given, shooting control unit 250 notifies control unit 220 via the bus. Control unit 220 generates trigger signal 530 and transmits trigger signal 530 from communication unit 210 to receiver cameras 102a to 102f.

[0070] Reception trigger signals 540-542 indicate the timing at which receiver cameras 102a-102c receive trigger signal 530. When trigger signal 530 sent from sender camera 101 arrives at communication unit 210 of receiver cameras 102a-102c, communication unit 210 determines by pattern matching that a packet has arrived and notifies shooting control unit 250 via notification line 292.

[0071] When the imaging control unit 250 is notified, it is set to perform imaging at the next imaging timing (dashed line 512) notified by the synchronization signal generation unit 240. This makes it possible to shorten the time it takes for the control unit 220 to receive a packet via the bus, determine the contents of the packet, and go to the imaging control unit 250 to make settings.

[0072] Shooting 550-553 indicate the timing when the shooting control unit 250 of each camera drives the shooting unit 270 to shoot. Since the shooting control unit 250 is set to "shoot at the next shooting timing" at the timing of shooting instruction 520, it notifies the shooting unit 270 at the timing of the next shooting timing, which is the dashed line 512. Upon receiving the notification from the shooting control unit 250, the shooting unit 270 shoots, and the image processing unit 260 records the image data after image processing in the storage unit 230. Since each camera is set to shoot at the next shooting timing by the shooting instruction 520 and received trigger signals 540-542, shooting is performed simultaneously at the timing of the dashed line 512.

[0073] Through the above process, sender camera 101 and receiver cameras 102a to 102c capture images at the timing indicated by dashed line 512. Due to the time synchronization in step S340 and the setting of the capture timing in step S350, dashed lines 510 to 513 are set to the same timing for each camera, so that each camera can capture images in synchronization.

[0074] Fig. 6 is a flow chart showing the process performed by the sender camera 101 in the synchronous shooting system 100 shown in Fig. 1. A method for controlling the sender camera 101 will be described below.

[0075] 6. Start S610 indicates the starting point of the flowchart in FIG. 6, and indicates a state in which the sender camera 101 is activated as one of the terminals constituting the synchronous photography system 100 shown in FIG.

[0076] In step S620, the sender camera 101 executes the initial setting flow shown in Fig. 3. The communication unit 210 of the sender camera 101 establishes a connection with the receiver cameras 102a to 102f and performs time synchronization, and the synchronization signal generation unit 240 periodically transmits shooting timing to the shooting control unit 250.

[0077] In step S630, the shooting control unit 250 of the sender camera 101 selects a path on the condition that a shooting instruction is issued from the shutter button 280. If a shooting instruction is issued from the shutter button 280, the shooting control unit 250 proceeds to step S640, and if not, the shooting control unit 250 maintains the current state.

[0078] In step S640, the control unit 220 of the sender camera 101 transmits a trigger signal to the receiver cameras 102a to 102f via the communication unit 210. The shooting control unit 250 notifies the control unit 220 via the bus that the shutter button 280 has been pressed. In response, the control unit 220 generates a trigger signal and transmits the trigger signal via the communication unit 210.

[0079] In step S650, the shooting control unit 250 of the sender camera 101 selects a path based on whether or not shooting timing has been generated. If shooting timing has been generated by the synchronization signal generation unit 240, the shooting control unit 250 proceeds to step S660, and if not, maintains the current state.

[0080] In step S660, the shooting control unit 250 of the sender camera 101 controls the shooting unit 270 to drive and capture images at the shooting timing generated in step S650.

[0081] In step S670, the control unit 220 of the sender camera 101 selects a path based on whether or not there has been an instruction to stop the sender camera 101. If an instruction to stop synchronous shooting has been given by a user or the like, the control unit 220 proceeds to STOP S680, otherwise it proceeds to step S630.

[0082] Stop S680 indicates the end of the flowchart in FIG. 6.

[0083] FIG. 7 is a flowchart when the receiver cameras 102a to 102f perform synchronous shooting in the synchronous shooting system 100 shown in FIG. 1. Hereinafter, a control method for the receiver cameras 102a to 102f will be described.

[0084] Start S710 indicates the starting point of the flowchart in FIG. 7, and shows a state in which the receiver cameras 102a to 102f are activated as one of the terminals constituting the synchronous shooting system 100 shown in FIG. 1.

[0085] In step S720, the receiver cameras 102a to 102f execute the initial setting flow shown in FIG. 3. The communication unit 210 of the receiver cameras 102a to 102f establishes a connection with the sender camera 101 and performs time synchronization, and the synchronization signal generation unit 240 of the receiver cameras 102a to 102f is in a state of periodically transmitting the shooting timing to the shooting control unit 250.

[0086] In step S730, the communication unit 210 of the receiver cameras 102a to 102f performs route selection on the condition of receiving a packet from the outside. When the communication unit 210 receives a packet, it proceeds to step S740, and otherwise, maintains the current state.

[0087] In step S740, when the communication unit 210 of the receiver cameras 102a to 102f receives a packet in step S730, it determines whether the received packet is a trigger signal by pattern matching and performs route selection. When the received packet is a trigger signal, the communication unit 210 notifies the shooting control unit 250 via the notification line 292 and proceeds to step S750, and otherwise, proceeds to step S730.

[0088] In step S750, the imaging control unit 250 of the receiver cameras 102a to 102f selects a path based on whether or not imaging timing has been generated. If imaging timing has been generated by the synchronization signal generation unit 240, the imaging control unit 250 proceeds to step S760, and if not, maintains the current state.

[0089] In step S760, the imaging control units 250 of the receiver cameras 102a to 102f control the imaging units 270 to drive and capture images at the imaging timings generated in step S750.

[0090] In step S770, control units 220 of receiver cameras 102a-102f select a path based on whether or not there has been an instruction to stop receiver cameras 102a-102f. If an instruction to stop synchronous shooting has been given by a user or the like, control unit 220 proceeds to stop S780, and if not, proceeds to step S730.

[0091] Stop S780 marks the end of the flow chart of FIG.

[0092] Second embodiment The second embodiment will be described below. In the second embodiment, the shooting control unit 250 of the sender camera 101 in Fig. 2 has an internal shooting timing counter. The shooting timing counter is a counter that measures the time from one shooting timing to the next shooting timing, and is reset when the shooting timing is received from the synchronization signal generation unit 240.

[0093] The photographing control unit 250 knows, by means of a photographing timing counter, at what timing within the photographing timing the photographing instruction from the shutter button 280 was issued. The storage unit 230 stores a specified value, and notifies the photographing control unit 250 of the specified value via the bus. The specified value here is a value set as a time from when the shutter button 280 is pressed until the terminal receiver cameras 102a to 102f are on standby for photographing in time for the next photographing timing. The specified value may be set in the storage unit 230 by a user operation, or may be set from an external device via the communication unit 210.

[0094] Figure 8 is a flowchart in which the relationship between shooting instructions and shooting timing is taken into consideration in the flowchart of Figure 6. The flowchart of Figure 8 is a flowchart in which step S810 is added to the flowchart of Figure 6. Unless otherwise specified, Figure 8 is the same as Figure 6, and only the differences will be explained.

[0095] In step S630, if a shooting instruction is issued from the shutter button 280, the shooting control unit 250 of the sender camera 101 proceeds to step S810.

[0096] In step S810, the shooting control unit 250 of the sender camera 101 selects a path based on whether or not the shooting timing counter is equal to or less than a specified value when the shutter button 280 is pressed. If the shooting timing counter is equal to or less than the specified value, the shooting control unit 250 proceeds to step S640, and if not, maintains the current state.

[0097] Fig. 9 is a diagram showing the timing at which the cameras in Fig. 1 perform synchronous shooting. For the sake of explanation, receiver cameras 102a to 102f indicate receiver camera 102. Unless otherwise specified, Fig. 9 is the same as Fig. 5, and only the differences will be explained.

[0098] The shooting instruction 910 indicates the timing when the shutter button 280 of the sender camera 101 is pressed. At this time, the value of the shooting timing counter at the time when the shutter button 280 is pressed is greater than the specified value, and in step S810, the shooting control unit 250 waits until the shooting timing counter is reset and becomes smaller than the specified value.

[0099] The dashed line 921 indicates the timing at which a trigger signal would normally be transmitted if step S810 did not occur. The sender camera 101 receives the shooting instruction 910, immediately transmits a trigger signal, and is set to "shoot at the next shooting timing." In this case, shooting is performed at the timing indicated by the dashed line 511.

[0100] The transmission trigger signal 920 is a trigger signal transmitted from the sender camera 101 to the receiver cameras 102a to 102f. In step S810, the shooting control unit 250 waits until the timing after the dashed line 511, and the communication unit 210 transmits the trigger signal 920 to the receiver camera 102. The sender camera 101 performs shooting 550 at the dashed line 512.

[0101] As a result, receiver camera 102 receives a trigger signal at the timing of received trigger signal 930 , and captures an image 551 at the timing of dashed line 512 .

[0102] A received trigger signal 930 indicates the timing at which the trigger signal is received by the receiver camera 102. Since the transmitted trigger signal 920 from the sender camera 101 is delayed in step S810, shooting 551 is performed at the same dotted line 512 as the sender camera 101, without any changes to the processing of the receiver camera 102.

[0103] As described above, in step S640, when the interval between the shooting timing immediately before the shooting instruction and the current time is equal to or less than the first threshold, communication unit 210 transmits a trigger signal to receiver camera 102 so that receiver camera 102 receives the trigger signal before the shooting timing immediately after the shooting instruction. The first threshold is, for example, a specified value. Also, when the interval between the shooting timing immediately before the shooting instruction and the current time is longer than the first threshold, communication unit 210 transmits a trigger signal to receiver camera 102 so that receiver camera 102 receives the trigger signal after the shooting timing immediately after the shooting instruction.

[0104] Specifically, when the interval between the shooting timing immediately before the shooting instruction and the current time is equal to or less than the first threshold, communication unit 210 transmits a trigger signal to receiver camera 102 before the shooting timing immediately after the shooting instruction. Also, when the interval between the shooting timing immediately before the shooting instruction and the current time is longer than the first threshold, communication unit 210 transmits a trigger signal to receiver camera 102 after the shooting timing immediately after the shooting instruction.

[0105] (Third embodiment) The third embodiment will be described below. The sender camera 101 in the third embodiment has a shooting timing counter and a specified value, similar to the sender camera 101 in the second embodiment.

[0106] Figure 10 is a flowchart in which the relationship between shooting instructions and shooting timing is taken into consideration in the flowchart of Figure 6. The flowchart of Figure 10 is a flowchart in which steps S1010 and S1020 are added to the flowchart of Figure 6. Unless otherwise specified, Figure 10 is the same as Figure 6, and only the differences will be explained.

[0107] After step S640, the process proceeds to step S1010.

[0108] In step S1010, the shooting control unit 250 of the sender camera 101 selects a path based on whether the shooting timing counter is equal to or less than a specified value when the shutter button 280 is pressed. The specified value here is a value set as the time from when the shutter button 280 is pressed until the end receiver cameras 102a to 102f are on standby to shoot in time for the next shooting timing.

[0109] If the shooting timing counter is equal to or smaller than the specified value, the shooting control unit 250 proceeds to step S650, otherwise, proceeds to step S1020.

[0110] In step S1020, the shooting control unit 250 of the sender camera 101 selects a path based on whether or not the shooting timing has arrived. If the shooting control unit 250 receives the shooting timing from the synchronization signal generation unit 240, it proceeds to step S650, and if not, it maintains the current state.

[0111] Fig. 11 is a diagram showing the timing at which the cameras in Fig. 1 perform synchronous shooting. For the sake of explanation, receiver cameras 102a to 102f indicate receiver camera 102. Unless otherwise specified, Fig. 11 is the same as Fig. 5, and only the differences will be explained.

[0112] A shooting instruction 1110 indicates the timing when the shutter button 280 of the sender camera 101 is pressed.

[0113] A transmission trigger signal 1120 is a trigger signal transmitted to receiver cameras 102a to 102f from sender camera 101. The value of the shooting timing counter is larger than the specified value, and if shooting continues in this state, shooting will be performed at the timing indicated by dashed line 511.

[0114] On the other hand, receiver camera 102 receives a trigger signal at the timing of received trigger signal 1130 which straddles dashed line 511 , and captures an image 551 at the timing of dashed line 512 .

[0115] Therefore, the sender camera 101 does not capture an image at the timing indicated by the dashed line 511 in step S1020, and captures an image 550 at the timing indicated by the dashed line 512 in the subsequent step S650.

[0116] A received trigger signal 1130 indicates the timing at which the receiver camera 102 receives the trigger signal. Due to a delay caused by communication, the received trigger signal 1130 occurs after the timing indicated by the dashed line 511. The receiver camera 102 captures an image 551 at the timing indicated by the dashed line 512.

[0117] As described above, even if the transmission and reception of the trigger signal overlaps with the image capturing timing, the sender camera 101 can skip image capturing, so that each camera can capture images at the same timing.

[0118] As described above, in step S660, the photographing control unit 250 controls so that photographing is performed at the photographing timing immediately after the transmission of the trigger signal when the interval between the photographing timing immediately before the photographing instruction and the current time is equal to or less than the second threshold. The second threshold is, for example, a specified value. Also, when the interval between the photographing timing immediately before the photographing instruction and the current time is longer than the second threshold, the photographing control unit 250 controls so that photographing is performed at the photographing timing two times after the transmission of the trigger signal.

[0119] According to the first to third embodiments, the synchronous imaging system 100 brings the timing of imaging intended by the user closer to the timing of actual imaging, thereby enabling synchronous imaging close to the timing intended by the user.

[0120] (Other embodiments) The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) for implementing one or more functions.

[0121] It should be noted that the above-described embodiments are merely illustrative of specific examples of implementing the present disclosure, and the technical scope of the present disclosure should not be interpreted as being limited by these embodiments. In other words, the present disclosure can be implemented in various forms without departing from its technical concept or main features.

[0122] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) A first imaging device; and a second imaging device, The first imaging device is a first generating means for generating periodic photographing timing synchronized with the second photographing device; a first communication means for transmitting a trigger signal to the second photographing device based on a photographing instruction; a first photographing control means for controlling photographing to be performed at the photographing timing generated by the first generating means after the transmission of the trigger signal; The second imaging device is a second generating means for generating periodic photographing timing synchronized with the first photographing device; a second communication means for receiving the trigger signal from the first image capture device; and second photography control means for controlling photography to be performed at the photography timing generated by said second generation means after receiving the trigger signal. (Configuration 2) The first communication means includes: when an interval between a photographing timing immediately before the photographing instruction and a current time is equal to or less than a first threshold value, transmitting the trigger signal to the second photographing device so that the second photographing device receives the trigger signal before the photographing timing immediately after the photographing instruction; The photographing system according to configuration 1, characterized in that, when an interval between the photographing timing immediately before the photographing instruction and the current time is longer than a first threshold value, the trigger signal is transmitted to the second photographing device so that the second photographing device receives the trigger signal after the photographing timing immediately after the photographing instruction. (Configuration 3) The first communication means includes: when an interval between the photographing timing immediately before the photographing instruction and a current time is equal to or less than a first threshold value, transmitting the trigger signal to the second photographing device before the photographing timing immediately after the photographing instruction; The photographing system according to configuration 2, characterized in that, when an interval between the photographing timing immediately before the photographing instruction and the current time is longer than a first threshold value, the trigger signal is transmitted to the second photographing device after the photographing timing immediately after the photographing instruction. (Configuration 4) The first photographing control means When an interval between the photographing timing immediately before the photographing instruction and the current time is equal to or less than a second threshold value, control is performed so that photographing is performed at the photographing timing immediately after the transmission of the trigger signal; The photographing system according to configuration 1, characterized in that, when an interval between the photographing timing immediately before the photographing instruction and the current time is longer than a second threshold value, the photographing is controlled to be performed at the photographing timing two times after the transmission of the trigger signal. (Configuration 5) 5. The photographing system according to any one of configurations 1 to 4, wherein the second communication means determines whether or not a packet received from the first photographing device is a trigger signal. (Configuration 6) 6. The photographing system according to configuration 5, wherein the second communication means determines whether or not the packet received from the first photographing device is a trigger signal by pattern matching. (Configuration 7) 7. The photographing system according to any one of configurations 1 to 6, wherein the first generating means and the second generating means synchronize photographing timing by PTP. (Configuration 8) the first generation means generates a photographing timing based on a counter of the first photographing device; the second generation means generates a photographing timing based on a counter of the second photographing device; 8. The photographing system according to any one of configurations 1 to 7, wherein the counter of the first photographing device and the counter of the second photographing device are synchronized with each other. (Configuration 9) 9. The photographing system according to configuration 8, wherein the counter value of the second photographing device is corrected based on the time when the first photographing device transmits a first packet, the time when the second photographing device receives the first packet, the time when the second photographing device transmits a second packet, and the time when the first photographing device receives the second packet. (Configuration 10) 10. The photographing system according to any one of configurations 1 to 9, wherein the photographing instruction is an instruction to photograph using a shutter button. (Configuration 11) An imaging device, A generating means for generating periodic photographing timing synchronized with another photographing device; a communication means for transmitting a trigger signal to the other photographing device based on a photographing instruction; an imaging control means for controlling imaging so as to perform imaging at the imaging timing generated by the generation means after the transmission of the trigger signal; 13. An imaging device comprising: (Configuration 12) An imaging device, A generating means for generating periodic photographing timing synchronized with another photographing device; A communication means for receiving a trigger signal from the other image capture device; an imaging control means for controlling imaging so as to perform imaging at the imaging timing generated by the generation means after receiving the trigger signal; An imaging device comprising: (Method 1) A first imaging device; a second imaging device; and a control method for a photography system having the second imaging device, a first generation step in which the first photographing device generates periodic photographing timing synchronized with the second photographing device; a first communication step in which the first photographing device transmits a trigger signal to the second photographing device based on a photographing instruction; a first photographing control step of controlling the first photographing device to perform photographing at the photographing timing generated by the first generation step after the transmission of the trigger signal; a second generation step in which the second photographing device generates periodic photographing timing synchronized with the first photographing device; a second communication step in which the second photographing device receives the trigger signal from the first photographing device; a second photographing control step of controlling the second photographing device to photograph at the photographing timing generated by the second generation step after receiving the trigger signal; 13. A method for controlling an imaging system comprising: (Method 2) A method for controlling an imaging device, comprising: A generating step of generating periodic photographing timing synchronized with other photographing devices; a communication step of transmitting a trigger signal to the other photographing device based on a photographing instruction; an imaging control step of controlling imaging so as to perform imaging at the imaging timing generated in the generating step after the transmission of the trigger signal; 13. A method for controlling an imaging device, comprising: (Method 3) A method for controlling an imaging device, comprising: A generating step of generating periodic photographing timing synchronized with other photographing devices; a communication step of receiving a trigger signal from the other image capture device; an imaging control step of controlling imaging so as to perform imaging at the imaging timing generated in the generating step after receiving the trigger signal; 13. A method for controlling an imaging device, comprising: (Program 1) A program for causing a computer to function as the photographing device according to configuration 11 or 12. [Explanation of symbols]

[0123] 100 Synchronous shooting system, 101 Sender camera, 210 Communication unit, 240 Synchronous signal generating unit, 250 Shooting control unit, 292 Notification line

Claims

1. A first imaging device; a second imaging device; The first imaging device is a first generating means for generating periodic photographing timing synchronized with the second photographing device; a first communication means for transmitting a trigger signal to the second photographing device based on a photographing instruction; a first imaging control means for controlling imaging so as to perform imaging at the imaging timing generated by the first generation means after the transmission of the trigger signal, The second imaging device is a second generating means for generating periodic photographing timing synchronized with the first photographing device; a second communication means for receiving the trigger signal from the first image capture device; and second photography control means for controlling photography to be performed at the photography timing generated by said second generation means after receiving the trigger signal.

2. The first communication means includes: when an interval between a photographing timing immediately before the photographing instruction and a current time is equal to or less than a first threshold value, transmitting the trigger signal to the second photographing device so that the second photographing device receives the trigger signal before the photographing timing immediately after the photographing instruction; 2. The photographing system according to claim 1, wherein, when an interval between the photographing timing immediately before the photographing instruction and the current time is longer than a first threshold value, the trigger signal is transmitted to the second photographing device so that the second photographing device receives the trigger signal after the photographing timing immediately after the photographing instruction.

3. The first communication means includes: When an interval between the photographing timing immediately before the photographing instruction and a current time is equal to or less than a first threshold value, the trigger signal is transmitted to the second photographing device before the photographing timing immediately after the photographing instruction; The photographing system according to claim 2, characterized in that, when an interval between the photographing timing immediately before the photographing instruction and the current time is longer than a first threshold value, the trigger signal is transmitted to the second photographing device after the photographing timing immediately after the photographing instruction.

4. The first photographing control means When an interval between the photographing timing immediately before the photographing instruction and the current time is equal to or less than a second threshold value, control is performed so that photographing is performed at the photographing timing immediately after the transmission of the trigger signal; 2. The photographing system according to claim 1, further comprising: a trigger signal outputting a trigger for outputting a photograph of a subject to be photographed; a trigger signal outputting a trigger for outputting a photograph of a subject to be photographed;

5. 2. The photographing system according to claim 1, wherein the second communication means determines whether or not a packet received from the first photographing device is a trigger signal.

6. 6. The photographing system according to claim 5, wherein the second communication means determines whether or not the packet received from the first photographing device is a trigger signal by pattern matching.

7. 2. The imaging system according to claim 1, wherein the first generation means and the second generation means synchronize the imaging timing by PTP.

8. the first generating means generates a photographing timing based on a counter of the first photographing device; the second generation means generates a photographing timing based on a counter of the second photographing device; 2. The photographing system according to claim 1, wherein the counter of said first photographing device and the counter of said second photographing device are synchronized with each other.

9. 9. The photographing system according to claim 8, wherein the counter value of the second photographing device is corrected based on the time when the first photographing device transmits a first packet, the time when the second photographing device receives the first packet, the time when the second photographing device transmits a second packet, and the time when the first photographing device receives the second packet.

10. 2. The photographing system according to claim 1, wherein the photographing instruction is an instruction to photograph using a shutter button.

11. An imaging device, A generating means for generating periodic photographing timing synchronized with another photographing device; a communication means for transmitting a trigger signal to the other photographing device based on a photographing instruction; an imaging control means for controlling imaging so as to perform imaging at the imaging timing generated by the generation means after the transmission of the trigger signal; An imaging device comprising:

12. An imaging device, A generating means for generating periodic photographing timing synchronized with another photographing device; A communication means for receiving a trigger signal from the other image capture device; an imaging control means for controlling imaging so as to perform imaging at the imaging timing generated by the generation means after receiving the trigger signal; 13. An imaging device comprising:

13. A first imaging device; A control method for a photography system having a first photography device and a second photography device, comprising: a first generation step in which the first photographing device generates periodic photographing timing synchronized with the second photographing device; a first communication step in which the first photographing device transmits a trigger signal to the second photographing device based on a photographing instruction; a first photographing control step of controlling the first photographing device to perform photographing at the photographing timing generated in the first generation step after the trigger signal is transmitted; a second generation step in which the second photographing device generates periodic photographing timing synchronized with the first photographing device; a second communication step in which the second image capture device receives the trigger signal from the first image capture device; a second photographing control step of controlling the second photographing device to photograph at the photographing timing generated in the second generation step after receiving the trigger signal; 13. A method for controlling an imaging system comprising:

14. A method for controlling an imaging device, comprising: A generating step of generating periodic photographing timing synchronized with other photographing devices; a communication step of transmitting a trigger signal to the other photographing device based on a photographing instruction; an imaging control step of controlling imaging so as to perform imaging at the imaging timing generated in the generating step after the transmission of the trigger signal; 13. A method for controlling an imaging device, comprising:

15. A method for controlling an imaging device, comprising: A generating step of generating periodic photographing timing synchronized with other photographing devices; a communication step of receiving a trigger signal from the other image capture device; an imaging control step of controlling imaging so as to perform imaging at the imaging timing generated in the generating step after receiving the trigger signal; 13. A method for controlling an imaging device, comprising:

16. A program for causing a computer to function as the imaging device according to claim 11 or 12.

Images