Image editing device, method for controlling the same, and program

Abstract

To provide a device that aligns the colors of picked-up images acquired by a plurality of imaging apparatuses so as to reduce complicated operations performed by a user.SOLUTION: An image editing device has a memory that stores a pre-picked-up image and an actual picked-up image for each of target cameras whose color and brightness are aligned and a reference camera having reference color and brightness, and comprises: a first association unit that associates with each other the pre-picked-up image and the actual picked-up image in the reference camera and each of the target cameras on the basis of an additional imaging condition; a second association unit that associates with each other the actual picked-up image in the reference camera and the actual picked-up images in the target cameras on the basis of simultaneity guarantee information guaranteeing simultaneity in the picked-up images; and a third association unit that associates with each other the pre-picked-up image in the reference camera and the pre-picked-up images in the target cameras by referring to an association result. The image editing device can align the color and brightness of the actual picked-up image in the target camera with the color and brightness of the actual picked-up image in the corresponding reference camera.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an image editing apparatus for associating captured images captured by a plurality of imaging devices, a control method thereof, and a program.

Background Art

[0002] In the field of video production and the like, imaging is generally performed using a plurality of imaging devices. Even when imaging the same subject, the color and luminance of the subject in the captured image (still image, moving image) obtained from the imaging device vary depending on imaging conditions such as the imaging device used, the lighting environment, and the relative positional relationship among the imaging device, lighting, and subject.

[0003] Therefore, when adjusting the color and luminance of captured images between imaging devices during editing, it is necessary to acquire, as captured images, the information necessary for adjusting the color and luminance for each imaging device and imaging condition in the preparation stage before the actual shooting. When adjusting the color and luminance, first, a reference and target captured images (reference captured image, target captured image) are selected and associated from among the actual shooting images of each imaging device. Further, from the pre-captured images captured in advance for each imaging device, a captured image whose imaging conditions match the actual shooting image is searched for and associated. Then, by combining the above-described respective results, the "reference" and "target" captured images are extracted from the pre-captured images and used for color and luminance adjustment.

[0004] Patent Document 1 discloses a technique related to the following moving image playback apparatus. That is, the apparatus groups moving images related to a captured image captured, for example, on a summer night based on imaging conditions such as the imaging position, date and time, white balance, and exposure information attached to the moving image acquired by the imaging device, and continuously plays back a plurality of moving images belonging to the same group.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, with only the above-described conventional technology, operations such as selecting and associating reference and target imaging images from the live imaging images of a plurality of imaging devices and operations such as selecting and associating reference and target imaging images from pre-imaging images occur. Such operations need to be performed manually and are very complicated.

[0007] An object of the present invention is to provide an image editing apparatus, a control method thereof, and a program for performing association between imaging images for matching colors and luminances between imaging images acquired by a plurality of imaging devices in order to reduce the complexity for the user.

Means for Solving the Problems

[0008] In order to achieve the above object, one aspect of the present invention is an image editing apparatus having storage means for storing pre-imaging images acquired in advance and live imaging images acquired during live operation in each of a reference camera serving as a color and luminance matching reference and a target camera serving as a color and luminance matching target. In each of the reference camera and the target camera, first association means for associating a pre-imaging image and a live imaging image based on imaging conditions attached to the imaging image, and based on simultaneity guarantee information for guaranteeing simultaneity in the imaging image, second association means for associating the live imaging image of the reference camera and the live imaging image of the target camera, and third association means for associating the pre-imaging image of the reference camera and the pre-imaging image of the target camera with reference to the association result by the first association means and the second association means, and characterized in that it enables the color and luminance of the live imaging image of the target camera to be matched with the color and luminance of the live imaging image of the corresponding reference camera.

Effects of the Invention

[0009] According to the present invention, an effect is obtained that the colors and luminances between imaging images acquired by a plurality of imaging devices can be matched in order to reduce the complexity for the user.

Brief Description of Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Modes for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in the embodiments.

[0012] In this embodiment, the imaging device A100 serves as the "main camera (reference camera: reference imaging device)", and the imaging device B200 serves as the "sub camera (target camera: target imaging device)". The "pre-capture image" is an image captured in advance, and the "live capture image" is an image captured during the live event. These captured images are stored in the memory 303. Also, the present invention enables the color and brightness of the live capture image of the imaging device B200 to be adjusted to match the color and brightness of the live capture image of the corresponding imaging device A100 according to the result of the association described below.

[0013] In the following description, it is assumed that the number of sub cameras is one, but the present invention is applicable even if there are multiple sub cameras. Even if there are multiple sub cameras, the present invention can be applied by performing the characteristic processing of the present invention (see FIG. 3, etc.) for each of the multiple sub cameras.

[0014] <<First Embodiment>> (FIG. 1: Configuration diagram of the image editing device) Hereinafter, the first embodiment of the present invention will be described. FIG. 1 is a configuration diagram of the image editing system device according to the first embodiment of the present invention. As shown in FIG. 1, the image editing device according to the first embodiment includes an imaging device A100, an imaging device B200, a control device 300, and a display device 400.

[0015] (Imaging device A100) The imaging device A100 outputs imaging data "DATA_A", which is composed of imaging conditions, imaging images, audio, time codes, etc., to the control device 300. Here, the imaging conditions include information related to imaging in the imaging device A100, such as the model number, serial number, time code, pan / tilt / zoom state, white balance / exposure / shutter speed, etc. of the imaging device A100. At least one of these imaging conditions is adopted. Also, the imaging image includes information related to one or more images captured by the imaging device A100. The imaging image includes the following imaging images. That is, it includes an imaging image (hereinafter referred to as "pre-imaging image") at the time of pre-imaging of the imaging device A100, which serves as a reference for matching color and luminance with the imaging device B200. It also includes an imaging image (hereinafter referred to as "main imaging image") at the time of main imaging of the imaging device A100, which serves as a reference for matching color and luminance with the imaging device B200. Note that when the imaging image is a moving image, it is possible to hold the imaging conditions for each so-called frame.

[0016] (Imaging device B200) The imaging device B200 outputs imaging data "DATA_B", which is composed of imaging conditions, imaging images, audio, time codes, etc., to the control device 300. Here, the imaging conditions include information related to imaging in the imaging device B200, such as the model number, serial number, time code, pan / tilt / zoom state, white balance / exposure / shutter speed, etc. of the imaging device B200. At least one of these imaging conditions is adopted in the same way as the imaging device A100. Also, the imaging image includes information related to one or more images captured by the imaging device B200. Also, the imaging image includes the "pre-imaging image" that is the target for matching color and luminance with the imaging device A and the "main imaging image" that is the target for matching color and luminance with the imaging device A in the "pre-imaging image" of the imaging device B200.

[0017] (Control device 300) The control device 300 receives the imaging data "DATA_A" from the imaging device A100 and the imaging data "DATA_B" from the imaging device B200. The control device 300 outputs an image generated based on the imaging data "DATA_A" and the imaging data "DATA_B", a user control menu of the control device 300, etc. to the display device 400 as an image "IMG".

[0018] (Display device 400) The display device 400 displays the image data "IMG" received from the control device 300. The user can visually confirm the captured images of the imaging device A100 and the imaging device B200 based on the display information of the display device 400.

[0019] In this embodiment, a device configuration for performing color and luminance adjustment between two imaging devices, the imaging device A100 and the imaging device B200, will be described as an example. However, the number of imaging devices may be two or more. Also, in this embodiment, an example in which the imaging device A100 and the imaging device B200 directly output imaging data to the control device 300 will be described. However, the imaging data may be indirectly output from the imaging device A100 and the imaging device B200 to the control device 300 via a storage medium. That is, the user may temporarily store the imaging data of the imaging device A100 and the imaging device B200 in a storage medium and load the imaging data into the control device 300 by attaching the storage medium to the control device 300.

[0020] (Figure 2: Configuration diagram of the control device 300) Figure 2 is a configuration diagram of the control device 300. As shown in Figure 2, the control device 300 includes a control unit 301, an imaging data input unit 302, a memory 303, an imaging image association unit 304, an image correction unit 305, an image output unit 306, and a control bus 307. Each component of the control device 300 is communicably connected to each other via the control bus 307 to communicate the required information.

[0021] (Control unit 301) The control unit 301 is configured to have a microcomputer. The microcomputer is configured to have, for example, a CPU, a ROM, and a RAM. By executing a program non-volatilely stored in the memory 303 by the control unit 301, the control unit 301 controls the imaging data input unit 302, the imaging image association unit 304, the image correction unit 305, and the image output unit 306. Thus, the control unit 301 performs overall operation control of the control device 300. Various functions of the control unit 301 are realized by a processor such as a CPU executing a program stored in the memory 303.

[0022] (Imaging data input unit 302: Memory 303) The imaging data input unit 302 includes an interface corresponding to wired inputs such as LAN, HDMI (registered trademark), and USB, and wireless inputs such as Bluetooth and Wi-Fi (registered trademark), and receives imaging data from outside the control device 300. The memory 303 stores imaging data received by the imaging data input unit 302, programs executed by the control unit 301, etc., and is also used as a buffer for results of association processing and the like described later and for each process. In addition, the memory 303 temporarily stores the display information when the control device 300 sends the display information to the display device 400 via the image output unit 306.

[0023] (Imaging image association unit 304) The imaging image association unit 304 includes a first association unit 3041, a second association unit 3042, and a third association unit 3043. The association processing and the like performed by the first association unit 3041, the second association unit 3042, and the third association unit 3043 are realized by a processor such as a CPU executing a program stored in a storage medium such as a ROM with reference to various imaging images stored in the memory 303.

[0024] (First association unit 3041) The first association unit 3041 associates and stores in the memory 303 the pre-capture images and the live-capture images stored in the memory 303 in each of the imaging device A100 and the imaging device B200 based on the imaging conditions associated with the imaging images. Hereinafter, the association result of the first association unit 3041 is referred to as the "first association result". As described above, the imaging conditions are at least one or more of the imaging information related to imaging such as the model number, serial number, time code, pan / tilt / zoom state, white balance / exposure / shutter speed of the imaging device B200.

[0025] (Second association unit 3042: Third association unit 3043) The second association unit 3042 performs the following association based on information that can guarantee simultaneity in the imaging images, such as the time code and audio data, associated with the imaging images, by referring to the stored content of the memory 303. That is, the second association unit 3042 associates and stores in the memory 303 the live-capture image of the imaging device A100 and the live-capture image of the imaging device B200. Hereinafter, the association result of the second association unit 3042 is referred to as the "second association result". Further, the third association unit 3043 associates the pre-capture images corresponding to each of the live-capture images between the imaging devices by referring to the first association result and the second association result. That is, the third association unit 3043 refers to the first association result and the second association result stored in the memory 303, associates the pre-capture image of the imaging device A100 and the pre-capture image of the imaging device B200, and stores them in the memory 303. Hereinafter, the association result of the third association unit 3043 is referred to as the "third association result". The association results may be stored in the memory 303 by the first association unit 3041, the second association unit 3042, and the third association unit 3043, or may be stored in another memory (not shown).

[0026] (Image correction unit 305) The image correction unit 305 performs color and luminance adjustment on the live imaging images between imaging devices based on the pre-imaging images between imaging devices with reference to the third association result. Also, the image correction unit 305 refers to the second association result and adjusts the color and luminance of the live imaging image of the imaging device B200 (target imaging device) to match the color and luminance of the live imaging image of the corresponding imaging device A100 (reference imaging device). Examples of the color and luminance adjustment method include creating a 3D-LUT (Look Up Table) based on the reference imaging image and the color chart images captured for each target imaging device under the same imaging conditions and applying it to the live imaging image of the target imaging device. More generally, the image correction unit 305 can adjust any one or more of the three attributes (hue, lightness, chroma) of the color information of the basic live imaging image of the imaging device B200 to match any one or more of the three attributes (hue, lightness, chroma) of the color information of the live imaging image of the corresponding imaging device A100. Similarly, the image correction unit 305 can also match the color information between the preparatory imaging images of both imaging devices (100, 200).

[0027] (Image output unit 306) The image output unit 306 transmits the image "IMG" to other devices via HDMI, DisplayPort, etc. The image output unit 306 outputs the image "IMG" to the display device 400.

[0028] <Basic operation of the first embodiment> (Fig. 3: Flowchart showing the association process of the imaging images in the first embodiment) Next, with reference to Fig. 3, the process of associating imaging images to adjust the color and luminance between imaging devices in the first embodiment will be described. The process shown in Fig. 3 is also applicable when there are two or more imaging devices. The process shown in Fig. 3 starts when the operation unit (not shown) of the control device 300 receives a user's process start operation on the operation unit.

[0029] Here, it is assumed that the user has specified the imaging device serving as the reference for color and luminance adjustment (hereinafter referred to as the "reference imaging device"), the target imaging device (hereinafter referred to as the "target imaging device"), and the imaging data, etc. before the start of the process shown in FIG. 3. Here, the "imaging data" is data composed of, for example, a plurality of "imaging images", "imaging conditions", and "audio, time code, etc." that the user has continuously imaged while changing the imaging conditions using the imaging device. Also, the "imaging conditions" are, for example, the pan / tilt / zoom state, white balance / exposure / shutter speed, etc.

[0030] (Step S301) First, in step S301, according to the control instruction of the control unit 301, the first association unit 3041 refers to the "pre-imaging data" and "main operation imaging data" in the "reference imaging device (100)" and the "target imaging device (200)" stored in the memory 303. Next, according to the control instruction of the control unit 301, the first association unit 3041 refers to the imaging images included in the referred data and the imaging conditions associated with the imaging images, and associates the "pre-imaging devices" and the "main operation imaging devices" with the same imaging conditions.

[0031] (FIG. 4: Explanation diagram of the association of pre-imaging and main operation imaging images) FIG. 4 is a schematic explanatory diagram of the association in step S301. FIG. 4 shows how, in the imaging device A100, the pre-imaging data and the main operation imaging data are referred to and the imaging images with the same imaging conditions are associated.

[0032] In FIG. 4, first, the first association unit 3041 compares the pre-capture data and the live-capture data, and associates the pre-capture image A1 that matches under the imaging condition A1 with the live-capture image A1. Thereafter, similarly, the first association unit 3041 associates the "pre-capture image A2" that matches the "imaging condition A2" with the "live-capture image A2". Here, the imaging condition A1 will be described by taking pan / tilt / zoom (hereinafter "PTZ") as an example. For example, assume that the PTZ has 9 states each, and these states are replaced and represented by numerical values from "0" to "9". And when all the states of the PTZ are "0", it is expressed as "PTZ = 000", then the imaging condition A1 is, for example, "PTZ = 000". Similarly, for example, the imaging condition A2 is "PTZ = 111". Eventually, in step S301, the first association unit 3041 associates the imaging images whose imaging conditions match between the pre-capture image and the live-capture image within the same imaging device.

[0033] Once the association is completed as described above, under the control instruction of the control unit 301, the first association unit 3041 stores the first association result in the memory 303 and sends a completion signal to the control unit 301. The control unit 301 receives the completion signal and proceeds to step S302 for processing. Here, the "first association result" consists of, for example, an identifier that can uniquely identify each associated imaging image, and the associated data which is the result of the association. The identifier that can be uniquely identified is, for example, a character string composed of the model number, serial number, imaging date and time (year, month, day, hour, minute, second) of the imaging device that captured each imaging image, etc. Also, in FIG. 4, it shows the state of referring to the imaging conditions of the pre-capture data and the live-capture data in the imaging device A100 and associating the imaging images whose imaging conditions of both match. However, the same association is possible for the imaging device B200. That is, the first association unit 3041 refers to the imaging conditions of the pre-capture data and the live-capture data in the imaging device B200 and associates the two imaging images whose imaging conditions of both match.

[0034] (Step S302) Next, in step S302, according to the control instruction of the control unit 301, the first association unit 3041 determines whether the processing in step S301 has been completed for all imaging devices stored in the memory 303. If it is determined that not all processing has been completed (N), the first association unit 3041 sends an incomplete signal to the control unit 301. As soon as the control unit 301 receives the incomplete signal, it gives a control instruction to the first association unit 3041 again to execute the processing in step S301. On the other hand, when the first association unit 3041 determines that the processing in step S301 has been completed for the reference imaging device and all target imaging devices stored in the memory 303 (Y), it sends a completion signal to the control unit 301. As soon as the control unit 301 receives the completion signal, it proceeds to the processing in step S303.

[0035] (Step S303) Next, in step S303, according to the control instruction of the control unit 301, the second association unit 3042 refers to the live imaging images of the reference imaging device (100) and the target imaging device (200) stored in the memory 303 and the time code attached to the imaging images. Next, according to the control instruction of the control unit 301, the second association unit 3042 associates the live imaging images with matching time codes between the reference imaging device (100) and the target imaging device (200).

[0036] (FIG. 5: Explanatory diagram of the association of live imaging images between imaging devices) FIG. 5 is a schematic explanatory diagram of the association in step S303. FIG. 5 shows a state in which live imaging images with matching time codes are associated, with imaging device A100 as the "reference imaging device" and imaging device B200 as the "target imaging device". In FIG. 5, first, the second association unit 3042 executes the following process. That is, the second association unit 3042 compares the time codes attached to the live imaging images of imaging device A100 and imaging device B200, and associates the live imaging image A1 of imaging device A100 and the live imaging image B1 of imaging device B200 with matching time codes. Thereafter, similarly, the second association unit 3042 associates the live imaging image A2 of imaging device A100 and the live imaging image B2 of imaging device B200 with matching attached time codes. Eventually, in step S301, the second association unit 3042 associates live imaging images with matching time codes between the two imaging devices (100, 200).

[0037] Once the association by the second association unit 3042 is completed as described above, under the control instruction of the control unit 301, the second association unit 3042 stores the second association result in the memory 303 and sends a completion signal to the control unit 301. Once the control unit 301 receives the completion signal, it proceeds to step S304 for processing.

[0038] Here, the "second association result" is, for example, an identifier that can uniquely identify each live imaging image of each associated imaging device, and the associated data that is the result of the association. The identifier that can be uniquely identified is the same as the first association result. In addition, it is assumed that the time codes used for associating the live imaging images between the reference imaging device (100) and the target imaging device (200) in step S303 have been synchronized in advance between the imaging devices. Also, the synchronization of the time codes does not need to be exactly the same, as long as they are synchronized to the extent that there is no audio confusion.

[0039] (Step S304) Next, in step S304, under the control instruction of the control unit 301, the third association unit 3043 refers to the first association result and the second association result, and associates the pre-imaging images corresponding to each live imaging image with each other.

[0040] (FIG. 6: Diagram for explaining the result of associating pre-capture images between imaging devices) FIG. 6 is a schematic explanatory diagram of the association in step S304. FIG. 6 shows how pre-capture images are associated between the imaging device A100 of the reference imaging device and the imaging device B200 of the target imaging device. In FIG. 6, first, the third association unit 3043 refers to the result in the second association result where the main capture image B1 of the imaging device B200 corresponds to the main capture image A1 of the imaging device A100.

[0041] Next, the third association unit 3043 grasps from the first association result that the pre-capture image A1 corresponds to the main capture image A1 of the imaging device A100. Similarly, the third association unit 3043 grasps from the first association result that the pre-capture image B1 corresponds to the main capture image B1 of the imaging device B200. From the correspondence relationships grasped above, the "pre-capture image A1 of the imaging device A100" and the "pre-capture image B1 of the imaging device B200" are associated. Thereafter, similarly, the third association unit 3043 associates the "pre-capture image A2 of the imaging device A100" with the "pre-capture image B2 of the imaging device B200".

[0042] Once the association by the third association unit 3043 is completed as described above, under the control instruction of the control unit 301, the third association unit 3043 stores the third association result in the memory 303 and sends a completion signal to the control unit 301. Once the control unit 301 receives the completion signal, the process proceeds to step S305. Here, the "third association result" is, for example, as described above, an identifier that can uniquely identify each pre-capture image of each imaging device after association, and the associated data and the like that are the result of the association. The identifier that can be uniquely identified is the same as the first association result.

[0043] (Step S305) Next, in step S305, the third association unit 3043 determines, according to the control instruction of the control unit 301, whether the process of step S304 has been completed for all imaging devices stored in the memory 303. If it is determined that the process is not completed (N), the third association unit 3043 sends an incomplete signal to the control unit 301 according to the control instruction of the control unit 301. As soon as the control unit 301 receives the incomplete signal, it causes the third association unit 3043 to execute the process of step S304 again. On the other hand, if it is determined that the process of step S304 has been completed for all imaging devices stored in the memory 303 (Y), the third association unit 3043 sends a completion signal to the control unit 301. As soon as the control unit 301 receives the completion signal, it ends the processing flow of FIG. 3.

[0044] Through the steps S301 to S305 described above, imaging images can be automatically associated based on imaging conditions, time codes, etc. associated with the imaging images. As a result, it is possible to automatically perform the association between the actual shooting images and the pre-shooting images, etc. between imaging devices for adjusting color, brightness, etc., while reducing the complexity for the user.

[0045] Note that in step S303, as shown in FIG. 5, the "actual shooting images" between imaging devices are associated using the synchronized time codes between the reference imaging device (100) and the target imaging device (200), but the association mode is not limited to this. Other information that ensures the simultaneity between the actual shooting images may be used. For example, the "actual shooting images" of the reference imaging device (100) and the target imaging device (200) may be associated based on the coincidence of the waveform information of the audio data associated with the imaging images. Alternatively, for example, a display device on which a code that changes moment by moment is displayed is placed within the imaging angle of view during imaging by each imaging device, and the "actual shooting images" between imaging devices may be associated using the fact that the code values extracted by image processing from the imaging images match. That is, information such as the time code displayed in the imaging image that ensures simultaneity is extracted by an image processing unit (not shown) provided in the control unit 301, and the association process of step S303 can be executed using the information extracted by the image processing unit.

[0046] <<Second Embodiment>> Next, a second embodiment of the present invention will be described. In the first embodiment described above, the case where there is an imaging image to be associated in the association of imaging images was shown. The second embodiment is characterized in that it adds processing for the case where there is no imaging image to be associated in the association of imaging images in the first embodiment. Since the configuration of the control device 300 in the second embodiment is the same as that in the first embodiment, duplicate explanations will be omitted.

[0047] <Basic Operation of the Second Embodiment> (Fig. 7: Flowchart showing the association process of imaging images in the second embodiment) With reference to Fig. 7, the characteristic processing of the second embodiment when there is no imaging image to be associated in the association of various imaging images in the first embodiment will be described. Note that the processing shown in Fig. 7 can also be applied when there are two or more imaging devices. The processing shown in Fig. 7 is started when the operation unit (not shown) of the control device 300 receives a user's processing start operation on the operation unit. Also, it is assumed that the designation of the reference imaging device (100) serving as the reference for color and luminance adjustment and the target imaging device (200) to be adjusted for color and luminance, and the designation of the imaging data are performed by the user before the start of the processing shown in Fig. 7. The imaging data and imaging conditions are the same as those in the first embodiment.

[0048] (Step S701) First, in step S701, the same processing as step S301 of the first embodiment shown in FIG. 3 is executed. That is, according to the control instruction of the control unit 301, the first association unit 3041 associates a pre-capture image and a live-capture image in which the imaging conditions attached to the imaging images match in the imaging images of the reference imaging device (100) and the target imaging device (200). Further, as soon as the association by the first association unit 3041 is completed, the first association result is stored in the memory 303 and a completion signal is sent to the control unit 301. When the control unit 301 receives the completion signal, it proceeds to the processing of step S702. Here, the first association result is data in which a pre-capture image and a live-capture image with matching imaging conditions are associated in the same manner as the association result of step S301 of the first embodiment 1, as shown in FIG. 4 for example.

[0049] (Step S702) Next, in step S702, the same processing as step S302 of the first embodiment shown in FIG. 3 is executed. That is, according to the control instruction of the control unit 301, the first association unit 3041 determines whether the processing of step S701 has been completed for all the imaging devices stored in the memory 303. If it is determined that not all the processing has been completed (N), the first association unit 3041 sends an incomplete signal to the control unit 301. When the control unit 301 receives the incomplete signal, it gives a control instruction to the first association unit 3041 again in step S701 to execute the processing of step S701. On the other hand, if it is determined that all the processing has been completed (Y), the first association unit 3041 sends a completion signal to the control unit 301. When the control unit 301 receives the completion signal, it proceeds to the processing of step S703.

[0050] (Step S703) Next, in step S703, according to the control instruction of the control unit 301, the first association unit 3041 extracts the live imaging images stored in the memory 303 that are not included in the first association result from among the live imaging images of each imaging device. Here, the "live imaging image" which is the extraction result (hereinafter referred to as the "first extraction result") is a live imaging image for which there is no pre-imaging image with matching imaging conditions. As soon as the extraction is completed, according to the control instruction of the control unit 301, the first association unit 3041 stores the first extraction result in the memory 303 and sends a completion signal to the control unit 301. As soon as the control unit 301 receives the completion signal, it proceeds with the processing to step S704.

[0051] Here, the "first extraction result" is, for example, data that enumerates identifiers that can uniquely identify each of the extracted live imaging images. Here, the identifier that can be uniquely identified is a character string composed of, for example, the model number, serial number, imaging date and time (year, month, day, hour, minute, second) of the imaging device that captured each imaging image.

[0052] (Step S704) Next, in step S704, according to the control instruction of the control unit 301, the first association unit 3041 refers to the first extraction result stored in the memory 303. If it determines that there is an extracted live imaging image (Y), it sends a corresponding signal to the control unit 301. As soon as the control unit 301 receives the corresponding signal, it proceeds with the processing to step S705. On the other hand, if the first association unit 3041 determines that there is no extracted live imaging image (N), it sends a non-corresponding signal to the control unit 301. As soon as the control unit 301 receives the non-corresponding signal, it proceeds with the processing to step S706.

[0053] (Step S705) Next, in step S705, according to the control instruction of the control unit 301, the first association unit 3041 generates an image for notification (hereinafter referred to as the "first notification image") based on the first extraction result stored in the memory 303. The generated first notification image is output to the display device 400 by the image output unit 306.

[0054] (Fig. 8: Explanation diagram of the first notification image) An example of the first notification image displayed by the display device 400 will be described with reference to FIG. 8. FIG. 8 shows a state in which, among the live imaging images of the imaging device A100 and the imaging device B200, the outer periphery of the live imaging image included in the first extraction result is highlighted by being surrounded by a thick line. In FIG. 8, first, all the live imaging images of the imaging device A100 are arranged in the order of time codes as live imaging image A1, live imaging image A2, and live imaging image A3 in the time axis direction. Here, nothing is displayed on the outer peripheries of the live imaging image A1 and the live imaging image A3 that are not included in the first extraction result. That is, no highlighting is performed. On the other hand, the outer periphery of the live imaging image A2 included in the first extraction result is highlighted by being surrounded by a thick line.

[0055] Similarly, for the imaging device B200, all the live imaging images are shown, and among them, only the outer periphery of the live imaging image B3 included in the first extraction result is highlighted by being surrounded by a thick line. Also, a character string indicating a sentence explaining the meaning surrounded by a thick line is displayed at the upper part of the display image. As described above, as soon as the output of the first notification image to the display device 400 is completed, the first association unit 3041 sends a completion signal to the control unit 301. As soon as the control unit 301 receives the completion signal, the process proceeds to step S706.

[0056] (Step S706) Next, in step S706, in the same manner as step S303 of the first embodiment shown in FIG. 3, the second association unit 3042 executes the following process according to the control instruction of the control unit 301. The second association unit 3042 associates the live imaging images with matching time codes between the reference imaging device (100) and the target imaging device (200). As soon as the association by the second association unit 3042 is completed, the second association result is stored in the memory 303 and a completion signal is sent to the control unit 301. As soon as the control unit 301 receives the completion signal, the process proceeds to step S707. Here, the "second association result" is the same as, for example, the association result of step S303 of the first embodiment shown in FIG. 3, and is data in which the live imaging images with matching time codes between the reference imaging device (100) and the target imaging device (200) are associated. Also, the time code used in step S706 is the same as that in step S303 of the first embodiment.

[0057] (Step S707) Next, in step S707, according to the control instruction of the control unit 301, the second association unit 3042 refers to the live imaging image of the reference imaging device (100) included in the first extraction result stored in the memory 303. Further, the second association unit 3042 extracts, with reference to the second association result stored in the memory 303, the live imaging image of the target imaging device (imaging device B200) whose time code matches the referred live imaging image (hereinafter referred to as "second extraction result"). As soon as the extraction is completed, according to the control instruction of the control unit 301, the second association unit 3042 stores the second extraction result in the memory 303 and sends a completion signal to the control unit 301. As soon as the control unit 301 receives the completion signal, it proceeds to step S708. Here, the "second extraction result" is, for example, data listing identifiers that can uniquely identify each extracted live imaging image, similar to the first extraction result in step S703.

[0058] (Step S708) Next, in step S708, according to the control instruction of the control unit 301, the second association unit 3042 refers to the second extraction result stored in the memory 303. If there is a live imaging image of the target imaging device (200) extracted (Y), the second association unit 3042 sends a corresponding signal to the control unit 301. As soon as the control unit 301 receives the corresponding signal, it proceeds to step S709. On the other hand, if there is no live imaging image of the target imaging device (200) extracted (N), the second association unit 3042 sends a non - corresponding signal to the control unit 301. As soon as the control unit 301 receives the non - corresponding signal, it proceeds to step S716.

[0059] (Step S709) Next, in step S709, according to the control instruction of the control unit 301, the second association unit 3042 generates an image for notification (hereinafter referred to as "second notification image") based on the first and second extraction results stored in the memory 303. The image output unit 306 outputs the generated second notification image to the display device 400. Here, an example of the second notification image to be displayed on the display device 400 is shown in FIG. 9.

[0060] (Fig. 9: Explanation diagram of the second notification image) Referring to Fig. 9, an example of the second notification image displayed by the display device 400 will be described. Fig. 9 shows, among the actual shooting images of the imaging device A100 as the reference imaging device and the imaging device B200 as the target imaging device, the outer periphery of the actual shooting images included in the first extraction result is highlighted by surrounding it with a thick solid line. Furthermore, it shows the state where the outer periphery of the actual shooting images included in the second extraction result is highlighted by surrounding it with a thick dotted line.

[0061] In Fig. 9, first, all the actual shooting images of the imaging device A100 are arranged and displayed in the order of time code in the time axis direction as the actual shooting image A1, the actual shooting image A2, and the actual shooting image A3. Here, nothing is displayed on the outer peripheries of the actual shooting image A1 and the actual shooting image A3 that are not included in the first extraction result, while the outer periphery of the actual shooting image A2 included in the first extraction result is highlighted by surrounding it with a thick solid line. Similarly, for the imaging device B200, all the actual shooting images are shown, and only the outer periphery of the actual shooting image B3 included in the first extraction result among them is highlighted by surrounding it with a thick solid line. Furthermore, for the imaging device B200 as the target imaging device, the outer periphery of the actual shooting image B2 included in the second extraction result is highlighted by surrounding it with a thick dotted line.

[0062] Finally, a character string indicating a sentence explaining the meaning surrounded by thick solid and dotted lines is displayed at the upper part of the image. As described above, once the output of the second notification image to the display device 400 is completed, the second association unit 3042 sends a completion signal to the control unit 301. Once the control unit 301 receives the completion signal, the process proceeds to step S710.

[0063] (Step S710) Next, in step S710, according to the control instruction of the control unit 301, the second association unit 3042 executes the following process. For each live imaging image (hereinafter referred to as "target image") of each target imaging device in the second extraction result stored in the memory 303, the second association unit 3042 extracts live imaging images (hereinafter referred to as "adjacent images") whose time codes are before and after that of the target image from the live imaging images of the same target imaging device. This extraction result is hereinafter referred to as the "third extraction result". As soon as the extraction by the second association unit 3042 is completed, according to the control instruction of the control unit 301, the second association unit 3042 stores the third extraction result in the memory 303 and sends a completion signal to the control unit 301. As soon as the control unit 301 receives the completion signal, it proceeds to the process in step S711. Here, the "third extraction result" is, for example, an identifier that can uniquely identify each target image and its adjacent images, and data of each target image and its adjacent images which are the results of the above extraction. Here, the identifier that can be uniquely identified is the same character string as in step S703.

[0064] (Step S711) Next, in step S711, according to the instruction of the control unit 301, the second association unit 3042 refers to the target image and its adjacent images stored in the memory 303. Then, the second association unit 3042 compares the imaging conditions associated with the target image with the imaging conditions associated with each of the adjacent images. As a result of the comparison, when only the imaging conditions of the target image and those of one of the adjacent images match (Y), according to the control instruction of the control unit 301, the second association unit 3042 sends a corresponding signal to the control unit 301. As soon as the control unit 301 receives the corresponding signal, it proceeds to the process in step S712. On the other hand, in other cases (N), the second association unit 3042 sends a non-corresponding signal to the control unit 301. As soon as the control unit 301 receives the non-corresponding signal, it proceeds to the process in step S713.

[0065] (Step S712) Next, in step S712, according to the control instruction of the control unit 301, the second association unit 3042 refers to the target image stored in the memory 303. Further, among the front and rear images, the second association unit 3042 refers to the in-field imaging image (hereinafter, "matching image") whose imaging conditions match the target image. Next, the second association unit 3042 associates the in-field imaging image of the reference imaging device (100) whose time code matches the matching image with the target image.

[0066] (Fig. 10: Explanation diagram for associating the in-field imaging image of the reference imaging device with the target image) Fig. 10 is an explanatory diagram of the outline of the processing content in step S712. In Fig. 10, first, all the in-field imaging images of the imaging device A100 are arranged and displayed in the order of time code in the time axis direction as in-field imaging image A1, in-field imaging image A2, and in-field imaging image A3. Here, nothing is displayed on the outer perimeters of the in-field imaging image A1 and the in-field imaging image A3 that are not included in the first extraction result, while the outer perimeter of the in-field imaging image A2 included in the first extraction result is highlighted by surrounding it with a thick solid line. Similarly, for the imaging device B200, all the in-field imaging images are shown, and among them, only the outer perimeter of the in-field imaging image B3 included in the first extraction result is highlighted by surrounding it with a thick solid line. Further, for the target imaging device (200), the outer perimeter of the in-field imaging image B2 which is the target image included in the second extraction result is highlighted by surrounding it with a thick dotted line. That is, including the highlighting in Fig. 10, the display of the in-field imaging images for the imaging device A and the imaging device B is the same as in Fig. 9.

[0067] Next, the second association unit 3042 refers to the in-field imaging image B2 of the imaging device B200 as the "target image", and further refers to the in-field imaging image B1 as the "matching image". Next, the second association unit 3042 associates the in-field imaging image A1 of the reference imaging device (100) whose time code matches the "matching image" in-field imaging image B1 with the in-field imaging image B2 which is the target image.

[0068] Once the association by the second association unit 3042 is completed, under the control instruction of the control unit 301, the second association unit 3042 stores the association result (hereinafter referred to as the "fourth association result") in the memory 303 and sends a completion signal to the control unit 301. Once the control unit 301 receives the completion signal, it proceeds to the process of step S716. Here, the "fourth association result" is, for example, an identifier that can uniquely identify each live imaging image of each associated imaging device, and the associated data that is the result of the association. Here, the identifier that can be uniquely identified is the same character string as the first extraction result in step S703.

[0069] (Step S713) Next, in step S713, under the control instruction of the control unit 301, the second association unit 3042 compares the imaging conditions between the target image stored in the memory 303 and the pre-and post-images in the same manner as in step S711. As a result of the comparison, when the second association unit 3042 determines that the imaging conditions of the target image match the imaging conditions of both the pre-and post-images (Y), the second association unit 3042 sends a corresponding signal to the control unit 301 under the control instruction of the control unit 301. Once the control unit 301 receives the corresponding signal, it proceeds to the process of step S714. On the other hand, in other cases (N), the second association unit 3042 sends a non-corresponding signal to the control unit 301. Once the control unit 301 receives the non-corresponding signal, it proceeds to the process of step S715.

[0070] (Step S714) Next, in step S714, under the control instruction of the control unit 301, the second association unit 3042 refers to the live imaging image of the reference imaging device whose time code is on the front side (hereinafter referred to as the "front image") with respect to the target image among the pre-and post-images stored in the memory 303. Then, the second association unit 3042 associates the live imaging image of the reference imaging device whose time code matches the front image with the target image in the same manner as in step S712. For example, as shown in FIG. 10, the second association unit 3042 associates the live imaging image A1 of the imaging device A100 (reference imaging device) whose time code matches the live imaging image B1 (front image) with the live imaging image B2 that is the target image.

[0071] Once the association by the second association unit 3042 is completed, under the control instruction of the control unit 301, the second association unit 3042 stores the association result (hereinafter referred to as the "fifth association result") in the memory 303 and sends a completion signal to the control unit 301. Once the control unit 301 receives the completion signal, it proceeds to the process in step S716. Here, the "fifth association result" is, for example, similar to the fourth association result in step S712, and is an identifier that can uniquely identify each live imaging image of each imaging device after association, and the associated data and the like that are the result of the association.

[0072] (Step S715) Next, in step S715, under the control instruction of the control unit 301, the second association unit 3042 generates an image for notification (hereinafter referred to as the "third notification image") for the target images determined in step S713 where the imaging conditions do not match both the front and rear images. The image output unit 306 outputs the generated third notification image to the display device 400.

[0073] (Fig. 11: Explanation diagram of the third notification image) Fig. 11 is an explanatory diagram of the third notification image displayed on the display device 400. In Fig. 11, all the live imaging images of the imaging device A100, which is the reference imaging device, are arranged in the order of time codes as live imaging image A1, live imaging image A2, and live imaging image A3 and displayed side by side in the time axis direction. Here, the second association unit 3042 does not display anything on the outer perimeters of the live imaging image A1 and the live imaging image A3 that are not included in the first extraction result, while the outer perimeter of the live imaging image A2 included in the first extraction result is surrounded by a thick solid line and highlighted. Similarly, for the imaging device B200, which is the target imaging device, all the live imaging images are displayed, and among them, only the outer perimeter of the live imaging image B3 included in the first extraction result is surrounded by a thick solid line and highlighted. Also, only the outer perimeter of the live imaging image B2, which is the target image included in the second extraction result, is surrounded by a thick dotted line and highlighted.

[0074] Here, the imaging condition of the target image, the actual shooting image B2, is "imaging condition B2", while the imaging conditions of the actual shooting images B1 and B3, which are the images before and after the target image, are imaging condition B1. Therefore, the imaging conditions do not match. In order to notify that the imaging conditions do not match, an "X" mark is displayed in the display area of the actual shooting image B2, which is the target image. Also, a string indicating a sentence explaining the meaning surrounded by a thick solid line and a thick dotted line at the upper part of the image and the meaning of the displayed "X" mark is displayed. As described above, as soon as the output to the display device 400 of the third notification image is completed, the second association unit 3042 sends a completion signal to the control unit 301. As soon as the control unit 301 receives the completion signal, it proceeds to the process of step S716.

[0075] (Step S716) Next, in step S716, according to the control instruction of the control unit 301, the second association unit 3042 executes the following process. That is, the second association unit 3042 determines whether the corresponding process in steps S711 to S715 has been completed for all the actual shooting images included in the third extraction result stored in the memory 303. If the second association unit 3042 determines that the corresponding process has not been executed yet and is incomplete (N), it sends an incomplete signal to the control unit 301. As soon as the control unit 301 receives the incomplete signal, it returns to the process of step S711 again. On the other hand, if the second association unit 3042 determines that the corresponding process has been all executed and is complete (Y), the second association unit 3042 sends a completion signal to the control unit 301. As soon as the control unit 301 receives the completion signal, it proceeds to the process of step S717.

[0076] (Step S717) Next, in step S717, according to the control instruction of the control unit 301, the third association unit 3043 refers to the second, fourth, and fifth association results stored in the memory 303. Next, according to the control instruction of the control unit 301, the third association unit 3043 refers to the imaging images (hereinafter referred to as "duplicate images") included in the fourth or fifth association results among the actual shooting images of the target imaging device included in the second association result. Then, according to the control instruction of the control unit 301, the third association unit 3043 overwrites and changes the second association result regarding the "duplicate images" with the fourth or fifth association result regarding the duplicate images and stores it in the memory 303. Thereafter, similar to step S304 of the first embodiment shown in FIG. 3, according to the control instruction of the control unit 301, the third association unit 3043 associates the pre-shooting images between the reference imaging device (100) and the target imaging device (200).

[0077] (Step S718) Then, in step S718, similar to step S305 of the first embodiment shown in FIG. 3, according to the control instruction of the control unit 301, the third association unit 3043 determines whether the processing for all the imaging images has been completed. If it is determined by the third association unit 3043 that the state is still incomplete and not yet completed (N), the control unit 301 returns the process to step S717. On the other hand, if it is determined by the third association unit 3043 that the state is a completed state where all the processing has been completed (Y), the control unit 301 ends the series of processes shown in FIG. 7.

[0078] Through the above steps, in the association of various imaging images of the first embodiment, even when there are no imaging images to be associated, the association is automatically performed based on imaging images with adjacent time codes and the like. As a result, it is possible to perform the association of imaging images for color and luminance adjustment while reducing the complexity for the user.

[0079] <<Modification Example>> In steps S705, S709, and S715, when notifying various extraction results, the relevant location is surrounded by a solid line, a dotted line, etc., or an "X" mark is displayed. However, the display mode when performing display notification is not limited to these. For example, it may be any display mode that allows the user to immediately grasp the notification content, such as coloring the corresponding captured image with a color corresponding to the content to be notified. Also, for the target image that is the notification target in step S715, the second association unit 3042 may determine and associate the actual operation captured image of the reference imaging device (imaging device A100) to be associated based on the user's specification.

[0080] Also, in step S706, when there is an actual operation captured image of the target imaging device (200) for which there is no actual operation captured image of the reference imaging device with a matching time code, the following processing may be executed. That is, for the captured image, the same processing from step S709 to step S716 may be executed, and it may be associated with the actual operation captured image of the reference imaging device (100), or if the imaging conditions do not match the previous and subsequent images, that fact may be notified. Also, for the target image that has become the notification target, the actual operation captured image of the reference imaging device (100) to be associated may be determined and associated based on the user's specification.

[0081] Also, when there is no actual operation captured image of the reference imaging device (100) for which the time code matches the actual operation captured image of the target imaging device (200), the control unit 301 may execute the following processing. That is, in such a case, the control unit 301 controls the image output unit 306 to notify information indicating the actual operation captured image of the target imaging device (200) (fourth notification unit). Also, regarding the association in the first association unit 3041, the second association unit 3042, and the third association unit 3043, it is also possible to adopt a configuration that allows the pre-captured image and / or the actual operation captured image to be associated to be changed based on the user's specification.

[0082] In addition, not limited to the association result, association may be enabled based on a user's designation for any captured images stored in the memory 303. Note that, in the first and second embodiments, the "association" is performed based on the coincidence of imaging conditions, time codes, etc. associated with each captured image, but the coincidence does not necessarily have to be a perfect match. For example, regarding the pan / tilt angle and the time code, if the difference between them is within the range designated by the user as a result of comparison for the purpose of association, it may be determined that they match. Also, for example, when the imaging apparatuses A100 and B200 include a plurality of imaging modes, it is also possible to determine that the imaging conditions match between the captured images captured by selecting a specific imaging mode from among them.

[0083] Further, the present invention is applicable not only to still images but also to moving images. In the case of a moving image, if the imaging conditions are held for each frame as described above, the first association unit 3041, the second association unit 3042, and the third association unit 3043 can perform association in S301, S303, and S304 based on that information. Also, for example, the imaging conditions may be displayed at the lower right or the like of the moving image constantly or at a predetermined period, or the time code may also be constantly displayed at the lower right of the moving image. An image processing apparatus (not shown) included in the control unit 301 extracts these pieces of information, and based on the extracted information, the first association unit 3041, the second association unit 3042, and the third association unit 3043 can perform association in S301, S303, and S304. Also, a configuration may be adopted in which the user can designate a moving image as a color matching reference for each moving image to be color-matched. Further, the control unit 301 can also highlight and notify a frame for which association between cameras is impossible among the imaging frames of the camera (200) to be color-matched.

[0084] By miniaturizing the device according to the present invention and improving its portability, there can be other usage modes. For example, by bringing the device to the imaging site, it becomes possible to quickly perform color and luminance adjustment of the pre-imaging images of the target imaging device (200) and the reference imaging device (100) on-site. As a result, by performing color and luminance adjustment between the pre-imaging images and then performing main imaging, color and luminance adjustment between the subsequent main imaging images becomes easier than before.

[0085] (Other) As described above, the preferred embodiments of the present invention have been explained, but the present invention is not limited to these embodiments, and various changes and modifications of the embodiments may be made within the scope of the gist, and these are also included in the present invention. For example, some of the above-described embodiments may be appropriately combined. Also, it may be realized by storing a program for realizing the functions according to the present invention in a storage medium and directly executing it, or by downloading and executing the program using wired communication / wireless communication from a specific site or the like.

[0086] Also, in order to realize the functions according to the present invention by a computer, the program code itself supplied to and installed in the computer also realizes the present invention. That is, the computer program itself for realizing the functions according to the present invention is also included in the present invention. In this case, regardless of the type of program such as object code, a program executed by an interpreter, and script data supplied to the OS, as long as it has the functions of the program.

[0087] Examples of the storage medium for supplying the program include magnetic storage media such as hard disks and magnetic tapes, optical / photo-magnetic storage media, and non-volatile semiconductor memories. Also, as a method of supplying the program, a computer program constituting the present invention may be stored in a server on a network, and a client terminal connected to the network may download and execute the computer program.

[0088] <Supplementary Note> The disclosure of this embodiment includes the following configurations, methods, and programs. (Configuration 1) An image editing apparatus having storage means for storing a pre-capture image captured in advance and a live capture image captured during a live event in each of a reference camera serving as a color and luminance matching standard and a target camera to be color and luminance matched, first association means for associating the pre-capture image and the live capture image in each of the reference camera and the target camera based on imaging conditions associated with the imaging image, second association means for associating the live capture image of the reference camera and the live capture image of the target camera based on simultaneity guarantee information for guaranteeing simultaneity in the imaging image, third association means for associating the pre-capture image of the reference camera and the pre-capture image of the target camera with reference to the association results by the first association means and the second association means, characterized in that the color and luminance of the live capture image of the target camera can be adjusted to match the color and luminance of the live capture image of the corresponding reference camera. (Configuration 2) The image editing apparatus according to Configuration 1, further comprising first notification means for notifying, in a notification mode indicating that there is no pre-capture image corresponding to a live capture image when there is a live capture image for which no pre-capture image can be associated as a result of the association between the pre-capture image and the live capture image by the first association means. (Configuration 3) The image editing apparatus according to Configuration 2, further comprising second notification means for notifying, in a manner indicating the live capture image of the target camera associated by the second association means with respect to the live capture image of the reference camera that is the notification target of the first notification means among the live capture images of the reference camera. (Configuration 4) The second association means further In the association of the live imaging image of the target camera which is the notification target of the second notification means, re-associate with the live imaging image of the reference camera corresponding to the live imaging image in which the imaging conditions attached to the imaging image are the same among the live imaging images of the target camera whose time codes are before and after the said live imaging image. The image editing apparatus according to Configuration 3. (Configuration 5) The second association means further In the association of the live imaging image of the target camera which is the notification target of the second notification means, when the imaging conditions match both of the live imaging images whose time codes are before and after the said live imaging image, re-associate with the live imaging image of the reference camera corresponding to the live imaging image whose time code is before. The image editing apparatus according to Configuration 3 or 4. (Configuration 6) When the imaging conditions of the live imaging image of the target camera which is the notification target of the second notification means do not match either of the imaging conditions of both of the live imaging images whose time codes are before and after the said live imaging image, further include third notification means for notifying information indicating non-matching. The image editing apparatus according to Configuration 3 or 4. (Configuration 7) The second association means further For the live imaging image of the target camera which is the notification target of the third notification means, determine and associate the live imaging image of the reference camera to be associated based on the user's designation. The image editing apparatus according to Configuration 6. (Configuration 8) When there is no live imaging image of the reference camera that matches the live imaging image of the target camera in terms of time code, further include fourth notification means for notifying information indicating the live imaging image of the target camera. The image editing apparatus according to Configuration 6. (Configuration 9) The first notification means further Highlight the said live imaging image so that it can be understood that there is no pre-imaging image corresponding to the live imaging image, and display a character string explaining that fact. The image editing apparatus according to Configuration 2. (Configuration 10) The second notification means further characterized in that the live imaging image of the target camera associated by the second association means with respect to the live imaging image is highlighted and a character string explaining the fact is displayed, the image editing apparatus according to Configuration 3. (Configuration 11) In the association in the first association means, the second association means, and the third association means, the pre-imaging image and / or the live imaging image to be associated can be changed based on a user's designation, the image editing apparatus according to any one of Configurations 1 to 4. (Configuration 12) The imaging conditions are at least one of pan, tilt, zoom, white balance, aperture, and shutter speed, the image editing apparatus according to any one of Configurations 1 to 4. (Configuration 13) The simultaneity guarantee information for guaranteeing simultaneity in the captured image is a time code displayed in the captured image, the image editing apparatus according to any one of Configurations 1 to 4. (Configuration 14) The pre-imaging image and the live imaging image in each of the reference camera and the target camera are a still image or a moving image, the image editing apparatus according to any one of Configurations 1 to 4. (Method) A control method of an image editing apparatus having storage means for storing a pre-imaging image captured in advance and a live imaging image captured in a live broadcast in each of a reference camera serving as a color / brightness matching reference and a target camera to be color / brightness matched, a first association step of associating the pre-imaging image and the live imaging image in each of the reference camera and the target camera based on imaging conditions attached to the captured image; a second association step of associating the live imaging image of the reference camera and the live imaging image of the target camera based on simultaneity guarantee information for guaranteeing simultaneity in the captured image; A third association step of associating a pre-capture image of the reference camera and a pre-capture image of the target camera with reference to the association results of the first association step and the second association step; A control method for an image editing apparatus, characterized in that the color and brightness of the live capture image of the target camera can be adjusted to match the color and brightness of the live capture image of the corresponding reference camera. (Program) A program for causing a computer to execute a control method for an image editing apparatus having storage means for storing pre-capture images acquired in advance and live capture images acquired during a live shoot in each of a reference camera serving as a color / brightness adjustment reference and a target camera serving as a color / brightness adjustment target, The control method includes: A first association step of associating, for each of the reference camera and the target camera, a pre-capture image and a live capture image based on the imaging conditions associated with the imaging images; A second association step of associating the live capture image of the reference camera and the live capture image of the target camera based on simultaneity guarantee information that guarantees simultaneity in the imaging images; A third association step of associating the pre-capture image of the reference camera and the pre-capture image of the target camera with reference to the association results of the first association step and the second association step; A program, characterized in that the color and brightness of the live capture image of the target camera can be adjusted to match the color and brightness of the live capture image of the corresponding reference camera.

[0089] As described above, the preferred embodiments of the present invention have been explained. However, the present invention is not limited to the above-described embodiments, and various modifications and changes are possible within the scope of the gist. For example, the present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a recording medium, and having a processor of a computer in the system or apparatus read and execute the program. Further, the present invention can also be realized by a circuit (for example, an ASIC) that realizes one or more functions.

Explanation of Signs

[0090] 100 Imaging device A 200 Imaging device B 300 Control device 301 Control unit 302 Imaging data input unit 303 Memory 304 Imaging image association unit 3041 First association unit 3042 Second association unit 3043 Third association unit 305 Image correction unit 306 Image output unit 307 Control bus 400 Display device

Claims

1. An image editing apparatus having storage means for storing a pre-captured image captured in advance and a live-captured image captured during a live event in each of a reference camera serving as a color and luminance matching standard and a target camera to be color and luminance matched, first associating means for associating the pre-captured image and the live-captured image in each of the reference camera and the target camera based on imaging conditions associated with the captured image, second associating means for associating the live-captured image of the reference camera and the live-captured image of the target camera based on simultaneity guarantee information for guaranteeing simultaneity in the captured image, third associating means for associating the pre-captured image of the reference camera and the pre-captured image of the target camera with reference to the association results by the first associating means and the second associating means, and characterized in that the color and luminance of the live-captured image of the target camera can be adjusted to match the color and luminance of the live-captured image of the corresponding reference camera.

2. The image editing apparatus according to claim 1, further comprising first notification means for notifying, in a notification mode indicating that there is no pre-captured image corresponding to a live-captured image for which no associable pre-captured image exists as a result of the association of the pre-captured image and the live-captured image by the first associating means.

3. The image editing apparatus according to claim 2, further comprising second notification means for notifying, in a mode indicating the live-captured image of the target camera associated by the second associating means with respect to the live-captured image of the reference camera that is the notification target of the first notification means among the live-captured images of the reference camera.

4. The second associating means further comprises: In the association of the live-captured image of the target camera that is the notification target of the second notification means, re-associating with the live-captured image of the reference camera corresponding to the live-captured image of the target camera in which the imaging conditions associated with the captured image are the same among the live-captured images of the target camera whose time codes are before and after that of the live-captured image. The image editing apparatus according to claim 3.

5. The second associating means further comprises: In the association of the actual shooting image of the target camera which is the notification target of the second notification means, when the shooting conditions match both the actual shooting image and the actual shooting images whose time codes are before and after, the image editing apparatus according to claim 3 or 4, characterized in that the association is re - made with the actual shooting image of the reference camera corresponding to the actual shooting image with the earlier time code.

6. When the shooting conditions of the actual shooting image of the target camera which is the notification target of the second notification means do not match any of the shooting conditions of both the actual shooting image and the actual shooting images whose time codes are before and after, the image editing apparatus according to claim 3 or 4, further comprising third notification means for notifying information indicating non - matching.

7. The second association means further For the actual shooting image of the target camera which is the notification target of the third notification means, the image editing apparatus according to claim 6, characterized in that the actual shooting image of the reference camera to be associated is determined and associated based on the user's designation.

8. When there is no actual shooting image of the reference camera that matches the actual shooting image of the target camera in terms of time code, the image editing apparatus according to claim 6, further comprising fourth notification means for notifying information indicating the actual shooting image of the target camera.

9. The first notification means further The image editing apparatus according to claim 2, characterized in that the actual shooting image is highlighted so that it can be understood that there is no pre - shooting image corresponding to the actual shooting image, and a character string explaining that fact is displayed.

10. The second notification means further The image editing apparatus according to claim 3, characterized in that the actual shooting image of the target camera associated by the second association means with respect to the actual shooting image is highlighted so that it can be understood, and a character string explaining that fact is displayed.

11. In the associations in the first association means, the second association means, and the third association means, the image editing apparatus according to any one of claims 1 to 4, characterized in that the pre - shooting image and / or the actual shooting image to be associated can be changed based on the user's designation.

12. The shooting conditions are at least one of pan, tilt, zoom, white balance, aperture, and shutter speed, the image editing apparatus according to any one of claims 1 to 4.

13. The image editing apparatus according to any one of claims 1 to 4, characterized in that the simultaneity guarantee information for guaranteeing simultaneity in the captured image is a time code displayed in the captured image.

14. The image editing apparatus according to any one of claims 1 to 4, characterized in that the pre-captured image and the live-captured image in each of the reference camera and the target camera are still images or moving images.

15. A control method for an image editing apparatus having storage means for storing a pre-captured image captured in advance and a live-captured image captured during a live broadcast in each of a reference camera serving as a color / brightness adjustment reference and a target camera to be adjusted for color / brightness, a first association step of associating the pre-captured image and the live-captured image in each of the reference camera and the target camera based on imaging conditions attached to the captured image; a second association step of associating the live-captured image of the reference camera and the live-captured image of the target camera based on simultaneity guarantee information for guaranteeing simultaneity in the captured image; a third association step of associating the pre-captured image of the reference camera and the pre-captured image of the target camera with reference to the association results of the first association step and the second association step, and characterized in that it enables the color and brightness of the live-captured image of the target camera to be adjusted to match the color and brightness of the live-captured image of the corresponding reference camera.

16. A program for causing a computer to execute a control method for an image editing apparatus having storage means for storing a pre-captured image captured in advance and a live-captured image captured during a live broadcast in each of a reference camera serving as a color / brightness adjustment reference and a target camera to be adjusted for color / brightness, wherein the control method includes a first association step of associating the pre-captured image and the live-captured image in each of the reference camera and the target camera based on imaging conditions attached to the captured image; a second association step of associating the live-captured image of the reference camera and the live-captured image of the target camera based on simultaneity guarantee information for guaranteeing simultaneity in the captured image; and a third association step of associating the pre-captured image of the reference camera and the pre-captured image of the target camera with reference to the association results of the first association step and the second association step. A program characterized by enabling the color and brightness of the live imaging image of the target camera to be adjusted to match the color and brightness of the live imaging image of the corresponding reference camera.

Images