Imaging apparatus, control method for the same, imaging system, and program

Abstract

To enable a master camera and a remote camera to work together more reliably for capturing an image.SOLUTION: An imaging system has switching means for switching between a first mode and a second mode, communication means for connecting to an external imaging apparatus via a network, imaging means for repeatedly performing a process of imaging a subject and outputting first image data in accordance with an imaging instruction received from the external imaging apparatus when in a first mode, storage means for holding the first image data sequentially, image processing means for generating a second image data for recording by performing image processing on the first image data, calculation means for calculating an evaluation value of the first image data, and control means. In the first mode, the image processing means processes unprocessed first image data in the order of priority on the basis of evaluation values. When receiving the imaging instruction, the first image data held in the storage means is discarded before the imaging means starts capturing an image.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an imaging device, a control method thereof, an imaging system, and a program, and more particularly to a photography control technique in an imaging system made up of a plurality of imaging devices. [Background technology]

[0002] Conventionally, systems have been known that use multiple cameras to take pictures at events such as sports, photo sessions, etc. Patent Document 1 proposes a system in which a digital camera is equipped with a communication function, image data captured by the multiple cameras is transmitted to an external device located in one place via wireless communication or the like, and the image data is stored for each digital camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-148215 Summary of the Invention [Problem to be solved by the invention]

[0004] The conventional technology disclosed in Patent Document 1 can save the storage capacity of the digital camera's recording media, but the total number of images sent from multiple cameras to the external device becomes very large, which places a heavy burden on the person who wants to select images after taking them.

[0005] In addition, one of the multiple cameras can be configured as a master camera and the other cameras as remote cameras, with photography being linked to the release operation of the master camera, and photography being performed according to the judgment of the remote camera. However, in this case, the number of images to be processed by the remote camera increases, which extends the processing time and increases the risk of missing a photography opportunity linked to the release operation of the master camera, but this is not taken into consideration in the prior art.

[0006] The present invention has been made in consideration of the above-mentioned problems, and has as its object to enable a master camera and a remote camera to perform photography in a more reliable manner in conjunction with each other. [Means for solving the problem]

[0007] In order to achieve the above object, the imaging device of the present invention has a switching means for switching between a first mode and a second mode, a communication means for connecting to an external imaging device via a network, an imaging means for, in the first mode, repeatedly photographing a subject in accordance with a shooting instruction received from the external imaging device and outputting first image data, a storage means for sequentially storing the first image data, an image processing means for performing image processing on the first image data stored in the storage means to generate second image data for recording, a calculation means for calculating an evaluation value of the first image data, and a control means, wherein, in the first mode, the image processing means performs image processing on the unprocessed first image data stored in the storage means, starting with the first image data having the highest priority based on the evaluation value, and when the control means receives the shooting instruction, it controls the control means to discard the first image data stored in the storage means before starting shooting by the imaging means. [Effects of the Invention]

[0008] According to the present invention, it is possible to more reliably perform photography in conjunction with the master camera and the remote camera. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic diagram showing an example of the configuration of an imaging system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a block diagram showing the functional configuration of a digital camera according to an embodiment. [Figure 3] FIG. 2 is a block diagram showing the functional configuration of an image processing unit according to the embodiment. [Figure 4]5 is a timing chart showing the timing of the photographing operation and the developing operation for recording in the master camera and the remote camera according to the embodiment. [Figure 5] 10 is a flowchart for explaining master photographing processing in the master camera according to the embodiment. [Figure 6] 10 is a flowchart for explaining a remote shooting process in a remote camera according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] In the following description, the present invention will be described in terms of its application to an imaging device, and a digital camera will be used as an example of the imaging device. However, the imaging device is not limited to a digital camera, and may be any electronic device with a camera function, such as a digital video camera, a camera-equipped mobile phone, a camera-equipped computer, a game console, etc.

[0012] Fig. 1 is a schematic diagram showing an example of the configuration of an imaging system according to an embodiment of the present invention. As shown in Fig. 1, the imaging system of this embodiment has a configuration in which multiple digital cameras 100 and a server 101 having a large-capacity storage (external storage device) are connected via a network 102 such as a wired or wireless LAN. In this embodiment, it is assumed that one of the multiple digital cameras 100 operates as a master camera and the others operate as remote cameras.

[0013] FIG. 2 is a block diagram showing the functional configuration of the digital camera 100 according to this embodiment. The control unit 201 is, for example, a CPU, and reads out the operation programs of each component of the digital camera 100 from the ROM 202, expands them into the RAM 203, and executes them to control the operation of each component of the digital camera 100. The ROM 202 is a rewritable non-volatile memory, and stores the operation programs of each component of the digital camera 100 as well as parameters and the like required for the operation of each component. The RAM 203 is a rewritable volatile memory, and is used as a temporary storage area for data output during the operation of each component of the digital camera 100.

[0014] The optical system 204 includes a plurality of lenses and an aperture, and forms an optical image of a subject on the imaging unit 205. The optical system 204 may be configured integrally with the digital camera 100, or may be configured to be detachable.

[0015] The imaging unit 205 includes an imaging element such as a CCD or CMOS sensor, and photoelectrically converts an optical image formed on the imaging element by the optical system 204 to output an image signal. In this embodiment, the imaging element is covered with a Bayer array color filter, and each pixel outputs an analog image signal of one of the color components red (R), green (G), or blue (B). The output analog image signal is input to the A / D conversion unit 206, which applies A / D conversion processing to the input analog image signal and outputs the resulting digital image data (RAW image data) to the RAM 203 for storage.

[0016] An image processing unit 207 applies various processes to the RAW image data stored in the RAM 203, such as image processing and calculation of image evaluation values, which will be described later.

[0017] The recording medium 208 is a removable memory card or the like, and records image data for recording that has been image-processed for recording by the image processing unit 207, RAW image data that has been A / D converted by the A / D conversion unit 206, etc. Furthermore, the image evaluation value calculated by the image processing unit 207 is recorded in association with the image data for recording, such as in the header of the image data for recording, and can be used for selecting images after shooting.

[0018] The display unit 209 is a display device such as an LCD, and provides an electronic viewfinder function by displaying images captured by the imaging unit 205 through the display, and also plays back and displays images recorded on the recording medium 208, and displays various information. The control unit 201 can also cause the display unit 209 to play back and display an icon display or the like based on the image evaluation value recorded in the header of the image data for recording, superimposed on the corresponding image, and to display the results of a narrowed search based on the image evaluation value.

[0019] The communication unit 210 is used for communication between the digital cameras 100 and for transferring image data recorded on the recording medium 208 or the like to the server 101 via the network 102 .

[0020] The operation unit 211 is composed of various buttons, switches, a touch panel, etc., and includes a release button for issuing a shooting instruction and a mode selection switch for selecting whether the digital camera 100 operates in master camera mode or remote camera mode. When the master camera mode is selected, the digital camera 100 operates as a master camera, and when the remote camera mode is selected, the digital camera 100 operates as a remote camera. In this embodiment, as described above, when an imaging system is constructed using multiple digital cameras 100, one digital camera 100 operates in master camera mode and the remaining digital cameras 100 operate in remote camera mode.

[0021] FIG. 3 is a block diagram showing the functional configuration of the image processing unit 207 in this embodiment. The recording development unit 301 inputs RAW image data in a Bayer array stored in the RAM 203. Then, it applies various image processing to the input RAW image data to generate YUV image data for recording, such as white balance adjustment, color interpolation, gamma correction, edge emphasis, noise reduction, and reduction / enlargement, and outputs the processed YUV image data for recording.

[0022] Here, the RAW image data is assumed to be RAW image data in a Bayer array, and the recording image data is assumed to be YUV image data, but the present invention is not limited to this. For example, the RAW image data may be data in an RGB format obtained by an image sensor with three RGB chips, and the recording image data may be in an RGB format.

[0023] The image conversion unit 303 inputs RAW image data in a Bayer array and converts it into simplified Y image data. The Bayer array is a 2x2 repeating array of four pixels, each consisting of an R pixel, two G pixels, and a B pixel. Here, the Y signal is generated by averaging these four pixels, and the Y signal is converted into simplified Y image data that is reduced to half vertically and half horizontally. By employing such simple calculations, image conversion can be performed faster than the recording development unit 301, which performs complex calculations.

[0024] The input selection unit 304 selects either the recording image data output from the recording development unit 301 or the simple Y image data output from the image conversion unit 303, and inputs this to the image evaluation unit 302. In this embodiment, in accordance with the mode selection by the operation unit 211, if the digital camera 100 is operating in the master camera mode, the input selection unit 304 selects the recording image data, and if it is operating in the remote camera mode, the input selection unit 304 selects the simple Y image data.

[0025] The image evaluation unit 302 calculates and outputs the degree of blur or shake of the image as an image evaluation value for the recording image data or simplified Y image data selected by the input selection unit 304. Note that the method for calculating the evaluation value of the blur and shake of the image may be any known technique, and for example, the method disclosed in Japanese Patent Application Laid-Open No. 2009-253936 may be used.

[0026] Furthermore, although the degree of blur and shaking has been used as the image evaluation value, the present invention is not limited to this. For example, if the subject is a person, the evaluation value may be an evaluation value of facial expressions such as facial direction, blinking, and emotions (smile, surprise, anger, sadness, etc.). For example, the smile level disclosed in Japanese Patent Laid-Open Publication No. 2012-104900 may be used as the image evaluation value.

[0027] Next, the timing of the photographing operation and the developing operation for recording in the master camera and the remote camera will be described. Fig. 4 is a timing chart specifically explaining an example of the photographing operation and the developing operation for recording in the master camera and the remote camera.

[0028] Here, as an example, each digital camera 100 will be described as performing a shooting operation and a recording development operation under the following conditions. First, in the shooting operation, RAW image data is read from the imaging unit 205 at 30 frames per second and stored in the RAM 203. Furthermore, shooting continues for three seconds for each shooting instruction issued by pressing the release button. In the recording development operation, RAW image data is read from the RAM 203 at 20 frames per second, which is slower than the shooting operation, and is developed, and the memory area for the processed RAW image data is released. It is assumed that a memory area for storing RAW image data for 120 frames is secured.

[0029] When the release button is pressed, the master camera takes continuous shots for a period 401 (3 seconds), during which RAW image data for 30 frames / second x 3 seconds = 90 frames is stored in the memory area of ​​RAM 203. Meanwhile, during a period 403, the recording development unit 301 executes a recording development operation. That is, the memory area is occupied for 90 frames ÷ 20 frames / second = 4.5 seconds, and then released. At this time, the image evaluation unit 302 of the master camera uses the recording image data to determine and output the image evaluation value described above.

[0030] Furthermore, if the release button is pressed again 0.5 seconds after the end of the development operation for recording, continuous shooting will occur again for period 402 (3 seconds). During this time, RAW image data will be written to the released memory area of ​​RAM 203, and the development operation for recording will be executed for period 404. The above process is performed each time the release button is pressed.

[0031] Note that the memory area is not released until processing of the RAW image data held in the memory area of ​​RAM 203 is completed. Therefore, for example, while image processing for recording is being performed, a message indicating that photography is not possible may be displayed on the display unit 209, or the release button may be locked so that it cannot be pressed, and when the memory area is released, the message may be turned off or the lock may be released. Alternatively, when photography is possible, a message indicating that photography is possible may be displayed.

[0032] Meanwhile, the remote camera continuously captures images for a period 405 (four seconds). The first three seconds of the period 405 are a capture period linked to pressing the release button on the master camera, and the last one second is a capture period determined by the remote camera as a release opportunity. During the period 405, RAW image data for 120 frames (30 frames / second x 4 seconds) is stored in the memory area of ​​the RAM 203. Meanwhile, during a period 407, the recording development unit 301 executes a recording development operation. In parallel with the recording development operation, the image conversion unit 303 of the image processing unit 207 converts the RAW image data into simplified Y image data, and the image evaluation unit 302 calculates an image evaluation value using the simplified Y image data. At this time, the recording development unit 301 and the image conversion unit 303 perform processes independently of each other, and can process different RAW image data. The recording development unit 301 of the remote camera then reads out the RAW image data with the highest image evaluation value at that time from among the unprocessed RAW image data stored in the memory area of ​​the RAM 203, and performs the recording development operation. Note that if the image evaluation value has not been calculated or if the image evaluation values ​​are the same, priorities can be assigned as appropriate, such as processing the RAW image data captured first. The image evaluation value obtained using the simplified Y image data is then recorded in the header of the resulting recording image data.

[0033] When performing the recording development operation on all 120 RAW image data, the memory area is occupied for 120 frames divided by 20 frames per second = 6 seconds, and then released. However, in the example shown in FIG. 4, the next shooting instruction is received from the master camera before 6 seconds have elapsed, so unprocessed RAW image data remains in the memory area of ​​RAM 203. In such a case, in this embodiment, the recording development operation is terminated at that point, and the memory area is released. As a result, the unprocessed RAW image data is discarded, but the discarded RAW image data has a low image evaluation value.

[0034] If the remote camera does not determine that there is a release opportunity, the continuous shooting ends in the same three seconds as the master camera. Therefore, the recording development operation for all 90 RAW image data stored in RAM 203 can be completed by the time the release button on the master camera is next pressed.

[0035] By controlling as described above, the remote camera can stop the development operation for recording RAW image data with a low image evaluation value, thereby prioritizing the next shooting operation. Also, the master camera can directly evaluate the developed image for recording, thereby improving the accuracy of image evaluation.

[0036] FIG. 5 is a flowchart for explaining the master photographing process when the digital camera 100 is operating in the master camera mode. In S501, the control unit 201 determines whether to end the photographing process, for example, by turning off the power or by switching to an operation mode other than photographing, such as playback or setting. If the photographing operation is to be ended, the master photographing process is ended, and if the photographing process is to be continued, the process proceeds to S502.

[0037] In S502, the control unit 201 determines whether the release button has been pressed. If it has not been pressed, the process returns to S501. If pressing of the release button is detected in S502, the process proceeds to S503, where the shooting operation is started and a shooting instruction (remote shooting instruction) is sent to the remote camera via the communication unit 210. As described above with reference to FIG. 4, continuous shooting is performed at predetermined intervals for a predetermined time after the release button is pressed, and the obtained RAW image data is sequentially stored in the memory area of ​​the RAM 203. Then, in S504, the image processing unit 207 starts image processing of the RAW image data stored in the memory area of ​​the RAM 203. Here, the recording development unit 301 performs a recording development operation on the RAW image data of each frame to generate recording image data, and the image evaluation unit 302 calculates an image evaluation value using the generated recording image data, and records the recording image data and the image evaluation value on the recording medium 208.

[0038] In S505, the control unit 201 determines whether a predetermined time has elapsed, and if so, proceeds to S506, where the photographing operation ends. Note that even at this time, processing of the RAW image data stored in the memory area of ​​the RAM 203 continues.

[0039] Then, the process proceeds to S507, where the control unit 201 determines whether processing of all RAW image data stored in the memory area of ​​the RAM 203 has been completed and the memory area has been freed. If image processing is continuing, the determination of S507 is repeated, and once image processing is completed and the memory area has been freed, the process returns to S501. After this, the next shooting process becomes possible.

[0040] FIG. 6 is a flowchart for explaining the remote photographing process when the digital camera 100 is operating in the remote camera mode. In S601, the control unit 201 determines whether to end the photographing process, for example, by turning off the power or by switching to an operation mode other than photographing, such as playback or setting, as in S501. If the photographing operation is to be ended, the remote photographing process ends, and if the photographing process is to be continued, the process proceeds to S602.

[0041] In S602, the control unit 201 determines whether a remote shooting instruction has been received from the master camera (external image capture device), and if not received, returns to S601, and if a remote shooting instruction has been received, proceeds to S603.

[0042] In S603, the shooting operation is started. Here, as described above with reference to FIG. 4, continuous shooting is performed at a predetermined interval for a predetermined time after receiving a remote shooting instruction, and the obtained RAW image data is sequentially stored in the memory area of ​​the RAM 203. Then, in S604, the image processing unit 207 starts image processing of the RAW image data stored in the memory area of ​​the RAM 203. Here, in the remote camera, the recording development unit 301, as described above, performs a recording development operation on the RAW image data with the highest priority among the unprocessed RAW image data stored in the memory area of ​​the RAM 203, to generate recording image data. Furthermore, the image conversion unit 303 generates simple Y image data, and the image evaluation unit 302 calculates an image evaluation value using the generated simple Y image data. The calculated image evaluation value is used to determine the priority of the RAW image data to be subjected to the recording development operation by the recording development unit 301.

[0043] Next, in S605, the control unit 201 determines whether a predetermined time has elapsed, and if it determines that the predetermined time has elapsed, the process proceeds to S606.

[0044] In S606, it is determined whether or not to continue shooting. Here, the remote camera determines whether or not there is a release chance, and if it determines that there is a release chance, it proceeds to S607 and continues shooting for an additional predetermined time. The determination of whether or not there is a release chance is made, for example, by evaluating image data captured for the electronic viewfinder function of the display unit 209, and determining that there is a release chance when the subject's frontal face, smiling face, etc. is detected continuously for a certain period of time. Note that the determination of a release chance is not limited to this, and any arbitrary conditions may be used for the determination.

[0045] If it is determined in S606 that there is no release chance, that is, if it is determined that continuous shooting will not be performed, or if the additional shooting operation is completed in S607, the process proceeds to S608. In S608, it is determined whether image processing of all RAW image data stored in the memory area of ​​RAM 203 has been completed and the memory area has been released, and if it has been completed, the process returns to S601.

[0046] On the other hand, if image processing has not been completed, in S609, the control unit 201 determines whether a remote shooting instruction has been received from the master camera, and if not, returns to S608 and repeats the above, or if a remote shooting instruction has been received, proceeds to S610.

[0047] In S610, image processing is interrupted, unprocessed RAW image data remaining in the memory area of ​​the RAM 203 is discarded, the memory area is released, and the process proceeds to S603, where the shooting operation is started.

[0048] With the above control, when the release button on the master camera is pressed, the remote cameras can simultaneously take pictures. Furthermore, even after the release button on the master camera is released, if each remote camera determines that there is an opportunity to release a picture, it can continue taking pictures for a predetermined period of time.

[0049] Furthermore, at sporting events and the like, a system may be configured using a large number of remote cameras, such as one master camera and ten remote cameras. When shooting continuously in such a system, the number of images obtained becomes large. In such cases, the number of image data for recording can be reduced by discarding RAW image data with low image evaluation values ​​without image processing (for example, discarding one RAW image data from ten remote cameras results in 10 images). This significantly reduces the human burden of selecting images after shooting.

[0050] In this embodiment, the remote camera terminates image processing of RAW image data with low image evaluation values ​​upon receiving the next shooting instruction, thereby preventing missed release opportunities. However, the present invention is not limited to this. For example, a threshold value may be set in advance for the image evaluation value, and RAW image data with values ​​below the threshold may be immediately deleted from the memory area. This eliminates the need to manage multiple RAW image data sets in descending order of image evaluation value, thereby reducing the control load for image processing for recording. In this case, a threshold value may also be set for the remaining memory area, and when the remaining memory area falls below the threshold, the threshold value for the image evaluation value may be further increased to delete more RAW image data.

[0051] Furthermore, among the recording image data recorded on the recording medium 208, for example, recording image data that has been transferred to the server 101 (external storage) via the communication unit 210 may be automatically deleted. This makes it possible to prevent the remaining capacity of the recording medium 208 from becoming insufficient. Furthermore, a threshold value may be set in advance for the image evaluation value, and transferred recording image data that is less than the threshold value may be deleted from the recording medium 208. Furthermore, a threshold value may also be set for the remaining capacity of the recording medium 208, and when the remaining capacity falls below the threshold value, the threshold value for the image evaluation value may be further increased so that more transferred recording image data may be deleted.

[0052] Furthermore, when transferring the recording image data recorded on the recording medium 208 to the server 101 (external storage) via the communication unit 210, the data may be transferred in the order in which they were captured, or in the order of highest image evaluation value. By transferring the data in the order of highest image evaluation value, when the communication network is congested, the load can be reduced by limiting data transfer to recording image data with high image evaluation values, and when the communication network becomes less congested, recording image data with low image evaluation values ​​can be transferred. This makes it possible to efficiently distribute the load on the communication network.

[0053] In addition, in this embodiment, the remote camera calculates the image evaluation value using the simple Y image data, but the present invention is not limited to this. For example, by using two systems of image evaluation units, image evaluation values ​​may be calculated from the simple Y image data and the image data for recording, and the evaluation value obtained from the image data for recording may be used for image selection after image processing for recording.

[0054] In addition, in this embodiment, the remote camera calculates the image evaluation value using simple Y image data obtained by high-speed image conversion of RAW image data. However, the present invention is not limited to this, and it is sufficient to perform simple image processing faster than image processing for recording and calculate the image evaluation value using image data with reduced data volume. The simple image processing may be, for example, image processing that reduces the RAW image data, or image processing of a portion of the RAW image data that is cropped from the screen around the autofocus frame position, etc.

[0055] In addition, in this embodiment, it has been described that one of the multiple digital cameras 100 is set to master camera mode and the remaining digital cameras 100 are set to remote camera mode by operation of the operation unit 211. However, the present invention is not limited to this. For example, a configuration may be adopted in which, in response to setting one of the multiple digital cameras 100 as the master camera, the remaining digital cameras 100 automatically operate as remote cameras via the network 102.

[0056] Furthermore, among the multiple digital cameras 100, multiple digital cameras 100 may be designated as master cameras. In this case, the master cameras operate independently of the other master cameras, and the remote cameras assign priority to the master cameras and execute remote shooting instructions. This configuration makes it possible to obtain images from multiple digital cameras 100 of release opportunities judged from different viewpoints by multiple photographers.

[0057] In the above example, the photographing operation is repeated for a predetermined period of time in response to a single press of the release button, but the present invention is not limited to this. For example, the photographing operation may be controlled to be repeated in a predetermined period while the release button is pressed. In this case, when the release button is released, a notification to end remote photographing is sent from the main camera to the remote camera, and the photographing operation is controlled to end in response to the notification.

[0058] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0059] <Summary> The disclosure of this embodiment includes the following configuration.

[0060] (Configuration 1) a switching means for switching between the first mode and the second mode; a communication means for connecting to an external image capture device via a network; an imaging means for repeatedly performing a process of photographing a subject in accordance with a photographing instruction received from the external imaging device and outputting first image data in the first mode; a storage means for sequentially storing the first image data; an image processing means for performing image processing on the first image data stored in the storage means to generate second image data for recording; a calculation means for calculating an evaluation value of the first image data; a control means; In the first mode, the image processing means performs image processing on the unprocessed first image data stored in the storage means in descending order of priority based on the evaluation value; the control means, when receiving the shooting instruction, controls the image capturing means to discard the first image data stored in the storage means before starting shooting.

[0061] (Configuration 2) further comprising a conversion means for generating third image data with a reduced data amount from the first image data stored in the storage means; 2. The imaging device according to configuration 1, wherein in the first mode, the calculation means calculates the evaluation value using the third image data.

[0062] (Configuration 3) 3. The imaging device according to configuration 1 or 2, characterized in that in the first mode, the control means discards the first image data that is stored in the storage means and has not been processed by the image processing means, and whose evaluation value corresponds to an evaluation value that is less than a predetermined first threshold value.

[0063] (Configuration 4) 4. The imaging device according to claim 3, wherein when the remaining capacity of the storage means falls below a predetermined second threshold, the control means changes the first threshold to a larger value.

[0064] (Configuration 5) the control means determines the timing for the imaging means to perform imaging based on the first image data; The imaging means further captures an image at a timing determined by the control means. 5. The imaging device according to any one of configurations 1 to 4.

[0065] (Configuration 6) 6. The imaging device according to any one of configurations 1 to 5, further comprising a recording means for recording the second image data and the evaluation value in association with each other on a storage medium.

[0066] (Configuration 7) further comprising a conversion means for generating third image data with a reduced data amount from the first image data stored in the storage means; the calculation means includes a first calculation means for calculating an evaluation value using the second image data and a second calculation means for calculating an evaluation value using the third image data; In the first mode, the priority order is calculated based on the evaluation value calculated by the second calculation means, The recording means records the evaluation value calculated by the first calculation means in the storage medium. 7. The imaging device according to configuration 6,

[0067] (Configuration 8) 8. The imaging device according to configuration 6 or 7, wherein in the second mode, the calculation means calculates the evaluation value using the second image data.

[0068] (Configuration 9) The imaging device according to any one of configurations 6 to 8, wherein the control means transmits the second image data and the evaluation value recorded on the storage medium from the communication means to an external storage device connected via the network.

[0069] (Configuration 10) 10. The imaging device according to configuration 9, wherein the control means transmits the second image data and the evaluation values ​​to the external storage device in descending order of the evaluation values.

[0070] (Configuration 11) 11. The imaging device according to configuration 9 or 10, wherein the recording means deletes the second image data and the evaluation value transmitted to the external storage device from the storage medium.

[0071] (Configuration 12) The imaging device described in configuration 9 or 10, characterized in that the recording means deletes from the storage medium the second image data and the evaluation values ​​transmitted to the external storage device, if the evaluation values ​​are less than a predetermined fourth threshold value.

[0072] (Configuration 13) 13. The imaging device according to claim 12, wherein when the remaining capacity of the storage medium falls below a predetermined fifth threshold, the control means changes the fourth threshold to a larger value.

[0073] (Configuration 14) further comprising an operation means for issuing a photographing instruction, In the second mode, the imaging means repeatedly performs a process of photographing a subject and outputting first image data in response to a photographing instruction from the operation means; the control means transmits a photographing instruction to the external image capture device via the network using the communication means; The image processing means performs image processing on the unprocessed first image data stored in the storage means in the order in which they were photographed, and outputs second image data for recording. 14. The imaging device according to any one of configurations 1 to 13.

[0074] (Configuration 15) 15. The imaging device according to any one of configurations 1 to 14, wherein the calculation means calculates at least one of a degree of blur and shaking of the image and an evaluation value of facial expression as the evaluation value.

[0075] (Configuration 16) 16. The imaging device according to any one of configurations 1 to 15, further comprising a search means for searching for the second image data based on the evaluation value.

[0076] (Configuration 17) Further comprising a display means, The imaging device according to any one of configurations 1 to 16, wherein the control means displays an evaluation value corresponding to the second image data superimposed on an image of the second image data displayed on the display means.

[0077] (Configuration 18) An imaging system in which a plurality of imaging devices according to any one of configurations 1 to 17 are connected via the network, An imaging system, wherein at least one of the plurality of imaging devices operates in the second mode.

[0078] (Configuration 19) A control method for an imaging device that operates by switching between a first mode and a second mode, wherein in the first mode, an imaging step in which the imaging means repeatedly performs a process of photographing a subject in accordance with a photographing instruction received from an external imaging device via a network and outputting first image data; a storage step in which a control means sequentially stores the first image data in a storage means; a calculation step in which a calculation means calculates an evaluation value of the first image data; an image processing step in which image processing means performs image processing on the unprocessed first image data stored in the storage means in order of priority based on the evaluation value to generate second image data for recording; a discarding step in which, when the control means receives the photographing instruction, the control means discards the first image data stored in the storage means before starting photographing by the imaging means; A control method comprising:

[0079] (Configuration 20) 18. A program for causing a computer to function as each of the means of the imaging device according to any one of configurations 1 to 17.

[0080] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0081] 100: digital camera, 101: server, 102: network, 201: control unit, 202: ROM, 203: RAM, 204: optical system, 205: imaging unit, 206: A / D conversion unit, 207: image processing unit, 208: recording medium, 209: display unit, 210: communication unit, 301: recording development unit, 302: image evaluation unit, 303: image conversion unit, 304: input selection unit

Claims

1. switching means for switching between a first mode and a second mode; communication means for connecting to an external imaging device via a network; imaging means for repeatedly performing a process of photographing a subject in response to a photographing instruction received from the external imaging device in the first mode and outputting first image data; storage means for sequentially storing the first image data; image processing means for performing image processing on the first image data held in the storage means to generate second image data for recording; calculation means for calculating an evaluation value corresponding to the first image data; control means, and having, in the case of the first mode, the image processing means performs image processing on the unprocessed first image data held in the storage means in descending order of priority based on the evaluation value, the control means, when receiving the photographing instruction, controls to discard the first image data held in the storage means before starting photographing by the imaging means. The imaging device is characterized by this.

2. further having conversion means for generating third image data with a reduced data amount from the first image data held in the storage means, in the case of the first mode, the calculation means calculates the evaluation value using the third image data. The imaging device according to claim 1 is characterized by this.

3. in the case of the first mode, the control means discards the first image data corresponding to an evaluation value less than a first threshold value determined in advance among the unprocessed first image data held in the storage means. The imaging device according to claim 1 is characterized by this.

4. The imaging device according to claim 3, wherein when the remaining capacity of the memory means becomes less than a predetermined second threshold value, the control means changes the first threshold value to a larger value.

5. The control means determines the timing of performing shooting by the imaging means based on the first image data. The imaging means further performs shooting at the timing determined by the control means. The imaging device according to claim 1, characterized in that.

6. The imaging device according to claim 1, further comprising recording means for recording the second image data and the evaluation value in association with each other on a storage medium.

7. The imaging device further comprises conversion means for generating third image data with a reduced data amount from the first image data held in the memory means. The calculation means includes first calculation means for calculating an evaluation value using the second image data and second calculation means for calculating an evaluation value using the third image data. In the case of the first mode, The priority order is obtained based on the evaluation value calculated by the second calculation means. The recording means records the evaluation value calculated by the first calculation means on the storage medium. The imaging device according to claim 6, characterized in that.

8. The imaging device according to claim 6, characterized in that in the case of the second mode, the calculation means calculates an evaluation value using the second image data.

9. The imaging device according to claim 6, characterized in that the control means transmits the second image data and the evaluation value recorded on the storage medium from the communication means to an external storage device connected via the network.

10. The imaging device according to claim 9, wherein the control means transmits the second image data and the evaluation value to the external storage device in descending order of the evaluation value.

11. The imaging device according to claim 9, wherein the recording means deletes the second image data and the evaluation value transmitted to the external storage device from the storage medium.

12. The imaging device according to claim 9, wherein the recording means deletes, from the storage medium, the second image data and the evaluation value in which the evaluation value is less than a predetermined fourth threshold among the second image data and the evaluation value transmitted to the external storage device.

13. The imaging device according to claim 12, wherein when the remaining capacity of the storage medium becomes less than a predetermined fifth threshold, the control means changes the fourth threshold to a larger value.

14. The imaging device further comprises operation means for giving a shooting instruction. In the case of the second mode, the imaging means repeatedly performs a process of shooting a subject in response to a shooting instruction by the operation means and outputting first image data. the control means transmits a shooting instruction to the external imaging device via the network by the communication means. the image processing means performs image processing on the unprocessed first image data held in the storage means in the order of shooting and outputs second image data for recording. The imaging device according to claim 1.

15. The imaging device according to claim 1, wherein the calculating means calculates at least one of the degree of blur and shake of an image and the evaluation value of an expression as the evaluation value.

16. The imaging device according to claim 1, further comprising search means for searching for the second image data based on the evaluation value. Claim 17 further comprising display means, The imaging apparatus according to claim 1, wherein the control means superimposes and displays an evaluation value corresponding to the second image data on an image of the second image data displayed on the display means. Claim 18 An imaging system in which a plurality of imaging apparatuses according to any one of claims 1 to 17 are connected via the network, An imaging system, wherein at least one of the plurality of imaging apparatuses operates in the second mode. Claim 19 A control method for an imaging apparatus that operates by switching between a first mode and a second mode. In the case of the first mode, an imaging step in which an imaging unit repeatedly performs a process of photographing a subject in response to a photographing instruction received from an external imaging apparatus via a network and outputting first image data; a storage step in which a control unit sequentially stores the first image data in a storage unit; a calculation step in which a calculation unit calculates an evaluation value corresponding to the first image data; an image processing step in which an image processing unit performs image processing on the unprocessed first image data held in the storage unit in descending order of priority based on the evaluation value to generate second image data for recording; a deletion step in which the control unit deletes the first image data held in the storage unit before starting photographing by the imaging unit when the photographing instruction is received; A control method characterized by comprising: Claim 20 A program for causing a computer to function as each unit of the imaging apparatus according to any one of claims 1 to 17.

Images