Imaging device and its control method, imaging system, and program

Abstract

To enable a master camera and a remote camera to work together more reliably for capturing an image.SOLUTION: An imaging system has switching means for switching between a first mode and a second mode, communication means for connecting to an external imaging apparatus via a network, imaging means for repeatedly performing a process of imaging a subject and outputting first image data in accordance with an imaging instruction received from the external imaging apparatus when in a first mode, storage means for holding the first image data sequentially, image processing means for generating a second image data for recording by performing image processing on the first image data, calculation means for calculating an evaluation value of the first image data, and control means. In the first mode, the image processing means processes unprocessed first image data in the order of priority on the basis of evaluation values. When receiving the imaging instruction, the first image data held in the storage means is discarded before the imaging means starts capturing an image.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method thereof, an imaging system, and a program, and particularly relates to a shooting control technique in an imaging system composed of a plurality of imaging devices.

Background Art

[0002] Conventionally, in events such as sports and photo shoots, a system that uses a plurality of cameras for shooting has been known. In Patent Document 1, a communication function is mounted on a digital camera, and image data captured by a plurality of cameras is transmitted to an external device at one location by wireless communication or the like, and a system for storing image data for each digital camera has been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional technology disclosed in Patent Document 1, the recording medium capacity of a digital camera can be saved. However, in an external device, the total number of images transmitted from a plurality of cameras becomes very large, and the human burden when selecting images after shooting is large.

[0005] Also, one of the plurality of cameras is used as a master camera, and the other cameras are used as remote cameras. After configuring to shoot in conjunction with the release operation of the master camera, shooting can be performed according to the judgment in the remote camera. However, in that case, the number of images processed in the remote camera increases and the processing time extends, and the risk of missing a shooting opportunity in conjunction with the release operation of the master camera becomes high, but this has not been considered in the conventional technology.

[0006] This invention was made in view of the above-mentioned problems, and aims to enable the master camera and remote camera to work together more reliably for shooting. [Means for solving the problem]

[0007] To achieve the above objective, the imaging apparatus of the present invention includes: switching means for switching between a first mode and a second mode; communication means for connecting to an external imaging device via a network; imaging means that, in the first mode, repeatedly performs the process of photographing a subject in response to a shooting instruction received from the external imaging device and outputting first image data; storage means for sequentially holding the first image data; image processing means for performing image processing on the first image data held in the storage means to generate second image data for recording; and the first image data Corresponding The system includes a calculation means for calculating an evaluation value and a control means. In the first mode, the image processing means processes the unprocessed first image data held in the storage means, starting with the one with the highest priority based on the evaluation value. When the control means receives a shooting instruction, it controls the system to discard the first image data held in the storage means before the imaging means starts shooting. [Effects of the Invention]

[0008] According to the present invention, it is possible to more reliably enable the master camera and the remote camera to work together in conjunction to take pictures. [Brief explanation of the drawing]

[0009] [Figure 1] A schematic diagram showing an example configuration of an imaging system according to an embodiment of the present invention. [Figure 2] A block diagram showing the functional configuration of a digital camera according to this embodiment. [Figure 3] A block diagram showing the functional configuration of the image processing unit according to the embodiment. [Figure 4]A timing chart showing the timing of shooting operations and recording development operations in the master camera and remote camera according to the embodiment. [Figure 5] A flowchart illustrating the master shooting process in the master camera according to the embodiment. [Figure 6] A flowchart illustrating the remote shooting process in a remote camera according to this embodiment. [Modes for carrying out the invention]

[0010] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0011] In the following description, we will explain the case where the present invention is applied to an imaging device, and we will use a digital camera as an example of the imaging device. However, the imaging device is not limited to a digital camera, but may be any electronic device equipped with a camera function, such as a digital video camera, a camera-equipped mobile phone, a camera-equipped computer, or a game console.

[0012] Figure 1 is a schematic diagram showing an example of the configuration of an imaging system according to an embodiment of the present invention. As shown in Figure 1, the imaging system of this embodiment has a configuration in which a plurality of digital cameras 100 and a server 101 having a large-capacity storage (external storage device) are connected via a network 102 such as a wired or wireless LAN. In this embodiment, one of the plurality of digital cameras 100 operates as a master camera, and the others operate as remote cameras.

[0013] Figure 2 is a block diagram showing the functional configuration of the digital camera 100 according to this embodiment. The control unit 201 is, for example, a CPU, which controls the operation of each component of the digital camera 100 by reading the operation programs for each component from the ROM 202, loading them into the RAM 203, and executing them. The ROM 202 is a rewritable non-volatile memory that stores the operation programs for each component of the digital camera 100, as well as parameters necessary for the operation of each component. The RAM 203 is a rewritable volatile memory that is used as a temporary storage area for data output during the operation of each component of the digital camera 100.

[0014] The optical system 204 includes multiple lenses and apertures, and forms an optical image of the subject on the imaging unit 205. The optical system 204 may be integrated with the digital camera 100 or it may be detachable.

[0015] The imaging unit 205 includes an image sensor such as a CCD or CMOS sensor, and outputs an image signal by photoelectric conversion of the optical image formed on the image sensor by the optical system 204. In this embodiment, the image sensor is covered with a Bayer array color filter, and an analog image signal of one of the color components of red (R), green (G), or blue (B) is output from each pixel. The output analog image signal is input to the A / D conversion unit 206, which applies A / D conversion processing to the input analog image signal and outputs the obtained digital image data (RAW image data) to the RAM 203 for storage.

[0016] The image processing unit 207 applies various processes to the RAW image data stored in the RAM 203, such as image processing and calculation of image evaluation values, which will be described later.

[0017] The recording medium 208 is a removable memory card or the like, and stores the recording image data that has been image-processed for recording by the image processing unit 207, the RAW image data that has been A / D converted by the A / D conversion unit 206, and the like. Further, the image evaluation value calculated by the image processing unit 207 is recorded in association with the header of the recording image data and the like, and can be utilized for image selection after shooting.

[0018] The display unit 209 is a display device such as an LCD, and constitutes an electronic viewfinder function by performing through-display of the image captured by the imaging unit 205, performs playback display of the images recorded on the recording medium 208, and displays various types of information. Further, the control unit 201 can cause the display unit 209 to perform playback display with an icon display or the like based on the image evaluation value recorded in the header of the recording image data superimposed on the corresponding image, or display the result of narrowing-down search based on the image evaluation value.

[0019] The communication unit 210 is used for communication between digital cameras 100 and for transferring the image data recorded on the recording medium 208 and the like to the server 101 via the network 102.

[0020] The operation unit 211 is composed of various buttons, switches, a touch panel, etc., and includes a release button for instructing shooting and a mode selection switch for selecting whether to operate the digital camera 100 in the master camera mode or the remote camera mode. When the master camera mode is selected, the digital camera 100 operates as a master camera, and when the remote camera mode is selected, the digital camera 100 operates as a remote camera. In this embodiment, as described above, when constructing an imaging system using a plurality of digital cameras 100, one digital camera 100 is operated in the master camera mode, and the remaining digital cameras 100 are operated in the remote camera mode.

[0021] FIG. 3 is a block diagram showing the functional configuration of the image processing unit 207 in this embodiment. The recording development unit 301 receives RAW image data in a Bayer array stored in RAM 203. It then applies various image processing to the input RAW image data, such as white balance adjustment, color interpolation, gamma correction, edge enhancement, noise reduction, and reduction / enlargement, to generate recording YUV image data, and outputs the processed recording YUV image data.

[0022] In this invention, RAW image data is defined as Bayer array RAW image data and recording image data as YUV image data, but the present invention is not limited to these. For example, RAW image data may be RGB format data obtained by an RGB3 image sensor, and recording image data may be in RGB format.

[0023] The image conversion unit 303 receives RAW image data in a Bayer array and converts it into simplified Y image data. Since the Bayer array is a repeating array of 4 pixels in a 2x2 configuration consisting of an R pixel, two G pixels, and a B pixel, the average of these 4 pixels is used to generate the Y signal, which is then converted into simplified Y image data that is reduced to half its original size vertically and horizontally. By employing such a simplified calculation, image conversion can be performed faster than the recording and development unit 301, which performs more complex calculations.

[0024] The input selection unit 304 selects either the recording image data output from the recording development unit 301 or the simplified Y image data output from the image conversion unit 303 and inputs it to the image evaluation unit 302. In this embodiment, according to the mode selected by the operation unit 211, if the digital camera 100 is operating in master camera mode, the input selection unit 304 selects the recording image data, and if it is operating in remote camera mode, it selects the simplified Y image data.

[0025] The image evaluation unit 302 calculates and outputs an image evaluation value representing the degree of blur or blur in the recording image data or simplified Y image data selected by the input selection unit 304. The method for calculating the image blur and blur evaluation value can be based on known techniques; for example, the method disclosed in Japanese Patent Application Publication No. 2009-253936 can be used.

[0026] Furthermore, while the degree of blur and blur was used as the image evaluation value, the present invention is not limited to this. For example, when the subject is a person, evaluation values ​​of facial expressions such as the direction of the face, whether the eyes are closed, and emotions (smile, surprise, anger, sadness) may also be used as the image evaluation value. For example, the degree of smile disclosed in Japanese Patent Application Publication No. 2012-104900 may also be used as the image evaluation value.

[0027] Next, we will explain the timing of the shooting operation and the recording development operation in the master camera and the remote camera. Figure 4 is a timing chart that specifically illustrates an example of the shooting operation and recording development operation in the master camera and the remote camera.

[0028] Here, as an example, each digital camera 100 is described as performing shooting and recording development operations under the following conditions. First, during shooting, RAW image data is read from the image unit 205 at 30 frames per second and stored in the RAM 203. Also, for each shooting command by pressing the shutter release button, shooting continues for 3 seconds. During recording development, RAW image data is read from the RAM 203 at a slower speed of 20 frames per second than during shooting, processed, and the memory area for the processed RAW image data is released. It is assumed that memory area for holding RAW image data is reserved for 120 images.

[0029] In the master camera, when the release button is pressed, continuous shooting takes place for a period of 401 (3 seconds), during which 90 RAW image data files (30 frames / second × 3 seconds) are stored in the RAM 203 memory area. Meanwhile, during period 403, the recording development unit 301 performs recording development operations. That is, the memory area is occupied for 90 frames ÷ 20 frames / second = 4.5 seconds before being released. At this time, the image evaluation unit 302 of the master camera uses the recorded image data to calculate and output the image evaluation value mentioned above.

[0030] Furthermore, if the release button is pressed again 0.5 seconds after the completion of the recording development operation, continuous shooting will be performed again for a period of 402 (3 seconds). During this time, the RAW image data is written to the memory area of ​​the freed RAM203, and the recording development operation is performed during a period of 404. The above process is performed each time the release button is pressed.

[0031] Furthermore, the memory area of ​​RAM 203 is not released until the processing of the RAW image data held in the memory area is completed. For this reason, for example, while image processing for recording is being performed, the display unit 209 may display a message indicating that shooting is not possible, or the release button may be locked so that it cannot be pressed, and the display may be turned off or the lock released when the memory area is released. Alternatively, when shooting is possible, a message indicating that shooting is possible may be displayed.

[0032] Meanwhile, the remote camera performs continuous shooting for a period of 405 (4 seconds). Of this period, the first 3 seconds are a shooting period linked to the press of the master camera's release button, and the last 1 second is a shooting period determined by the remote camera to be a release opportunity. During this period, 120 frames of RAW image data (30 frames / second x 4 seconds) are stored in the memory area of ​​the RAM 203. Meanwhile, during this period, the recording development unit 301 performs recording development operations. In parallel with the recording development operations, the image conversion unit 303 of the image processing unit 207 converts the RAW image data into simplified Y image data, and the image evaluation unit 302 calculates an image evaluation value using the simplified Y image data. At this time, the recording development unit 301 and the image conversion unit 303 process independently of each other, making it possible to process different RAW image data. Then, the remote camera's recording development unit 301 reads the RAW image data with the highest image evaluation value at that time from the unprocessed RAW image data held in the RAM 203 memory area and performs the recording development operation. If the image evaluation value has not been calculated or if the image evaluation values ​​are the same, the RAW image data that was captured earlier should be processed first, or other appropriate priorities should be set. The header of the obtained recording image data then records the image evaluation value obtained using the simplified Y image data.

[0033] When performing a recording development operation on all 120 RAW image data, the memory area is occupied for 120 images ÷ 20 frames / second = 6 seconds before being released. However, in the example shown in Figure 4, the next shooting instruction is received from the master camera before 6 seconds have elapsed, so unprocessed RAW image data remains in the RAM 203 memory area. In such a case, in this embodiment, the recording development operation is terminated at that point, and the memory area is released. As a result, the unprocessed RAW image data is discarded, but the discarded RAW image data is those with low image evaluation values.

[0034] Furthermore, if the remote camera does not determine that it is a release opportunity, continuous shooting will end after 3 seconds, the same as the master camera. Therefore, the development process for recording all 90 RAW image data stored in RAM203 can be completed before the master camera's release button is pressed again.

[0035] By controlling the system as described above, the remote camera can prioritize the next shooting operation by terminating the recording and development process for RAW image data with low image evaluation values. Furthermore, the master camera can improve the accuracy of image evaluation by directly evaluating the recorded and developed images.

[0036] Figure 5 is a flowchart illustrating the master shooting process when the digital camera 100 is operating in master camera mode. In S501, the control unit 201 determines whether to terminate the shooting process, for example, by switching to an operation mode other than shooting, such as powering off or playback or settings. If the shooting operation is terminated, the master shooting process is terminated; if the shooting process continues, the process proceeds to S502.

[0037] In S502, the control unit 201 determines whether or not the release button has been pressed. If it has not been pressed, the process returns to S501. If the release button has been detected to have been pressed in S502, the process proceeds to S503, where the shooting operation begins and a shooting instruction (remote shooting instruction) is sent to the remote camera via the communication unit 210. Here, as described above with reference to Figure 4, continuous shooting is performed at predetermined intervals and for predetermined time periods after the release button is pressed, and the obtained RAW image data is sequentially stored in the memory area of ​​the RAM 203. Then, in S504, the image processing unit 207 begins image processing of the RAW image data stored in the memory area of ​​the RAM 203. Here, the recording development unit 301 performs a recording development operation on the RAW image data of each frame to generate recording image data, and the image evaluation unit 302 calculates an image evaluation value using the generated recording image data, and records the recording image data and image evaluation value on the recording medium 208.

[0038] In S505, the control unit 201 determines whether a predetermined time has elapsed. If it determines that the predetermined time has elapsed, it proceeds to S506 and terminates the shooting operation. At this time, however, processing of the RAW image data stored in the memory area of ​​RAM 203 continues.

[0039] Then, the process proceeds to S507, where the control unit 201 determines whether the processing of all RAW image data stored in the RAM 203 memory area has been completed and whether the memory area has been freed. If image processing is still ongoing, the determination in S507 is repeated, and once image processing is complete and the memory area is freed, the process returns to S501. From this point onward, the next shooting process becomes possible.

[0040] Figure 6 is a flowchart illustrating the remote shooting process when the digital camera 100 is operating in remote camera mode. In S601, the control unit 201, similar to S501, determines whether to terminate the shooting process by, for example, turning off the power or switching to an operation mode other than shooting, such as playback or settings. If the shooting operation is terminated, the remote shooting process is terminated; if the shooting process is to continue, the process proceeds to S602.

[0041] In S602, the control unit 201 determines whether it has received a remote shooting instruction from the master camera (external imaging device). If it has not received the instruction, it returns to S601. If it has received the remote shooting instruction, it proceeds to S603.

[0042] In S603, the shooting operation is initiated. As described above with reference to Figure 4, continuous shooting is performed at predetermined intervals and for predetermined time periods after receiving a remote shooting instruction, and the obtained RAW image data is sequentially stored in the memory area of ​​RAM 203. Then, in S604, the image processing unit 207 starts image processing of the RAW image data stored in the memory area of ​​RAM 203. Here, in the remote camera, as described above, the recording development unit 301 performs a recording development operation on the RAW image data with the highest priority among the unprocessed RAW image data stored in the memory area of ​​RAM 203 to generate recording image data. The image conversion unit 303 generates simplified Y image data, and the image evaluation unit 302 calculates an image evaluation value using the generated simplified Y image data. Using this calculated image evaluation value, the priority of the RAW image data for which the recording development operation is performed by the recording development unit 301 is determined.

[0043] Next, in S605, the control unit 201 determines whether a predetermined time has elapsed, and if it determines that the predetermined time has elapsed, it proceeds to S606.

[0044] In S606, a decision is made as to whether to continue shooting. Here, the remote camera determines whether it is a release opportunity, and if it is determined to be a release opportunity, the process proceeds to S607, where the shooting operation continues for a predetermined time. The determination of whether it is a release opportunity is made, for example, by evaluating the image data captured for the electronic viewfinder function of the display unit 209, and determining that it is a release opportunity when the subject's frontal face or smile, etc., is detected continuously for a certain period of time. However, the determination of a release opportunity is not limited to this, and any conditions can be used for determination.

[0045] If S606 determines that it is not a release opportunity, that is, if it is decided not to continue shooting, and if the additional shooting operation is completed in S607, the process proceeds to S608. In S608, it is determined whether the image processing of all RAW image data stored in the RAM203 memory area has been completed and whether the memory area has been freed. If it has been completed, the process returns to S601.

[0046] On the other hand, if image processing is not yet complete, in S609 the control unit 201 determines whether it has received a remote shooting instruction from the master camera. If it has not received the instruction, it returns to S608 and repeats the above process. If it has received the remote shooting instruction, it proceeds to S610.

[0047] In S610, image processing is interrupted, any unprocessed RAW image data remaining in the RAM203 memory area is discarded, the memory area is freed, and the process proceeds to S603 to start the shooting operation.

[0048] With the above control, when the release button on the master camera is pressed, the remote camera can take a picture at the same time. Furthermore, even after the release button on the master camera is released, if each remote camera determines that there is a release opportunity, it can continue taking pictures for a predetermined period of time.

[0049] Furthermore, in sports events and similar situations, systems are sometimes configured using a large number of remote cameras, such as one master camera and ten remote cameras. When shooting is done continuously in such a system, a large number of images are obtained. In such cases, discarding RAW image data with low image quality without image processing can reduce the number of image data files used for recording (for example, if 10 remote cameras discard the equivalent of one RAW image data, that's equivalent to 10 images). This significantly reduces the human burden of sorting images after shooting.

[0050] In this embodiment, the remote camera terminates image processing of RAW image data with low image evaluation values ​​when it receives the next shooting command to avoid missing the release opportunity. However, the present invention is not limited to this. For example, a threshold value may be set in advance for the image evaluation value, and RAW image data below the threshold value may be immediately deleted from the memory area. This eliminates the need to manage multiple RAW image data in descending order of image evaluation value, thereby reducing the control load of image processing for recording. In addition, a threshold value may be set for the remaining memory area, and when the remaining memory area falls below the threshold value, the threshold value for the image evaluation value may be further increased to delete more RAW image data.

[0051] Furthermore, among the recording image data recorded on the recording medium 208, recording image data that has already been transferred to the server 101 (external storage) via the communication unit 210 may be automatically deleted. This prevents the recording medium 208 from running out of remaining capacity. In addition, a threshold may be set in advance for the image evaluation value, and transferred recording image data below this threshold may be deleted from the recording medium 208. Furthermore, a threshold may also be set for the remaining capacity of the recording medium 208, and when the remaining capacity falls below the threshold, the threshold for the image evaluation value may be further increased to delete even more transferred recording image data.

[0052] Furthermore, when transferring recording image data recorded on the recording medium 208 to the server 101 (external storage) via the communication unit 210, the data may be transferred in the order in which it was captured, or in order of highest image evaluation value. By transferring the data in order of highest image evaluation value, when the communication network is congested, the load can be reduced by limiting data transfer to recording image data with high image evaluation values, and then transferring recording image data with low image evaluation values ​​once the communication network is less congested. This allows for efficient distribution of the load on the communication network.

[0053] Furthermore, in this embodiment, the remote camera calculates image evaluation values ​​using simplified Y image data, but the present invention is not limited to this. For example, by using two image evaluation units, image evaluation values ​​may be calculated from both the simplified Y image data and the recording image data, and the evaluation values ​​obtained from the recording image data may be used for image selection after recording image processing.

[0054] Furthermore, in this embodiment, the remote camera calculates the image evaluation value using simplified Y image data obtained by rapidly converting RAW image data. However, the present invention is not limited to this, and the image evaluation value can be calculated using image data with reduced data volume obtained by performing simplified image processing that is faster than the image processing for recording. Simplified image processing may be, for example, image processing that reduces the size of RAW image data, or image processing of a portion of the RAW image data that has been cropped around the autofocus frame position, etc.

[0055] Furthermore, in this embodiment, it has been described that one of the multiple digital cameras 100 is set to master camera mode and the remaining digital cameras 100 are set to remote camera mode by operation of the operation unit 211. However, the present invention is not limited to this. For example, in response to setting one of the multiple digital cameras 100 as the master camera, the remaining digital cameras 100 may be configured to automatically operate as remote cameras via the network 102.

[0056] Furthermore, several of the multiple digital cameras 100 may be designated as master cameras. In this case, the master cameras operate independently of the other master cameras, and the remote cameras are configured to prioritize the master cameras and execute remote shooting commands accordingly. This configuration makes it possible to obtain images of release opportunities judged from different perspectives by multiple photographers from multiple digital cameras 100.

[0057] Furthermore, although the above example described the shooting operation as being repeated at a predetermined time and interval in response to a single press of the release button, the present invention is not limited to this. For example, the shooting operation may be controlled to be repeated at a predetermined interval while the release button is pressed. In that case, when the release button is released, a notification to terminate remote shooting can be sent from the main camera to the remote camera, and the shooting operation can be terminated in response to this notification.

[0058] <Other Embodiments> Furthermore, the present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0059] <Summary> This embodiment includes the following configuration.

[0060] (Composition 1) A switching means for switching between the first mode and the second mode, A communication means for connecting to an external imaging device via a network, In the first mode described above, the imaging means repeatedly performs the process of photographing a subject in response to a shooting instruction received from the external imaging device and outputting first image data, A storage means for sequentially holding the first image data, Image processing means that performs image processing on the first image data held in the storage means to generate a second image data for recording, A calculation means for calculating the evaluation value of the first image data, It has control means, In the case of the first mode described above, The image processing means performs image processing on the unprocessed first image data held in the storage means, starting with the one with the highest priority based on the evaluation value. The imaging apparatus is characterized in that, when the control means receives the shooting instruction, it controls the first image data held in the storage means to be discarded before shooting is started by the imaging means.

[0061] (Configuration 2) The system further includes a conversion means for generating a third image data with reduced data volume from the first image data held in the storage means, The imaging apparatus according to Configuration 1, characterized in that, in the case of the first mode, the calculation means calculates the evaluation value using the third image data.

[0062] (Composition 3) In the case of the first mode, the imaging apparatus according to configuration 1 or 2 is characterized in that the control means discards the first image data from the first image data held in the storage means that has not been processed by the image processing means, and the evaluation value corresponds to an evaluation value that is less than a predetermined first threshold.

[0063] (Composition 4) The imaging apparatus according to configuration 3, characterized in that when the remaining capacity of the storage means falls below a predetermined second threshold, the control means changes the first threshold to a larger value.

[0064] (Composition 5) The control means determines the timing for taking a picture using the imaging means based on the first image data. The imaging means further performs imaging at a timing determined by the control means. An imaging device according to any one of configurations 1 to 4, characterized by the above.

[0065] (Composition 6) The imaging apparatus according to any one of configurations 1 to 5, further comprising recording means for associating the second image data with the evaluation value and recording it on a storage medium.

[0066] (Composition 7) The system further includes a conversion means for generating a third image data with reduced data volume from the first image data held in the storage means, The calculation means includes a first calculation means for calculating an evaluation value using the second image data and a second calculation means for calculating an evaluation value using the third image data. In the case of the first mode described above, The priority order is determined based on the evaluation value calculated by the second calculation means. The recording means records the evaluation value calculated by the first calculation means onto the storage medium. The imaging apparatus according to configuration 6, characterized in that...

[0067] (Composition 8) The imaging apparatus according to configuration 6 or 7, characterized in that, in the case of the second mode, the calculation means calculates an evaluation value using the second image data.

[0068] (Composition 9) The imaging apparatus according to any one of configurations 6 to 8, characterized in that the control means transmits the second image data and the evaluation value recorded in the storage medium from the communication means to an external storage device connected via the network.

[0069] (Composition 10) The imaging apparatus according to configuration 9, characterized in that the control means transmits the second image data and the evaluation value to the external storage device in order of the higher evaluation value.

[0070] (Composition 11) The imaging apparatus according to configuration 9 or 10, characterized in that the recording means deletes the second image data and the evaluation value transmitted to the external storage device from the storage medium.

[0071] (Composition 12) The imaging apparatus according to configuration 9 or 10, wherein the recording means deletes from the storage medium any second image data and evaluation values ​​transmitted to the external storage device that have an evaluation value less than a predetermined fourth threshold.

[0072] (Composition 13) The imaging apparatus according to configuration 12, characterized in that when the remaining capacity of the storage medium falls below a predetermined fifth threshold, the control means changes the fourth threshold to a larger value.

[0073] (Composition 14) It further has operating means for giving shooting instructions, In the case of the second mode described above, The imaging means repeatedly performs the process of photographing a subject and outputting first image data in response to a shooting instruction from the operating means. The control means transmits a shooting instruction to the external imaging device via the network using the communication means. The image processing means performs image processing on the unprocessed first image data held in the storage means in the order in which it was captured, and outputs a second image data for recording. An imaging apparatus according to any one of configurations 1 to 13, characterized by the above.

[0074] (Composition 15) The imaging apparatus according to any one of configurations 1 to 14, characterized in that the calculation means calculates at least one of the degree of blur and blur of the image and the facial expression evaluation value as the evaluation value.

[0075] (Composition 16) The imaging apparatus according to any one of configurations 1 to 15, further comprising a search means for searching the second image data based on the evaluation value.

[0076] (Composition 17) It further has a means of display, The imaging apparatus according to any one of configurations 1 to 16, characterized in that the control means displays an evaluation value corresponding to the second image data superimposed on the image of the second image data displayed on the display means.

[0077] (Composition 18) An imaging system comprising multiple imaging devices described in any of configurations 1 to 17, connected via the network, An imaging system characterized in that at least one of the plurality of imaging devices operates in the second mode.

[0078] (Composition 19) A control method for an imaging device that operates by switching between a first mode and a second mode, wherein in the case of the first mode, The imaging means repeatedly performs an imaging process in which it photographs a subject in response to a shooting instruction received from an external imaging device via a network and outputs first image data, The control means includes a storage step in which the first image data is sequentially stored in the storage means, The calculation means includes a calculation step of calculating the evaluation value of the first image data, Image processing steps include: an image processing step in which the image processing means performs image processing on the unprocessed first image data held in the storage means, starting with the one with the highest priority based on the evaluation value, to generate a second image data for recording; When the control means receives the shooting instruction, before starting shooting by the imaging means, it performs a discarding step of discarding the first image data held in the storage means. A control method characterized by having the following features.

[0079] (Composition 20) A program for causing a computer to function as one of the means of an imaging apparatus described in any of configurations 1 to 17.

[0080] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of symbols]

[0081] 100: Digital camera, 101: Server, 102: Network, 201: Control unit, 202: ROM, 203: RAM, 204: Optical system, 205: Imaging unit, 206: A / D conversion unit, 207: Image processing unit, 208: Recording medium, 209: Display unit, 210: Communication unit, 301: Recording development unit, 302: Image evaluation unit, 303: Image conversion unit, 304: Input selection unit

Claims

1. A switching means for switching between the first mode and the second mode, A communication means for connecting to an external imaging device via a network, In the first mode described above, the imaging means repeatedly performs the process of photographing a subject in response to a shooting instruction received from the external imaging device and outputting first image data, A storage means for sequentially holding the first image data, Image processing means that performs image processing on the first image data held in the storage means to generate a second image data for recording, A calculation means for calculating an evaluation value corresponding to the first image data, It has control means, In the case of the first mode described above, The image processing means performs image processing on the unprocessed first image data held in the storage means, starting with the one with the highest priority based on the evaluation value. The imaging apparatus is characterized in that, when the control means receives the shooting instruction, it controls the first image data held in the storage means to be discarded before shooting is started by the imaging means.

2. The system further includes a conversion means for generating a third image data with reduced data volume from the first image data held in the storage means, The imaging apparatus according to claim 1, characterized in that, in the case of the first mode, the calculation means calculates the evaluation value using the third image data.

3. The imaging apparatus according to claim 1, characterized in that, in the case of the first mode, the control means discards the first image data from the unprocessed first image data held in the storage means that corresponds to an evaluation value less than a predetermined first threshold.

4. The imaging apparatus according to claim 3, characterized in that when the remaining capacity of the storage means falls below a predetermined second threshold, the control means changes the first threshold to a larger value.

5. The control means determines the timing for taking a picture using the imaging means based on the first image data. The imaging means further performs imaging at a timing determined by the control means. The imaging apparatus according to feature 1.

6. The imaging apparatus according to claim 1, further comprising recording means for associating the second image data with the evaluation value and recording it on a storage medium.

7. The system further includes a conversion means for generating a third image data with reduced data volume from the first image data held in the storage means, The calculation means includes a first calculation means for calculating an evaluation value using the second image data and a second calculation means for calculating an evaluation value using the third image data. In the case of the first mode described above, The priority order is determined based on the evaluation value calculated by the second calculation means. The recording means records the evaluation value calculated by the first calculation means onto the storage medium. The imaging device according to feature 6.

8. The imaging apparatus according to claim 6, characterized in that, in the case of the second mode, the calculation means calculates an evaluation value using the second image data.

9. The imaging apparatus according to claim 6, characterized in that the control means transmits the second image data and the evaluation value recorded in the storage medium from the communication means to an external storage device connected via the network.

10. The imaging apparatus according to claim 9, characterized in that the control means transmits the second image data and the evaluation value to the external storage device in order of the higher evaluation value.

11. The imaging apparatus according to claim 9, characterized in that the recording means deletes the second image data and the evaluation value transmitted to the external storage device from the storage medium.

12. The imaging apparatus according to claim 9, wherein the recording means deletes from the storage medium any second image data and evaluation values ​​transmitted to the external storage device that have an evaluation value less than a predetermined fourth threshold.

13. The imaging apparatus according to claim 12, characterized in that when the remaining capacity of the storage medium falls below a predetermined fifth threshold, the control means changes the fourth threshold to a larger value.

14. It further has operating means for giving shooting instructions, In the case of the second mode described above, The imaging means repeatedly performs the process of photographing a subject and outputting first image data in response to a shooting instruction from the operating means. The control means transmits a shooting instruction to the external imaging device via the network using the communication means. The image processing means performs image processing on the unprocessed first image data held in the storage means in the order in which the images were taken, and outputs a second image data for recording. The imaging apparatus according to feature 1.

15. The imaging apparatus according to claim 1, characterized in that the calculation means calculates at least one of the degree of blur and blur of the image and the facial expression evaluation value as the evaluation value.

16. The imaging apparatus according to claim 1, further comprising a search means for searching the second image data based on the evaluation value.

17. It further has a means of display, The imaging apparatus according to claim 1, characterized in that the control means displays an evaluation value corresponding to the second image data superimposed on the image of the second image data displayed on the display means.

18. An imaging system comprising a plurality of imaging devices according to any one of claims 1 to 17, connected via the network, An imaging system characterized in that at least one of the plurality of imaging devices operates in the second mode.

19. A control method for an imaging device that operates by switching between a first mode and a second mode, wherein in the case of the first mode, The imaging means repeatedly performs an imaging process in which it photographs a subject in response to a shooting instruction received from an external imaging device via a network and outputs first image data, The control means includes a storage step in which the first image data is sequentially stored in the storage means, The calculation means includes a calculation step of calculating an evaluation value corresponding to the first image data, Image processing steps include: an image processing step in which the image processing means processes the unprocessed first image data held in the storage means, starting with the one with the highest priority based on the evaluation value, to generate a second image data for recording; When the control means receives the shooting instruction, before starting shooting by the imaging means, it performs a discarding step of discarding the first image data held in the storage means. A control method characterized by having the following features.

20. A program for causing a computer having imaging means to execute a control method for an imaging device, wherein the control method is: An imaging step which repeatedly performs the process of photographing a subject with the imaging means in response to a shooting instruction received from an external imaging device via a network and outputting first image data, A storage step of sequentially storing the first image data in a storage means, A calculation step for calculating an evaluation value corresponding to the first image data, Image processing step to generate second image data for recording by performing image processing on the first image data held in the storage means, starting with the one with the highest priority based on the evaluation value, Before starting to take images using the imaging means in response to the shooting instruction, a discard step is performed to discard the first image data held in the storage means. A computer-readable program characterized by having [a certain feature].

Images