Electronic apparatus, control method of the same and program

Abstract

To allow a desired image to be easily selected from a plurality of images that is continuously captured.SOLUTION: An electronic apparatus (100) of recording and reproducing a plurality of images that is continuously captured by imaging means (22) comprises: detection means which detects a subject imaged in the image; tracking means which tracks the subject detected by the detection means among the plurality of images; evaluation means which evaluates accuracy of a focus of the subject for each of the plurality of images; recording control means which records the plurality of images and the evaluation result of the evaluation means in a recording medium; and display control means which performs control so as to display the image recorded in the recording medium. The display control means performs control so as to display the plurality of images recorded in the recording medium with a priority based on the evaluation result of the selected subject when the subject detected in the plurality of images is selected.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an electronic device that records and plays back a plurality of images continuously captured by an imaging means, and a control method and program therefor. [Background technology]

[0002] In some imaging devices such as digital cameras, in order to prevent missing a photo opportunity, continuous shooting is performed to take multiple pictures in succession, and a desired image can be selected from the multiple images that have been continuously shot. However, as basic performance such as continuous shooting speed improves, a large number of images can be obtained, and the burden of selecting a desired image from the multiple images that have been continuously shot increases. As a technology for enabling a desired image to be selected from multiple images, Patent Document 1 discloses a technology for extracting specific person parts from each captured image obtained by taking multiple consecutive images, evaluating the shooting conditions while analyzing these specific person parts, and identifying captured images that include specific person parts that have received a high evaluation from the evaluation results of the specific person parts evaluated for each captured image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2005-45600 A Summary of the Invention [Problem to be solved by the invention]

[0004] The technology disclosed in Patent Document 1 is based on the premise that information about a person is stored and managed in advance and the person is identified. Therefore, when one wishes to select an image by focusing on a person other than the specified person appearing in the image, the load of selecting a desired image cannot be reduced.

[0005] The present invention has been made in consideration of the above-mentioned points, and has an object to make it easier to select a desired image from a plurality of images captured in continuous shooting. [Means for solving the problem]

[0006] The electronic device of the present invention comprises a detection means for detecting a subject appearing in an image, a tracking means for tracking the subject detected by the detection means between the multiple images, an evaluation means for evaluating the subject for each of the multiple images, a recording control means for recording the multiple images and the evaluation results of the evaluation means on a recording medium, and a display control means for controlling the images recorded on the recording medium to be displayed, wherein the display control means controls the multiple images recorded on the recording medium to be displayed with a priority based on the evaluation result of the selected subject when a subject detected in the multiple images is selected. Effect of the Invention

[0007] According to the present invention, it is easy to select a desired image from a plurality of images captured in succession. [Brief description of the drawings]

[0008] [Figure 1] 1 is an external view of a digital camera according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing an example of the configuration of a digital camera according to an embodiment; [Diagram 3] 4 is a flowchart showing a process executed by the digital camera according to the embodiment at the time of photographing. [Figure 4] 5 is a flowchart showing a process executed during playback by the digital camera according to the embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of a plurality of images shot continuously in one continuous shooting scene. [Figure 6] FIG. 13 is a diagram showing an example of the display order of images when no subject is selected. [Figure 7] 13A and 13B are diagrams illustrating an example of a display order of images when a subject is selected. [Figure 8]11A and 11B are diagrams illustrating an example of information and scores relating to a subject. [Figure 9] FIG. 2 is a diagram for explaining a representative image in one continuous shot scene. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. In this embodiment, a digital camera 100 will be described as an example of an electronic device that records and plays back a plurality of images captured continuously by an imaging means. Fig. 1 is an external view of the digital camera 100 according to the embodiment. Fig. 1(a) is a perspective view of the digital camera 100 as seen from the front side, and Fig. 1(b) is a perspective view of the digital camera 100 as seen from the rear side.

[0010] The display unit 28 is provided on the rear surface of the digital camera 100 and displays images and various information. The touch panel 70a detects touch operations on the display surface (touch operation surface) of the display unit 28. The outside-finder display unit 43 is provided on the top surface of the digital camera 100 and displays various setting values ​​such as shutter speed and aperture. The shutter button 61 is an operation member for issuing shooting instructions. The mode change switch 60 is an operation member for switching between various modes. The terminal cover 40 is a cover that protects a connector (not shown) for a connection cable or the like that connects the digital camera 100 to an external device.

[0011] The main electronic dial 71 is a rotary operation member used to change settings such as shutter speed and aperture. The power switch 72 is an operation member for switching the power of the digital camera 100 ON and OFF. The sub electronic dial 73 is a rotary operation member used to move the selection frame (cursor) and advance images. The four-way key 74 is configured so that the up, down, left, and right parts can each be pressed, and a process corresponding to the part that is pressed is executed. The SET button 75 is an operation member used mainly to confirm a selection item, etc.

[0012] The video button 76 is an operating member for issuing commands to start or stop video shooting (recording). The AE lock button 77 is an operating member for locking AE. By pressing the AE lock button 77 in a shooting standby state, the exposure state can be fixed. The enlargement button 78 is an operating member for switching the enlargement mode ON and OFF in the live view display in the shooting mode. By turning the enlargement mode ON and then operating the main electronic dial 71, the live view image can be enlarged or reduced. In the playback mode, the enlargement button 78 also functions as an operating member for enlarging the playback image or increasing its magnification ratio.

[0013] The playback button 79 is an operating member for switching between a shooting mode and a playback mode. By pressing the playback button 79 during the shooting mode, the mode is switched to the playback mode, and the latest image among the images recorded on the recording medium 200 described later can be displayed on the display unit 28. The menu button 81 is an operating member for performing an instruction operation for displaying a menu screen. By pressing the menu button 81, a menu screen on which various settings can be made is displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the four-way key 74, and the SET button 75.

[0014] The touch bar 82 (multifunction bar: M-Fn bar) is a line-shaped touch operation member (line touch sensor) capable of receiving touch operations. The touch bar 82 is disposed at a position where it can be touched (touched) by the thumb of the right hand when the grip part 90 is held in the right hand (held with the little finger, ring finger, and middle finger of the right hand) so that the shutter button 61 can be pressed with the index finger of the right hand. That is, the touch bar 82 is disposed at a position where it can be operated when the eyepiece part 16 is placed close to the viewfinder and the user is in a position (shooting posture) so that the shutter button 61 can be pressed at any time. The touch bar 82 can receive tap operations (operations of touching and releasing without moving within a predetermined period) and slide operations to the left and right (operations of touching and then moving the touch position while keeping the touch) on the touch bar 82. The touch bar 82 is an operation member different from the touch panel 70a and does not have a display function.

[0015] The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with a removable lens unit 150 side, which will be described later. The eyepiece 16 is an eyepiece of an eyepiece finder 17 (a peer-in type finder), and a user can view an image displayed on an internal EVF 29 (Electronic View Finder) through the eyepiece 16. The eyepiece detection unit 57 is composed of an eyepiece detection sensor that detects whether or not a user (photographer) places his / her eye on the eyepiece 16. The cover 202 is a cover for a slot that stores a recording medium 200. The grip unit 90 is a holding unit that is shaped so that the user can easily hold it with the right hand when holding the digital camera 100. When the digital camera 100 is held by holding the grip unit 90 with the little finger, ring finger, and middle finger of the right hand, the shutter button 61 and the main electronic dial 71 are arranged at positions that can be operated with the index finger of the right hand. In the same state, the sub electronic dial 73 and the touch bar 82 are arranged at positions that can be operated with the thumb of the right hand. The thumb rest portion 91 (thumb standby position) is a grip member provided at a position on the rear side of the digital camera 100 where it is easy to place the thumb of the right hand when gripping the grip portion 90 without operating any of the operation members. The thumb rest portion 91 is made of a rubber member or the like to enhance holding power (grip feeling).

[0016] Fig. 2 is a block diagram showing an example of the configuration of a digital camera 100 according to an embodiment of the present invention. Note that the same components as those shown in Fig. 1 are denoted by the same reference numerals. A lens unit 150 is attached to the digital camera 100. The lens unit 150 includes an aperture 1, a lens 103, an aperture drive circuit 2, an AF drive circuit 3, a lens system control circuit 4, and a communication terminal 6. The lens 103 is usually composed of a plurality of lenses, but for simplicity, only one lens is shown here. The communication terminal 6 is a communication terminal through which the lens unit 150 communicates with the digital camera 100. The communication terminal 10 is a communication terminal through which the digital camera 100 communicates with the lens unit 150. The lens unit 150 communicates with the system control unit 50 via these communication terminals 6 and 10. In the lens unit 150, the lens system control circuit 4 controls the aperture 1 via the aperture drive circuit 2. In the lens unit 150, the lens system control circuit 4 displaces the position of the lens 103 via the AF drive circuit 3 to adjust the focus.

[0017] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50. The imaging unit 22 functions as an imaging means according to the present invention, and includes an imaging element (image sensor) configured with a CCD, CMOS element, etc. that converts an optical image into an electrical signal. The imaging unit 22 may include an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 23 converts the analog signal output from the imaging unit 22 into a digital signal. The image processing unit 24 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion, etc.) on the data from the A / D converter 23 or the data from the memory control unit 15. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs exposure control and distance measurement control based on the arithmetic results obtained by the image processing unit 24. This allows TTL (through-the-lens) type AF (autofocus) processing, AE (autoexposure) processing, EF (flash pre-flash) processing, etc. to be performed. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the arithmetic results obtained.

[0018] The output data from the A / D converter 23 is written to the memory 32 via the image processing unit 24 and the memory control unit 15. Alternatively, the output data from the A / D converter 23 is written to the memory 32 via the memory control unit 15 without passing through the image processing unit 24. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, and image data to be displayed on the display unit 28 and the EVF 29. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. The memory 32 also serves as a memory for image display (video memory). The D / A converter 19 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28 and the EVF 29. The display image data written to the memory 32 is displayed on the display unit 28 and the EVF 29 via the D / A converter 19. The display unit 28 and the EVF 29 are displays such as LCDs and organic EL displays, and perform display according to the analog signal from the D / A converter 19. The digital signal that has been A / D converted by the A / D converter 23 and stored in the memory 32 is converted to an analog signal by the D / A converter 19, and then sequentially transferred and displayed on the display unit 28 or EVF 29, thereby providing a live view display.

[0019] The system control unit 50 is a control unit consisting of at least one processor or circuit, and controls the entire digital camera 100. The system control unit 50 realizes each process described below by executing programs stored in the non-volatile memory 56. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 19, the display unit 28, the EVF 29, etc. The system memory 52 is, for example, a RAM. The system control unit 50 loads constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 56, and the like, in the system memory 52. The non-volatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM, in which constants, programs, etc. for operating the system control unit 50 are recorded.

[0020] The system timer 53 is a timing unit that measures the time used for various controls and the time of a built-in clock. The communication unit 54 transmits and receives video signals and audio signals to and from an external device connected wirelessly or via a wired cable. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with an external device via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including live view images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can receive image data and various other information from the external device. The attitude detection unit 55 detects the attitude of the digital camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 55, it is possible to determine whether the image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the attitude detection unit 55. It is also possible to detect the movement of the digital camera 100 (panning, tilting, lifting, whether it is stationary, etc.) using the acceleration sensor or gyro sensor that is the attitude detection unit 55.

[0021] The eyepiece detection unit 57 is an eyepiece detection sensor that detects the approach (eyepiece approach) and departure (eye departure) of the eye (object) to the eyepiece unit 16 of the eyepiece finder 17 (approach detection). The system control unit 50 switches between display (display state) / non-display (non-display state) of the display unit 28 and the EVF 29 according to the state detected by the eyepiece detection unit 57. Specifically, at least in a shooting standby state and when the display destination switching setting is automatic switching, when the eye is not placed in contact with the camera, the display is turned on as the display unit 28 and the EVF 29 is not displayed. Also, when the eye is placed in contact with the camera, the display is turned on as the display destination with the EVF 29 and the display unit 28 is not displayed. For example, an infrared proximity sensor can be used as the eyepiece detection unit 57, and it can detect the approach of some object to the eyepiece unit 16 of the eyepiece finder 17 incorporating the EVF 29. When an object approaches, infrared light projected from a light projecting section (not shown) of the eyepiece detection section 57 is reflected by the object and received by a light receiving section (not shown) of the infrared proximity sensor. The amount of infrared light received can also determine how close the object is to the eyepiece section 16 (eyepiece distance). In this way, the eyepiece detection section 57 performs eyepiece detection to detect the proximity of the object to the eyepiece section 16. When an object is detected approaching within a predetermined distance from the non-eyepiece state (non-approaching state), it is detected that the object has been placed in eye contact. When an object whose approach was detected moves away from the eyepiece state (approaching state) by a predetermined distance or more, it is detected that the object has been removed. The threshold for detecting eye contact and the threshold for detecting removal of the eye may be different, for example, by providing a hysteresis. In addition, after detecting the eye contact, the eyepiece remains in the eye contact state until removal of the eye is detected. After detecting the removal of the eye, the eyepiece remains in the non-eye contact state until removal of the eye is detected. The infrared proximity sensor is just an example, and other sensors may be used for eye proximity detection unit 57 as long as they can detect a state that can be regarded as eye proximity.

[0022] Various setting values ​​such as shutter speed and aperture are displayed on the viewfinder external display section 43 via a viewfinder external display section drive circuit 44 . The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to which electricity is applied, and the like, and detects whether a battery is attached, the type of battery, and the remaining battery power, etc. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the necessary voltage for the necessary period to each unit including the recording medium 200. The power supply unit 30 is composed of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, and Li batteries, an AC adapter, etc.

[0023] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0024] The operation unit 70 is an input unit that accepts user operations and is used to input various operational instructions to the system control unit 50. The operation unit 70 includes a shutter button 61, a mode changeover switch 60, a power switch 72, a touch panel 70a, other operation members 70b, etc. The other operation members 70b include a main electronic dial 71, a sub electronic dial 73, a four-way key 74, a SET button 75, a video button 76, an AE lock button 77, a magnification button 78, a playback button 79, a menu button 81, a touch bar 82, etc.

[0025] The shutter button 61 includes a first shutter switch 62 and a second shutter switch 64. The first shutter switch 62 is turned on when the shutter button 61 is pressed halfway (instruction to prepare for shooting) and generates a first shutter switch signal SW1. The system control unit 50 starts preparations for shooting, such as AF processing, AE processing, AWB processing, and EF processing, in response to the first shutter switch signal SW1. The second shutter switch 64 is turned on when the shutter button 61 is pressed fully (instruction to shoot) and generates a second shutter switch signal SW2. The system control unit 50 starts a series of shooting processes, from reading out a signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file, in response to the second shutter switch signal SW2. Continuous pressing of the shutter button 61 can be used to execute continuous shooting.

[0026] The mode changeover switch 60 changes the operation mode of the system control unit 50 to one of a still image shooting mode, a video shooting mode, a playback mode, etc. Modes included in the still image shooting mode include an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). In addition, there are various scene modes and custom modes that are shooting settings according to shooting scenes. The user can directly switch to one of these modes using the mode changeover switch 60. Alternatively, after switching to a list screen of shooting modes with the mode changeover switch 60, the user may selectively switch to one of the displayed modes using another operating member. Similarly, the video shooting mode may also include multiple modes.

[0027] The touch panel 70a is a touch sensor that detects various touch operations on the display surface of the display unit 28 (the operation surface of the touch panel 70a). The touch panel 70a and the display unit 28 can be configured integrally. For example, the touch panel 70a is configured so that the light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Then, input coordinates on the touch panel 70a are associated with display coordinates on the display surface of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that makes it seem as if the user can directly operate the screen displayed on the display unit 28.

[0028] Fig. 3 is a flowchart showing the process executed by the digital camera 100 according to the embodiment when photographing. The flowchart in Fig. 3 is started when the shutter button 61 is half-pressed (instruction to prepare for photographing). In this embodiment, the system control unit 50 executes a predetermined program to realize the functions of the detection means, tracking means, evaluation means, and recording control means of the present invention, and each process shown in Fig. 3 is executed. In step S301, the system control unit 50 detects a subject appearing in an image (a live view image or an image being continuously shot) captured by the imaging unit 22, and acquires subject information. The subject information is, for example, information on the position and size of the subject.

[0029] In step S302, the system control unit 50 detects the movement of the subject based on the feature amount (e.g., color information) of the subject detected in step S301, and executes a tracking process to track the subject. As the tracking process, a precise tracking process and a simple tracking process can be executed, and the tracking process to be executed may be changed depending on whether or not time is available for the tracking process. In this case, information on which tracking process was executed is stored in, for example, the non-volatile memory 56. In step S303, the system control unit 50 executes AF processing to focus on the main subject.

[0030] In step S304, the system control unit 50 receives the full press of the shutter button 61 (shooting instruction) and starts a series of shooting processes from reading out a signal from the imaging unit 22 to writing the captured image as an image file to the recording medium 200. If the shutter button 61 is kept fully pressed, continuous shooting is performed. In step S305, the system control unit 50 evaluates the focus accuracy of the subject (focus rating) and calculates a score based on the degree of blur and shaking of the subject.

[0031] In step S306, the system control unit 50 adds the subject information and tracking information (hereinafter referred to as information about the subject), which are information representing the results of the detection in step S301 and the tracking in step S302, and the score calculated in step S305, to each image data, and records them on the recording medium 200. Furthermore, if the tracking process executed in step S302 is a simple tracking process, information that can confirm this may be added to the image data. Although the information about the subject and the score are added to the image data, the present invention is not limited to this. At least one of the information about the subject and the score may be recorded in the recording medium 200 or another recording medium (e.g., non-volatile memory 56) in a state associated with the image, separately from the image data, with or without adding the information to the image data. In this case, the information about the subject and the score can be read without accessing and reading the individual image data.

[0032] In step S307, the system control unit 50 determines whether or not shooting is in progress. If the shutter button 61 is being pressed all the way down to execute continuous shooting, the process returns to step S301. If the shooting operation is completed, the process ends this flowchart.

[0033] FIG. 5 shows an example of multiple images shot in one continuous shooting scene. FIG. 5(a) shows the first image shot in the continuous shooting, (b) shows the second image shot in the continuous shooting, and (c) shows the third image shot in the continuous shooting. Subjects A, B, and C are shown in the images. Below each image, the scores of subjects A, B, and C calculated for each image are shown. The higher the score, the better the focus and the higher the focus accuracy. In the example of FIG. 5, in the first image shot in the continuous shooting, subjects A, B, and C have higher focus accuracy and higher scores in that order. Then, in the second image shot in the continuous shooting, the scores change to higher in the order of subjects A, C, and B. Furthermore, in the third image shot in the continuous shooting, the main subject is switched, and the scores change to higher in the order of subjects B, C, and A.

[0034] Next, Fig. 4 is a flowchart showing the process executed by the digital camera 100 according to the embodiment during playback. Assuming the continuous shooting scene of Fig. 5, the process when playing back a plurality of continuously shot images will be described with reference to Figs. 6 to 9. In this embodiment, the system control unit 50 executes a predetermined program, thereby realizing the functions of the display control means and separate tracking means of the present invention, and executing each process. In step S401, the system control unit 50 displays a representative image in the selected continuous shot scene on the display unit 28. The representative image refers to an image displayed as a representative of one continuous shot scene when the scene is treated as a group. Normally, images are displayed in the order of continuous shooting as shown in Fig. 9, and the first image of the continuous shooting is the first image displayed as the representative image.

[0035] In step S402, the system control unit 50 determines whether or not an instruction to start displaying the priority of images in a continuous shooting scene has been issued via the touch panel 70a or other operation member 70b. If an instruction to start displaying the priority of images has been issued, the process proceeds to step S403. If an instruction to start displaying the priority of images has not been issued, the process returns to step S401.

[0036] In step S403, the system control unit 50 reads out the information and score related to the subject added to each image data in step S306, and develops an information table in the system memory 52. ​​The information table includes subject information (position, size), tracking information (color, direction), and pin rating (score) for each subject, as shown in Fig. 8. Fig. 8(a) shows information and score related to the subject appearing in the first image in the continuous shooting, (b) shows information and score related to the subject appearing in the second image in the continuous shooting, and (c) shows information and score related to the subject appearing in the third image in the continuous shooting. As described above, if information about the subject and the score are recorded in recording medium 200 or another recording medium (e.g., non-volatile memory 56) separately from the image data, the information about the subject and the score can be read without accessing and reading the individual image data.

[0037] In step S404, the system control unit 50 determines whether or not to re-track. The system control unit 50 refers to the tracking processing information stored in the non-volatile memory 56 in step S302, and determines to re-track if simple tracking processing is performed in consideration of time constraints during shooting. If re-tracking is to be performed, the system control unit 50 proceeds to step S405, and if not, the system control unit 50 proceeds to step S407. Note that the system control unit 50 may also determine whether or not to re-track by collating the positions of the subject between images to determine whether the tracking accuracy is low. In step S405, the system control unit 50 performs a tracking process between the images recorded on the recording medium 200, which is different from the simple tracking process performed during shooting, in order to improve tracking accuracy. In step S406, the system control unit 50 re-evaluates the subject based on the result of re-tracking in step S405, detects information about the subject, and calculates a score. The system control unit 50 reflects the content of the re-evaluation in the information table created in step S403.

[0038] In step S407, the system control unit 50 refers to the information table expanded in the system memory 52 and determines the display priority. Here, the highest score value is selected for each image, and the highest score value is the highest priority. In the first image shot in the continuous shooting of FIG. 5(a), the highest score value is "0.7" (subject A), in the second image shot in the continuous shooting of FIG. 5(b), the highest score value is "0.8" (subject A), and in the third image shot in the continuous shooting of FIG. 5(c), the highest score value is "1.0" (subject B). Since the highest score value is the highest priority, the third image shot in the continuous shooting has the highest priority, followed by the second image shot in the continuous shooting and the first image shot in the continuous shooting.

[0039] In step S408, the system control unit 50 sorts the images according to the priority determined in step S407 and displays them on the display unit 28. Fig. 6 is a diagram showing an example of the display order of images when no subject is selected. Since the priority is determined in descending order of the highest score, as shown in Fig. 6(a), the third image in the continuous shooting becomes the first display image as a representative image. Then, as shown in Fig. 6(b), the second image in the continuous shooting becomes the second display image, and as shown in Fig. 6(c), the first image in the continuous shooting becomes the third display image.

[0040] In step S409, the system control unit 50 determines whether or not a subject other than the main subject has been selected in the image being displayed via the touch panel 70a or other operation member 70b. For example, when the third image in the continuous shooting is displayed as shown in FIG. 6(a), the system control unit 50 determines whether or not a subject A or C other than the main subject B in the image has been selected. If a subject has been selected, the process proceeds to step S410, and if a subject has not been selected, the process proceeds to step S411.

[0041] In step S410, the system control unit 50 refers to the information table expanded in the system memory 52 and determines the display priority based on the score of the subject selected in step S409. In step S409, assume that subject A is selected when the third image of the continuous shooting is displayed as shown in Fig. 6(a), for example. In this case, the score of subject A is "0.7" in the first image of the continuous shooting, the score of subject A is "0.8" in the second image of the continuous shooting, and the score of subject A is "0.4" in the third image of the continuous shooting, so the second image has a higher priority, followed by the first image and then the third image.

[0042] In step S408, the system control unit 50 sorts the images according to the priority determined in step S410 and displays them on the display unit 28. Since the priority is determined in descending order of the score with respect to subject A, the display order is changed from that of Figs. 6(a)-(c) to that of Figs. 7(a)-(c). Fig. 7 is a diagram showing an example of the display order of images when a subject is selected. As shown in Fig. 7(a), the second image in the continuous shooting is the first display image as a representative image. Then, as shown in Fig. 7(b), the first image in the continuous shooting is the second display image, and as shown in Fig. 7(c), the third image in the continuous shooting is the third display image.

[0043] In the present embodiment, an example is given in which a subject other than the main subject can be selected in the displayed image, but all subjects may be selectable. In step S409, for example, when the third image of the continuous shooting is displayed as shown in FIG. 6(a), the main subject B in the image is selected. In this case, the score of subject B in the first image of the continuous shooting is "0.5", the score of subject B in the second image of the continuous shooting is "0.3", and the score of subject B in the third image of the continuous shooting is "1.0". The third image of the continuous shooting has a high priority, and the first image of the continuous shooting and the second image of the continuous shooting have low priority in that order. As a result, in step S408, the third image of the continuous shooting becomes the first image to be displayed as a representative image, just like in FIG. 6, but the first image of the continuous shooting becomes the second image to be displayed, and the second image of the continuous shooting becomes the third image to be displayed. That is, the display order of FIG. 6 is changed so that the display orders of FIG. 6(b) and FIG. 6(c) are interchanged.

[0044] In step S408, the system control unit 50 determines whether or not an instruction to end playback has been given via the touch panel 70a or other operation members 70b. If an instruction to end playback has not been given, the process returns to step S401. If an instruction to end playback has been given, the process ends this flowchart.

[0045] As described above, the subject in the multiple images captured in the continuous shooting is detected and tracked, and the focus accuracy of the subject is evaluated for each image. It is not assumed that the person is specified, and there is no need to store and manage information about the person in advance. When the multiple images captured in the continuous shooting are played back, the display priority is determined based on the focus accuracy of each subject, and when the user selects a subject, the image with the high focus accuracy of the subject is preferentially displayed. In this way, when the user wants to change the subject of interest and select an image after shooting, the images can be arranged in the priority order intended by the user. This makes it easier to select a desired image from the multiple images captured in the continuous shooting.

[0046] In the present embodiment, the focus accuracy of the subject is evaluated for each image, but the present invention is not limited to this example. For example, the subject may be evaluated in terms of the position, size, and orientation of the subject in the image in addition to or instead of the focus accuracy.

[0047] Although the present invention has been described above with reference to the embodiments, the above embodiments are merely illustrative of the specific examples of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these embodiments. In other words, the present invention can be embodied in various forms without departing from its technical concept or main features. In the above embodiment, the present invention is applied to a digital camera, but is not limited thereto. The present invention can be widely applied to any electronic device that records and plays back a plurality of images captured continuously by an imaging device, including smartphones, tablet terminals, and the like. (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a recording medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for implementing one or more of the functions.

[0048] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An electronic device that records and reproduces a plurality of images continuously shot by an imaging means, A detection means for detecting a subject appearing in an image; a tracking means for tracking the subject detected by the detection means between the plurality of images; an evaluation means for evaluating the subject for each of the plurality of images; a recording control means for recording the plurality of images and the evaluation result of the evaluation means on a recording medium; a display control means for controlling the recording medium to display an image; The electronic device is characterized in that, when a subject detected in the plurality of images is selected, the display control means controls so that the plurality of images recorded on the recording medium are displayed with a priority based on the evaluation result of the selected subject. (Configuration 2) 2. The electronic device according to configuration 1, wherein the evaluation means evaluates the focus accuracy of the subject. (Configuration 3) 3. The electronic device according to configuration 1 or 2, wherein the recording control means records information representing the results of detection by the detection means and tracking by the tracking means onto the recording medium. (Configuration 4) 4. The electronic device according to any one of configurations 1 to 3, wherein the recording control means makes it possible to read out the evaluation result evaluated by the evaluation means without accessing the image. (Configuration 5) 5. The electronic device according to any one of configurations 1 to 4, further comprising another tracking means for tracking the subject between the images recorded on the recording medium. (Configuration 6) A method for controlling an electronic device that records and plays back a plurality of images continuously captured by an imaging means, comprising the steps of: A detection step of detecting a subject appearing in an image; a tracking step of tracking the subject detected in the detection step among the plurality of images; an evaluation step of evaluating the subject for each of the plurality of images; a recording step of recording the plurality of images and the evaluation result of the evaluation step on a recording medium; a display control step of controlling the recording medium so as to display the image recorded on the recording medium, A control method for an electronic device, characterized in that, in the display control step, when a subject detected in the plurality of images is selected, the plurality of images recorded on the recording medium are controlled to be displayed with a priority based on the evaluation result of the selected subject. (Configuration 7) A program for recording and reproducing a plurality of images continuously captured by an imaging means, A detection means for detecting a subject appearing in an image; a tracking means for tracking the subject detected by the detection means between the plurality of images; an evaluation means for evaluating the subject for each of the plurality of images; a recording control means for recording the plurality of images and the evaluation result of the evaluation means on a recording medium; causing a computer to function as a display control means for controlling the display of an image recorded on the recording medium; The display control means is a program characterized by controlling, when a subject detected in the plurality of images is selected, to display the plurality of images recorded on the recording medium in a priority order based on the evaluation result of the selected subject. [Explanation of symbols]

[0049] 22: imaging unit, 28: display unit, 50: system control unit, 56: non-volatile memory, 100: camera, 200: recording medium

Claims

1. An electronic device that records and plays back a plurality of images taken in a continuous shooting mode by an imaging means, a detection means for detecting a subject from the images, a tracking means for tracking the subject detected by the detection means among the plurality of images, an evaluation means for evaluating the subject detected by the detection means for each of the plurality of images, a recording control means for recording the plurality of images and the evaluation results of the subject for each of the plurality of images by the evaluation means on a recording medium, the recording control means recording the evaluation results of the subject on the recording medium together with information regarding the results of tracking by the tracking means, a display control means for controlling to display the images recorded on the recording medium, and comprising: when one of the subjects detected in the plurality of images is selected by a user, the display control means determines a priority based on the evaluation result of the same subject as the selected subject determined based on the information regarding the results of tracking by the tracking means, and controls to display the plurality of images based on the priority. An electronic device characterized by this.

2. The evaluation means evaluates the focus accuracy of the subject detected by the detection means. The electronic device according to claim 1, characterized by this.

3. The recording control means enables the evaluation results evaluated by the evaluation means to be read out without accessing the images. The electronic device according to claim 1, characterized by this.

4. The electronic device according to claim 1, further comprising another tracking means for tracking the subject among the images recorded on the recording medium.

5. The detection means is capable of detecting a plurality of subjects. When the detection means detects a plurality of subjects, the evaluation means evaluates each of the plurality of subjects, and the recording control means records the evaluation results of the plurality of subjects on the recording medium. The electronic device according to claim 1, characterized by this.

6. When the detection means detects a plurality of subjects, the tracking means tracks the plurality of subjects, and the recording control means records the evaluation results of the plurality of subjects together with information regarding the tracking of each subject. The electronic device according to claim 5, characterized by this.

7. When the subject is not selected by the user, the display control means determines the priority based on the evaluation results of the plurality of images regardless of the information regarding the result of tracking by the tracking means, and controls to display the plurality of images based on the priority. The electronic device according to claim 1, characterized in that.

8. A control method for an electronic device that records and reproduces a plurality of images continuously shot by an imaging means, A detection step of detecting a subject from the images, A tracking step of tracking the subject detected in the detection step among the plurality of images, An evaluation step of evaluating the subject detected in the detection step for each of the plurality of images, A recording control step of recording the plurality of images and the evaluation results of the subjects for each of the plurality of images by the evaluation step on a recording medium, the recording control step of recording the evaluation results of the subject on the recording medium together with the information regarding the result of tracking by the tracking step, A display control step of controlling to display the images recorded on the recording medium, and having, In the display control step, when one of the subjects detected in the plurality of images is selected by the user, the priority is determined based on the evaluation result of the same subject as the selected subject determined based on the information regarding the result of tracking by the tracking step, and the plurality of images are controlled to be displayed based on the priority. A control method for an electronic device, characterized in that.

9. A program for causing a computer to function as each means of the electronic device according to any one of claims 1 to 7.

Images