Image display device, image display method, and program

Abstract

To provide an image display device, an image display method, and a program for stably displaying an object frame without damaging followability with respect to a detected object.SOLUTION: An image display device 11 is provided with: an image acquisition unit 101 that acquires successive images; an object detection unit 103 that detects an object from the images; an object frame determination unit 105 that determines an object frame which is a range of the object from the latest image among the images; an insensitive zone determination unit that determines an insensitive zone with respect to the position of the object frame; a storage unit 260 that stores a preceding object frame which corresponds to an object frame determined from an immediately preceding image and a preceding insensitive zone which corresponds to an insensitive zone determined from the immediately preceding image; and a display control unit 109 that displays the object frame when the position of the object is outside the range of the preceding insensitive zone, and displays the preceding object frame when the position of the object is within the range of the preceding insensitive zone.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an image display device, an image display method, and a program, and more particularly to an image display device, an image display method, and a program for displaying an object frame that indicates the range of a detected object. [Background technology]

[0002] Conventionally, when photographing with a digital camera, if the subject is a human, face detection is performed and a face frame (object frame) is displayed based on information on the position and size of the detected face.

[0003] A technique has been proposed for stably displaying an object frame when the object frame is continuously displayed on a display unit formed of an LCD (Liquid Crystal Display) of a digital camera.

[0004] For example, in a standby state, face area detection and non-detection may be repeated, and an object frame (rectangular frame) for indicating the face area may appear or disappear on a live view image (through image). The technology described in Patent Document 1 aims to prevent this object frame from appearing and disappearing repeatedly. In the technology described in Patent Document 1, when a subject area is not detected, the previously set detected subject area is continued to display the object frame as the detected subject area. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2007-221312 A Summary of the Invention [Problem to be solved by the invention]

[0006] Here, the displayed object frame can be displayed unstably depending on the movement of the detected object. For example, if the detected object is a face, the object frame will move to track even the slightest movement of the face, making the display of the object frame unstable. On the other hand, a technology has been proposed that displays the object frame by halving the amount of movement in order to suppress the fluctuation range of the object frame, but in this case, the object frame's ability to track the object is lost.

[0007] The technology described in Patent Document 1 is intended to prevent the repeated display and hiding of the object frame, and does not mention unstable display of the object frame caused by the movement of the object.

[0008] The present invention has been made in consideration of the above circumstances, and its object is to provide an image display device, an image display method, and a program that can stably display an object frame without impairing the ability to track a detected object. [Means for solving the problem]

[0009] In order to achieve the above-mentioned object, one aspect of the present invention is an image display device comprising an image acquisition unit that acquires successive images, an object detection unit that detects an object from the image, an object frame determination unit that determines an object frame that is the range of the object from the latest image in the images, a dead zone determination unit that determines a dead zone for the position of the object frame, a memory unit that stores a previous object frame corresponding to the object frame determined from the image one image before and a previous dead zone corresponding to the dead zone determined from the image one image before, and a display control unit that displays the object frame when the position of the object is outside the range of the previous dead zone, and displays the previous object frame when the position of the object is within the range of the previous dead zone.

[0010] According to this aspect, if the target position is within the range of the previous dead zone, the target frame displayed previously is displayed, so that the target frame can be stably displayed without changing the position information for displaying the target frame even with small fluctuations (position fluctuations). Also, if the target position is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed, so that the target frame can be displayed with excellent tracking ability (position tracking ability) to the detected target.

[0011] Preferably, the object detection unit detects position information of the object, and the dead zone determination unit changes the dead zone based on the position information.

[0012] Preferably, the dead zone determination unit determines a movement of the object based on the position information and the previous dead zone, and changes the previous dead zone based on a result of the movement determination.

[0013] Another aspect of the present invention is an image display device that includes an image acquisition unit that acquires successive images, an object detection unit that detects an object from the images, an object frame determination unit that determines an object frame that is the range of the object from the latest image in the images, a dead zone determination unit that determines a dead zone for the size of the object frame, a memory unit that stores a previous object frame corresponding to the object frame determined from the image one image before and a previous dead zone corresponding to the dead zone determined from the image one image before, and a display control unit that displays the object frame when the size of the object is outside the range of the previous dead zone, and displays the previous object frame when the size of the object is within the range of the previous dead zone.

[0014] According to this aspect, if the size of the object is within the range of the previous dead zone, the object frame displayed previously is displayed, so that the object frame can be stably displayed without changing the size information for displaying the object frame in the case of small fluctuations (variations in size). Also, if the position of the object is outside the range of the previous dead zone, the object frame corresponding to the object detected this time is displayed, so that an object frame with excellent tracking ability (size tracking ability) to the detected object can be displayed.

[0015] Preferably, the object detection unit detects size information of the object, and the dead zone determination unit changes the dead zone based on the size information.

[0016] Preferably, the dead zone determination unit determines the movement of the object based on the size information and the previous dead zone, and changes the previous dead zone based on the result of the movement determination.

[0017] Preferably, the dead zone determination unit reduces the dead zone in the first direction when a result of the motion determination indicates the first direction.

[0018] Preferably, the dead zone determination unit increases the dead zone in the first direction when the result of the motion determination does not indicate the first direction.

[0019] Preferably, the change of the dead zone is performed by changing a position or a size of the dead zone depending on an object detected by the object detection section.

[0020] Another aspect of the present invention is an image display device that includes an image acquisition unit that acquires successive images having information regarding the position of a detected object and the position of an object frame that is the range of the object, a dead zone determination unit that determines a dead zone for the position of the object frame, a memory unit that stores a previous object frame corresponding to the object frame determined from the image one image before and a previous dead zone corresponding to the dead zone determined from the image one image before, and a display control unit that displays the object frame when the position of the object is outside the range of the previous dead zone, and displays the previous object frame when the position of the object is within the range of the previous dead zone.

[0021] Another aspect of the present invention is an image display device that includes an image acquisition unit that acquires successive images having information regarding the size of a detected object and the size of an object frame that is the range of the object, a dead zone determination unit that determines a dead zone for the size of the object frame, a memory unit that stores a previous object frame corresponding to the object frame determined from the image one image before and a previous dead zone corresponding to the dead zone determined from the image one image before, and a display control unit that displays the object frame when the size of the object is outside the range of the previous dead zone, and displays the previous object frame when the size of the object is within the range of the previous dead zone.

[0022] Preferably, the image processing device further comprises an information adding section which records position information of the target frame displayed by the display control section in the image.

[0023] Preferably, the dead zone is a dead zone width for the target window, and the initial value of the dead zone is constant.

[0024] Preferably, the target detected by the target detection unit is an object.

[0025] Preferably, the object is a face or an eye.

[0026] Preferably, the target area is rectangular.

[0027] Preferably, the frame of interest is an ellipse.

[0028] Another aspect of the present invention is an image display method including the steps of acquiring successive images, detecting an object from the images, determining an object frame, which is the range of the object, from the latest image in the images, determining a dead zone for the position of the object frame, storing a previous object frame corresponding to the object frame determined from the image one image before, and a previous dead zone corresponding to the dead zone determined from the image one image before, and displaying the object frame if the position of the object is outside the range of the previous dead zone, and displaying the previous object frame if the position of the object is within the range of the previous dead zone.

[0029] Another aspect of the present invention is an image display method including the steps of acquiring successive images, detecting an object from the images, determining an object frame that is the range of the object from the latest image in the images, determining a dead zone for the size of the object frame, storing a previous object frame corresponding to the object frame determined from the image one image before, and a previous dead zone corresponding to the dead zone determined from the image one image before, and displaying the object frame if the size of the object is outside the range of the previous dead zone, and displaying the previous object frame if the size of the object is within the range of the previous dead zone.

[0030] Another aspect of the present invention is a program that causes a computer to execute an image display process including the steps of acquiring successive images, detecting an object from the images, determining an object frame that is the range of the object from the latest image in the images, determining a dead zone for the position of the object frame, storing a previous object frame that corresponds to the object frame determined from the image one image before, and a previous dead zone that corresponds to the dead zone determined from the image one image before, and displaying the object frame if the position of the object is outside the range of the previous dead zone, and displaying the previous object frame if the position of the object is within the range of the previous dead zone.

[0031] Another aspect of the present invention is a program that causes a computer to execute an image display process including the steps of acquiring successive images, detecting an object from the images, determining an object frame that is the range of the object from the latest image in the images, determining a dead zone for the size of the object frame, storing a previous object frame that corresponds to the object frame determined from the image one image before, and a previous dead zone that corresponds to the dead zone determined from the image one image before, and displaying the object frame if the size of the object is outside the range of the previous dead zone, and displaying the previous object frame if the size of the object is within the range of the previous dead zone. Effect of the Invention

[0032] According to the present invention, when the target position is within the range of the previous dead zone, the target frame displayed previously is displayed, so that even if the target moves slightly, the display of the target frame does not change and the target frame can be displayed stably. Also, when the target position is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed, so that an object frame with excellent tracking ability to the detected target can be displayed. [Brief description of the drawings]

[0033] [Figure 1] FIG. 1 is a perspective view showing an example of an imaging device. [Diagram 2] FIG. 2 is a rear view illustrating an example of the imaging device. [Diagram 3] FIG. 3 is a diagram showing the configuration of the imaging device. [Figure 4] FIG. 4 is a block diagram showing an example of a main functional configuration of the image display device. [Diagram 5] FIG. 5 is a diagram illustrating the dead zone. [Figure 6] FIG. 6 is a diagram illustrating the dead zone. [Figure 7] FIG. 7 is a diagram showing a specific example of determining the dead zone. [Figure 8] FIG. 8 is a flowchart showing an image display method. [Figure 9] FIG. 9 is a flowchart showing the image display method. [Figure 10] FIG. 10 is a diagram showing a specific example of the dead zone processing. [Figure 11] FIG. 11 is a diagram for explaining the dead zone of the size of the target frame. [Figure 12] FIG. 12 is a flowchart showing the image display method. [Figure 13] FIG. 13 is a flowchart showing an image display method. [Figure 14] FIG. 14 is a diagram showing the appearance of a smartphone. [Figure 15] FIG. 15 is a block diagram showing the configuration of a smartphone. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0034] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of an image display device, an image display method, and a program according to the present invention will now be described with reference to the accompanying drawings.

[0035] [Imaging device] 1 and 2 are a perspective view and a rear view, respectively, showing an example of an imaging device (digital camera) equipped with an image display device of the present invention.

[0036] The image display device 11 (see FIG. 4) is mounted on the imaging device 10 and displays a live view image (through image) captured by the imaging device 10. Note that the image display device 11 can also display recorded moving images.

[0037] The imaging device 10 is a digital camera that receives light that has passed through a lens with an imaging element, converts the light into a digital signal, and records the signal as image data of a still image or a moving image on a recording medium.

[0038] As shown in Fig. 1, an imaging device 10 has a photographing lens 12, a strobe 1, etc. on the front side, and a shutter button 2, a power / mode switch 3, a mode dial 4, etc. on the top side. On the other hand, as shown in Fig. 2, a monitor (LCD) 30, a zoom button, etc. are arranged on the back side of the camera. On the touch panel are arranged a touch panel 5, a cross button 6, a MENU / OK button 7, a playback button 8, a BACK button 9, etc.

[0039] The photographing lens 12 is composed of a retractable zoom lens, and is extended from the camera body when the camera's operating mode is set to photography mode by the power / mode switch 3. The strobe 1 irradiates the main subject with strobe light.

[0040] The shutter button 2 is a two-stroke switch having a so-called "halfway press" and "full press," and functions as a shooting preparation instruction section and also as an image recording instruction section.

[0041] When a still image shooting mode is selected as the shooting mode of the imaging device 10 and the shutter button 2 is "half-pressed," the imaging device 10 performs a shooting preparation operation that performs AF (Autofocus) / AE (Auto Exposure) control, and when the shutter button 2 is "fully pressed," the imaging device 10 captures and records a still image.

[0042] Furthermore, when a moving image shooting mode is selected as the shooting mode and the shutter button 2 is "fully pressed," the imaging device 10 starts recording a moving image, and when the shutter button 2 is "fully pressed" again, the imaging device 10 stops recording and goes into a standby state.

[0043] The power / mode switch 3 has both the function of a power switch for turning the power of the imaging device 10 ON / OFF and the function of a mode switch for setting the mode of the imaging device 10, and is disposed so as to be freely slidable between an "OFF position", a "playback position", and a "shooting position". The imaging device 10 is turned ON by sliding the power / mode switch 3 to the "playback position" or "shooting position", and is turned OFF by sliding the power / mode switch 3 to the "OFF position". The imaging device 10 is set to the "playback mode" by sliding the power / mode switch 3 to the "playback position", and is set to the "shooting mode" by sliding the power / mode switch 3 to the "shooting position".

[0044] The mode dial 4 functions as a mode switching unit that sets the shooting mode of the imaging device 10, and the shooting mode of the imaging device 10 is set to various modes depending on the setting position of the mode dial 4. For example, there is a "still image shooting mode" for shooting still images, a "moving image shooting mode" for shooting moving images, etc.

[0045] The monitor 30 functions as a display unit, displays a live view image in shooting mode, and displays still images or videos in playback mode, and also functions as part of a graphical user interface by displaying a menu screen, etc.

[0046] The zoom button 5 functions as a zoom instruction means for instructing zooming, and is composed of a telephoto button 5T for instructing zooming to the telephoto side, and a wide button 5W for instructing zooming to the wide-angle side. In the imaging device 10, the focal length of the photographing lens 12 changes when the telephoto button 5T and the wide button 5W are operated in the shooting mode. Also, in the playback mode, the image being played back is enlarged or reduced when the telephoto button 5T and the wide button 5W are operated.

[0047] The cross button 6 is an operation unit for inputting instructions in four directions, up, down, left and right, and functions as a button (cursor movement operation means) for selecting an item from the menu screen and for instructing the selection of various setting items from each menu. The left / right keys function as frame-by-frame (forward / reverse) buttons in the playback mode.

[0048] The MENU / OK button 7 is an operation button that functions both as a menu button for issuing a command to display a menu on the screen of the monitor 30 and as an OK button for issuing a command to confirm and execute a selection.

[0049] The playback button 8 is a button for switching to a playback mode in which a captured and recorded still image or video is displayed on the monitor 30.

[0050] The BACK button 9 functions as a button for canceling an input operation or returning to the previous operation state.

[0051] In the imaging device 10 according to this embodiment, instead of providing specific members for the buttons / switches, a touch panel may be provided and the functions of the buttons / switches may be realized by operating the touch panel.

[0052] [Internal structure of the imaging device] 3 is a diagram showing the configuration of the imaging device 10. The imaging device 10 forms a subject image (optical image) on an imaging element 210 via a photographing lens 12.

[0053] The photographing lens 12 is composed of a zoom lens 110 and a focus lens 150. The imaging device 10 also includes an aperture 130 and a lens driving unit 140. The lens driving unit 140 drives the zoom lens 110 and the focus lens 150 forward and backward in response to a command from a CPU 240 serving as a control unit, to perform zoom (optical zoom) adjustment and focus adjustment. The zoom adjustment and focus adjustment may be performed in response to a command from the CPU 240, or in response to a zoom operation and a focus operation performed by a user. The lens driving unit 140 also controls the aperture 130 in response to a command from the CPU 240 to adjust the exposure. Meanwhile, information such as the positions of the zoom lens 110 and the focus lens 150, and the opening degree of the aperture 130 is input to the CPU 240.

[0054] The imaging device 10 includes an imaging element 210, an AFE 220 (AFE: Analog Front End), an A / D converter 230 (A / D: Analog to Digital), a CPU 240, an operation unit 250, a storage unit 260, and a monitor 30. The imaging device 10 may include a mechanical shutter (not shown) for blocking light transmitted through the imaging element 210. The imaging element 210 includes a light receiving surface on which a large number of light receiving elements are arranged in a matrix, and subject light transmitted through the zoom lens 110, the focus lens 150, and the diaphragm 130 is imaged on the light receiving surface of the imaging element 210 and converted into an electrical signal by each light receiving element. R (red), G (green), or B (blue) color filters are provided on the light receiving surface of the imaging element 210, and a color image of the subject can be obtained based on the signals of each color. As the imaging element 210, various photoelectric conversion elements such as a complementary metal-oxide semiconductor (CMOS) or a charge-coupled device (CCD) can be used. The AFE 220 performs noise removal and amplification of the analog image signal output from the imaging element 210, and the A / D converter 230 converts the captured analog image signal into a digital image signal with a gradation range. The shutter may be a mechanical shutter or an electronic shutter. In the case of an electronic shutter, the exposure time (shutter speed) can be adjusted by controlling the charge accumulation period of the imaging element 210 by the CPU 240.

[0055] The storage unit 260 is composed of various types of magneto-optical recording media, non-temporary recording media such as semiconductor memory, and their control circuits, and stores moving images (including live view images) and still images. The recording media may be of a type that is detachable from the imaging device 10. The storage unit 260 also stores programs and information used for various types of control of the CPU 240.

[0056] The monitor 30 can display videos (live view images, recorded videos) and still images. The imaging device 10 may be equipped with a viewfinder, which functions as the monitor 30. The viewfinder is composed of, for example, a liquid crystal display panel, a prism, a lens, etc., and the user can view the videos and still images through an eyepiece (not shown). As the viewfinder, an "Optical View Finder (OVF)", an "Electronic View Finder (EVF)", or a "Hybrid View Finder (HVF)" which is a combination of these can be used.

[0057] The CPU 240 reads out necessary programs and information used for various controls from the storage unit 260, and performs various processes and various controls performed by the CPU 240.

[0058] The CPU 240 executes various controls. The hardware structure is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and acts as various functional units, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing specific processing such as an ASIC (Application Specific Integrated Circuit).

[0059] A processing unit may be configured with one of these various processors, or may be configured with two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple functional units may be configured with one processor. As an example of configuring multiple functional units with one processor, first, as represented by a computer such as a client or server, there is a form in which one processor is configured with a combination of one or more CPUs and software, and this processor acts as multiple functional units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple functional units with one IC (Integrated Circuit) chip. In this way, the various functional units are configured using one or more of the above various processors as a hardware structure.

[0060] <First embodiment> Next, a first embodiment will be described. In this example, a dead zone is set for the position of the target frame.

[0061] 4 is a block diagram showing an example of a main functional configuration of the image display device 11 mounted on the imaging device 10. The image display device 11 includes an image acquisition unit 101, an object detection unit 103, an object frame determination unit 105, a dead zone determination unit 107, a display control unit 109, an information addition unit 111, a storage unit 260, and a monitor 30. The image acquisition unit 101, the object detection unit 103, the object frame determination unit 105, the dead zone determination unit 107, the display control unit 109, and the information addition unit 111 are realized by a CPU 240.

[0062] The image acquisition unit 101 acquires successive images. Specifically, the image acquisition unit 101 acquires successive images output from the A / D converter 230. For example, the image acquisition unit 101 acquires a live view image composed of a plurality of frame images captured by the imaging device 10.

[0063] The object detection unit 103 detects an object from the acquired image. For example, the object detection unit 103 detects a human face using a known technique. The object detection unit 103 detects the human face in the image and acquires position information consisting of, for example, position coordinates. The object detection unit 103 can also detect objects other than a face. For example, the object detection unit 103 can detect an eye.

[0064] The object frame determination unit 105 determines an object frame, which is a range of an object, from the latest image in the images. The object frame determination unit 105 determines an object frame for an object detected in each of a plurality of images acquired by the image acquisition unit 101. The object frame is for notifying the user of the detected object, and various shapes can be adopted. For example, the object frame is a rectangle including a square, and the object frame is, for example, an ellipse including a perfect circle.

[0065] The dead zone determination unit 107 determines a dead zone for the display of the object frame. The dead zone determination unit 107 determines, for example, a dead zone for the position of the object frame. Here, the dead zone for the display of the object frame means that when the object frame (or object) moves within the range of the dead zone, the object frame to be displayed is constant and does not follow the object, and when the object frame (or object) moves outside the range of the dead zone, the object frame to be displayed follows the object (is the object frame corresponding to the object).

[0066] 5 and 6 are diagrams for explaining the dead zone determined by the dead zone determination unit 107. In FIG. 5 and FIG. 6, a face 125 detected by the object detection unit 103 in the n-th frame, an object frame 121 determined by the object frame determination unit 105 according to the face 125, and a dead zone 120 determined by the dead zone determination unit 107 are shown. Also, a face 127 detected by the object detection unit 103 in the n+1-th frame and an object frame 123 determined by the object frame determination unit 105 according to the face 127 are shown. In this example, the object frame 121 and the object frame 123 are respectively determined in the same positional relationship for the face 125 and the face 127. In this example, the reference points for the position of the object or the position of the object frame are the reference point B1 (object frame 121) and the reference point B2 (object frame 123) in the upper left corner of the object frame.

[0067] 5, face 127 detected in the n+1th frame is located within the range of dead zone 120 set in the nth frame. That is, the n+1th reference point B2 is within the range of dead zone 120. Therefore, target frame 121 is also displayed in the n+1th frame.

[0068] 6, face 127 detected in the n+1th frame is located outside the range of dead zone 122 set in the nth frame. That is, the n+1th reference point B2 is outside the range of dead zone 122. Therefore, in the n+1th frame, target frame 121 corresponding to face 127 is displayed.

[0069] In this way, by setting a dead zone for the position of the detected target, stable display is possible without moving the target frame in response to minute movements of the target, and the target frame can be displayed with good tracking ability for movements of the target that exceed the dead zone.

[0070] Furthermore, the dead zone determination unit 107 can change the position and / or size of the dead zone depending on the detected object. That is, the dead zone determination unit 107 can change the position and size of the dead zone depending on the position of the detected object. Furthermore, the dead zone determination unit 107 can change the width of the dead zone depending on the movement of the object. The dead zone determination unit 107 performs a movement judgment of the object based on the position information and the previous dead zone, and changes the dead zone (the previous dead zone) based on the result of the movement judgment. For example, when the result of the movement judgment indicates a first direction, the dead zone determination unit 107 makes the dead zone in the first direction smaller. That is, the width of the dead zone is set small in the direction in which the detected object is moving, thereby improving the tracking ability of the object frame to the object. Furthermore, when the result of the movement judgment does not indicate the first direction, the dead zone determination unit 107 makes the dead zone in the first direction larger. That is, the width of the dead zone is set large in the direction in which the detected object is not moving, thereby improving the stability of the display of the object frame.

[0071] Fig. 7 is a diagram showing a specific example of the dead zone determined by the dead zone determining unit 107. In the case shown in Fig. 7, the dead zone is determined in the positive direction and the negative direction of the X-axis in the figure.

[0072] In the case shown in FIG. 7(A), the width of the dead zone in the positive direction and the negative direction is the same as the display position P of the previous object frame. In this way, when it is unknown in which direction the object will move, the width of the dead zone in the positive direction and the negative direction is set to be the same, so that the object frame can be displayed appropriately. For example, the initial value of the dead zone may be fixed, and the dead zone of the same width may be set in the positive direction and the negative direction from the center of the angle of view. In the case shown in FIG. 7(B), the width of the dead zone is generally increased. In the case shown in FIG. 7(C), the width of the dead zone is generally decreased. As shown in FIG. 7(B), when the width of the dead zone is generally increased, the stability of the display of the object frame is improved, and as shown in FIG. 7(C), when the width of the dead zone is generally decreased, the tracking ability of the display of the object frame is improved. In the case shown in FIG. 7(D), the dead zone determination unit 107 determines that the object has moved in the positive direction, and the width of the dead zone in the positive direction is decreased. In addition, in the case shown in FIG. 7(D), it is determined that the object has not moved in the negative direction, and the width of the dead zone in the negative direction is increased. 7(E) shows a case where the dead zone determination unit 107 determines that the target has moved in the negative direction in its motion determination, and narrows the width of the dead zone in the negative direction. Also, in the case shown in FIG. 7(E), it determines that the target has not moved in the positive direction, and widens the width of the dead zone in the positive direction.

[0073] In this way, the dead zone determination unit 107 can display the object frame stably and with good tracking by changing the position and size of the dead zone in accordance with the movement of the object.

[0074] Returning to Fig. 4, the storage unit 260 stores a previous object frame corresponding to the object frame determined from the image immediately preceding the image, and a previous dead zone corresponding to the dead zone determined from the image immediately preceding the image. Specifically, the storage unit 260 stores the object frame 121 and the dead zone 120 (dead zone 122) in the n-th frame described in Figs. 5 and 6. The previous object frame and the previous dead zone stored in the storage unit 260 are used for the control of the display control unit 109. The information stored in the storage unit 260 may be updated for each image, or information for each image may be accumulated.

[0075] The display control unit 109 controls the display on the monitor 30. A live view image, a recorded video, and a still image are displayed on the monitor 30. The display control unit 109 also displays an object frame superimposed on the live view image or the recorded video. The display control unit 109 displays the object frame when the position of the object is outside the range of the previous dead zone, and displays the previous object when the position is within the range of the previous dead zone.

[0076] The information adding unit 111 records the position information of the displayed object frame in the image by the display control unit 109. Specifically, the coordinate value of the displayed object frame is added for each frame. The information adding unit 111 adds information by a known method.

[0077] Next, an image display method (image display step) using the image display device 11 will be described.

[0078] 8 and 9 are flowcharts showing an image display method using the image display device 11. In this example, a face is detected as the target, and a face frame corresponding to the detected face is displayed.

[0079] First, the image acquisition unit 101 acquires successive frame images in which a face is photographed (step S10). After that, the object detection unit 103 detects a face in each of the acquired frames and acquires position information of the detected face (step S11).

[0080] The dead zone determination unit 107 determines whether the previous "positive (positive direction)" motion determination is "1" (step S12). If the previous "positive" motion determination is "1", the dead zone determination unit 107 sets a small dead zone width in the positive direction (step S13). On the other hand, if the previous "positive" motion determination is "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the positive direction (step S14).

[0081] Next, the dead zone determination unit 107 determines whether the previous "negative (negative direction)" motion determination is "1" (step S15). If the previous "negative" motion determination is "1", the dead zone determination unit 107 sets a small dead zone width in the negative direction (step S16). On the other hand, if the previous "negative" motion determination is "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the negative direction (step S17).

[0082] Next, the dead zone determination unit 107 uses the dead zone width set by the above process to set the dead zone based on the coordinates after the previous dead zone process (step S18).

[0083] 9, the dead zone determination unit 107 judges whether the acquired current face position has exceeded the dead zone set as described above (step S19). If the acquired current face position has exceeded the set dead zone, the dead zone determination unit 107 judges whether it has exceeded in a positive direction (step S20). Then, if the current face position has exceeded in a positive direction, the dead zone determination unit 107 sets the movement judgment to "positive: 1" and "negative: 0" (step S21). On the other hand, if the current face position has exceeded in a negative direction, the object detection unit 103 sets the movement judgment to "positive: 0" and "negative: 1" (step S22). After that, the display control unit 109 uses the currently detected position information for displaying the face frame to display the face frame (step S23).

[0084] On the other hand, if it is determined that the current face position does not exceed the dead zone, the current movement determination is set to "positive: 0" and "negative: 0" (step S24). Then, the current position information is overwritten with the previous position information (step S25). After that, the display control unit 109 uses the previous position information for displaying the face frame (step S26).

[0085] The above-mentioned configurations and functions can be realized by any hardware, software, or a combination of both. For example, the present invention can be applied to a program that causes a computer to execute the above-mentioned processing steps (processing procedures), a computer-readable recording medium (non-transitory recording medium) on which such a program is recorded, or a computer on which such a program can be installed.

[0086] FIG. 10 is a diagram showing a specific example of dead zone processing. The graph shown in FIG. 10 shows a live view image in which the detection target is a face and a face frame is displayed according to the detected face. In FIG. 10, the horizontal axis indicates the number of face detections performed for each frame, and the vertical axis indicates the X coordinate on the display unit. The line represented by square marks on the graph indicates the upper limit of the dead zone, the line represented by diamond marks indicates the position (X coordinate) of the detected face, the line represented by cross marks indicates the display position (X coordinate) of the face frame after processing, and the line represented by triangle marks indicates the lower limit of the dead zone. Note that the display position of the face frame indicates the X coordinate of the center position of the frame. In the following description, the direction in which the X coordinate increases is the positive direction, and the direction in which the X coordinate decreases is the negative direction.

[0087] From the detection count 170 to the timing indicated by the arrow T1, the face position is detected between the upper limit and lower limit of the dead zone (within the dead zone). Therefore, the display of the face frame does not change, and the face frame is displayed at a constant position.

[0088] At the timing indicated by arrow T2, the face position is detected as exceeding the upper limit of the dead zone, so the display position of the face frame is set to a position according to the detected face position. Also, at the timing indicated by arrow T2, the same dead zone as at the timing indicated by arrow T1 is set. This is because the face position is detected within the dead zone at the timing indicated by arrow T1.

[0089] At the timing indicated by the arrow T3, the face position is detected as exceeding the upper limit of the dead zone, so the display position of the face frame is a position according to the detected face position. Also, at the timing indicated by the arrow T3, the dead zone moves and the width of the dead zone is also changed. Specifically, at the timing indicated by the arrow T3, the face frame is displayed at a position exceeding the upper limit of the dead zone at the timing indicated by the arrow T2, based on the display position of the face frame at the timing indicated by the arrow T2, so the dead zone width in the positive direction is changed to a smaller value at the timing indicated by the arrow T3.

[0090] In this way, by providing a dead zone for the display of the face frame, stable display of the face frame and tracking of the detected face position are not impaired. Also, in the above-mentioned aspect, the position and width of the dead zone are adjusted based on the previous display position of the face frame, so that a more stable and tracking-friendly face frame can be displayed.

[0091] <Second embodiment> In the first embodiment, the dead zone for the position is described, but in the second embodiment, an example of setting the dead zone for the size of the target frame is described. In this embodiment, each unit described in Fig. 4 has the following functions. In the following description, the characteristic points of the second embodiment are described.

[0092] The object detection unit 103 detects an object and detects size information of the object. For example, the object detection unit 103 detects a face, which is an object, and detects size information (area, length) of the face.

[0093] The object frame determination unit 105 determines an object frame, which is the range of an object, from the latest image. The size of the object frame is determined according to the size of the detected object. For example, when a face is detected, the size of the object frame is determined so as to surround the range of the detected face.

[0094] The dead zone determination unit 107 can determine the motion of the object based on the size information and the previous dead zone, and change the previous dead zone based on the result of the motion determination. When the result of the motion determination indicates a first direction, the dead zone determination unit 107 reduces the dead zone in the first direction. Here, the dead zone determination unit 107 can perform motion determination by converting the length of one side of the square face frame into a numerical value, and determining the direction in which the number increases as the positive direction and the direction in which the number decreases as the negative direction.

[0095] If the size of the object is outside the range of the previous dead zone, the display control unit 109 displays the object frame, and if it is within the range of the previous dead zone, the display control unit 109 displays the previous object frame.

[0096] The information adding unit 111 records size information of the displayed object frame in the image by the display control unit 109. Specifically, the size (area or length of one side) of the displayed object frame is added for each frame. The information adding unit 111 adds information by a known method.

[0097] Fig. 11 is a diagram for explaining the dead zone of the size of the object frame. In Fig. 11, object frame 131 indicates the lower limit of the dead zone, object frame 133 indicates the upper limit of the dead zone, and object frame 139 indicates the object frame for display. For example, when an object corresponding to object frame 137 is detected within the range of the lower limit of the dead zone indicated by object frame 131 and the upper limit of the dead zone indicated by object frame 133, display control unit 109 displays object frame 139. On the other hand, when an object corresponding to object frame 135 is detected outside the range of the lower limit of the dead zone indicated by object frame 131 and the upper limit of the dead zone indicated by object frame 133, display control unit 109 displays object frame 135 as the object frame for display.

[0098] Next, a description will be given of an image display method (image display step) using the image display device 11. The image display method detects faces in successive frames, and continuously displays face frames that notify the user of the positions of the detected faces.

[0099] 12 and 13 are flow charts showing an image display method (image display process) using the image display device 11. FIG.

[0100] First, the image acquisition unit 101 acquires successive frame images in which a face is photographed (step S30). After that, the object detection unit 103 detects a face in each of the acquired frames and acquires size information of the detected face (step S31).

[0101] The dead zone determination unit 107 determines whether the previous "positive (positive direction)" motion judgment is "1" (step S32). If the previous "positive" motion judgment is "1", the dead zone determination unit 107 sets a small dead zone width in the positive direction (step S33). On the other hand, if the previous "positive" motion judgment is "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the positive direction (step S34). Note that the positive direction indicates the direction in which the frame becomes larger, and the negative direction indicates the direction in which the frame becomes smaller.

[0102] Next, the dead zone determination unit 107 determines whether the previous "negative" motion determination is "1" (step S35). If the previous "negative (negative direction)" motion determination is "1", the dead zone determination unit 107 sets a small dead zone width in the negative direction (step S36). On the other hand, if the previous "negative" motion determination is "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the negative direction (step S37).

[0103] Next, the dead zone determination unit 107 uses the dead zone width set by the above process to set the dead zone based on the size after the previous dead zone process (step S38).

[0104] 13, the dead zone determination unit 107 next judges whether the acquired face size this time exceeds the dead zone set this time (step S39). If the acquired face size this time exceeds the dead zone set this time, the dead zone determination unit 107 judges whether it has exceeded in the positive direction (step S40). Then, if the face size this time exceeds in the positive direction, the dead zone determination unit 107 sets the movement judgment to "positive: 1" and "negative: 0" (step S41). On the other hand, if the face size this time exceeds in the negative direction, the object detection unit 103 sets the movement judgment to "positive: 0" and "negative: 1" (step S42). After that, the display control unit 109 displays the face frame using the size information detected this time for displaying the face frame (step S43).

[0105] On the other hand, if it is determined that the current face size does not exceed the dead zone, the current movement determination is set to "positive: 0" and "negative: 0" (step S44). Then, the current size information is overwritten with the previous size information (step S45). After that, the display control unit 109 uses the previous size information for displaying the face frame (step S46).

[0106] As explained above, if the size of the object is within the range of the previous dead zone, the object frame displayed previously is displayed, so that the object frame can be stably displayed without changing the size information for displaying the object frame in the case of small fluctuations (variations in size). Also, if the size of the object is outside the range of the previous dead zone, the object frame corresponding to the object detected this time is displayed, so that an object frame with excellent tracking ability (size tracking ability) to the detected object can be displayed.

[0107] <Other> [Bad zone for position and size] In the above description, the first embodiment describes the dead zone for the position of the target frame, and the second embodiment describes the dead zone for the size of the target frame. In the present invention, the dead zone can also be determined for the position and size of the target frame. That is, the dead zone is set simultaneously for the position and size of the target frame. In this way, by setting the dead zone for the position and size of the target frame, the target frame can be displayed more stably and with good tracking ability to the target.

[0108] [Sequential images] In the above description, the object is detected by the object detection unit 103 from the image acquired by the image acquisition unit 101, and the object frame is determined by the object frame determination unit 105. However, the present invention is not limited to this aspect. For example, the consecutive images acquired by the image acquisition unit 101 may have information on the position of the detected object and the position of the object frame, which is the range of the object. Also, for example, the consecutive images acquired by the image acquisition unit 101 may have information on the size of the detected object and the size of the object frame, which is the range of the object. In this case, the image display device 11 does not need to detect the object (object detection unit 103) and determine the object frame (object frame determination unit 105) from the acquired image.

[0109] <Smartphone configuration> In the above description, a camera is used as an example of the imaging device 10 in FIG. 1, but the application of the present invention is not limited to this. Other aspects to which the present invention can be applied include, for example, mobile phones and smartphones with camera functions, PDAs (Personal Digital Assistants), and portable game machines. An example of a smartphone to which the present invention can be applied will be described below. Note that the CPU 240 in FIG. 4 corresponds to the main control unit 501, the storage unit 260 corresponds to the storage unit 550, and the monitor 30 corresponds to the display panel 521.

[0110] Fig. 14 is a diagram showing the appearance of a smartphone 500. The smartphone 500 shown in Fig. 14 has a flat housing 502, and is provided with a display input unit 520 in which a display panel 521 as a display unit and an operation panel 522 as an input unit are integrated on one surface of the housing 502. The housing 502 also includes a speaker 531, a microphone 532, an operation unit 540, and a camera unit 541. Note that the configuration of the housing 502 is not limited to this, and for example, a configuration in which the display unit and the input unit are independent, or a configuration having a folding structure or a sliding mechanism can be adopted.

[0111] Fig. 15 is a block diagram showing the configuration of the smartphone 500 shown in Fig. 14. As shown in Fig. 15, the smartphone includes, as main components, a wireless communication unit 510 that performs mobile wireless communication via a base station and a mobile communication network, a display input unit 520, a call unit 530, an operation unit 540, a camera unit 541, a storage unit 550, an external input / output unit 560, a GPS (Global Positioning System) receiving unit 570, a motion sensor unit 580, a power supply unit 590, and a main control unit 501.

[0112] The wireless communication unit 510 performs wireless communication with a base station contained in a mobile communication network according to instructions from the main control unit 501. Using this wireless communication, it transmits and receives various file data such as voice data and image data, e-mail data, and the like, and receives Web data, streaming data, and the like.

[0113] The display input unit 520 is a so-called touch panel that displays images (still images and videos), text information, etc. under the control of the main control unit 501 to visually convey information to the user and detects user operations on the displayed information, and is equipped with a display panel 521 and an operation panel 522.

[0114] The display panel 521 uses an LCD (Liquid Crystal Display), an OELD (Organic Electro-Luminescence Display), or the like as a display device. The operation panel 522 is placed so that an image displayed on the display surface of the display panel 521 can be seen, and is a device that detects one or more coordinates operated by a user's finger or a stylus. When such a device is operated by the user's finger or a stylus, a detection signal generated due to the operation is output to the main control unit 501. Next, the main control unit 501 detects the operation position (coordinates) on the display panel 521 based on the received detection signal.

[0115] 14, the display panel 521 and the operation panel 522 of the smartphone 500 exemplified as an embodiment of the imaging device 10 of the present invention are integrated to form the display input unit 520, and the operation panel 522 is arranged so as to completely cover the display panel 521. When such an arrangement is adopted, the operation panel 522 may also have a function of detecting user operations in an area outside the display panel 521. In other words, the operation panel 522 may have a detection area for the overlapping portion that overlaps the display panel 521 (hereinafter referred to as the display area) and a detection area for the other outer edge portion that does not overlap the display panel 521 (hereinafter referred to as the non-display area).

[0116] The size of the display area and the size of the display panel 521 may be completely the same, but they do not necessarily have to be the same. Furthermore, the operation panel 522 may have two sensitive areas, an outer edge part and the other inner part. Furthermore, the width of the outer edge part is designed appropriately according to the size of the housing 502, etc. Furthermore, the position detection method adopted by the operation panel 522 may be a matrix switch method, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, a capacitance method, etc., and any method may be adopted.

[0117] The call unit 530 includes a speaker 531 and a microphone 532, and converts the user's voice input through the microphone 532 into voice data that can be processed by the main control unit 501 and outputs it to the main control unit 501, or decodes voice data received by the wireless communication unit 510 or the external input / output unit 560 and outputs it from the speaker 531. Also, as shown in Fig. 14, for example, the speaker 531 and the microphone 532 can be mounted on the same surface on which the display input unit 520 is provided.

[0118] The operation unit 540 is a hardware key using a key switch or the like, and receives instructions from a user. For example, as shown in Fig. 14, the operation unit 540 is a push-button switch mounted on the side of the housing 502 of the smartphone 500, which is turned on when pressed with a finger or the like, and turned off by the restoring force of a spring or the like when the finger is released.

[0119] The storage unit 550 stores the control program of the main control unit 501, control data, application software, address data associated with names and telephone numbers of communication partners, data of emails sent and received, Web data downloaded by Web browsing, and downloaded content data, and also temporarily stores streaming data. The storage unit 550 is composed of an internal storage unit 551 built into the smartphone and an external storage unit 552 having a removable external memory slot. The internal storage unit 551 and the external storage unit 552 constituting the storage unit 550 are realized using recording media such as a flash memory type, a hard disk type, a multimedia card micro type, a card-type memory (e.g., Micro SD (registered trademark) memory, etc.), a RAM (Random Access Memory), and a ROM (Read Only Memory).

[0120] The external input / output unit 560 serves as an interface with all external devices connected to the smartphone 500, and is for directly or indirectly connecting to other external devices via communication (e.g., Universal Serial Bus (USB) and IEEE1394, etc.) or a network (e.g., the Internet, wireless LAN (Local Area Network), Bluetooth (registered trademark), RFID (Radio Frequency Identification), Infrared Data Association (IrDA) (registered trademark), UWB (Ultra Wideband) (registered trademark), ZigBee (registered trademark), etc.).

[0121] Examples of external devices connected to the smartphone 500 include wired / wireless headsets, wired / wireless external chargers, wired / wireless data ports, memory cards connected via card sockets, SIM (Subscriber Identity Module Card) / UIM (User Identity Module Card) cards, external audio / video devices connected via audio / video I / O (Input / Output) terminals, wirelessly connected external audio / video devices, wired / wirelessly connected smartphones, wired / wirelessly connected personal computers, wired / wirelessly connected PDAs, and earphones. The external input / output unit 560 can transmit data received from such external devices to each component inside the smartphone 500, or transmit data inside the smartphone 500 to the external devices.

[0122] The GPS receiver 570 receives GPS signals transmitted from the GPS satellites ST1 to STn in accordance with instructions from the main controller 501, executes positioning calculation processing based on the received GPS signals, and detects a position consisting of the latitude, longitude, and altitude of the smartphone 500. When the GPS receiver 570 can obtain position information from the wireless communication unit 510 or the external input / output unit 560 (for example, wireless LAN), it can also detect the position using the position information.

[0123] The motion sensor unit 580 includes, for example, a three-axis acceleration sensor and a gyro sensor, and detects the physical movement of the smartphone 500 according to an instruction from the main control unit 501. By detecting the physical movement of the smartphone 500, the moving direction and acceleration of the smartphone 500 are detected. The detection result is output to the main control unit 501.

[0124] The power supply unit 590 supplies power stored in a battery (not shown) to each unit of the smartphone 500 in accordance with instructions from the main control unit 501.

[0125] The main control unit 501 includes a microprocessor, operates according to a control program and control data stored in the storage unit 550, and controls each unit of the smartphone 500. The main control unit 501 also includes a mobile communication control function and an application processing function that control each unit of the communication system in order to perform voice communication and data communication via the wireless communication unit 510.

[0126] The application processing function is realized by main control unit 501 operating in accordance with application software stored in storage unit 550. Examples of the application processing function include an infrared communication function for controlling external input / output unit 560 to perform data communication with a counterpart device, an e-mail function for sending and receiving e-mail, a web browsing function for viewing web pages, and an image processing function for performing compression processing according to the present invention.

[0127] The main control unit 501 also has an image processing function for displaying a video on the display input unit 520 based on image data (still image or video data) such as received data or downloaded streaming data. The image processing function refers to a function in which the main control unit 501 decodes the image data, performs image processing on the decoding result, and displays the image on the display input unit 520.

[0128] Furthermore, the main control unit 501 executes display control for the display panel 521 and operation detection control for detecting user operations via the operation unit 540 and the operation panel 522 .

[0129] By executing the display control, main control unit 501 displays software keys such as icons and scroll bars for starting application software, or displays a window for creating an e-mail. Note that the scroll bar refers to a software key for receiving an instruction to move the displayed portion of an image, such as a large image that does not fit in the display area of ​​display panel 521.

[0130] In addition, by executing operation detection control, the main control unit 501 detects user operations through the operation unit 540, accepts operations on icons through the operation panel 522 and input of character strings into input fields of windows, or accepts requests to scroll a displayed image through a scroll bar.

[0131] Furthermore, by executing operation detection control, the main control unit 501 determines whether the operation position on the operation panel 522 is an overlapping portion (display area) that overlaps with the display panel 521, or an outer edge portion (non-display area) that does not overlap with the display panel 521, and is equipped with a touch panel control function that controls the sensitive area of ​​the operation panel 522 and the display position of the software keys.

[0132] Furthermore, the main control unit 501 can detect a gesture operation on the operation panel 522 and execute a preset function in response to the detected gesture operation. The gesture operation is not a simple touch operation as in the past, but refers to an operation of drawing a path with a finger or the like, designating multiple positions simultaneously, or combining these to draw a path for at least one of multiple positions.

[0133] The camera unit 541 is a digital camera that uses an image sensor such as a complementary metal oxide semiconductor (CMOS) or a charge-coupled device (CCD) to electronically capture images, and corresponds to the image capture device 10 shown in FIG. 1. The camera unit 541 can compress still image data obtained by capturing images, for example, using JPEG (Joint Photographic coding Experts Group), or compress moving image data, for example, using H.264 / AVC, under the control of the main control unit 501, and record the compressed image data in the storage unit 550, or output the compressed image data through the external input / output unit 560 or the wireless communication unit 510. As shown in FIG. 14, in the smartphone 500, the camera unit 541 is mounted on the same surface as the display input unit 520, but the mounting position of the camera unit 541 is not limited thereto, and the camera unit 541 may be mounted on the back surface of the display input unit 520, or multiple camera units 541 may be mounted. When multiple camera units 541 are mounted, the camera unit 541 used for capturing images can be switched to capture images alone, or multiple camera units 541 can be used simultaneously to capture images.

[0134] In addition, the camera unit 541 can be used for various functions of the smartphone 500. For example, an image acquired by the camera unit 541 can be displayed on the display panel 521, and an image of the camera unit 541 can be used as one of the operation inputs of the operation panel 522. In addition, when the GPS receiver unit 570 detects a position, the position can be detected by referring to an image from the camera unit 541. Furthermore, by referring to an image from the camera unit 541, the direction of the optical axis of the camera unit 541 of the smartphone 500 can be determined and the current usage environment can be determined without using a three-axis acceleration sensor or by using a three-axis acceleration sensor (gyro sensor) in combination. Of course, the image from the camera unit 541 can also be used in application software.

[0135] In addition, image data of still or video images can be added with location information acquired by the GPS receiver unit 570, voice information acquired by the microphone 532 (which may be converted to text information by the main control unit, etc.), posture information acquired by the motion sensor unit 580, etc., and recorded in the memory unit 550, or output via the external input / output unit 560 or wireless communication unit 510.

[0136] Although the present invention has been described above with reference to examples, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present invention. [Explanation of symbols]

[0137] 1: Strobe 2: Shutter button 3: Power / Mode Switch 4: Mode dial 5: Zoom button 6: Cross pad 7: MENU / OK button 8: Play button 9:BACK button 10: Imaging device 11: Image display device 12: Shooting lens 30: Monitor 101: Image acquisition unit 103: Object detection unit 105: Target quota determination department 107: Dead zone determination unit 109: Display control unit 110:Zoom lens 111: Information Addition Section 140: Lens drive unit 150: Focus lens 210: Image sensor 230: A / D converter 240 :CPU 250:Operation unit 260: Storage section

Claims

1. an image acquisition unit that accepts input of a plurality of images; an object detection unit that detects an object from a first image and a second image among the plurality of images; an object frame determination unit that determines a first object frame that is a range of the object in the first image and a second object frame that is a range of the object in the second image; a dead zone determiner for determining a dead zone for the object extracted from the first image; The position of the object detected from the second image is If the second target frame is outside the range of the dead zone determined from the first image, the second target frame is added to the second image. When the object is within the range of the dead zone determined from the first image, the first object frame is added to the second image; A display control unit that executes control to display; An image display device comprising:

2. The image display device according to claim 1 , wherein the dead zone determining unit determines the dead zone from a position of the first object frame relative to the object.

3. The object detection unit detects position information of the object, The image display device according to claim 1 , wherein the dead zone determination unit changes the dead zone based on the position information.

4. The image display device according to claim 3 , wherein the dead zone determination section determines a movement of the object based on the position information and the dead zone, and changes the dead zone based on a result of the movement determination.

5. an image acquisition unit that accepts input of a plurality of images; an object detection unit that detects an object from a first image and a second image among the plurality of images; an object frame determination unit that determines a first object frame that is a range of the object in the first image and a second object frame that is a range of the object in the second image; a dead zone determiner for determining a dead zone for the object extracted from the first image; The size of the object detected from the second image is If the second target frame is outside the range of the dead zone determined from the first image, the second target frame is added to the second image. When the object is within the range of the dead zone determined from the first image, the first object frame is added to the second image; A display control unit that executes control to display; An image display device comprising:

6. The image display device according to claim 5 , wherein the dead zone determining unit determines the dead zone from a size of the first object frame relative to the object.

7. The object detection unit detects size information of the object, The image display device according to claim 5 , wherein the dead zone determination section changes the dead zone based on the size information.

8. The image display device according to claim 5 , wherein the dead zone determination unit determines a motion of the object based on the size information and the dead zone, and changes the dead zone based on a result of the motion determination.

9. 9. The image display device according to claim 4, wherein the dead zone determination section reduces the dead zone in the first direction when the result of the motion determination indicates a first direction.

10. The image display device according to claim 9 , wherein the dead zone determination section increases the dead zone in the first direction when the result of the motion determination does not indicate a first direction.

11. 11. The image display device according to claim 1, wherein the second image and the first image are images of different frames constituting a moving image.

12. 12. The image display device according to claim 1, wherein the second image is captured more recently than the first image.

13. The image display device according to claim 3 , 4 , or 7 to 10 , wherein the change of the dead zone is performed by changing a position or a size of the dead zone depending on the object detected by the object detection unit.

14. The image display device according to claim 1 , further comprising an information adding unit that records position information or size information of the first target frame and the second target frame displayed by the display control unit into the image.

15. 15. The image display device according to claim 1, wherein the dead zone is a dead zone width for the first target frame and the second target frame, and an initial value of the dead zone is constant.

16. The image display device according to claim 1 , wherein the target detected by the target detection unit is an object.

17. The image display device according to claim 16 , wherein the object is a face or an eye.

18. The image display device according to claim 1 , wherein the first target frame and the second target frame are rectangular.

19. The image display device according to claim 1 , wherein the first target frame and the second target frame are ellipses.

20. an image acquisition step of accepting input of a plurality of images; an object detection step of detecting an object from a first image and a second image among the plurality of images; an object frame determining step of determining a first object frame that is a range of the object in the first image and a second object frame that is a range of the object in the second image; a dead zone determining step of determining a dead zone for the object extracted in the first image; The position of the object detected from the second image is If the second target frame is outside the range of the dead zone determined from the first image, the second target frame is added to the second image. When the object is within the range of the dead zone determined from the first image, the first object frame is added to the second image; a display control step for executing control for displaying; An image display method comprising:

21. an image acquisition step of accepting input of a plurality of images; an object detection step of detecting an object from a first image and a second image among the plurality of images; an object frame determining step of determining a first object frame that is a range of the object in the first image and a second object frame that is a range of the object in the second image; a dead zone determining step of determining a dead zone for the object extracted in the first image; The size of the object detected from the second image is If the second target frame is outside the range of the dead zone determined from the first image, the second target frame is added to the second image. When the object is within the range of the dead zone determined from the first image, the first object frame is added to the second image; a display control step for executing control for displaying; An image display method comprising:

22. an image acquisition step of accepting input of a plurality of images; an object detection step of detecting an object from a first image and a second image among the plurality of images; an object frame determining step of determining a first object frame that is a range of the object in the first image and a second object frame that is a range of the object in the second image; a dead zone determining step of determining a dead zone for the object extracted in the first image; The position of the object detected from the second image is If the second target frame is outside the range of the dead zone determined from the first image, the second target frame is added to the second image. When the object is within the range of the dead zone determined from the first image, the first object frame is added to the second image; a display control step for executing control for displaying; A program for causing a computer to execute an image display process including the steps of:

23. an image acquisition step of accepting input of a plurality of images; an object detection step of detecting an object from a first image and a second image among the plurality of images; an object frame determining step of determining a first object frame that is a range of the object in the first image and a second object frame that is a range of the object in the second image; a dead zone determining step of determining a dead zone for the object extracted in the first image; The size of the object detected from the second image is If the second target frame is outside the range of the dead zone determined from the first image, the second target frame is added to the second image. When the object is within the range of the dead zone determined from the first image, the first object frame is added to the second image; a display control step for executing control for displaying; A program for causing a computer to execute an image display process including the steps of:

Images