Electronic apparatus, control method of electronic apparatus, and program

Abstract

To reduce a load of an operation for selecting an image from a plurality of moving images and a plurality of still images.SOLUTION: An electronic apparatus controls display of a specific image screen displayed on display means. The electronic apparatus includes: acquiring means of acquiring a plurality of moving images photographed in each of a plurality of continuous time zones and a plurality of still images photographed in photographing of the plurality of moving images; and control means of displaying 1) the plurality of moving images in a time sequence order in a first region in the specific image screen, and 2) displaying in the first region the moving image photographed in the time zone and one or more still images photographed in the time zone while associating these images with each other in each time zone when the one or more still images are photographed in the plurality of time zones.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, and a program. [Background technology]

[0002] There are known digital cameras that can take still images while shooting a video without stopping the video. In news reporting and other situations, in order to reduce manpower, a single cameraman often shoots both video and still images (hereinafter, video and still images are collectively referred to as "shooting data"). For this reason, it is important that a single camera can capture still images while shooting a video.

[0003] Furthermore, when a news article or the like is generated using photographic data, the photographer transmits the photographic data to an editor via the Internet, and the editor selects and edits the photographic data.

[0004] However, since videos and still images are saved as separate files, it may be difficult to understand their relationship. For this reason, Patent Document 1 makes it easier to check the relationship between the video and still images by displaying the still images in association with each other on a timeline during video playback. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP2010-147861A Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, it is certainly easy to check the relationship between one selected video and multiple still images. However, it is not possible to check the relationship between multiple videos and multiple still images at the same time. In particular, when generating a news article, a selection task is performed from multiple short videos and multiple still images, so the selection task is difficult even if the technology of the first embodiment is used.

[0007] Therefore, an object of the present invention is to provide a technique for reducing the burden of the task of selecting images from a plurality of moving images and a plurality of still images. [Means for solving the problem]

[0008] One aspect of the present invention is a method for producing a composition comprising the steps of: An electronic device that controls the display of a specific screen displayed on a display means, An acquisition means for acquiring a plurality of videos captured in a plurality of consecutive time periods and a plurality of still images captured during the capture of the plurality of videos; A control means for 1) displaying the plurality of videos in chronological order in a first area on the specific screen, and 2) displaying, for each time period in which one or more still images were taken among the plurality of time periods, the video taken during that time period and the one or more still images taken during that time period in association with each other in the first area; The electronic device is characterized by having the following features.

[0009] One aspect of the present invention is a method for producing a composition comprising the steps of: A method for controlling an electronic device that controls display of a specific screen displayed on a display means, comprising the steps of: An acquisition step of acquiring a plurality of videos captured in a plurality of consecutive time periods and a plurality of still images captured during the capture of the plurality of videos; a control step of: 1) displaying the plurality of videos in a first area on the specific screen in chronological order; and 2) displaying, for each time period in which one or more still images were taken among the plurality of time periods, the video taken during that time period and the one or more still images taken during that time period in association with each other in the first area; The present invention relates to a method for controlling an electronic device, comprising the steps of: Effect of the Invention

[0010] According to the present invention, it is possible to reduce the burden of the task of selecting images from a plurality of moving images and a plurality of still images. [Brief description of the drawings]

[0011] [Figure 1] 1 is an overall configuration diagram of a shooting and editing system according to a first embodiment. [Diagram 2] 1 is an external view of a camera according to a first embodiment. [Diagram 3] FIG. 1 is a configuration diagram of a camera according to a first embodiment. [Figure 4] FIG. 2 is a configuration diagram of a server and a PC according to the first embodiment. [Diagram 5] FIG. 2 is a diagram showing a screen of an editing application according to the first embodiment. [Figure 6] FIG. 11 is a diagram showing a screen of an editing application according to the second embodiment. [Figure 7] 4 is a flowchart of the operation of the camera according to the first embodiment. [Figure 8] 4 is a flowchart of the operation of the server according to the first embodiment. [Figure 9] 4 is a flowchart of the operation of a PC according to the first embodiment. [Figure 10] 10 is a flowchart of the operation of the camera according to the second embodiment. [Figure 11] 10 is a flowchart of the operation of a server according to the second embodiment. [Figure 12] 10 is a flowchart of the operation of a PC according to the second embodiment. [Figure 13] 10 is a flowchart of processing according to an imaging signal etc. according to the second embodiment. [Figure 14] FIG. 13 is a diagram illustrating an editing process according to the third embodiment. [Figure 15] 13 is a flowchart of the operation of a PC according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0013] <Embodiment 1> Fig. 1 is a schematic diagram showing an example of the overall configuration of a shooting and editing system according to embodiment 1. The shooting and editing system according to embodiment 1 includes a camera 100, a server 300, and a personal computer (PC) 400. The server 300 and the PC 400 are information processing devices (electronic devices) that handle images captured by an imaging device such as the camera 100. Fig. 1 shows a configuration in which the camera 100 and the PC 400 are connected to each other wirelessly or via a wire so as to be able to communicate with each other.

[0014] 2A and 2B are external views showing an example of the appearance of an imaging device, camera 100. Fig. 2A is a perspective view of camera 100 seen from the front side, and Fig. 2B is a perspective view of camera 100 seen from the back side.

[0015] The camera 100 has, on its top surface, a shutter button 101, a power switch 102, a mode switch 103, a main electronic dial 104, a sub electronic dial 105, a movie button 106, and an outside viewfinder display 107. The shutter button 101 is an operating member for issuing a shooting preparation instruction or a shooting instruction. The power switch 102 is an operating member for switching the power of the camera 100 on and off. The mode switch 103 is an operating member for switching between various modes. The main electronic dial 104 is a rotary operating member for changing the settings of the shutter speed, aperture, etc. The sub electronic dial 105 is a rotary operating member for moving the selection frame (cursor) and scrolling through images, etc. The movie button 106 is an operating member for issuing an instruction to start and stop movie shooting (recording). The outside viewfinder display unit 107 displays various settings such as shutter speed and aperture.

[0016] The camera 100 has a display unit 108, a touch panel 109, a direction key 110, a SET button 111, an AE lock button 112, a magnification button 113, a playback button 114, a menu button 115, an eyepiece unit 116, an eyepiece detection unit 118, and a touch bar 119 on the rear surface. The display unit 108 displays images and various information. The touch panel 109 is an operation member that detects a touch operation on the display surface (touch operation surface) of the display unit 108. The direction key 110 is an operation unit that is composed of keys (four-way keys) that can be pressed up, down, left, and right. The camera 100 can execute a process according to the position where the direction key 110 is pressed. The SET button 111 is an operation member that is pressed mainly when deciding a selected item. The AE lock button 112 is an operation member that is pressed when fixing an exposure state in a shooting standby state. The enlargement button 113 is an operating member for switching the enlargement mode on and off in the live view display (LV display) in the shooting mode. When the enlargement mode is on, the live view image (LV image) is enlarged or reduced by operating the main electronic dial 104. The enlargement button 113 is also used to enlarge a playback image or increase the magnification ratio in the playback mode. The playback button 114 is an operating member for switching between the shooting mode and the playback mode. In the shooting mode, pressing the playback button 114 switches to the playback mode, and the latest image among the images recorded in the recording medium 227 described later can be displayed on the display unit 108.

[0017] Menu button 115 is an operation member that is pressed to display a menu screen on display unit 108 that allows various settings to be made. A user can intuitively make various settings using the menu screen displayed on display unit 108, direction key 110, and SET button 111. Eyepiece unit 116 is a portion that is used to place the eye close to eyepiece finder (peek-in type finder) 117 and peer into it. Through eyepiece unit 116, the user can view an image displayed on an EVF 217 (Electronic View Finder) (described later) inside camera 100. Eyepiece detection unit 118 is a sensor that detects whether the user places the eye close to eyepiece unit 116 (eyepiece finder 117).

[0018] The touch bar 119 is a line-shaped touch operation member (line touch sensor) capable of receiving a touch operation. The touch bar 119 is disposed at a position where it can be touched (touched) by the thumb of the right hand when the grip unit 120 is held in the right hand (held with the little finger, ring finger, and middle finger of the right hand) so that the shutter button 101 can be pressed with the index finger of the right hand. That is, the touch bar 119 can be operated in a state (shooting posture) where the eyepiece unit 116 is looked into by putting the eyepiece 117 close to the eyepiece finder 117 and the user is ready to press the shutter button 101 at any time. The touch bar 119 can receive a tap operation (operation of touching and releasing the touch position without moving it within a predetermined period of time) on the touch bar 119, a slide operation to the left and right (operation of touching and then moving the touch position while keeping the touch) and the like. The touch bar 119 is an operation member different from the touch panel 109, and does not have a display function. The touch bar 119 functions as, for example, a multi-function bar (M-Fn bar) to which various functions can be assigned.

[0019] The camera 100 also has a grip section 120, a thumb rest section 121, a terminal cover 122, a lid 123, a communication terminal 124, etc. The grip section 120 is a holding section formed in a shape that is easy to hold with the right hand when the user holds the camera 100. The shutter button 101 and the main electronic dial 104 are disposed in positions that can be operated with the index finger of the right hand when the camera 100 is held by gripping the grip section 120 with the little finger, ring finger, and middle finger of the right hand. Similarly, the sub electronic dial 105 and the touch bar 119 are disposed in positions that can be operated with the thumb of the right hand. The thumb rest section 121 (thumb standby position) is provided on the rear side of the camera 100 at a position where it is easy to place the thumb of the right hand that is gripping the grip section 120 when none of the operating members are being operated. This is a grip section. Thumb rest section 121 is made of a rubber member or the like for increasing holding power (grip feeling). Terminal cover 122 protects connectors such as a connection cable that connects camera 100 to an external device (external apparatus). Lid 123 protects recording medium 227 and the slot by closing the slot for storing recording medium 227 (described later). Communication terminal 124 is a terminal for communicating with a lens unit (such as lens unit 200 (described later)) that is detachable from camera 100.

[0020] Fig. 3 is a block diagram showing an example of the configuration of camera 100. Note that the same components as those in Fig. 2 are given the same reference numerals as those in Fig. 2, and descriptions of those components will be omitted as appropriate. In Fig. 3, lens unit 200 is attached to camera 100.

[0021] First, the lens unit 200 will be described. The lens unit 200 is a type of interchangeable lens that is detachable from the camera 100. The lens unit 200 is a single lens, and is an example of a normal lens. The lens unit 200 has an aperture 201, a lens 202, an aperture drive circuit 203, an AF (autofocus) drive circuit 204, a lens system control circuit 205, a communication terminal 206, and the like.

[0022] The aperture 201 is configured so that the aperture diameter can be adjusted. The lens 202 is composed of a plurality of lenses. The aperture drive circuit 203 adjusts the amount of light by controlling the aperture diameter of the aperture 201. The AF drive circuit 204 drives the lens 202 to adjust the focus. The lens system control circuit 205 controls the aperture drive circuit 203, the AF drive circuit 204, and the like, based on an instruction from a system control unit 50, which will be described later. The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203, and adjusts the focus by changing the position of the lens 202 via the AF drive circuit 204. The lens system control circuit 205 can communicate with the camera 100. Specifically, communication is performed via a communication terminal 206 of the lens unit 200 and a communication terminal 124 of the camera 100. The communication terminal 206 is a terminal through which the lens unit 200 communicates with the camera 100.

[0023] Next, a description will be given of the camera 100. The camera 100 has a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D / A converter 216, an EVF 217, a display unit 108, and a system control unit 50.

[0024] The shutter 210 is a focal plane shutter that can freely control the exposure time of the imaging unit 211 based on an instruction from the system control unit 50. The imaging unit 211 is an imaging element (image sensor) composed of a CCD or CMOS element that converts an optical image into an electric signal. The imaging unit 211 may have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 212 converts an analog signal output from the imaging unit 211 into a digital signal. The image processing unit 214 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion processing, etc.) on data from the A / D converter 212 or data from the memory control unit 213. In addition, the image processing unit 214 performs predetermined calculation processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained calculation result. This processing performs TTL (through-the-lens) type AF processing, AE (automatic exposure) processing, EF (flash pre-emission) processing, etc. Furthermore, the image processing unit 214 performs a predetermined calculation process using the captured image data, and the system control unit 50 performs TTL type AWB (auto white balance) processing based on the obtained calculation results.

[0025] Image data from the A / D converter 212 is written to the memory 215 via the image processing unit 214 and the memory control unit 213. Alternatively, image data from the A / D converter 212 is written to the memory 215 via the memory control unit 213 without passing through the image processing unit 214. The memory 215 stores image data obtained by the imaging unit 211 and digitized by the A / D converter 212. The memory 215 stores image data converted into digital data. The memory 215 stores image data to be displayed on the display unit 108 and the EVF 217. The memory 215 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. The memory 215 also serves as a memory for displaying images (video memory).

[0026] The D / A converter 216 converts the image data for display stored in the memory 215 into an analog signal and supplies it to the display unit 108 and the EVF 217. Therefore, the image data for display written in the memory 215 is displayed on the display unit 108 or the EVF 217 via the D / A converter 216. The display unit 108 or the EVF 217 performs display according to the analog signal from the D / A converter 216. The display unit 108 or the EVF 217 is, for example, an LCD or an organic EL display. The digital signal that is A / D converted by the A / D converter 212 and stored in the memory 215 is converted into an analog signal by the D / A converter 216. The converted analog signal is sequentially transferred to the display unit 108 or the EVF 217, and an image based on the analog signal is displayed on the display unit 108 or the EVF 217. In this manner, a live view display is performed.

[0027] The system control unit 50 is a control unit consisting of at least one processor and / or at least one circuit. That is, the system control unit 50 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 50 controls the entire camera 100. The system control unit 50 executes a program recorded in the non-volatile memory 219 to realize each process of the flowchart described later. The system control unit 50 also performs display control by controlling the memory 215, the D / A converter 216, the display unit 108, the EVF 217, etc.

[0028] The camera 100 also includes a system memory 218 , a non-volatile memory 219 , a system timer 220 , a communication unit 221 , an attitude detection unit 222 , and an eye proximity detection unit 118 .

[0029] As the system memory 218, for example, a RAM is used. In the system memory 218, constants and variables for the operation of the system control unit 50, programs read from the nonvolatile memory 219, etc. are deployed. The nonvolatile memory 219 is an electrically erasable and recordable memory. For example, an EEPROM is used as the nonvolatile memory 219. In the nonvolatile memory 219, constants and programs for the operation of the system control unit 50 are recorded. The programs here are programs for executing the flowcharts described later. The system timer 220 is a timing unit that measures the time used for various controls and the time of a built-in clock.

[0030] The communication unit 221 transmits and receives video signals and audio signals to and from an external device connected wirelessly or via a wired cable. The communication unit 221 can also connect to a wireless LAN (Local Area Network) and the Internet. The communication unit 221 can also communicate with an external device via Bluetooth (registered trademark) and Bluetooth Low Energy. The communication unit 221 can transmit images (including live images) captured by the imaging unit 211, shooting information signals indicating shooting information such as the file name and shooting date and time of the image, and images recorded in the recording medium 227. The communication unit 221 can receive images and various other information from the external device.

[0031] The attitude detection unit 222 detects the attitude of the camera 100 with respect to the direction of gravity. Based on the detected attitude, the attitude detection unit 222 can determine whether the image captured by the imaging unit 211 was captured with the camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 222 to the image file of the image captured by the imaging unit 211, or rotate the image according to the detected attitude. The attitude detection unit 222 can include, for example, an acceleration sensor or A gyro sensor or the like can be used. It is also possible to use the attitude detection unit 222 to detect the movement of the camera 100 (whether it is panned, tilted, lifted, or stationary, etc.).

[0032] Eyepiece detection unit 118 can detect the approach of some object to eyepiece unit 116 (eyepiece finder 117). Eyepiece detection unit 118 can be, for example, an infrared proximity sensor. When an object approaches eyepiece unit 116, infrared rays projected from a light-projecting unit of eyepiece detection unit 118 are reflected by the object and received by a light-receiving unit of the infrared proximity sensor. The distance from eyepiece unit 116 to the object can be determined based on the amount of infrared rays received. In this way, eyepiece detection unit 118 performs eyepiece detection to detect the proximity of an object to eyepiece unit 116.

[0033] The eye contact detection unit 118 is an eye contact detection sensor that detects the approach (eye contact) and separation (eye separation) of an eye (object) to the eye piece unit 116. The eye contact detection unit 118 detects that an object has been placed near the eye piece unit 116 when an object approaching within a predetermined distance from the non-eye contact state (non-approaching state) is detected. On the other hand, the eye contact detection unit 118 detects that an object that was detected as approaching the eye piece unit 116 has moved away from the eye piece unit 116 by a predetermined distance or more from the eye piece unit 116 (approaching state). The threshold value for detecting the approach of the eye and the threshold value for detecting the separation of the eye may be different, for example, by providing a hysteresis. In addition, after the approach of the eye is detected, the eye contact state is assumed to remain until the separation of the eye is detected. After the separation of the eye is detected, the non-eye contact state is assumed to remain until the eye contact is detected.

[0034] The system control unit 50 switches between display (display state) / non-display (non-display state) of the display unit 108 and the EVF 217 depending on the state detected by the eyepiece detection unit 118. Specifically, when at least the shooting standby state is present and the display destination switching setting is automatic switching, the display destination is set to the display unit 108 when the eye is not placed in contact with the subject, the display is turned on, and the EVF 217 is hidden. Also, when the eye is placed in contact with the subject, the display destination is set to the EVF 217, the display is turned on, and the display unit 108 is hidden. Note that the eyepiece detection unit 118 is not limited to an infrared proximity sensor, and other sensors may be used for the eyepiece detection unit 118 as long as they can detect a state that can be regarded as being in contact with the eyepiece.

[0035] The camera 100 also has an outside-finder display unit 107, an outside-finder display drive circuit 223, a power supply control unit 224, a power supply unit 225, a recording medium I / F 226, an operation unit 228, and the like.

[0036] The outside viewfinder display unit 107 is driven by an outside viewfinder display drive circuit 223, and displays various settings of the camera 100 such as the shutter speed and aperture. The power supply control unit 224 is composed of a battery detection circuit, a DC-DC converter, a switch circuit (a circuit that switches between blocks to which electricity is applied), etc. The power supply control unit 224 detects whether a battery is installed, the type of battery, and the remaining battery level, etc. Furthermore, the power supply control unit 224 controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage to each unit including the recording medium 227 for the required period of time.

[0037] Power supply unit 225 is a primary battery (such as an alkaline battery or a lithium battery), a secondary battery (such as a NiCd battery, a NiMH battery, or a Li battery), an AC adapter, or the like. Recording medium I / F 226 is an interface with recording medium 227 (such as a memory card or a hard disk). Recording medium 227 is a memory card or the like for recording captured images. Recording medium 227 is composed of a semiconductor memory, a magnetic disk, or the like. Recording medium 227 may be detachable from camera 100, or may be built into camera 100.

[0038] The operation unit 228 is an input unit that accepts operations from a user (user operations). The operation unit 228 is used to input various instructions to the system control unit 50. The operation unit 228 includes the shutter button 101, the power switch 102, the mode changeover switch 103, the touch panel 109, and other operation units 229. The other operation units 229 include the main electronic dial 1 04, a sub electronic dial 105, a video button 106, a directional key 110, a SET button 111, an AE lock button 112, a magnification button 113, a playback button 114, a menu button 115, a touch bar 119, etc.

[0039] The shutter button 101 has a first shutter switch 230 and a second shutter switch 231. When the first shutter switch 230 is turned on during the operation of the shutter button 101, that is, when the shutter button 101 is pressed halfway (instruction to prepare for shooting), it outputs a first shutter switch signal SW1. The system control unit 50 starts shooting preparation processing (AF processing, AE processing, AWB processing, EF processing, etc.) in response to the output of the first shutter switch signal SW1. When the second shutter switch 231 is turned on after the operation of the shutter button 101 is completed, that is, when the shutter button 101 is pressed all the way (instruction to shoot), it outputs a second shutter switch signal SW2. The system control unit 50 starts a series of shooting processing (processing from reading out a signal from the imaging unit 211 to generating an image file including a shot image and writing it to the recording medium 227) in response to the output of the second shutter switch signal SW2.

[0040] The mode changeover switch 103 changes the operation mode of the system control unit 50 to one of a still image shooting mode, a video shooting mode, a playback mode, etc. Modes included in the still image shooting mode include an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). Modes included in the still image shooting mode include various scene modes and custom modes that are shooting settings according to shooting scenes. A user can directly switch to one of the above-mentioned shooting modes by using the mode changeover switch 103. Alternatively, a user can selectively switch to one of the displayed modes by using the operation unit 228 after once switching to a list screen of shooting modes by using the mode changeover switch 103. Similarly, the video shooting mode may also include a plurality of modes.

[0041] The touch panel 109 is a touch sensor that detects various touch operations on the display surface of the display unit 108 (the operation surface of the touch panel 109). The touch panel 109 and the display unit 108 can be configured as one unit. For example, the touch panel 109 is attached to the upper layer of the display surface of the display unit 108 so that the light transmittance does not interfere with the display of the display unit 108. Then, by associating input coordinates on the touch panel 109 with display coordinates on the display surface of the display unit 108, a GUI (Graphical User Interface) can be configured as if the user could directly operate the screen displayed on the display unit 108. The touch panel 109 can be any of various types such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. Depending on the type, there is a type that detects a touch by contact with the touch panel 109, and a type that detects a touch by approaching a finger or a pen to the touch panel 109, but any type may be used.

[0042] The system control unit 50 can detect the following operations or states on the touch panel 109. A finger or pen that has not been touching the touch panel 109 touches the touch panel 109 again, that is, the start of touching (hereinafter referred to as Touch-Down). A state in which the touch panel 109 is touched with a finger or a pen (hereinafter referred to as Touch-On). The touch panel 109 is moved while being touched by a finger or a pen (hereinafter referred to as Touch-Move). The finger or pen that was touching the touch panel 109 is released from the touch panel 109, that is, the end of touch (hereinafter referred to as Touch-Up). say). A state in which nothing is being touched on the touch panel 109 (hereinafter referred to as Touch-Off).

[0043] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. If touch-move is detected, touch-on will also be detected at the same time. Even if touch-on is detected, touch-move will not be detected if the touch position does not move. After it is detected that all fingers or pens that were touching have touched up, touch-off will occur.

[0044] These operations and states, as well as the position coordinates of the touch panel 109 touched by a finger or pen, are notified to the system control unit 50 via the internal bus. The system control unit 50 determines what kind of operation (touch operation) has been performed on the touch panel 109 based on the notified information. Regarding touch-move, the moving direction of the finger or pen moving on the touch panel 109 can also be determined for each vertical component and horizontal component on the touch panel 109 based on changes in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed.

[0045] An operation in which a finger is touched on the touch panel 109, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced on the touch panel 109 as if flicking. When a touch-move is detected over a predetermined distance or more at a predetermined speed or more, and a touch-up is detected immediately after that, it is determined that a flick has been performed (it can be determined that a flick has occurred following a sliding operation). Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touch) and the touch positions are brought closer to each other is called a pinch-in, and a touch operation in which the touch positions are moved away from each other is called a pinch-out. Pinch-out and pinch-in are collectively called a pinch operation (or simply pinch).

[0046] 4A is a block diagram showing an example of the configuration of a server 300 that is an external device to a PC 400. The server 300 has a control unit 301, a ROM 302, a RAM 303, a recording medium 304, a communication unit 305, and a determination unit 306. These components can communicate with each other via a system bus 307. Note that each component of the server 300 may be included in the camera 100.

[0047] The control unit 301 is, for example, a Central Processing Unit (CPU). The control unit 301 controls the entire server 300.

[0048] The ROM 302 is a read-only memory that non-temporarily stores programs and parameters.

[0049] The RAM 303 is a random access memory that temporarily stores programs and data supplied from an external device or the like.

[0050] The recording medium 304 is a medium (a hard disk or a flash memory) that is fixedly installed in the server 300. Alternatively, the recording medium 304 is a medium that is removable from the server 300 (such as an optical disk, a magnetic card, an optical card, an IC card, or a memory card).

[0051] The communication unit 305 communicates with external devices (such as the camera 100 and the PC 400). The communication unit 305 receives moving images and still images from the camera 100. The received moving images and still images are stored in the recording medium 304. In response to a request from the PC 400, the communication unit 305 The communication unit 305 transmits to the PC 400 images (moving images and still images) stored in the recording medium 304 and information on the determination result of the state of the still images (whether the image is in focus, whether the eye is blinking, etc.). At this time, the communication unit 305 may transmit to the PC 400 a determination signal indicating the information on the determination result and information on the file name of the still image, separately from the still image. The communication unit 305 also receives a shooting information signal indicating shooting information of the still image generated by the camera 100, and transmits the shooting information signal to the PC 400.

[0052] The determination unit 306 determines the state of the still image (whether or not the image is in focus, whether or not the eye is blinking, etc.) stored in the recording medium 304. The determination unit 306 also stores information on the determination result of the state of the still image in the recording medium 304 together with the still image.

[0053] Furthermore, the system bus 307 connects the components of the server 300 so that they can communicate with each other.

[0054] 4B is a block diagram showing an example of the configuration of an electronic device, a PC 400. The PC 400 has a control unit 401, a ROM 402, a RAM 403, a recording medium 404, an operation unit 405, a display unit 406, and a communication unit 407. These components can communicate with each other via a system bus 408.

[0055] The control unit 401 is, for example, a central processing unit (CPU). The control unit 401 controls the entire PC 400. The control unit 401 also communicates with the server 300 via the communication unit 407 and checks whether a new video or still image has been transmitted from the camera 100 to the server 300. When a new video or still image has been transmitted to the server 300, the control unit 401 requests the server 300 to transmit the video or still image via the communication unit 407. Thereafter, the control unit 401 stores the new video or still image in the recording medium 404. The control unit 401 also automatically selects a video (a video shot in the same time period as the still image) corresponding to the still image selected in response to an operation on the operation unit 405.

[0056] The ROM 402 is a read-only memory that non-temporarily stores programs and parameters.

[0057] The RAM 403 is a random access memory that temporarily stores programs and data supplied from an external device or the like.

[0058] The recording medium 404 is a medium (such as a hard disk or a flash memory) that is fixedly installed in the PC 400. Alternatively, the recording medium 404 is a medium that is removable from the PC 400 (such as an optical disk, a magnetic card, an optical card, an IC card, or a memory card).

[0059] The operation unit 405 accepts an operation of a user (editor) on the PC 400. For example, one of one or more still images that satisfy a predetermined condition is selected in response to a user's operation on the operation unit 405. Here, the operation unit 405 may be an operation member (such as a button or a touch panel) provided on the PC 400, or may be an operation member (such as a keyboard or a mouse) that is detachable from the PC 400.

[0060] The display unit 406 displays data held by the PC 400, data supplied from an external device, and the like. The display unit 406 also displays moving images and still images recorded on the recording medium 404 in a list on the same time axis. The display unit 406 can also display only still images that satisfy a predetermined condition. The display unit 406 can display moving images that were taken in the same time period as a still image selected by the operation unit 405 by arranging them in predetermined areas of a specific screen. Furthermore, when reception of the still image is delayed, the display unit 406 displays the reception status of the still image and the determination result in response to the shooting information signal and the determination signal. The display unit 406 may be included in the PC 400, or may be a display device separate from the PC 400.

[0061] A communication unit 407 communicates with external devices such as the camera 100 and the server 300. A system bus 408 connects the components of the PC 400 to enable communication between them.

[0062] The basic processing from shooting to editing in the shooting and editing system will be described below. The shooting and editing system includes a camera 100, a server 300, and a PC 400.

[0063] 5 shows an example of a screen (a screen displayed on display unit 406) of an editing application running on PC 400. In the editing application, PC 400 displays moving images and still images received from camera 100, and selects still images and moving images (mutually related still images and moving images) to be used in a news article. In addition, according to the editing application, PC 400 can edit the text (wording) of a news article, and publish a news article (public article) that includes the text of the news article together with the selected still images and moving images.

[0064] The screen of the editing application includes a status area 600, a Good area 601, a timeline area 602, and an article area 603. The status area 600 displays a shooting status (a status indicating whether the camera 100 is shooting a video or not, and whether a still image has been shot or not).

[0065] The Good area 601 displays one or more still images that satisfy a predetermined condition in the center of the left side of the screen of the editing application, arranged in chronological order of shooting. The user can select one of the one or more still images displayed in the Good area 601.

[0066] The timeline area 602 displays videos and still images for each time period of shooting on a timeline (in chronological order). In the timeline area 602, the multiple videos displayed are multiple videos shot in consecutive time periods. A time period is a range of time of a certain length (for example, one minute, etc.). Here, if a still image satisfies a predetermined condition (conditions such as composition, focus state of a main subject, or presence or absence of blinking), a Good icon (a display item indicating that the still image is appropriately shot) is displayed superimposed on a part of the still image. Note that if a still image does not satisfy the predetermined condition, a Bad icon (a display item indicating that the still image is not appropriately shot) may be displayed superimposed on a part of the still image. In addition, an icon according to the state of the still image may be superimposed (displayed) on the still image. For example, an icon indicating that the eye is blinking may be superimposed on a still image in which a specific subject is blinking, and an icon indicating that the still image was shot in a specific composition may be superimposed on a still image in which a specific subject is blinking.

[0067] The article area 603 is an area for editing a news article. In the article area 603, the user can edit the title of the news article and the text of the article. The article area 603 includes a still image area 603A for inserting (placing) a still image, and a video area 603B for inserting (placing) a video. Here, when a still image displayed in the Good area 601 is selected by a user operation such as a mouse click, the selected still image is inserted into the still image area 603A of the article area 603. Furthermore, a video shot in the same time period as the still image is inserted into the video area 603B of the article area 603. This makes it possible to realize a preview of the news article close to its completed state.

[0068] If the user judges that the preview result is publicly available, the user presses a publish button 60 4. After that, a final confirmation message is displayed asking whether or not it is OK to publish the news article. If it is determined that the user has instructed to publish the news article based on the user's response to the final confirmation message, the news article is distributed (published on the Internet).

[0069] The operation of the camera 100 according to the first embodiment will be described with reference to the flowchart of Fig. 7. The flowchart of Fig. 7 starts when the camera 100 transitions to a shooting preparation state after the camera 100 is powered on (started up).

[0070] In step S701, the system control unit 50 starts image capture and starts live view display (display of a captured live view image).

[0071] In step S702, the system control unit 50 determines whether or not a moving image capture start instruction has been given (such as an operation on the moving image button 106 by the photographer). If it is determined that a moving image capture start instruction has been given, the process proceeds to step S703. If it is determined that a moving image capture start instruction has not been given, the process of step S702 is repeated.

[0072] In step S703, the system control unit 50 starts capturing a moving image with the imaging unit 211 and starts recording the captured moving image on the recording medium 227.

[0073] In step S704, the system control unit 50 determines whether or not a predetermined time has passed since the process of step S705 was last performed. If it is determined that the predetermined time has passed since the process of step S705 was last performed, the process proceeds to step S705. If it is determined that the predetermined time has not passed since the process of step S705 was last performed, the process proceeds to step S706. The predetermined time is, for example, a relatively short time (any time between 15 seconds and 3 minutes, for example) that is set in advance by the photographer in consideration of the performance of the camera 100 and the communication environment when transmitting the video.

[0074] In step S705, system control unit 50 transmits a predetermined amount of video since the previous processing of step S705 to server 300. The processing of transmitting a predetermined amount of video to server 300 continues until an instruction to end video shooting is given.

[0075] In step S706, the system control unit 50 determines whether or not a still image capture instruction has been issued. If it is determined that a still image capture instruction has been issued, the process proceeds to step S707. If it is determined that a still image capture instruction has not been issued, the process proceeds to step S709.

[0076] In step S707, the system control unit 50 captures one still image and records the one still image on the recording medium 227.

[0077] In step S708, the system control unit 50 transmits the still image captured in step S707 to the server 300. When an instruction to capture a still image is given in step S706, the system control unit 50 may continuously capture a plurality of still images in steps S707 and S708 until an instruction to end the still image capture is given, and transmit the captured plurality of still images to the server 300.

[0078] In step S709, the system control unit 50 determines whether or not an instruction to end video shooting has been issued. If it is determined that an instruction to end video shooting has been issued, the process proceeds to step S710. If it is determined that an instruction to end video shooting has not been issued, the process proceeds to step S704.

[0079] In step S710, the system control unit 50 ends shooting of the moving image. Then, the system control unit 50 transmits to the server 300 the moving image for the remaining time that has not yet been transmitted to the server 300 (the moving image that has not been transmitted in step S705).

[0080] The operation of the server 300 according to the first embodiment will be described with reference to the flowchart of Fig. 8. The process of the flowchart of Fig. 8 may be repeatedly executed continuously, or may be executed every time some information is transmitted from the camera 100 to the server 300.

[0081] In step S801, the control unit 301 determines whether or not a video has been received from the camera 100. If it is determined that a video has been received from the camera 100, the process proceeds to step S802. If it is determined that a video has not been received from the camera 100, the process proceeds to step S805.

[0082] In step S802, the control unit 301 stores the video received in step S801 in a database of the recording medium 304.

[0083] In step S803, the control unit 301 determines whether or not the PC 400 has requested the transmission of moving images (whether or not an instruction has been issued to the server 300 to transmit moving images to the PC 400). If it is determined that the transmission of moving images has been requested, the process proceeds to step S804. If it is determined that the transmission of moving images has not been requested, the process of step S803 is repeated.

[0084] In step S804, control unit 301 transmits to PC 400 any moving images that have not yet been transmitted to PC 400. Here, control unit 301 associates information indicating that a moving image has been transmitted to PC 400 with the moving image and stores the information in the database. This allows control unit 301 to prevent the same moving image from being transmitted to PC 400 multiple times.

[0085] In step S805, the control unit 301 determines whether or not a still image has been received from the camera 100. If it is determined that a still image has been received from the camera 100, the process proceeds to step S806. If it is determined that a still image has not been received from the camera 100, the process proceeds to step S801.

[0086] In step S806, the control unit 301 controls the determination unit 306 to determine the state of the still image (such as the composition of the still image, the focus state of the main subject, or the presence or absence of blinking). The control unit 301 can use a predetermined algorithm or AI (Artificial Intelligence) to determine the state of the still image.

[0087] In step S807, the control unit 301 associates the still image with the judgment result (hereinafter referred to as the “state judgment result”) of the state of the still image (such as composition, focus state of the main subject, or whether or not the eyes are blinking) and stores the result in a database in the recording medium 304.

[0088] In step S808, the control unit 301 determines whether or not the PC 400 has requested transmission of a still image (whether or not an instruction has been issued to the server 300 to transmit a still image to the PC 400). If it is determined that the PC 400 has requested transmission of a still image, the process proceeds to step S809. If it is determined that the PC 400 has not requested transmission of a still image, the process of step S808 is repeated.

[0089] In step S809, the control unit 301 transmits to the PC 400 the still image that has not yet been transmitted to the PC 400 together with the state determination result (information on the state determination result) of the still image. Here, the control unit 301 associates information indicating that a still image has been transmitted to the PC 400 with the still image and stores the information in the database, thereby enabling the control unit 301 to prevent the same still image from being transmitted to the PC 400 multiple times.

[0090] The operation of the PC 400 according to the first embodiment will be described with reference to the flowchart of Fig. 9. The process of the flowchart of Fig. 9 starts when the PC 400 is booted.

[0091] In step S901, the control unit 401 starts monitoring the database of the server 300 (the database of the recording medium 304).

[0092] In step S902, control unit 401 determines whether or not there is a new video (a video that has not been transmitted to PC 400) in the database of server 300. If it is determined that there is a new video (hereinafter, referred to as a "new video") in the database, the process proceeds to step S903. If it is determined that there is no new video in the database, the process proceeds to step S910.

[0093] In step S903, the control unit 401 requests the server 300 to transmit a new video.

[0094] In step S 904 , the control unit 401 receives the new video from the server 300 .

[0095] In step S905, the control unit 401 acquires a thumbnail of the new video based on the received new video. Then, the control unit 401 displays (adds) the thumbnail of the new video in an area corresponding to the time period during which the new video was shot in the timeline area 602 shown in FIG.

[0096] In step S910, the control unit 401 determines whether or not a new still image (a still image that has not been transmitted to the PC 400) exists in the database of the server 300. If it is determined that a new still image (hereinafter referred to as a "new still image") exists in the database, the process proceeds to step S911. If it is determined that a new still image does not exist in the database, the process proceeds to step S901.

[0097] In step S911, the control unit 401 requests the server 300 to transmit a new still image.

[0098] In step S912, the control unit 401 receives from the server 300 the new still image and the state determination result of the new still image.

[0099] In step S913, the control unit 401 determines whether the new still image satisfies a predetermined condition based on the received state determination result. Here, the predetermined condition is a condition for determining whether an appropriate still image has been captured. Specifically, the predetermined condition is a condition that the image is captured with a specific composition, a condition that the specific subject does not close his / her eyes, or a condition that the specific subject is in focus. Alternatively, the predetermined condition may be a condition that the image is not captured in backlight, a condition that the gaze of a person captured in the still image is directed toward the camera 100, or a condition that multiple people are captured in the still image. If it is determined that the new still image satisfies the predetermined condition, the process proceeds to step S914. If it is determined that the new still image does not satisfy the predetermined condition, the process proceeds to step S915.

[0100] In step S914, the control unit 401 displays (adds) a new still image in the Good area 601 shown in FIG.

[0101] In step S915, the control unit 401 displays (adds) the new still image in an area in the timeline area 602 shown in FIG. 5 that corresponds to the time period during which the new still image was captured.

[0102] In step S916, the control unit 401 displays (adds) the new still image together with a Good icon in the area corresponding to the time period during which the new still image was captured in the timeline area 602 shown in FIG.

[0103] Through the processing of steps S915 and S916, the new video and the new still image captured during the same time period are linked together and displayed in the timeline area 602.

[0104] In step S920, the control unit 401 determines whether or not one still image has been selected in the Good area 601 by a user operation. Note that the control unit 401 may determine whether or not one still image has been selected from either the Good area 601 or the timeline area 602. If it is determined that one still image has been selected, the process proceeds to step S921. If it is determined that one still image has not been selected, the process proceeds to step S901.

[0105] In step S921, the control unit 401 selects a moving image (hereinafter referred to as a "selected moving image") that was shot in the same time period as the still image selected in step S920 (hereinafter referred to as a "selected still image").

[0106] In step S922, the control unit 401 inserts (places) the selected still image in the still image area 603A shown in FIG.

[0107] In step S923, control unit 401 inserts (places) the selected video in video area 603B. At this time, the user (editor) can preview (check) the entire news article (news article content), as shown in article area 603 in FIG.

[0108] In step S924, control unit 401 determines whether or not an instruction to end content generation of a news article has been issued by pressing publish button 604 shown in Fig. 5. If it is determined that an instruction to end content generation has been issued, the process proceeds to step S925. If it is determined that an instruction to end content generation has not been issued, the process proceeds to step S920. Note that until publish button 604 is pressed, the form (position, size, etc.) of a selected still image in a news article or the form of a selected video may be adjustable by a user operation. Also, the text of the article may be changeable by a user operation.

[0109] In step S925, control unit 401 generates a news article (news article content) including the selected still image, the selected video, and the text of the article.

[0110] In step S926, control unit 401 determines whether or not an instruction to upload the news article (news article content) has been issued after the user has confirmed the final confirmation message before publication. If it is determined that an instruction to upload has been issued, the process proceeds to step S927. If it is determined that an instruction to upload has not been issued, the process proceeds to step S924.

[0111] In step S927, control unit 401 transmits the news article to the distribution server, which then makes the news article available on the Internet.

[0112] According to the first embodiment, the user can view the timeline area to find out which programs are available in the same time period. The user can grasp the captured video and still images. In addition, a Good icon is attached to a still image that satisfies a predetermined condition, so that the user can select a more suitable still image. Furthermore, when one still image is selected, a video captured in the same time period as the still image is selected. Therefore, the user can more easily select a still image and a video captured in the same time period. Then, when one still image is selected, the still image and the video captured in the same time period are inserted into the news article content, so that the user can easily create a news article.

[0113] <Embodiment 2> In the second embodiment, the PC 400 displays the reception status of the still image and the reception status of the state determination result in response to a signal received from the server 300. In the following, the description of the configuration and processing common to the first embodiment and the second embodiment will be omitted as appropriate.

[0114] 6 shows an example of a display screen of an editing application running on the PC 400 according to the second embodiment. As in the first embodiment, the editing application displays videos and still images received from the server 300 (camera 100) and allows the user to select still images and videos to be used in a news article. By using the editing application, a user can edit the text of a news article and publish the news article including the selected still images and videos.

[0115] In the second embodiment, in the timeline area 602 (area that displays on the timeline the videos and still images received from the server 300), a still image reception status icon 605 is displayed when a still image has not been received from the server 300. The still image reception status icon 605 is a display item that indicates that a still image will be transmitted in the future. At this time, similar to the first embodiment, the PC 400 also displays a Good icon if a still image to be transmitted in the future satisfies a predetermined condition. Thereafter, when the PC 400 receives a still image, it replaces the still image reception status icon 605 with the received still image.

[0116] Furthermore, when the status determination result has not been received from server 300, PC 400 displays a status determination result reception status icon 606 together with a still image (or a still image reception status icon 605). Reception status icon 606 is a display item indicating that the status determination result has not been received (it is unclear whether the still image satisfies a predetermined condition). When PC 400 receives the status determination result, it makes the status determination result reception status icon 606 invisible.

[0117] The operation of the camera 100 according to the second embodiment will be described with reference to the flowchart in Fig. 10. In the second embodiment, the process of step S1008 is performed in addition to the flowchart in Fig. 7. As shown in Fig. 10, step S1008 is performed between step S707 and step S708.

[0118] In step S1008, the system control unit 50 transmits a shooting information signal indicating information such as the file name and shooting date and time of the still image (the still image captured in step S707) to the server 300. That is, before the still image is transmitted, the shooting information signal is transmitted to the server 300.

[0119] The operation of the server 300 according to the second embodiment will be described with reference to the flowchart of Fig. 11. The process of the flowchart of Fig. 11 starts when the server 300 receives a shooting information signal or an image (moving image or still image) from the camera 100.

[0120] In step S1101, the control unit 301 receives a shooting information signal from the camera 100. If it is determined that the shooting information signal has been received, the process proceeds to step S1102. If it is determined that the shooting information signal has not been received, the process proceeds to step S1103.

[0121] In step S 1102 , the control unit 301 transmits the received shooting information signal to the PC 400 .

[0122] Steps S1103 to S1108 are similar to steps S801 to S806.

[0123] In step S 1109 , the control unit 301 generates a determination signal indicating the file name of the still image and the result of the state determination, and transmits the determination signal to the PC 400 .

[0124] In step S 1110 , the control unit 301 stores the received still image in a database in the recording medium 304 .

[0125] In step S1111, the control unit 301 determines whether or not a still image transmission has been requested by the PC 400. If it is determined that a still image transmission has been requested, the process proceeds to step S1112. If it is determined that a still image transmission has not been requested, the process of step S1111 is repeated.

[0126] In step S1112, the control unit 301 transmits to the PC 400 any still images that have not yet been transmitted to the PC 400.

[0127] The operation of the PC 400 according to the second embodiment will be described with reference to the flowchart in Fig. 12. In the second embodiment, in addition to the flowchart in Fig. 9, the process of step S1200 (steps S1328 to S1332 in Fig. 13) is executed. In step S912, since the determination signal has already been received, the control unit 401 receives only the new still image. In step S913, the control unit 401 determines whether or not the new still image satisfies a predetermined condition based on the determination signal.

[0128] In step S1200, the control unit 401 executes processing in response to reception of the image capturing signal and the determination signal. Details of the processing in step S1200 will be described with reference to the flowchart in FIG.

[0129] In step S1328, the control unit 401 determines whether or not a shooting information signal has been received from the server 300. If it is determined that a shooting information signal has been received, the process proceeds to step S1329. If it is determined that a shooting information signal has not been received, the process proceeds to step S1330.

[0130] In step S1329, the control unit 401 displays the still image reception status icon 605 in the timeline area 602 shown in Fig. 6. At this time, the control unit 401 refers to the shooting time zones of the already received videos to determine which video shooting time zone includes the shooting date and time recorded in the shooting information signal. Then, the control unit 401 displays the still image reception status icon 605 at a position where the still image in the determined shooting time zone should be placed. Here, the control unit 401 calculates the shooting time zone of the video based on the shooting start time and shooting end time (or the shooting start time and playback time of the video). Note that when reception of the still image is completed, the control unit 401 replaces the still image reception status icon 605 with the still image.

[0131] In step S1330, the control unit 401 determines whether or not a determination signal has been received from the server 300. If it is determined that a determination signal has been received, the process proceeds to step S1331. If it is determined that the determination signal has not been received, the process proceeds to step S1332.

[0132] In step S1331, control unit 401 displays an icon according to the state determination result of the still image based on the file name recorded in the determination signal. At this time, control unit 401 superimposes the icon according to the state determination result of the still image on the thumbnail of the still image or on the still image reception status icon 605. Here, the icon according to the state determination result is a Good icon when the still image corresponding to the state determination result satisfies a predetermined condition.

[0133] In step S1332, control unit 401 displays reception status icon 606 of the status determination result superimposed on the thumbnail of the still image or still image reception status icon 605. When control unit 401 receives a determination signal, it hides reception status icon 606 of the status determination result or replaces it with a Good icon or the like according to the status determination result.

[0134] If the still image reception status icon 605 is displayed in step S1329, then in steps S915 and S916, the still image reception status icon 605 is replaced with a thumbnail of the still image. If the status determination result reception status icon 606 is displayed in step S1332, then in step S916, the status determination result reception status icon 606 is replaced with an icon according to the status determination result.

[0135] According to the second embodiment, the PC 400 displays the reception status of the still image and the reception status of the state determination result in response to the received shooting information signal and determination signal. This allows the user to know that a still image that meets a predetermined condition will be transmitted to the PC 400 in the future, even if there is a delay in the transmission of the still image or the processing in the server 300, for example.

[0136] <Embodiment 3> In the third embodiment, an example will be described in which still image and video editing processing is added to the PC 400 as in the following (1) to (9) in comparison with the first embodiment. Note that in the third embodiment, descriptions of the same configurations and processing as in the first embodiment will be omitted as appropriate.

[0137] (1) The PC 400 can acquire the incidental information recorded in the image (still image and video). Specifically, the PC 400 can acquire the incidental information from the image (still image and video) recorded in the recording medium 404. The incidental information includes shooting information (information such as the shutter speed or aperture at the time of shooting), attitude information of the camera 100 at the time of shooting, or autofocus information (information such as focus coordinates), shooting date and time information, etc. The incidental information of the video also includes information for each frame. Note that, although an example in which the incidental information is recorded in the image (still image and video) has been shown, the incidental information may be recorded in a separate file associated with the image.

[0138] (2) The PC 400 can specify the cut-out range of a still image. Specifically, the PC 400 can specify the cut-out range of a still image in response to a user operation on the operation unit 405. In the third embodiment, the user specifies a rectangular area including a subject area as the cut-out range of a still image. However, when the user specifies a subject (position of the subject), the PC 400 may specify a rectangle including the specified subject area. In addition, the aspect ratio of the rectangle of the cut-out range is not particularly limited.

[0139] (3) The PC 400 can detect an area including a subject in a still image. Specifically, the PC 400 detects a subject from a still image and detects an area including the subject (subject area). There are no particular limitations on the method of detecting the subject, and a publicly known method may be used.

[0140] (4) The PC 400 can determine the cut-out range of a still image (the area in the still image to be cut out). Specifically, the PC 400 determines the cut-out range based on the supplementary information, the information of the specified cut-out range, the information of the subject area, or the like.

[0141] (5) The PC 400 can cut out a part of a still image. Specifically, the PC 400 cuts out a part of a still image to generate a new still image, as shown in FIG. 14A.

[0142] (6) The PC 400 can determine a frame of a moving image that corresponds to a still image (hereinafter referred to as a "corresponding frame"). Specifically, the PC 400 determines a frame in a moving image that was generated in a time period corresponding to the still image and that shows the same scene as the still image as the corresponding frame. In the third embodiment, the PC 400 acquires the shooting dates and times of the still image and the moving image from the attendant information of the still image and the moving image, and determines the frame with the shooting date and time closest to that of the still image as the corresponding frame among all frames of the moving image. The method of determining the corresponding frame may be any method, such as "a method of comparing the degree of similarity of two images" or "a method of determining the corresponding frame based on the correspondence of identifiers (GUIDs) recorded in the attendant information of the moving image and the still image at the time of shooting".

[0143] (7) The PC 400 can acquire information used to determine the cut-out range of a still image (referred to as "range determination information"). When acquiring the range determination information, the PC 400 also acquires the reason why the cut-out range was determined.

[0144] (8) The PC 400 can extract a part of a playback section from a video. Specifically, the PC 400 extracts a range of a part of the playback section from the video to generate a new video. The playback section to be extracted is determined based on range determination information so as to include a corresponding frame (a frame corresponding to a still image). In the third embodiment, the PC 400 determines, for example, as shown in FIG. 14B, a playback section in which a subject that was focused on when the area of ​​the still image was extracted, as the playback section to be extracted. The PC 400 may also change the length of the playback section to be extracted depending on the posting destination of the video (such as an SNS or a news article). If the playback section to be extracted does not reach a specific time in one video, the PC 400 may extract a part of the playback section from multiple videos with consecutive shooting times including the selected video, and combine the extracted playback sections together.

[0145] (9) The PC 400 can cut out a partial range of the image of each frame of the video. Specifically, after determining the "video cut-out range," the PC 400 cuts out the cut-out range from the image of each frame and treats the cut-out range of each frame as the image of each frame of the new video. In this way, the PC 400 generates a new video. In the third embodiment, the PC 400 determines the cut-out range in each frame in the same manner as for still images, as shown in FIG. 14C. Then, the PC 400 calculates a range that includes all of the cut-out ranges determined for each frame (the range surrounded by the thickest frame in FIG. 14C), and sets the range as the "video cut-out range" (the range to be cut out from each frame). In other words, the range in which a specific subject appears in the images of all frames (each frame) is determined.

[0146] The operation of the PC 400 in the third embodiment will be described with reference to the flowchart in Fig. 15. The process of the flowchart in Fig. 15 is executed between steps S921 and S922 in the flowchart in Fig. 9 according to the first embodiment. Other processes in the flowchart in Fig. 9 (processes of steps S901 to S927) are executed in the same manner as in the first embodiment.

[0147] In step S912, the control unit 401 not only receives the still image and the state determination result, but also The information on the target subject area at the time of determining the state of the still image is also received as "information used to determine the state of the still image". The target subject area is the area of ​​the subject that is the subject to be determined, for example, whether the eye is blinking or not, whether the subject is in focus or not, etc. For example, the target subject area is the area of ​​a specific person. In the third embodiment, "information on the target subject area" is used as an example of "information used to determine the state of the still image". However, "information used to determine the state of the still image" may be the coordinates used to determine the state of the still image, or face information used to determine the state of the still image, etc.

[0148] In step S1501, the control unit 401 acquires the still image selected in step S920 (selected still image).

[0149] In step S1502, the control unit 401 determines whether the selected still image satisfies a predetermined condition. If it is determined that the selected still image satisfies the predetermined condition, the process proceeds to step S1503. If it is determined that the selected still image does not satisfy the predetermined condition, the process proceeds to step S1505.

[0150] In step S1503, the control unit 401 acquires information on the target subject region at the time of determining the state of the selected still image.

[0151] In step S1504, the control unit 401 specifies a range in the selected still image that includes the target object based on the target object region information acquired in step S1503. The control unit 401 determines the specified range as the "cutout range" of the selected still image.

[0152] In step S1505, the control unit 401 determines whether or not the user has specified the cut-out range of the selected still image. If it is determined that the user has specified the cut-out range of the selected still image, the process proceeds to step S1506. If it is determined that the user has not specified the cut-out range of the selected still image, the process proceeds to step S1507.

[0153] In step S1506, the control unit 401 determines the range specified by the user (the range in the selected still image) as the "cut-out range" of the selected still image.

[0154] In step S1507, the control unit 401 acquires the supplementary information of the selected still image.

[0155] In step S1508, the control unit 401 detects one or more subjects in the selected still image, and then detects the subject closest to the focus coordinates included in the supplementary information as the subject of interest.

[0156] In step S1509, the control unit 401 specifies a range including the target subject based on the target subject detected in step S1508. The control unit 401 determines the specified range as the "cutout range" of the selected still image.

[0157] In step S1510, the control unit 401 cuts out the determined cut-out range from the selected still image to generate a new still image. In this way, the control unit 401 can obtain a new still image (hereinafter, referred to as a "cut-out still image") that is suitable for a news article by deleting unnecessary areas.

[0158] In step S1511, the control unit 401 acquires the moving image selected in step S921 (selected moving image).

[0159] In step S1512, the control unit 401 cuts out a part of the playback section of the selected moving image based on the information used to determine the cut-out range of the selected still image, thereby generating a new moving image.

[0160] In step S1513, control unit 401 determines a "video cut-out range" for the video generated in step S1512. Control unit 401 generates a new video (hereinafter referred to as a "cut-out video") by cutting out the "video cut-out range" from the image of each frame of the video generated in step S1512. Here, the cut-out video is generated so that the subject of interest is captured in the image of each frame of the cut-out video. This makes it possible to obtain a new video suitable for a news article, from which unnecessary playback sections and unnecessary areas have been deleted. Note that the "video cut-out range" can also be determined based on information used to determine the cut-out range of the selected still image (information on the range specified by the user, information on the subject of interest, or supplementary information of the selected still image).

[0161] In step S1514, control unit 401 replaces the selected still image and selected video selected in steps S920 and S921 with the extracted still image and extracted video newly generated in steps S1510 and S1513. That is, control unit 401 performs control so that the extracted still image and extracted video are used in the processes of steps S922 and S923.

[0162] According to the third embodiment, since unnecessary information can be deleted from the selected still image and the selected video, still images and videos more suitable for the news article can be easily generated. In other words, more suitable news articles can be generated while saving the user effort.

[0163] Although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0164] Also, in the above, "If A is equal to or greater than B, proceed to step S1, and if A is smaller (lower) than B, proceed to step S2" may be read as "If A is greater (higher) than B, proceed to step S1, and if A is equal to or less than B, proceed to step S2." Conversely, "If A is greater (higher) than B, proceed to step S1, and if A is equal to or less than B, proceed to step S2" may be read as "If A is greater (higher) than B, proceed to step S1, and if A is smaller (lower) than B, proceed to step S2." Therefore, unless a contradiction occurs, "equal to or greater than A" may be read as "equal to or greater than A (high; long; many)," and "equal to or less than A" may be read as "equal to or less than A (low; short; few)." And, "equal to or greater than A" may be read as "equal to or greater than A," and "equal to or less than A" may be read as "equal to or less than A."

[0165] Each functional unit in each of the above embodiments (variations) may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of a plurality of functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Furthermore, each functional unit may or may not be realized by hardware such as an ASIC, FPGA, or DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. Then, the functions of at least some of the functional units of the device may be realized by the processor reading and executing the control program from the memory.

[0166] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for implementing one or more of the functions.

[0167] The disclosure of the above embodiments includes the following configurations, methods, and programs. (Configuration 1) An electronic device that controls the display of a specific screen displayed on a display means, An acquisition means for acquiring a plurality of videos captured in a plurality of consecutive time periods and a plurality of still images captured during the capture of the plurality of videos; A control means for 1) displaying the plurality of videos in chronological order in a first area on the specific screen, and 2) displaying, for each time period in which one or more still images were taken among the plurality of time periods, the video taken during that time period and the one or more still images taken during that time period in association with each other in the first area; 1. An electronic device comprising: (Configuration 2) The electronic device described in configuration 1 further comprises a selection means for selecting, when one still image is selected from the plurality of still images, a first video that was shot during the time period in which the selected first still image was shot. (Configuration 3) the specific screen has a second area in which moving images and still images related to each other are arranged; when the first still image is selected, the control means arranges the first still image and the first moving image selected by the selection means in the second area. 3. The electronic device according to configuration 2. (Configuration 4) When the first still image is selected, the control means arranges a first range obtained by cutting out a part of the first still image in the second area. 4. The electronic device according to configuration 3. (Configuration 5) the control means determines the first range based on a user's designation, information of a specific subject in the first still image, or supplementary information of the first still image. 5. The electronic device according to configuration 4. (Configuration 6) when the first still image is selected, the control means places in the second area a second moving image obtained by cutting out at least one of a range of a partial playback section of the first moving image and a range of a partial image of each frame of the first moving image. 6. The electronic device according to any one of configurations 3 to 5. (Configuration 7) the control means determines a range of a playback section of a part of the first moving image based on a user's designation, information about a specific subject in the first still image, or supplementary information about the first still image. 7. The electronic device according to configuration 6. (Configuration 8) the control means cuts out a portion of an image of each frame of the first moving image so that a specific subject is captured in the image of each frame of the second moving image; 8. The electronic device according to configuration 6 or 7. (Configuration 9) The supplementary information includes at least one of information on the time of shooting, such as shutter speed information, aperture information, information on the attitude of the image capturing device, autofocus information, and information on the shooting date and time. 8. The electronic device according to configuration 5 or 7. (Configuration 10) In the second area, a content including a moving image and a still image related to each other and including a text is arranged; The electronic device further includes an output unit for outputting the content. 10. The electronic device according to any one of configurations 3 to 9. (Configuration 11) the acquiring means acquires the plurality of still images transmitted from an external device; the control means, when the acquisition means has not acquired any of the plurality of still images, displays in the first area a first display item indicating that the still image will be transmitted in place of the still image not acquired by the acquisition means. 11. The electronic device according to any one of configurations 1 to 10. (Configuration 12) when the acquisition means acquires a still image corresponding to the first display item displayed in the first area, the control means replaces the first display item displayed in the first area with the still image; 12. The electronic device according to configuration 11. (Configuration 13) When the control means displays a still image satisfying a predetermined condition in the first area, the control means further displays a second display item indicating that the still image satisfies the predetermined condition. 13. The electronic device according to any one of configurations 1 to 12. (Configuration 14) the specific screen has a third area different from the first area, the control means arranges one or more still images that satisfy the predetermined condition among the plurality of still images and displays them in the third area. 14. The electronic device according to configuration 13. (Configuration 15) the acquiring means acquires information on a determination result indicating whether or not each of the plurality of still images satisfies the predetermined condition; when information on the determination result of any of the plurality of still images has not been acquired by the acquisition means, the control means displays a third display item indicating that the determination result has not been acquired at a position in the first area corresponding to the still image for which the determination result has not been acquired. 15. The electronic device according to configuration 13 or 14. (Configuration 16) when the acquisition means acquires information on the determination result corresponding to the third display item displayed in the first area, the control means switches the third display item displayed in the first area to a display corresponding to the determination result. 16. The electronic device according to configuration 15. (Configuration 17) The predetermined condition is a condition that the photograph has a specific composition, a condition that the specific subject does not blink, or a condition that the specific subject is in focus. 17. The electronic device according to any one of configurations 13 to 16. (method) A method for controlling an electronic device that controls display of a specific screen displayed on a display means, comprising the steps of: An acquisition step of acquiring a plurality of videos captured in a plurality of consecutive time periods and a plurality of still images captured during the capture of the plurality of videos; 1) displaying the plurality of videos in chronological order in a first area on the specific screen; 2) for each time period in which one or more still images were taken among the plurality of time periods, linking the video taken during that time period with the one or more still images taken during that time period and displaying the link with each other in the first area; The control steps to be displayed on the 13. A method for controlling an electronic device comprising: (program) A program for causing a computer to function as each of the means of the electronic device described in any one of configurations 1 to 17. [Explanation of symbols]

[0168] 400: PC, 401: control unit, 406: display unit, 407: communication unit

Claims

1. An electronic device that controls the display of a specific screen displayed on a display means, An acquisition means for acquiring a plurality of videos captured in a plurality of consecutive time periods and a plurality of still images captured during the capture of the plurality of videos; 1) displaying the plurality of videos in a first area on the specific screen in chronological order; and 2) displaying, for each time period in which one or more still images were taken among the plurality of time periods, the video taken during that time period and the one or more still images taken during that time period in association with each other in the first area.

1. An electronic device comprising:

2. 2. The electronic device according to claim 1, further comprising a selection means for selecting, when one still image is selected from the plurality of still images, a first moving image that was shot during the time period in which the selected first still image was shot.

3. the specific screen has a second area in which moving images and still images related to each other are arranged; when the first still image is selected, the control means arranges the first still image and the first moving image selected by the selection means in the second area.

3. The electronic device according to claim 2.

4. when the first still image is selected, the control means arranges a first range obtained by cutting out a part of the first still image in the second area; 4. The electronic device according to claim 3.

5. the control means determines the first range based on a user's designation, information of a specific subject in the first still image, or supplementary information of the first still image.

5. The electronic device according to claim 4.

6. when the first still image is selected, the control means places in the second area a second moving image obtained by cutting out at least one of a range of a partial playback section of the first moving image and a range of a partial image of each frame of the first moving image; 4. The electronic device according to claim 3.

7. the control means determines a range of a playback section of a part of the first moving image based on a user's designation, information about a specific subject in the first still image, or supplementary information about the first still image.

7. The electronic device according to claim 6.

8. the control means cuts out a portion of an image of each frame of the first moving image so that a specific subject is captured in the image of each frame of the second moving image; 7. The electronic device according to claim 6.

9. The supplementary information includes at least one of information on the time of shooting, such as shutter speed information, aperture information, information on the attitude of the image capturing device, autofocus information, and information on the shooting date and time.

6. The electronic device according to claim 5,

10. The second area has content including a moving image and a still image related to each other, the content including a text, and The electronic device further includes an output unit for outputting the content.

4. The electronic device according to claim 3.

11. the acquiring means acquires the plurality of still images transmitted from an external device; the control means, when the acquisition means has not acquired any of the plurality of still images, displays in the first area a first display item indicating that the still image will be transmitted in place of the still image not acquired by the acquisition means; 2. The electronic device according to claim 1 .

12. when the acquisition means acquires a still image corresponding to the first display item displayed in the first area, the control means replaces the first display item displayed in the first area with the still image; 12. The electronic device according to claim 11 .

13. when the control means displays a still image satisfying a predetermined condition in the first area, the control means further displays a second display item indicating that the still image satisfies the predetermined condition.

2. The electronic device according to claim 1 .

14. the specific screen has a third area different from the first area, the control means arranges one or more still images among the plurality of still images which satisfy the predetermined condition and displays them in the third area.

14. The electronic device according to claim 13.

15. the acquiring means acquires information on a determination result indicating whether or not each of the plurality of still images satisfies the predetermined condition; and when information on the determination result of any of the plurality of still images has not been acquired by the acquisition means, the control means displays a third display item indicating that the determination result has not been acquired at a position in the first area corresponding to the still image for which the determination result has not been acquired.

14. The electronic device according to claim 13.

16. when the acquisition means acquires information on the determination result corresponding to the third display item displayed in the first area, the control means switches the third display item displayed in the first area to a display corresponding to the determination result; 16. The electronic device according to claim 15.

17. The predetermined condition is a condition that the photograph has a specific composition, a condition that the specific subject does not blink, or a condition that the specific subject is in focus.

14. The electronic device according to claim 13.

18. A method for controlling an electronic device that controls display of a specific screen displayed on a display means, comprising the steps of: An acquisition step of acquiring a plurality of videos captured in a plurality of consecutive time periods and a plurality of still images captured during the capture of the plurality of videos; a control step of: 1) displaying the plurality of videos in a chronological order in a first area on the specific screen; and 2) displaying, for each time period in which one or more still images were taken among the plurality of time periods, the video taken during that time period and the one or more still images taken during that time period in association with each other in the first area; 13. A method for controlling an electronic device comprising:

19. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 17.

Images