Electronic device, method for controlling electronic device, and program

Abstract

When combining multiple videos to create a single video file, the timing of the shots may be missed, resulting in a video that is not what the user intended. [Solution] The electronic device of the present invention includes a shooting means for shooting video, a generation means for generating a single video file from a plurality of videos shot by the shooting means, a determination means for determining the type of camera work of the video shot by the shooting means, an accumulation means for accumulating information regarding the type of camera work determined by the determination means, and a notification means for notifying the type of camera work that is below a predetermined threshold on the shooting standby screen if the information regarding the type of camera work accumulated by the accumulation means is below a predetermined threshold.

Description

Technical Field

[0003] ,

[0001] The present invention relates to an electronic device, a control method for an electronic device, and a program.

Background Art

[0002] In recent years, there has been an increasing need to shoot videos with a digital camera and not only enjoy the shot videos but also have fun by editing them according to the user's taste. One example of such editing is to combine a plurality of videos to generate one video file. When generating one video file, it is required that the video file contains the video intended by the user.

[0003] Patent Document 1 discloses that when a photo is taken, in the captured normal shooting image data, the number of shots and elements of shooting tendencies (such as full body, smiling face, upshot, etc.) for each person are aggregated. Patent Document 1 also discloses that in a confirmation screen separate from the shooting screen, the aggregated number of shots for each person is displayed. Furthermore, Patent Document 1 discloses assisting the next shooting by displaying a message indicating that the shooting of a person with fewer shots compared to other people is less.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in Patent Document 1, a message indicating that the shooting of a specific person is less is not displayed on the shooting screen, and there is a possibility of missing the shooting timing.

[0006] Therefore, the present invention aims to ensure that a single video file contains the user's intended video, captured without missing the timing of the shot. [Means for solving the problem]

[0007] To achieve the above objective, the electronic device of the present invention is characterized by comprising: a shooting means for shooting a video; a generation means for generating a single video file from a plurality of videos shot by the shooting means; a determination means for determining the type of camera work of the video shot by the shooting means; an accumulation means for accumulating information regarding the type of camera work determined by the determination means; and a notification means for notifying the type of camera work that is below a predetermined threshold on the shooting standby screen if the information regarding the type of camera work accumulated by the accumulation means is below a predetermined threshold. [Effects of the Invention]

[0008] According to the present invention, a single video file contains the user's intended video, captured without missing the timing of the shot. [Brief explanation of the drawing]

[0009] [Figure 1] This is an external view of a digital camera 100 (imaging device) as an example of a device (electronic device) to which the present invention can be applied. [Figure 2] This block diagram shows the configuration of a digital camera 100, which is an example of a device (electronic device) to which the present invention can be applied. [Figure 3] This is an example of the camera work threshold setting screen 301 (303, 305). [Figure 4] This is a flowchart explaining the process of setting thresholds for camera work. [Figure 5] This flowchart explains the process of notifying the user of missing camera work types on the shooting standby screen. [Figure 6] This is an example of cumulative information (shooting time) for each type of camera work, totaling 601 data points. [Figure 7] This is an example of a display unit 33 that displays information regarding the types of camera work that are missing. [Figure 8] This is an example of a display unit 33 that displays information regarding the types of camera work that are missing. [Figure 9] This process updates cumulative information during video recording. [Modes for carrying out the invention]

[0010] Preferred embodiments of the present invention will be described below with reference to the attached drawings.

[0011] [External view of Digital Camera 100] Figures 1(a) and 1(b) are external views of a digital camera 100 (imaging device) as an example of an apparatus (electronic device) to which the present invention can be applied. Figure 1(a) is a front perspective view of the digital camera 100, and Figure 1(b) is a rear perspective view of the digital camera 100.

[0012] The digital camera 100 includes a gripping unit 90, an imaging unit 110, and a posture control unit 300. The imaging unit 110 is configured to change its orientation relative to the gripping unit 90. The user can hold the digital camera 100 towards a subject by gripping the gripping unit 90 with either their left or right hand. The posture control unit 300 includes a pan axis drive unit 301, a roll axis drive unit 302, and a tilt axis drive unit 303. The pan axis drive unit 301 is fixed to the gripping unit 90, and the tilt axis drive unit 303 is fixed to the imaging unit 110. By driving (rotating) at least one of the pan axis drive unit 301, the roll axis drive unit 302, and the tilt axis drive unit 303, the orientation of the imaging unit 110 relative to the gripping unit 90 can be maintained or changed. The gripping unit 90 and the posture control unit 300 may be separable, and the imaging unit 110 and the posture control unit 300 may be separable. If the imaging unit 110 and the attitude control unit 300 are separable, the imaging unit 110 may be a smartphone or the like. The attitude control unit 300 is such as an electric gimbal device, but a non-electric gimbal device may be used instead of the attitude control unit 300.

[0013] The display unit 33 displays images and various information. The touch panel 70a can detect touch operations on the display surface (touch operation surface) of the display unit 33. The shutter button 61 is an operating member for issuing a shooting command. The mode switching switch 60 is an operating member for switching between various modes. The power switch 72 is an operating member for switching the power of the digital camera 100 ON and OFF.

[0014] The controller wheel 73 is a rotatable operation member and is used, for example, when indicating a selection item. When a rotation operation of the controller wheel 73 is performed, an electrical pulse signal is generated according to the operation amount (rotation amount), and each part of the digital camera 100 is controlled based on this pulse signal. With this pulse signal, it is possible to determine the angle and rotation speed of the rotation operation with respect to the controller wheel 73. The controller wheel 73 may be any operation member that can detect a rotation operation. For example, it may be a dial operation member in which the controller wheel 73 itself rotates according to a rotation operation to generate a pulse signal. The controller wheel 73 may also be an operation member including a touch sensor (so-called touch wheel), and the controller wheel 73 itself does not rotate, and it may be an operation member that detects the rotation operation of the user's finger on the controller wheel 73.

[0015] The four-way key 74 is configured such that its upper, lower, left, and right parts can be pushed in respectively, and processing can be performed according to the pushed part of the four-way key 74. The SET button 75 is a push button and is mainly used for determining a selection item, etc. The video button 76 is a push button and is used for instructing the start and stop of video shooting (recording). The menu button 81 is a push button used for performing an instruction operation to display a menu screen. When the menu button 81 is pressed, a menu screen on which various settings are possible is displayed on the display unit 33. The user can intuitively perform various settings using the menu screen displayed on the display unit 33, the four-way key 74, and the SET button 75.

[0016] [Block Diagram of Digital Camera 100] Figure 2 is a block diagram showing the configuration of the digital camera 100.

[0017] The imaging lens 103 is a lens group including a zoom lens and a focus lens. The shutter 101 is a shutter having an aperture function. The imaging processing unit 22 is an image sensor composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) element that converts an optical image into an electrical signal.

[0018] The A / D converter 23 converts the analog signal output from the imaging processing unit 22 into a digital signal. The barrier 102 covers the imaging system including the imaging lens 103, the shutter 101, and the imaging processing unit 22 of the digital camera 100 to prevent dirt and damage to the imaging system.

[0019] The image processing unit 24 performs predetermined processing (such as resizing processing like pixel interpolation and reduction, and color conversion processing) on the data from the A / D converter 23 or the data from the memory control unit 15. Further, the image processing unit 24 performs predetermined arithmetic processing using the captured image data (video), and the system control unit 50 performs exposure control and distance measurement control based on the arithmetic result obtained by the image processing unit 24. As a result, TTL (Through-the-Lens) AF (Auto Focus) processing, AE (Automatic Exposure) processing, and EF (Flash Pre-Flash) processing are performed. The image processing unit 24 further performs predetermined arithmetic processing using the captured image data (video) and performs TTL-based AWB (Auto White Balance) processing based on the obtained arithmetic result.

[0020] The subject detection unit 25 detects a subject from the captured image data (video) and acquires information about the subject's movement. This information about the subject's movement is used by the camera work determination unit 26, which will be described later, to determine the camera work. Furthermore, the subject detection unit 25 can also determine the type of subject. Examples of subject types to be determined include people, animals, scenery, buildings, and food. These subjects can be determined using general known image recognition techniques. By determining the type of subject, the type of camera work can be determined in the image data (video) group classified by subject type.

[0021] The camera work determination unit 26 determines the type of camera work performed by the digital camera 100 when the image data (video) included in the image data (video) group classified by type of subject was captured. Types of camera work include pan, tilt, and dolly. The camera work determination unit 26 determines the camera work based on at least one of the information regarding the movement of the subject detected by the subject detection unit 25 and the information regarding the movement of the gripping unit 90 detected by the attitude detection unit 55, which will be described later.

[0022] For example, if the camera work determination unit 26 determines, based on information regarding the subject's movement and information regarding the gripping unit 90's movement, that the gripping unit 90 is moving left and right in accordance with the subject's movement, it determines the camera work to be a "pan".

[0023] Furthermore, the camera work determination unit 26 determines that the camera work is "dolly" if it determines, based on information regarding the subject's movement and information regarding the gripping unit 90's movement, that the gripping unit 90 is moving horizontally from side to side relative to the subject in accordance with the subject's movement. Note that "dolly" is a camera work in which the digital camera 100 moves along with the moving subject while shooting. Therefore, the camera work determination unit 26 may also determine the camera work is "dolly" if it determines that the direction of movement of the subject and the gripping unit 90 matches the speed at which the subject and the gripping unit 90 move.

[0024] Furthermore, if the camera work determination unit 26 determines that the gripping unit 90 is moving up and down based solely on information regarding the movement of the gripping unit 90, it determines the camera work to be "tilt".

[0025] The type information storage unit 27 stores information regarding the type of camera work used when shooting the image data (videos) included in the image data (videos) group classified by the type of subject. For example, suppose the image data (videos) group in which the subject is a person includes video A, video B, and video C. For example, suppose the camera work used when shooting video A is determined by the camera work determination unit 26 to be a pan to the left, i.e., "pan (left)". Suppose the camera work used when shooting video B is determined by the camera work determination unit 26 to be a pan to the right, i.e., "pan (right)". Also, suppose the camera work used when shooting video C is determined by the camera work determination unit 26 to be a dolly to the right, i.e., "dolly (right)". In this case, video A is classified as "pan (left)", video B as "pan (right)", and video C as "dolly (right)".

[0026] Then, cumulative information is accumulated for each type of camera work, and this cumulative information is recorded in memory 32. This cumulative information is the accumulated (sum) shooting time of image data (video) classified into each type of camera work. Each time a video is shot, the camera work determination unit 26 determines the type of camera work, and the type information storage unit 27 stores information related to the type of camera work.

[0027] For example, if the camera work of video A is determined to be "pan (left)" after filming, the filming time of video A is added to the camera work type "pan (left)". Similarly, after filming videos B and C, the filming time of each video is added to the camera work type of each video. Furthermore, if video D is newly filmed and the camera work type of video D is determined to be "pan (left)", the filming time of the sum of the filming time of video A and the filming time of video D is accumulated as cumulative information for the camera work type "pan (left)".

[0028] The threshold setting unit 28 sets the shooting time for each type of camera work as a threshold, which is necessary to generate the video file (combined video) intended by the user. The threshold setting unit 28 also sets the ratio calculated from the number of image data (videos) for each type of camera work to the total number of already recorded image data (videos), which is necessary to generate the video file (combined video) intended by the user, as a threshold. The specific method for setting the thresholds will be described later using Figures 3 and 4.

[0029] The notification unit 29 notifies the display unit 33 of information regarding camera work types insufficient in terms of shooting time or proportion to the entire image, based on the cumulative information for each type of camera work stored by the type information storage unit 27 and the threshold set by the threshold setting unit 28. The specific notification method will be described later with reference to Figures 5 to 8.

[0030] The video compression unit 30 compresses and encodes multiple image data (videos) generated in the image processing unit 24 according to the MPEG compression encoding standard, and generates a video file in MPEG format.

[0031] The memory control unit 15 controls the transmission and reception of data between the A / D converter 23, the image processing unit 24, and the memory 32. Output data from the A / D converter 23 is written to the memory 32 via the image processing unit 24 and the memory control unit 15. Alternatively, output data from the A / D converter 23 is written to the memory 32 via the memory control unit 15 without going through the image processing unit 24. The memory 32 stores image data obtained by the imaging processing unit 22 and converted into digital data by the A / D converter 23, as well as image data for display on the display unit 33. The memory 32 has sufficient storage capacity to store a predetermined number of still images, a predetermined amount of video footage, and audio. The memory 32 also serves as a memory for image display (video memory). The D / A converter 13 converts the display image data stored in the memory 32 into analog signals and supplies them to the display unit 33. In this way, the display image data written to the memory 32 is displayed by the display unit 33 via the D / A converter 13.

[0032] The display unit 33 is a display such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence), and displays information according to the analog signal from the D / A converter 13. The digital signal, which has been converted from digital to digital by the A / D converter 23 and stored in the memory 32, is converted back to analog by the D / A converter 13 and sequentially transferred to the display unit 33 for display, thereby enabling live view display (LV display). Hereinafter, the image displayed in live view display will be referred to as the live view image (LV image).

[0033] The non-volatile memory 56 is a memory recording medium that can be electrically erased and recorded, such as an EEPROM (Electrically Erasable Programmable Read-Only Memory). The non-volatile memory 56 stores constants and programs for the operation of the system control unit 50. The program referred to here is a computer program for executing various flowcharts, which will be described later.

[0034] The system control unit 50 is a control unit consisting of at least one processor and / or at least one circuit, and controls the entire digital camera 100. The system control unit 50 implements the processes described later by executing programs stored in the non-volatile memory 56. The system memory 52 is, for example, RAM, and the system control unit 50 loads constants, variables, and programs read from the non-volatile memory 56 into the system memory 52 for the operation of the system control unit 50. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 13, the display unit 33, etc.

[0035] The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of the built-in clock.

[0036] The communication unit 54 transmits and receives video and audio signals to and from external devices connected wirelessly or via wired cables. The communication unit 54 can also connect to a wireless LAN (Local Area Network) or the internet. Furthermore, the communication unit 54 can communicate with external devices using Bluetooth® or Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the imaging processing unit 22 and images recorded on the recording medium 200, and can receive image data and other various information from external devices.

[0037] The attitude detection unit 55 detects the orientation of the gripping unit 90 relative to the direction of gravity. Based on the orientation detected by the attitude detection unit 55, the imaging processing unit 22 can determine whether the image captured was taken with the gripping unit 90 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the attitude detection unit 55 to the image file of the image captured by the imaging processing unit 22, or rotate the image before recording. Furthermore, the system control unit 50 can maintain the orientation of the imaging unit 110 relative to the direction of gravity by operating the attitude control unit 300 based on the orientation change information detected by the attitude detection unit 55. The system control unit 50 can also change the orientation of the imaging unit 110 while suppressing rapid changes in the orientation of the imaging unit 110. An acceleration sensor or a gyro sensor can be used as the attitude detection unit 55. It is also possible to detect the movement of the gripping unit 90 (pan, tilt, roll, lift, whether it is stationary or not, etc.) using the acceleration sensor or gyro sensor in the attitude detection unit 55.

[0038] The power control unit 80 consists of a battery detection circuit, a DC-DC converter, a switch circuit for switching which blocks are energized, and detects whether a battery is installed, the type of battery, and the remaining battery level. The power control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, supplying the necessary voltage to each part, including the recording medium 200, for the required period of time. The power supply unit 31 consists of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries and Li batteries, and an AC adapter.

[0039] The recording medium I / F18 is an interface to the recording medium 200, such as a memory card or hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of semiconductor memory, optical disks, magnetic disks, etc.

[0040] The operation unit 70 is an input unit that receives user input (user operation) and is used to input various operation instructions to the system control unit 50. Each operation component of the operation unit 70 is assigned a function as appropriate for each situation by selecting various function icons displayed on the display unit 33, and acts as various function buttons. Examples of function buttons include an exit button, a back button, an image advance button, a jump button, a filter button, and an attribute change button.

[0041] As shown in Figure 2, the operation unit 70 includes a mode switching switch 60, a shutter button 61, a power switch 72, a video button 76, a touch panel 70a, and other operating components 70b. The other operating components 70b include a controller wheel 73, a four-way key 74, a SET button 75, a menu button 81, and the like.

[0042] The mode switch 60 switches the operating mode of the system control unit 50 to one of the following: still image recording mode, video recording mode, playback mode, etc. Modes included in the still image recording mode include auto shooting mode, auto scene detection mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide shooting settings for different shooting scenes. The user can switch directly to any of these modes using the mode switch 60. Alternatively, the user can switch to a list screen of shooting modes using the mode switch 60, and then selectively switch to one of the displayed modes using another operating element. Similarly, the video recording mode may also include multiple modes.

[0043] The shutter button 61 is equipped with a first shutter switch 62 and a second shutter switch 64. The first shutter switch 62 turns ON during the operation of the shutter button 61, so-called half-press (instruction to prepare for shooting), and generates a first shutter switch signal SW1. The system control unit 50 starts shooting preparation operations such as AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and EF (flash pre-flash) processing in response to the first shutter switch signal SW1. The second shutter switch 64 turns ON when the operation of the shutter button 61 is completed, so-called full-press (instruction to shoot), and generates a second shutter switch signal SW2. The system control unit 50 starts a series of shooting operations from reading the signal from the image processing unit 22 to writing the captured image as an image file to the recording medium 200 in response to the second shutter switch signal SW2.

[0044] The power switch 72 is an operating component that switches the power of the digital camera 100 ON and OFF.

[0045] The video button 76 is a push button used to start and stop video recording.

[0046] The touch panel 70a is a touch sensor that detects various touch operations on the display surface of the display unit 33 (the operating surface of the touch panel 70a). The touch panel 70a and the display unit 33 can be configured as an integrated unit. For example, the touch panel 70a is configured such that its light transmittance does not interfere with the display of the display unit 33, and is mounted on the upper layer of the display surface of the display unit 33. Then, the input coordinates on the touch panel 70a are associated with the display coordinates on the display surface of the display unit 33. This makes it possible to provide a GUI (Graphical User Interface) that makes it seem as if the user can directly operate the screen displayed on the display unit 33.

[0047] The system control unit 50 can detect the following operations or states on the touch panel 70a. - A finger or pen that was not previously touching the touch panel 70a now touches the touch panel 70a, i.e., the start of a touch (hereinafter referred to as Touch-Down). • The state in which the touch panel 70a is being touched with a finger or pen (hereinafter referred to as Touch-On). • The finger or pen is moving while touching the touch panel 70a (hereinafter referred to as Touch-Move). - The finger or pen that was touching the touch panel 70a has been removed (released), i.e., the touch has ended (hereinafter referred to as Touch-Up). • The state in which nothing is being touched on the touch panel 70a (hereinafter referred to as Touch-Off)

[0048] When a touchdown is detected, a touch-on is also detected simultaneously. After a touchdown, touch-ons are usually detected continuously unless a touch-up is detected. Touch-ons are also detected if a touch-move is detected. A touch-move is not detected if the touch position has not moved, even if a touch-on has been detected. A touch-off occurs after all fingers or pens that were touching the screen have been detected as having touched up.

[0049] These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 70a, are notified to the system control unit 50 via the internal bus. The system control unit 50 then determines what kind of operation (touch operation) was performed on the touch panel 70a based on the notified information. For touch moves, the direction of movement of the finger or pen moving on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on the change in position coordinates. If it is detected that a touch move has occurred beyond a predetermined distance, it is determined that a slide operation has been performed.

[0050] A flick is an operation in which a finger is touched on the touch panel 70a, moved quickly a certain distance while still in contact with it, and then released. In other words, a flick is an operation in which the finger is quickly swiped across the touch panel 70a. If a touch move of a predetermined distance or more at a predetermined speed or faster is detected, and a touch-up is detected immediately afterward, it can be determined that a flick has occurred (it can be determined that a flick occurred following a slide operation). Furthermore, a touch operation in which multiple locations (for example, two points) are touched together (multitouch) and the touch positions are brought closer together is called a pinch-in, and a touch operation in which the touch positions are moved further apart is called a pinch-out. Pinch-out and pinch-in are collectively referred to as a pinch operation (or simply a pinch).

[0051] The touch panel 70a may be of any type from among various types of touch panels, such as resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor types. It may also be a method that detects a touch when there is contact with the touch panel, or when a finger or pen approaches the touch panel; either method is acceptable.

[0052] [Regarding the process of setting camera work thresholds] Figure 3 shows an example of the camera work threshold setting screen 301 (303, 305). This threshold setting screen 301 (303, 305) is displayed by selecting the "Camera Work Threshold Setting" item from the menu screen. This threshold setting screen 301 displays two items: "Priority Threshold" and "Threshold Setting". When the user selects (touches) the "Priority Threshold" item, the camera work priority threshold setting screen 302 is displayed. This priority threshold setting screen 302 displays two items: "Time Priority" and "Percentage Priority".

[0053] When the user selects (touches) the "Time Priority" option, the "Priority Threshold" is set to "Time Priority," and the system returns to threshold setting screen 303. This sets the thresholds for the shooting times of various camera movements required to generate the video file (combined video) intended by the user.

[0054] When the threshold setting screen 303 is displayed, if the user selects (touches) the "Threshold Setting" item, the threshold setting (shooting time) screen 304 for various camera work shooting times will be displayed. On this threshold setting (shooting time) screen 304, it is possible to set the shooting time thresholds for the camera work types "Pan (left)", "Pan (right)", and "Dolly (right)". On this threshold setting (shooting time) screen 304, for example, the shooting time thresholds are set to 3 hours for "Pan (left)", 3 hours for "Pan (right)", and 1 hour for "Dolly (right)". On this threshold setting (shooting time) screen 304, the user can change the shooting time thresholds in hours and minutes. When the user selects (touches) the exit button, the screen returns to the camera work threshold setting screen 303, and the shooting time thresholds for each camera work type are set.

[0055] On the camera work priority threshold setting screen 302, when the user selects (touches) the "Percentage Priority" option, the "Priority Threshold" is set to "Percentage Priority," and the system returns to the threshold setting screen 305. This sets a threshold for the percentage of the number of image data (videos) for each type of camera work relative to the total number of already recorded image data (videos) required to generate the video file (combined video) intended by the user.

[0056] When the threshold setting screen 305 is displayed, if the user selects (touches) the "Threshold Setting" item, the following process is executed. Specifically, the threshold setting (percentage) screen 306 is displayed, which allows the user to set a threshold for the ratio calculated from the number of image data (videos) for each type of camera work to the total number of image data (videos) already recorded. On this threshold setting (percentage) screen 306, the user can set the camera work types "Pan (left)", "Pan (right)", and "Dolly (right)", and the ratio calculated from the number of image data (videos) for each type of camera work to the total number of image data (videos) already recorded.

[0057] On this threshold setting (time) screen 306, for example, "Pan (left)" is set to 30%, "Pan (right)" to 30%, and "Dolly (right)" to 10% as percentage thresholds (%). When the user selects (touches) the end button, the screen returns to the camera work threshold setting screen 305, where the percentage is set based on the number of image data (videos) for each type of camera work relative to the total number of image data (videos) already recorded.

[0058] Figure 4 is a flowchart illustrating the process of setting the threshold for camera work. This process is achieved by the system control unit 50 executing a program stored in the non-volatile memory 56, which is then loaded into memory 32.

[0059] In S401, the system control unit 50 displays the threshold setting screen 301. This threshold setting screen 301 is displayed by selecting the "Camera Work Threshold Setting" item from the menu screen. This threshold setting screen 301 displays two items: "Priority Threshold" and "Threshold Setting".

[0060] In S402, the system control unit 50 determines whether or not the user has performed a selection operation (touch operation) to the "priority threshold". If it is determined that a selection operation to the "priority threshold" has been performed, the process proceeds to S403; otherwise, it proceeds to S401.

[0061] In S403, the system control unit 50 displays the priority threshold setting screen 302. This priority threshold setting screen 302 displays two items: "Time Priority" and "Percentage Priority".

[0062] In S404, the system control unit 50 determines whether the user has made a selection operation (touch operation) to "time priority". If it is determined that the selection operation to "time priority" has been made, the process proceeds to S404; otherwise, it proceeds to S413.

[0063] In S405, the system control unit 50 displays the threshold setting screen 303.

[0064] In S406, the system control unit 50 determines whether or not the user has made a selection operation (touch operation) to "threshold setting". If it is determined that a selection operation to "threshold setting" has been made, the process proceeds to S407; otherwise, it proceeds to S405.

[0065] In S407, the system control unit 50 displays the threshold setting (time) screen 304.

[0066] In S408, the system control unit 50 determines whether or not the user has changed the threshold (shooting time). If it is determined that the threshold (shooting time) has been changed, the process proceeds to S409; otherwise, it proceeds to S410.

[0067] In S409, the system control unit 50 changes the threshold (shooting time) for the selected camera work. In the threshold setting (time) screen 304 of Figure 3, the "Pan (left)" camera work is selected, and the shooting time threshold for "Pan (left)" can be changed.

[0068] In S410, the system control unit 50 determines whether or not the user has pressed the exit button. If it is determined that the exit button has been pressed, the process proceeds to S411; otherwise, it proceeds to S408.

[0069] In S411, the system control unit 50 controls the system to return to the threshold setting screen 303.

[0070] In S412, the threshold setting unit 28 sets the threshold (shooting time) for various camera operations and records it as threshold information in the memory 32, thereby completing the process of setting the threshold for the camera operations. Then, the LV image is displayed on the display unit 33.

[0071] In S413, the system control unit 50 determines that the user has selected "proportion priority".

[0072] In S414, the system control unit 50 displays the threshold setting screen 305.

[0073] In S415, the system control unit 50 determines whether the user has made a selection operation for "threshold setting". If it is determined that the user has made a selection operation for "threshold setting", proceed to S416; otherwise, proceed to S414.

[0074] In S416, the system control unit 50 displays the threshold setting (percentage) screen 306.

[0075] In S417, the system control unit 50 determines whether or not the user has performed an operation to change the threshold (percentage). If it is determined that the user has performed an operation to change the threshold (percentage), the process proceeds to S418; otherwise, it proceeds to S419.

[0076] In S418, the system control unit 50 changes the threshold (percentage) of the selected camera work. In the threshold setting (percentage) screen 306 in Figure 3, the camera work "Pan (left)" is selected, and the threshold for the percentage of "Pan (left)" can be changed.

[0077] In S419, the system control unit 50 determines whether or not the user has pressed the exit button. If it is determined that the exit button has been pressed, the process proceeds to S420; otherwise, it proceeds to S417.

[0078] In S420, the system control unit 50 controls the system to return to the threshold setting screen 305.

[0079] In S421, the threshold setting unit 28 sets the threshold (percentage) for each type of camera work and records it as threshold information in the memory 32, thereby completing the process of setting the threshold for the camera work. Then, the LV image is displayed on the display unit 33.

[0080] In this way, by allowing users to set the shooting time and proportion of various camera movements in the video file (combined video), it is possible to generate a video file (combined video) that matches the user's intentions.

[0081] [Regarding the process of notifying about missing camera work types] Figure 5 is a flowchart illustrating the process of notifying the system of missing camera work types on the shooting standby screen. This process is implemented by the system control unit 50 executing a program stored in the non-volatile memory 56, which is then loaded into memory 32. Figures 5-8 show that the system determines whether or not to notify the system of missing camera work types based on the shooting time of each type of camera work. However, the decision may also be based on the ratio calculated from the number of videos of each type of camera work to the total number of already recorded image data (videos).

[0082] In S501, the system control unit 50 determines whether the power of the digital camera 100 is turned ON based on the user's operation of pressing the power switch 72. If it is determined that the power of the digital camera 100 is ON, the process proceeds to S502; otherwise, the process proceeds to S501.

[0083] In S502, the system control unit 50 displays the LV image on the display unit 33. That is, the digital camera 100 is in shooting standby mode, and the shooting standby screen is displayed on the display unit 33. The imaging processing unit 22 captures an image at a specific frame rate for recording, and the display unit 33 displays the LV image at a specific frame rate for display.

[0084] In S503, the system control unit 50 detects a subject from the image data (video) captured by the subject detection unit 25 and determines whether or not information regarding the subject's movement has been acquired. Also in S503, the system control unit 50 determines whether or not information regarding the movement of the gripping part 90 of the digital camera 100 has been acquired by the attitude detection unit 50. If it is determined that at least one of the information regarding the subject's movement and the information regarding the movement of the gripping part 90 of the digital camera 100 has been acquired, the process proceeds to S504; otherwise, the process proceeds to S508.

[0085] In S504, the camera work determination unit 26 determines the type of camera work of the captured image data (video).

[0086] In S505, the system control unit 50 obtains threshold information from the memory 32 corresponding to the type of camera work determined in S504. Also in S505, the system control unit 50 obtains cumulative information from the memory 32 corresponding to the type of camera work determined in S504. Figure 6 shows an example of cumulative information (shooting time) 601 for each type of camera work recorded in the memory 32. The cumulative information 601 includes items for camera work types such as "Pan (left)", "Pan (right)", "Dolly (right)", and "Other", and contains information on the total shooting time of already recorded image data (video) for each of these items. For example, if the type of camera work determined in S504 is "Dolly (right)", the system control unit 50 obtains the threshold information for "Dolly (right)" set by the threshold setting unit 28 and the cumulative information for "Dolly (right)" stored by the type information storage unit 28.

[0087] In S506, the system control unit 50 determines whether the total shooting time of already recorded image data (video) is less than the threshold, based on the threshold information and cumulative information acquired in S505. Specifically, it compares the cumulative information and threshold information corresponding to the type of camera work determined in S504. If it is determined that the total shooting time of already recorded image data (video) is less than the threshold, the process proceeds to S507; otherwise, it proceeds to S510. For example, if the type of camera work determined in 504 is "Dolly (Right)", the threshold (shooting time) for "Dolly (Right)" is set to 1 hour in the threshold setting (time) screen 304 in Figure 3. Then, in the cumulative information (shooting time) in Figure 6, the total shooting time of already recorded image data (video) for "Dolly (Right)" is 30 minutes. Therefore, it is determined that the total shooting time of already recorded image data (video) for the "Dolly (Right)" camera work is less than the threshold.

[0088] In S507, the notification unit 30 notifies the user by displaying information about the missing camera work type along with the LV image on the display unit 33, and then terminates the process. Figure 7 is an example of the display unit 33 displaying information about the missing camera work type, indicating that the "Dolly (right)" camera work is missing. At this time, information about camera work types for which the total shooting time of already recorded image data (video) is determined to be above a threshold is not notified. In this way, by notifying the user of information about the missing camera work type while waiting to shoot, it is possible to determine whether it is OK to start video recording (shooting) with the camera work that is waiting to shoot, and it is possible to assist in the generation of the video file (combined video) intended by the user.

[0089] In S508, if neither information regarding the movement of the subject nor information regarding the movement of the gripping part 90 of the digital camera 100 can be obtained in S503, the system control unit 50 obtains threshold information and cumulative information recorded in the memory 32.

[0090] In S509, the notification unit 30 compares the threshold information acquired in S508 with the cumulative information and displays information on all camera work types for which the total shooting time of already recorded image data (video) is less than the threshold, along with the LV image, on the display unit 33. The user is notified of all camera work types for which the total shooting time of already recorded image data (video) is less than the threshold, and the process ends. Figure 8 is an example of the display unit 33 displaying information on missing camera work types, where the bar graphs for "Pan (Right)" and "Dolly (Right)" are filled in black, indicating that these camera work types are missing. In this way, by notifying the user of all missing camera work types while in standby mode, it is possible to determine which camera work to use to start video recording (shooting) from the standby mode. Therefore, video recording (shooting) can be performed without missing the timing to start video recording (shooting).

[0091] In Figure 8, the bar graphs for "Pan (Left)" and "Other" are shown filled in white, indicating that these camera movements are not lacking. When it is determined that a recording start command has been issued at S901 in the flowchart of Figure 9 (described later), and video recording (shooting) begins at S902, information regarding the types of camera movements that are lacking is not notified.

[0092] [Regarding the process of updating cumulative information] After notifying the user of information regarding the missing camera work types, the process shown in Figure 9 begins. Figure 9 shows the process of updating cumulative information during video recording. During video recording, no notification is given regarding information regarding the missing camera work types. This process is achieved by the system control unit 50 executing a program stored in the non-volatile memory 56, which is then loaded into memory 32.

[0093] In S901, the system control unit 50 determines whether or not a video recording start command has been issued by the user pressing the video button 76. If it is determined that a video recording start command has been issued, the process proceeds to S902; otherwise, it proceeds to S901.

[0094] In S902, the system control unit 50 starts video recording (shooting). Specifically, the system control unit 50 compresses the image data (video) obtained by the image processing unit 24 into a video file by encoding it as one frame at a specific frame rate for recording in the video compression unit 31. Then, it records the video file to the recording medium 200 via the recording medium I / F 18. If a video file already exists on the recording medium 200, it combines the video shot after the existing video file on the recording medium 200 to generate a single video file. Then, it records that video file to the recording medium 200.

[0095] In S903, the system control unit 50 detects a subject from the image data (video) using the subject detection unit 25 and determines whether or not it has acquired information regarding the subject's movement. Also in S903, the system control unit 50 determines whether or not it has acquired information regarding the movement of the gripping part 90 of the digital camera 100 using the posture detection unit 50. If it is determined that at least one of the information regarding the subject's movement and the information regarding the movement of the gripping part 90 of the digital camera 100 has been acquired, the process proceeds to S904; otherwise, the process proceeds to S906.

[0096] In S904, the camera work determination unit 26 determines the type of camera work of the captured image data (video).

[0097] In S905, the type information storage unit 27 updates the cumulative information corresponding to the type of camera work determined in S904 and stores the updated cumulative information. For example, if the type of camera work determined in S904 is "Dolly (Right)", the threshold (shooting time) for "Dolly (Right)" is set to 1 hour in the threshold setting (time) screen 304 in Figure 3. Then, in the cumulative information (shooting time) in Figure 6, the total shooting time of the image data already recorded for "Dolly (Right)" is 30 minutes. Subsequently, if a video of "Dolly (Right)" is shot for 30 minutes by the video recording process in Figure 9, this is added to the total shooting time of the image data already recorded (30 minutes), making the total shooting time 1 hour, and the cumulative information for "Dolly (Right)" is updated.

[0098] In S906, the system control unit 50 determines whether or not a video recording stop command has been issued by the user pressing the video button 76. If it is determined that a video recording stop command has been issued, the process proceeds to S907; otherwise, it proceeds to S903.

[0099] In S907, the system control unit 50 stops video recording (shooting). That is, it stops the compression process by the video compression unit 31.

[0100] In S908, the system control unit 50 determines whether the power to the digital camera 100 is turned off based on the user's operation of pressing the power switch 72. If it is determined that the power to the digital camera 100 is turned off, the process ends; otherwise, the process proceeds to S901.

[0101] [Other embodiments] The various controls described above, which are performed by the system control unit 50, may be performed by a single piece of hardware, or multiple pieces of hardware (for example, multiple processors or circuits) may share the processing to control the entire device.

[0102] Furthermore, although the present invention has been described in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0103] The present invention can also be realized by performing the following process: supplying software (programs) that realize the functions of the embodiments described above to a system or device via a network or various storage media, and having the computer (or CPU, MPU, etc.) of that system or device read and execute the program code. In this case, the program and the storage medium storing the program constitute the present invention.

[0104] (Composition 1) The means of shooting video, A generation means that generates a single video file from multiple videos captured by the aforementioned shooting means, A determination means for determining the type of camera work of a video captured by the aforementioned shooting means, Accumulation means for accumulating information regarding the type of camera work determined by the determination means, If the information regarding the type of camera work accumulated by the accumulation means is below a predetermined threshold, the shooting standby screen has a notification means that notifies the type of camera work that is below the predetermined threshold. An electronic device characterized by the following features.

[0105] (Configuration 2) The aforementioned electronic device further, A detection means for detecting a subject from a video captured by the aforementioned shooting means, The electronic device has a detection means for detecting movement, The determination means is, The electronic device according to configuration 1, characterized in that it determines the type of camera work based on at least one of the information relating to the movement of the subject detected by the detection means and the information relating to the movement of the electronic device detected by the detection means.

[0106] (Composition 3) The electronic device according to configuration 1 or 2, characterized in that the information relating to the type of camera work is the total shooting time for each type of camera work, or the ratio calculated from the number of videos for each type of camera work to the total number of videos included in the video file.

[0107] (Composition 4) The electronic device according to any one of configurations 1 to 3, characterized in that the notification means does not notify the type of camera work that is above a predetermined threshold on the shooting standby screen.

[0108] (Composition 5) The electronic device according to any one of configurations 1 to 4, characterized in that the notification means does not notify the type of camera work that is below the predetermined threshold on the screen during shooting.

[0109] (Composition 6) The steps involved in shooting a video, A generation step which generates a single video file from multiple videos captured in the aforementioned shooting step, A determination step to determine the type of camera work of the video captured in the aforementioned shooting step, An accumulation step for accumulating information regarding the type of camera work determined in the above determination step, If the information regarding the type of camera work accumulated in the aforementioned accumulation step is below a predetermined threshold, the shooting standby screen includes a notification step that notifies the camera work type that is below the predetermined threshold. A method for controlling electronic equipment characterized by the following features.

[0110] (Composition 7) A program to cause a computer to perform the control methods of the electronic devices described in Configuration 6.

[0111] (Composition 8) A computer-readable recording medium containing a program that causes the computer to perform the control method of the electronic device described in configuration 6.

Claims

1. The means of shooting video, A generation means that generates a single video file from multiple videos captured by the aforementioned shooting means, A determination means for determining the type of camera work of a video captured by the aforementioned shooting means, Accumulation means for accumulating information regarding the type of camera work determined by the determination means, If the information regarding the type of camera work accumulated by the accumulation means is below a predetermined threshold, the shooting standby screen has a notification means that notifies the type of camera work that is below the predetermined threshold. An electronic device characterized by the following features.

2. The aforementioned electronic device further, A detection means for detecting a subject from a video captured by the aforementioned shooting means, The electronic device has a detection means for detecting movement, The determination means is The electronic device according to claim 1, characterized in that the type of camera work is determined based on at least one of the information relating to the movement of the subject detected by the detection means and the information relating to the movement of the electronic device detected by the detection means.

3. The electronic device according to claim 1, characterized in that the information relating to the type of camera work is the total shooting time for each type of camera work, or the ratio calculated from the number of videos for each type of camera work to the total number of videos included in the video file.

4. The electronic device according to claim 1, characterized in that the notification means does not notify the type of camera work that is above a predetermined threshold on the shooting standby screen.

5. The electronic device according to claim 1, characterized in that the notification means does not notify the type of camera work that is below the predetermined threshold on the screen during shooting.

6. The steps involved in shooting a video, A generation step which generates a single video file from multiple videos captured in the aforementioned shooting step, A determination step to determine the type of camera work of the video captured in the aforementioned shooting step, An accumulation step for accumulating information regarding the type of camera work determined in the above determination step, If the information regarding the type of camera work accumulated in the aforementioned accumulation step is below a predetermined threshold, the shooting standby screen includes a notification step that notifies the camera work type that is below the predetermined threshold. A method for controlling electronic equipment characterized by the following features.

7. A program for causing a computer to execute the control method of an electronic device described in claim 6.

8. A computer-readable recording medium that stores a program for causing a computer to execute the control method of the electronic device described in claim 6.

Images