Electronic device, control method, computer program product, and computer-readable storage medium

Abstract

The present invention relates to an electronic apparatus, a control method, a computer program product, and a computer-readable storage medium. The electronic apparatus according to the present disclosure includes a control unit configured to control in response to a user operation to perform a simulation related to main photographing by an image pickup device, wherein the control unit controls in response to a first user operation to perform a first simulation of performing a preliminary photographing using an exposure parameter to be applied during the main photographing in a case where a trajectory of a change in a field of view of the image pickup device to be applied during the main photographing is not set, and to perform a second simulation of changing the field of view of the image pickup device according to the trajectory in a case where the trajectory is set.

Description

Technical Field

[0001] This disclosure relates to an electronic device, and more specifically to a camera device capable of performing time-lapse photography and motion time-lapse photography. Background Technology

[0002] Gimbal cameras integrating a camera and a gimbal have been proposed. Many gimbal cameras are small in size. Although small gimbal cameras have fewer operating components, in many cases, operating components corresponding to those of conventional gimbals that are not integrated with a camera are provided to improve the usability of gimbal cameras for users of conventional gimbals.

[0003] In addition to capturing still and moving images, many gimbal cameras can also perform time-lapse and motion time-lapse photography. Both time-lapse and motion time-lapse involve capturing multiple still images at constant time intervals and then combining these images to create a moving image. However, time-lapse photography is performed from a fixed perspective, while motion time-lapse photography involves changing the perspective simultaneously.

[0004] The similarity between time-lapse and motion time-lapse lies in the fact that both involve capturing still images multiple times at regular time intervals and generating a moving image by combining the multiple acquired still images. Therefore, many settings required for time-lapse are common to motion time-lapse. Thus, from an operability point of view, it is preferable to provide a common shooting mode for both time-lapse and motion time-lapse, rather than providing two separate shooting modes.

[0005] International Publication No. 2009 / 025345 discloses a technique for performing time-lapse and motion time-lapse photography in the same camera mode and conducting tests (simulations) before the main camera.

[0006] In the technology disclosed in International Publication No. 2009 / 025345, time-lapse and motion time-lapse simulations are performed in response to the same user operation, and the same simulations are performed. However, because the key verification items in time-lapse and motion time-lapse are different, the technology disclosed in International Publication No. 2009 / 025345 cannot efficiently perform simulations (time-lapse or motion time-lapse) related to the main camera. For example, necessary verifications cannot be performed or unnecessary verifications are performed during simulation. Although it is conceivable to perform time-lapse and motion time-lapse simulations in response to different user operations, the user operation becomes complicated, and simulations (time-lapse or motion time-lapse) related to the main camera cannot be performed efficiently. In addition, it is difficult to increase the number of operating components in a small gimbal camera. Summary of the Invention

[0007] This disclosure provides a technique for efficiently performing simulations related to the main camera.

[0008] The electronic device according to this disclosure includes a control unit configured to control in response to a user operation to perform a simulation related to a main camera operation, wherein the control unit controls in response to a first user operation to: perform a first simulation of pre-shooting using exposure parameters to be applied during the main camera operation when no trajectory of the camera's viewing angle change applied during the main camera operation is set, and perform a second simulation of changing the viewing angle of the camera based on the trajectory when a trajectory is set.

[0009] The features of this disclosure will become apparent from the following description of embodiments with reference to the accompanying drawings. The following description of the embodiments is given by way of example. Attached Figure Description

[0010] Figure 1A and Figure 1B This is a diagram showing the appearance of a digital camera.

[0011] Figure 2 This is a block diagram showing the configuration of a digital camera.

[0012] Figure 3 This is a flowchart of the camera mode processing.

[0013] Figure 4 This is a flowchart of the trajectory setting process.

[0014] Figure 5 This is a flowchart of the simulation process.

[0015] Figure 6 This is a flowchart of the simulation process.

[0016] Figure 7 This is a flowchart of the camera mode processing.

[0017] Figures 8A to 8F This is a schematic diagram of the displayed screen. Detailed Implementation

[0018] In the following description, embodiments of the present disclosure will be described with reference to the accompanying drawings. Figure 1A and Figure 1B This is an external view of a digital camera 100 (video recording device) that serves as an example of an apparatus (electronic device) to which this disclosure can be applied. Figure 1A This is a frontal perspective view of the digital camera 100, and Figure 1B This is a perspective view of the rear of the digital camera 100. The digital camera 100 is a digital camera including a gimbal mechanism.

[0019] The digital camera 100 includes a grip unit 90, a camera unit 110, and a posture control unit 300. The camera unit 110 is arranged to change its posture relative to the grip unit 90. The posture control unit 300 includes a pan axis drive unit 301, a tilt axis drive unit 302, and a pitch axis drive unit 303. The pan axis drive unit 301 is fixed to the grip unit 90, and the pitch axis drive unit 303 is fixed to the camera unit 110. By driving (rotating) at least one of the pan axis drive unit 301, the tilt axis drive unit 302, and the pitch axis drive unit 303, the posture of the camera unit 110 relative to the grip unit 90 can be maintained or changed. The grip unit 90 and the posture control unit 300 may be separable, or the camera unit 110 and the posture control unit 300 may be separable. When the camera unit 110 and the posture control unit 300 are separable, the camera unit 110 may be a smartphone or an action camera, etc.

[0020] Display unit 28 displays images and various types of information. Touch panel 70a can detect touch operations on the display surface (touch operation surface) of display unit 28. Shutter button 61 is an operating component for providing camera shooting instructions. Mode selector switch 60 is an operating component for switching between various modes. Power switch 72 is an operating component for switching the power supply of digital camera 100 between on and off.

[0021] The controller wheel 73 is a rotatable operating member and is used, for example, to indicate (select) selection items. When the controller wheel 73 is rotated, an electrical pulse signal is generated based on the operation amount (rotation amount), and the various units of the digital camera 100 (display unit 28, etc.) are controlled based on the pulse signal. The rotation angle and rotation speed of the controller wheel 73 can be determined by the pulse signal. The controller wheel 73 only needs to be an operating member capable of detecting rotation operation, and can be, for example, a dial operating member in which the controller wheel 73 itself rotates according to the rotation operation to generate a pulse signal. The controller wheel 73 can be an operating member including a touch sensor (a so-called touch wheel), or it can be an operating member that detects the rotational movement of the user's finger on the controller wheel 73 without the controller wheel 73 itself rotating.

[0022] The joystick 74 is an operating member arranged on the front side of the grip unit 90 (the rear side and user side of the digital camera 100), and it is assumed that the joystick 74 is operated by the thumb of the hand holding the grip unit 90 (grip). The joystick 74 is configured to be pushed in multiple directions such as up, down, left, and right, and can be processed according to the direction in which the joystick 74 is pushed. The center button 75 of the joystick is a push button and is mainly used to select an option. The moving image button 76 is a push button and is used to execute an instruction to start or stop moving image shooting (recording). The trigger button 77 is an operating member arranged on the rear side of the grip unit 90 (the front side and subject side of the digital camera 100), and it is assumed that the trigger button 77 is operated by the index finger of the hand holding the grip unit 90 (grip). The menu button 81 is a push button for executing an instruction to display a menu screen. When the menu button 81 is pressed, a menu screen on the display unit 28 is displayed, allowing various settings to be executed. Users can intuitively make various settings using the menu screen displayed on the display unit 28, the joystick 74, and the joystick center button 75.

[0023] The operation of the digital camera 100 includes the following. • Changes in viewing angle (changes in the posture of camera unit 110) in response to user operation of joystick 74. • Switching of gimbal mode in response to a short press of trigger button 77. • Switching to locked mode in response to holding (pressing and holding) the trigger button 77. • Responds to double-clicking or triple-clicking (continuous tapping) of trigger button 77 to return to the origin of the viewpoint and switch the camera direction between the self-portrait direction and the non-self-portrait direction.

[0024] When the user changes the posture of the holding unit 90, the posture control unit 300 smoothly changes the viewing angle (posture of the camera unit 110) based on the set gimbal mode (rule). For example, the following gimbal modes can be set. • Pan Follow Mode (PF Mode): This mode causes the viewing angle (the posture of the camera unit 110) to follow the changes in the posture of the holding unit 90 in the pan direction, while the viewing angle (the posture of the camera unit 110) remains fixed in the pitch and tilt directions. PF Mode is used when tracking a horizontally moving subject. • Locked Mode: The viewing angle (the posture of the camera unit 110) is fixed in the pan, tilt, and yaw directions. Locked mode is used when the camera continues to move in a specific direction. • Follow Mode: The viewpoint (the posture of the camera unit 110) follows the changes in the posture of the holding unit 90 in the pan and tilt directions, while the viewpoint (the posture of the camera unit 110) is fixed in the tilt direction. Use Follow Mode when you want to achieve natural camera operation. • Point of View (POV) Mode: This mode causes the viewing angle (the posture of the camera unit 110) to follow changes in the posture of the holding unit 90 in the pan, tilt, and yaw directions. Use POV mode when you want to perform dynamic video recording or make significant changes to the viewpoint.

[0025] Figure 2 This is a block diagram showing the configuration of the digital camera 100.

[0026] The imaging lens 103 is a lens group including a zoom lens and a focusing lens. The shutter 101 is a shutter with an aperture function. The image processing unit 22 is an imaging element (image sensor) composed of CCD or CMOS elements, etc., that converts optical images into electrical signals. The A / D converter 23 converts the analog signals (electrical signals) output from the image processing unit 22 into digital signals. The baffle 102 covers the imaging system including the imaging lens 103, shutter 101, and image processing unit 22 of the digital camera 100, thereby preventing contamination or damage to the imaging system.

[0027] The image processing unit 24 performs predetermined processing (such as pixel interpolation, size adjustment processing such as shrinkage, and color conversion processing) on ​​data (digital signals) from the A / D converter 23 or data from the memory control unit 15. Furthermore, the image processing unit 24 performs predetermined calculations using captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the calculation results obtained by the image processing unit 24. Therefore, TTL-type autofocus (AF), auto exposure (AE), and flash pre-flash (EF) processing are performed. The image processing unit 24 also performs predetermined calculations using captured image data and performs TTL-type automatic white balance (AWB) processing based on the obtained calculation results.

[0028] The memory control unit 15 controls the transmission and reception of data in the A / D converter 23, image processing unit 24, and memory 32. Output data from the A / D converter 23 is written to the memory 32 via the image processing unit 24 and memory control unit 15. Alternatively, output data from the A / D converter 23 can be written to the memory 32 via the memory control unit 15 without intervention from the image processing unit 24. The memory 32 stores image data acquired by the image processing unit 22 and converted into digital data by the A / D converter 23, as well as image data to be displayed on the display unit 28. The memory 32 has sufficient storage capacity to store a predetermined number of still images and moving images and audio over a predetermined time period. The memory 32 also serves as a memory for image display (video memory). The D / A converter 13 converts the image data to be displayed and stored in the memory 32 into an analog signal and supplies this analog signal to the display unit 28. Therefore, the image data to be displayed and written to the memory 32 is displayed by the display unit 28 via the D / A converter 13.

[0029] Display unit 28 is a display such as an LCD or OLED, and performs a display corresponding to the analog signal from D / A converter 13. The digital signal, which has undergone A / D conversion by A / D converter 23 and accumulated in memory 32, is converted into an analog signal in D / A converter 13, and the analog signal is sequentially transmitted to display unit 28 and displayed on display unit 28, thereby enabling live view display (LV display). Hereinafter, the image displayed in live view display is referred to as a live view image (LV image).

[0030] Non-volatile memory 56 is a memory that serves as an electrically erasable and recordable recording medium, and is, for example, an EEPROM. Constants and programs for the operation of system control unit 50 are stored in non-volatile memory 56. The programs used herein are computer programs for performing the processes shown in the various flowcharts described later. System control unit 50 is a control unit including at least one processor and / or at least one circuit, and controls the entire digital camera 100. System control unit 50 implements the processes described later by executing the programs stored in non-volatile memory 56. System memory 52 is, for example, RAM, and system control unit 50 loads constants, variables, and programs read from non-volatile memory 56 into system memory 52 for the operation of system control unit 50. Furthermore, system control unit 50 also performs display control by controlling memory 32, D / A converter 13, and display unit 28, etc.

[0031] System timer 53 is a timer unit that counts the time used for various controls and the time of the embedded clock.

[0032] The communication unit 54 transmits video and audio signals to and receives video and audio signals from external devices, either wirelessly or via a wired connection. The communication unit 54 can also connect to a wireless local area network (LAN) and the Internet. Furthermore, the communication unit 54 can communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the camera processing unit 22 and images recorded on the recording medium 200, and can receive image data and other various types of information from external devices.

[0033] The posture detection unit 55 detects the posture of the gripping unit 90 relative to the direction of gravity. Based on the posture detected by the posture detection unit 55, it can be determined whether the image captured by the image processing unit 22 is an image captured by the gripping unit 90 held horizontally or vertically. The system control unit 50 can add posture information corresponding to the posture detected by the posture detection unit 55 to the image file of the image captured by the image processing unit 22, or rotate and record the image. In addition, the system control unit 50 can maintain the posture of the camera unit 110 relative to the direction of gravity by operating the posture control unit 300 based on the posture change information detected by the posture detection unit 55. The system control unit 50 can also change the posture of the camera unit 110 while suppressing sudden posture changes of the camera unit 110. For example, an accelerometer or gyroscope sensor can be used in the posture detection unit 55. The movement of the gripping unit 90 (regardless of whether the gripping unit 90 is translating, pitching, tilting, lifting, or stationary, etc.) can also be detected by using an accelerometer or gyroscope sensor that serves as the posture detection unit 55.

[0034] The power control unit 80 includes a battery detection circuit, a DC-DC converter, and a switching circuit for switching which blocks are to be powered, and detects whether a battery is installed, the type of battery, and the remaining battery power. Furthermore, based on the detection results and instructions from the system control unit 50, the power control unit 80 controls the DC-DC converter and supplies the required voltage to the portion including the recording medium 200 during necessary time periods. The power supply unit 30 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a lithium-ion battery, or an AC adapter.

[0035] Recording medium I / F 18 is an interface to recording medium 200, such as a memory card or hard disk. Recording medium 200 is a recording medium, such as a memory card, used to record captured images, and is composed of semiconductor memory, optical disk, or magnetic disk.

[0036] The operation unit 70 is an input unit that receives operations from the user (user operations) and is used to input various operation instructions to the system control unit 50. Functions are appropriately assigned to the operation components of the operation unit 70 (which are programmable) for each camera scene by selecting and operating various function icons displayed on the display unit 28, for example. These operation components act as various function buttons. Examples of function buttons include an end button, a return button, an image delivery button, a jump button, a zoom button, and an attribute change button. These function buttons include... Figure 2 The other operating components 70b shown.

[0037] like Figure 2As shown, the operation unit 70 includes a mode selector switch 60, a shutter button 61, a power switch 72, a touch panel 70a, and other operation components 70b. Other operation components 70b include a controller wheel 73, a joystick 74, a joystick center button 75, a motion image button 76, a trigger button 77, and a menu button 81.

[0038] The mode selector switch 60 switches the operating mode of the system control unit 50 to any of the following: still image recording mode, motion image recording mode, and playback mode. Still image recording modes include modes such as automatic recording mode, automatic scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). Furthermore, still image recording modes also include various scene modes containing recording settings for different recording scenarios, as well as custom modes. The user can directly switch the operating mode to any of these modes using the mode selector switch 60. Alternatively, the user can temporarily switch the screen to a recording mode list screen using the mode selector switch 60, and then selectively switch the mode to any of the multiple display modes using other operating components. Similarly, motion image recording modes can include multiple modes.

[0039] The shutter button 61 includes a first shutter switch 62 and a second shutter switch 64. The first shutter switch 62 is activated during operation of the shutter button 61 in response to a so-called half-press (video preparation indication), and generates a first shutter switch signal SW1. The system control unit 50 uses the first shutter switch signal SW1 to initiate video preparation operations such as autofocus (AF) processing, auto exposure (AE) processing, auto white balance (AWB) processing, or flash pre-flash (EF) processing. The second shutter switch 64 is activated upon completion of operation of the shutter button 61 in response to a so-called full press (video indication), and generates a second shutter switch signal SW2. The system control unit 50 uses the second shutter switch signal SW2 to initiate a series of video processing operations from reading signals from the image processing unit 22 to writing the captured image as an image file to the recording medium 200.

[0040] Touch panel 70a is a touch sensor that detects any touch operation among various touch operations on the display surface of display unit 28 (the operation surface of touch panel 70a). Touch panel 70a and display unit 28 can be configured integrally. For example, touch panel 70a is configured such that light transmittance does not obstruct the display of display unit 28 and is attached to the upper layer of the display surface of display unit 28. Then, input coordinates on touch panel 70a are associated with display coordinates on the display surface of display unit 28. As a result, a graphical user interface (GUI) configured as if the user could directly operate the screen displayed on display unit 28 can be provided.

[0041] The system control unit 50 can detect the following operations on the touch panel 70a or the following states of the touch panel 70a. • The operation of a finger or stylus that has not previously touched the touch panel 70a to newly touch the touch panel 70a, i.e., the start of a touch (hereinafter referred to as a touch). • The state in which a finger or stylus is touching the touch panel 70a (hereinafter referred to as touch persistence). • Operations involving moving a finger or stylus while touching the touch panel 70a (hereinafter referred to as touch movement). • Releasing the finger or stylus that is touching the touch panel 70a, i.e., the end of the touch (hereinafter referred to as touch stop). • The touch panel 70a is in a state where nothing is touching it (hereinafter referred to as "not touched").

[0042] When a touch is detected, touch persistence is also detected. After a touch, touch persistence is typically detected continuously unless the touch is detected to have stopped. Furthermore, touch persistence is detected continuously when touch movement is detected. Even if touch persistence is detected, touch movement is not detected as long as the touch location does not move. The state changes to "not touched" after all fingers and styluses that have touched the touch panel have detected to have stopped.

[0043] These operations and states, as well as the position coordinates of the touch on the touch panel 70a by a finger or stylus, are notified to the system control unit 50 via the internal bus. The system control unit 50 then determines what operation (touch operation) was performed on the touch panel 70a based on the notified information. Regarding touch movement, the direction of movement of the finger or stylus on the touch panel 70a can be determined based on changes in the position coordinates for each vertical and horizontal component. When a touch movement of a predetermined distance or greater is detected, it is determined that a swipe operation has been performed. A flick is an operation in which a finger is quickly moved a certain distance while touching the touch panel 70a, and then released from the touch panel 70a. In other words, a flick is an operation in which a finger quickly swipes across the touch panel 70a to lightly brush the touch panel 70a. When a touch movement of a predetermined speed or higher and a predetermined distance or greater is detected, and then a touch stop is detected, it can be determined that a flick has been performed (it can be determined that a flick was performed after a swipe operation). Furthermore, a touch operation where multiple locations (e.g., two points) are touched (multi-touch) and the touch locations are close to each other is called a pinch-in, and a touch operation where the touch locations are far apart is called a pinch-out. Pinching and pinching are collectively referred to as a pinch operation (or simply pinch). The touch panel 70a can be any type of touch panel from various types, such as resistive film type, capacitive type, surface acoustic wave type, infrared light type, electromagnetic induction type, image recognition type, and optical sensor type. Although there are types that include those where a touch is detected due to contact with the touch panel and those where a touch is detected due to a finger or pen approaching the touch panel, any of these types can be used.

[0044] The digital camera 100 can perform time-lapse photography, motion time-lapse photography, and their simulations. In both time-lapse and motion time-lapse photography, still images are captured multiple times at constant time intervals, and a moving image is generated by combining the multiple acquired still images. Generating a moving image is not mandatory. However, time-lapse photography is performed from a fixed perspective, while motion time-lapse photography is performed while the perspective changes.

[0045] The digital camera 100 can perform time-lapse photography, motion time-lapse photography, and their simulations in the same shooting mode to improve operability. Time-lapse photography and motion time-lapse photography are performed in response to the same user operation. Furthermore, time-lapse photography simulation and motion time-lapse photography simulation are performed in response to the same user operation.

[0046] Here, the key considerations for time-lapse photography differ from those for motion time-lapse photography. Exposure is important in time-lapse photography, and changes in perspective are also important in motion time-lapse photography.

[0047] Therefore, in this embodiment, when no trajectory for the viewpoint change applied during the main camera is set (when time-lapse photography is used as the main camera), a simulation of pre-shooting using the exposure parameters to be applied during the main camera is performed. Then, when a trajectory is set (when motion time-lapse photography is used as the main camera), a simulation of changing the viewpoint according to the trajectory is performed. In this way, simulations related to the main camera can be performed efficiently (appropriately).

[0048] Figure 3 This is a flowchart of the video mode processing performed by the digital camera 100. Figure 3 The camera mode processing shown is achieved by the system control unit 50 loading a program stored in the non-volatile memory 56 into the system memory 52 and executing the program. For example, when the camera mode is set, the system control unit 50 begins... Figure 3 Camera mode processing.

[0049] In S301, the system control unit 50 initializes flags or control variables, etc.

[0050] In S302, the system control unit 50 displays the camera mode screen on the display unit 28. For example, the system control unit 50 displays a live view image on the display unit 28, and displays camera information such as camera settings (camera parameters) superimposed on the live view image. Figure 8A This is a schematic diagram illustrating an example of a video recording mode screen. Camera information 802 and operation guidance 803 are superimposed on the live view image 801. Operation guidance 803 indicates user operations specific to time-lapse or motion time-lapse video recording.

[0051] In S303, the system control unit 50 determines whether a user operation (track setting start operation) has been performed to instruct the operation unit 70 to begin track setting. If a track setting start operation has been performed, the process proceeds to S304. Otherwise, the process proceeds to S305.

[0052] In S304, the system control unit 50 performs trajectory setting processing. (See later...) Figure 4 Describe the details of trajectory setting and processing.

[0053] In S305, the system control unit 50 determines whether a user operation (exposure parameter change operation) has been performed to instruct the operation unit 70 to change the exposure parameters. If an exposure parameter change operation has been performed, the process proceeds to S306. Otherwise, the process proceeds to S307.

[0054] In S306, the system control unit 50 changes the exposure parameters based on the exposure parameter change operation. Exposure parameters may include, for example, aperture value, shutter speed, ISO sensitivity, or exposure correction parameters.

[0055] In S307, the system control unit 50 determines whether a user operation (delay / motion delay parameter change operation) has been performed, instructing the operation unit 70 to change a setting value (parameter) specific to time-lapse or motion time-lapse. If a delay / motion delay parameter change operation has been performed, the process proceeds to S308. Otherwise, the process proceeds to S309.

[0056] In S308, the system control unit 50 changes parameters specific to time-lapse or motion time-lapse photography based on a delay / motion delay parameter change operation. Specific parameters may include the shooting interval, number of shots, shooting time, shooting start time, the presence or absence of autofocus processing for each still image capture, the presence or absence of autoexposure processing for each still image capture, the image (recording format of still or moving images), or the presence or absence of highlight compositing processing. The shooting interval is the time interval between still image captures, and the number of shots is the number of still image captures. The shooting time is the total time used for performing time-lapse or motion time-lapse photography, and the shooting start time is the start time of the time-lapse or motion time-lapse photography (first still image capture).

[0057] In S309, the system control unit 50 determines whether a user operation (simulation start operation) has been performed to instruct the operation unit 70 to start the simulation. If a simulation start operation has been performed, the process proceeds to S310. Otherwise, the process proceeds to S311.

[0058] In S310, the system control unit 50 performs simulation processing. (See later...) Figure 5 Describe the details of the simulation process.

[0059] In S311, the system control unit 50 determines whether a user operation (camera start / stop operation) has been performed to instruct the operation unit 70 to start or stop the main camera. If a camera start / stop operation has been performed, the process proceeds to S312. Otherwise, the process proceeds to S315.

[0060] In S312, the system control unit 50 determines whether one or more viewpoint information is included in the trajectory queue (whether a trajectory for viewpoint change has been set). Viewpoint information is information representing the viewpoint, and the trajectory queue represents the trajectory for viewpoint change by representing one or more viewpoint information in a time series. When one or more viewpoint information is included in the trajectory queue (the trajectory has been set), the process proceeds to S314. Otherwise, the process proceeds to S313.

[0061] In S313, the system control unit 50 starts or stops time-delay recording. When time-delay recording is not in progress, it starts in response to the recording start / stop operation, and when time-delay recording is in progress, it stops in response to the recording start / stop operation.

[0062] In S314, the system control unit 50 starts or stops motion time-lapse photography. When motion time-lapse photography is not in progress, it starts in response to a start / stop operation; when motion time-lapse photography is in progress, it stops in response to a start / stop operation.

[0063] In step S315, the system control unit 50 determines whether other user operations have been performed on the operation unit 70. If other user operations have been performed, the process proceeds to step S316. Otherwise, the process proceeds to step S317.

[0064] In S316, the system control unit 50 performs processing corresponding to other user operations. For example, the system control unit 50 changes the screen displayed on the display unit 28 from the camera mode screen to the menu screen.

[0065] In S317, the system control unit 50 determines whether a user operation (end operation) has been performed to instruct the operation unit 70 to end the video recording mode processing. If an end operation has been performed, the video recording mode processing ends. Otherwise, processing proceeds to S303. The end operation is a user operation used to instruct switching to another operating mode (such as playback mode) or to instruct the digital camera 100 to be turned off, etc.

[0066] Figure 4 Is Figure 3 The flowchart shows the trajectory setting process performed in S304.

[0067] In S401, the system control unit 50 initializes flags or control variables, etc. At this time, a GUI (such as icons) indicating that the trajectory setting process is in progress can be displayed on the display unit 28.

[0068] In S402, the system control unit 50 determines whether a user operation (viewpoint change operation) has been performed to instruct the operation unit 70 to change the viewing angle. If a viewpoint change operation has been performed, the process proceeds to S403. Otherwise, the process proceeds to S404.

[0069] In S403, the system control unit 50 changes the viewing angle according to the viewing angle change operation. The viewing angle change operation can be a user operation on the joystick 74 as in the case of a typical gimbal, or it can be a user operation on other operating components.

[0070] In S404, the system control unit 50 determines whether a user operation (track addition operation) has been performed to instruct the operation unit 70 to add viewpoint information to the track queue. If a track addition operation has been performed, the process proceeds to S405. Otherwise, the process proceeds to S406.

[0071] In S405, the system control unit 50 adds view information representing the current viewpoint to the trajectory queue. The view information is added to the trajectory queue based on a first-in, first-out (FIFO) rule. Therefore, when multiple view information pieces are included in the trajectory queue, they are arranged sequentially from the view information added to the trajectory queue earlier. View information can also be added to the trajectory queue based on other rules.

[0072] In S406, the system control unit 50 determines whether a user operation (track deletion operation) has been performed to instruct the operation unit 70 to delete viewpoint information from the track queue. If a track deletion operation has been performed, the process proceeds to S407. Otherwise, the process proceeds to S408.

[0073] In S407, the system control unit 50 removes viewpoint information from the trajectory queue. Viewpoint information is removed from the trajectory queue based on a Last-In-First-Out (LIFO) rule. Therefore, when multiple viewpoint information entries are included in the trajectory queue, in response to the trajectory deletion operation, the viewpoint information most recently added to the trajectory queue is deleted. Viewpoint information can also be removed from the trajectory queue based on other rules.

[0074] In S408, the system control unit 50 determines whether other user operations have been performed on the operation unit 70. If other user operations have been performed, the process proceeds to S409. Otherwise, the process proceeds to S410.

[0075] In S409, the system control unit 50 performs processing corresponding to other user operations. For example, the system control unit 50 selects any viewpoint information included in the trajectory queue and controls the posture of the camera unit 110 to a posture corresponding to the viewpoint information.

[0076] In S410, the system control unit 50 determines whether a user operation (end operation) has been performed to instruct the operation unit 70 to end the trajectory setting process. If an end operation has been performed, the trajectory setting process ends. Otherwise, the process proceeds to S402.

[0077] Figure 8DThis is a schematic diagram illustrating an example of a screen during trajectory setting processing. A thumbnail image 810 representing viewpoint information included in the current trajectory queue is overlaid on the live view image 801. When the trajectory queue includes multiple viewpoint information, the multiple thumbnail images 810 corresponding to the multiple viewpoint information are arranged according to the order in which the multiple viewpoint information is arranged in the trajectory queue. Note that during the timing of S401, the state of the trajectory queue can be reset to a state that does not include viewpoint information, or it can be a state that has ended with the previous trajectory setting process. Instead of the thumbnail image 810, icons such as numbers corresponding to the positions of viewpoint information in the trajectory queue can be displayed. Any information can be displayed, as long as that information represents the set trajectory.

[0078] Figure 5 Is Figure 3 The flowchart shows the simulation process performed in S310.

[0079] In S501, the system control unit 50 initializes flags or control variables, etc. At this time, a GUI (such as an icon) indicating that the simulation process is in progress can be displayed on the display unit 28.

[0080] In S502, the system control unit 50 determines whether one or more viewpoint information is included in the trajectory queue (whether the trajectory for viewpoint change is set). When one or more viewpoint information is included in the trajectory queue (the trajectory is set), the process proceeds to S504. Otherwise, the process proceeds to S503.

[0081] In S503, the system control unit 50 performs pre-capture using the exposure parameters to be applied during the main capture. For example, using... Figure 3 The exposure parameters are set in S306, etc. When the automatic exposure processing for capturing each still image is enabled in S308, etc., the system control unit 50 performs automatic exposure processing in S503. In this embodiment, it is assumed that a pre-capture of still images is performed. The system control unit 50 records the captured images (still images in this embodiment) obtained through the pre-capture in a storage medium such as an SD card. In S503, the user (by zooming in, etc.) carefully reviews the still images recorded on the storage medium. The processing in S503 is performed when the main camera is a time-lapse camera. Since the exposure time for capturing each still image in a time-lapse camera is usually long, it is important to carefully review the still images obtained by the exposure parameters to be applied during the main camera before the time-lapse camera. Although an example of pre-capture of still images has been described, pre-capture of short moving images (short-time moving images) can also be performed.

[0082] Figure 8CAn example of the display screen in S503 is shown. In S503, the system control unit 50 records the captured image 804 obtained through pre-capture photography in a storage medium, and then displays the captured image 804 on the display unit 28 for a predetermined time. Note that the display time of the captured image 804 is not limited, and the captured image 804 can be displayed, not displayed, zoomed in, or zoomed out according to user operation.

[0083] In S504, the system control unit 50 changes the viewing angle according to the trajectory queue (set trajectory). The exposure of the displayed live view image is not particularly limited at this time, but it is preferable that the live view image has high visibility and that the change in viewing angle is easily confirmed. Therefore, in this embodiment, it is assumed that the system control unit 50 performs pre-capture processing by automatic exposure processing without using the exposure parameters to be applied during the main capture, in order to obtain a live view image (captured image) with appropriate exposure. In S504, the captured image is not recorded in the storage medium to avoid straining the storage medium's capacity. The processing of S504 is performed when the main capture is a motion time-lapse video. Because the viewing angle changes during the motion time-lapse video, it is important to confirm the change in viewing angle before the motion time-lapse video begins. Although an example of not recording the captured image in the storage medium has been described in S504, whether or not the captured image is recorded in the storage unit in S504 can be set.

[0084] Figure 8E and Figure 8F An example of the display screen in S504 is shown. A progress bar 811, representing the progress of the viewpoint change (simulated time passage), is superimposed on the live view image 805. The progress bar 811 is displayed at the bottom of the screen. The viewpoint changes as time passes. Figure 8F It shows Figure 8E The subsequent state.

[0085] As described above, according to this embodiment, when no trajectory for the viewpoint change applied during the main camera is set (when time-lapse photography is used as the main camera), a simulation of pre-shooting using the exposure parameters to be applied during the main camera is performed. Then, when a trajectory is set (when motion time-lapse photography is used as the main camera), a simulation of changing the viewpoint according to the trajectory is performed. In this way, simulations related to the main camera can be performed efficiently (appropriately).

[0086] Note that the various types of control described above can be performed by a single piece of hardware (e.g., a processor or circuitry) or by processing in other ways. Processing can be distributed among multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits), thereby performing control over the entire device.

[0087] Furthermore, the processors mentioned above are processors in a broad sense, encompassing both general-purpose and special-purpose processors. Examples of general-purpose processors include central processing units (CPUs), microprocessor units (MPUs), and digital signal processors (DSPs). Examples of special-purpose processors include graphics processing units (GPUs), application-specific integrated circuits (ASICs), and programmable logic devices (PLDs). Examples of PLDs include field-programmable gate arrays (FPGAs) and complex programmable logic devices (CPLDs).

[0088] The above embodiments (including variations) are merely examples. Any configurations obtained by appropriately modifying or changing some configurations of the embodiments within the scope of this disclosure are also included in this disclosure. This disclosure also includes other configurations obtained by appropriately combining various features of the embodiments.

[0089] For example, in Figure 3 In the S310, it is possible to perform Figure 6 The simulation process is shown below. Here, it is assumed that the simulation start operation is pressing the shutter button 61. Note that the operating component used for the simulation start operation is not limited to the shutter button 61, but can be other operating components capable of performing two-stage operations such as half-pressing and full-pressing.

[0090] In S601, the system control unit 50 initializes flags or control variables, etc. At this time, a GUI (such as an icon) indicating that the simulation process is in progress can be displayed on the display unit 28.

[0091] In S602, the system control unit 50 determines whether one or more viewpoint information is included in the trajectory queue (whether the trajectory for viewpoint change is set). If one or more viewpoint information is included in the trajectory queue (the trajectory is set), the process proceeds to S605. Otherwise, the process proceeds to S603.

[0092] In S603, the system control unit 50 performs at least one of autofocus processing, auto exposure processing, and auto white balance processing in response to the half-pressing of the shutter button 61 (pressing of the first shutter switch 62). Then, the system control unit 50 displays information related to this processing on the display unit 28.

[0093] Figure 8B An example of the display screen in S603 is shown. Camera information 802 and AF frame 809 are superimposed on the live view image 801. AF frame 809 indicates the area of ​​the subject that is focused through autofocus processing. Camera information 802 includes exposure parameters such as F-number (aperture value).

[0094] In S604, in response to the full pressing of the shutter button 61 (pressing of the second shutter switch 64), the system control unit 50 performs pre-capture with the exposure parameters to be applied during the main capture. Then, the system control unit 50 records the captured image obtained through the pre-capture in the storage medium and displays the captured image on the display unit 28 for a predetermined time.

[0095] In S605, the system control unit 50, in response to the half-pressing of the shutter button 61 (pressing of the first shutter switch 62), displays information indicating the set trajectory (trajectory information) on the display unit 28. For example, as Figure 8D As shown, a thumbnail image 810 representing viewpoint information included in the current trajectory queue is overlaid on the live view image 801. Instead of the thumbnail image 810, icons such as numbers corresponding to the positions of viewpoint information in the trajectory queue can be displayed. Any information can be displayed, as long as it represents the set trajectory.

[0096] In S606, the system control unit 50 changes the viewing angle according to the trajectory queue (set trajectory) in response to the full pressing of the shutter button 61 (pressing of the second shutter switch 64). At this time, the system control unit 50 performs automatic exposure processing to prepare for shooting without using the exposure parameters to be applied during the main shooting, so as to obtain a live view image (captured image) with proper exposure.

[0097] replace Figure 3 Camera mode processing can be performed Figure 7 Camera mode processing. Simulated start operation and camera start / stop operation are in... Figure 3 They are different in China, but in Figure 7 In this context, we assume that these user actions are identical.

[0098] S701 to S708 and Figure 3 S301 to S308 are the same.

[0099] In S709, the system control unit 50 determines whether a user operation (process switching operation) is performed to instruct the operation unit 70 to switch the process to be performed in response to the camera start / stop operation. If a process switching operation is performed, the process proceeds to S710. Otherwise, the process proceeds to S711.

[0100] In S710, the system control unit 50 performs the processing required to switch between analog and main camera start / stop operations in response to camera start / stop operations.

[0101] In S711, the system control unit 50 determines whether a camera start / stop operation has been performed on the operation unit 70. If a camera start / stop operation has been performed, the process proceeds to S712. Otherwise, the process proceeds to S717.

[0102] In S712, the system control unit 50 determines whether the start / end of the main camera is set as a process to be performed in response to the camera start / stop operation. If the start / end of the main camera is set, the process proceeds to S714. Otherwise (when simulation is set), the process proceeds to S713.

[0103] In S713, the system control unit 50 performs... Figure 5 or Figure 6 Simulation processing.

[0104] In S714, the system control unit 50 determines whether one or more viewpoint information is included in the trajectory queue (whether the trajectory for viewpoint change is set). If one or more viewpoint information is included in the trajectory queue (the trajectory is set), the process proceeds to S716. Otherwise, the process proceeds to S715.

[0105] In S715, the system control unit 50 starts or stops time-lapse photography. When no time-lapse photography is being performed, it starts in response to a start / stop operation; when time-lapse photography is being performed, it stops in response to a start / stop operation.

[0106] In S716, the system control unit 50 starts or stops motion time-lapse photography. When motion time-lapse photography is not in progress, it starts in response to a start / stop operation; when motion time-lapse photography is in progress, it stops in response to a start / stop operation.

[0107] S717 to S719 and Figure 3 S315 to S317 are the same.

[0108] When no viewpoint change trajectory is set, the main camera recording is not limited to time-lapse photography. When no viewpoint change trajectory is set, other camera recordings can be performed using the set exposure parameters. For example, still image capture can be performed once. When a trajectory is set, the main camera recording is not limited to motion time-lapse photography. When a trajectory is set, other camera recordings can be performed while changing the viewpoint according to the set trajectory. For example, a panoramic image can be generated by taking multiple still image captures while changing the viewpoint and then combining the multiple still image captures.

[0109] Although examples have been described of digital cameras equipped with a gimbal mechanism (gimbal camera integrating a camera and a gimbal) changing the viewing angle by driving a drive unit for changing the posture of the camera unit, this disclosure is not limited thereto. For example, this disclosure can be applied to wide-range cameras with a wide shooting range (such as a 360° camera capable of shooting in all directions), and the camera can change the viewing angle by changing the range to be used in the shooting range.

[0110] This disclosure is not limited to pan-tilt cameras or wide-range cameras, but can also be applied to cameras mounted on pan-tilt units or cameras. In such a configuration, communication with the pan-tilt unit or camera can be established to operate the pan-tilt unit or camera for motion time-lapse. This disclosure can be applied to pan-tilt units or cameras. Additionally, this disclosure can be applied to controllers such as smartphones capable of communicating with cameras, pan-tilt units, or cameras.

[0111] While examples of altering the simulation or main camera based on whether a perspective-changing trajectory is set have been described, other modifications are possible. For instance, without a trajectory set, at least one of the number of shots and the shooting interval can be adjusted. Figure 3 The values ​​set in S308, etc., are changed to values ​​corresponding to time-lapse photography. When a trajectory is set, at least one of the recording time and recording interval can be changed from the values ​​set in S308, etc., to values ​​corresponding to motion time-lapse photography. In this way, various parameters can be changed to values ​​suitable for the main camera to be performed, depending on whether a trajectory for changing the viewpoint is set.

[0112] According to this disclosure, simulations related to the main camera can be performed efficiently. Other embodiments

[0113] Embodiments of the present invention can also be implemented by providing software (including computer program products of computer programs) that performs the functions of the above embodiments to a system or device via a network or various storage media, and the computer (central processing unit (CPU) or microprocessor unit (MPU) of the system or device) reads and executes the computer program.

[0114] While this disclosure has been described with reference to embodiments, it should be understood that this disclosure is not limited to the disclosed embodiments. The scope of the appended claims should be given the broadest interpretation to cover all such modifications and equivalent structures and functions.

Claims

1. An electronic device comprising a control unit configured to control, in response to a user operation, to perform an analog operation related to a main camera operation by a camera device, wherein, The control unit performs the following control in response to a first user operation: Without setting the trajectory of the camera's viewing angle change during the main camera recording, a first simulation of pre-shooting using the exposure parameters to be applied during the main camera recording is performed, and With the trajectory set, a second simulation is performed to change the viewing angle of the camera device according to the trajectory.

2. The electronic device according to claim 1, further comprising a first setting unit configured to set the trajectory.

3. The electronic device according to claim 1 or 2, further comprising a second setting unit configured to set the exposure parameters.

4. The electronic device according to claim 1 or 2, wherein, In the second simulation, the pre-capture video is taken to obtain a captured image with proper exposure.

5. The electronic device according to claim 1 or 2, wherein, In the first simulation, the captured images are recorded in the storage unit, and In the second simulation, the captured images are not recorded in the storage unit.

6. The electronic device according to claim 1 or 2, wherein, In the first simulation, the captured images are recorded in the storage unit, and Whether to record the captured images in the storage unit during the second simulation is configurable.

7. The electronic device according to claim 1 or 2, wherein, In the first simulation, a preliminary still image is captured.

8. The electronic device according to claim 1 or 2, wherein, In the first simulation, a short motion image is pre-captured.

9. The electronic device according to claim 1 or 2, wherein, The first user operation is a user operation with a first operational quantity performed on the operating component. In response to a second user operation, which is a second operation amount smaller than the first operation amount, performed on the operating member, the control unit performs the following control: Without setting the aforementioned trajectory, perform at least one of autofocus processing, auto exposure processing, and auto white balance processing, and When the trajectory is set, information representing the trajectory is displayed on the display unit.

10. The electronic device according to claim 1 or 2, wherein, The control unit performs the following control functions in response to a third user's operation: Without setting the trajectory, and without changing the viewing angle of the camera device, the main camera performs video recording using the exposure parameters. With the trajectory set, the main camera performs video recording while changing the viewing angle of the camera device according to the trajectory.

11. The electronic device of claim 10, further comprising a switching unit configured to switch the processing performed in response to the first user operation between the analog and the main camera. in, The first user operation and the third user operation are the same user operation.

12. The electronic device according to claim 10, wherein, The control unit performs the following control in response to the third user's operation: Without setting the trajectory, time-lapse photography is used as the main camera, and With the trajectory set, motion time-lapse photography is used as the main camera.

13. The electronic device according to claim 12, wherein, The control unit: Without setting the trajectory, the value corresponding to the time-lapse video is set to at least one of the number of still image captures and the time interval during which the main camera takes pictures, and With the trajectory set, the value corresponding to the motion time-lapse video is set to at least one of the time for performing the main camera and the time interval for capturing the still image during the main camera.

14. The electronic device according to claim 10, wherein, The control unit performs the following control in response to the third user's operation: Without setting the trajectory, a still image is captured as the main camera, and With the trajectory set, the camera takes multiple still images as the main camera while changing the viewing angle of the camera device, and the multiple still images obtained by taking multiple still images are combined to generate a panoramic image.

15. The electronic device according to claim 1 or 2, wherein, The control unit controls the camera to change its viewing angle by driving a drive unit that alters the camera's posture.

16. The electronic device according to claim 1 or 2, wherein, The control unit controls the camera to change the viewing angle of the camera device by changing the range to be used within the camera's field of view.

17. A method for controlling an electronic device, the method comprising: The receiving step is used to receive user operations; as well as Control steps are used to control the execution of a simulation related to the main camera operation performed by the camera device in response to the user operation, wherein, In the control step, the following control is performed in response to the user operation: Without setting the trajectory of the camera's viewing angle change during the main camera recording, a first simulation of pre-shooting using the exposure parameters to be applied during the main camera recording is performed, and With the trajectory set, a second simulation is performed to change the viewing angle of the camera device according to the trajectory.

18. A computer program product comprising a program that causes a computer to perform the steps of the control method according to claim 17.

19. A computer-readable storage medium storing a program that causes a computer to perform the steps of the control method according to claim 17.

Images