Display control device and control method thereof, program, and recording medium

JP2023077994A5Active Publication Date: 2024-11-22CANON KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2021191537
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-11-25
Publication Date
2024-11-22
Estimated Expiration
2041-11-25

AI Technical Summary

Technical Problem

Existing technologies do not allow users to preview where watermarks will be inserted in moving images, leading to potential overlap with shooting settings and reduced visibility.

Method used

A system that enables users to set and preview display elements to be recorded with a moving image before recording, allowing control over the superimposition of these elements on the moving image during capture.

Benefits of technology

Enables users to grasp display elements to be recorded with the moving image beforehand, reducing the risk of visibility deterioration and re-shooting due to unwanted superimposed elements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

To allow a user to grasp a display element recorded together with a moving image before recording the moving image, and reduce a deterioration in visibility of the moving image.SOLUTION: A display control device includes setting means for setting whether to record both a moving image captured by imaging means and a first display element as an image file, and control means for performing control to superimpose and display the first display element on the moving image when the setting means sets the first display element to be recorded as the image file together with the moving image, and not display the first display element superimposed on the moving image when the setting by the setting means is completed.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a display control device, a control method therefor, a program, and a recording medium. [Background technology]

[0002] In recent years, techniques have become known for inserting watermarks into various digital content such as video files, still images, etc. Patent Document 1 discloses a technique for determining the type of content after acquiring the content and inserting a watermark according to the type of content. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-96778 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in Patent Document 1, the user can only know where the watermark will be inserted after the video has been recorded (saved). On the other hand, if a watermark is displayed superimposed on the video before or during recording, it may overlap with other display elements required during shooting, such as shooting settings, which can make the video less visible.

[0005] SUMMARY OF THE INVENTION It is therefore an object of the present invention to enable a user to grasp display elements to be recorded together with a moving image before the moving image is recorded, and to reduce the deterioration of visibility of the moving image. [Means for solving the problem]

[0006] In order to solve the above problems, the present invention provides a setting unit for setting whether to record both a moving image captured by an imaging unit and a first display element as an image file; When the setting means sets the first display element to be recorded together with the moving image as the image file, the first display element is displayed superimposed on the moving image; The display device further includes a control means for controlling the display so that the first display element is not superimposed on the moving image when the setting by the setting means is completed. [Effects of the Invention]

[0007] The user can grasp the display elements to be recorded together with the moving image before the moving image is recorded, and the deterioration of the visibility of the moving image can be reduced. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is an external view of a digital camera 100. [Figure 2] FIG. 1 is a block diagram showing the configuration of a digital camera 100. [Figure 3] FIG. 2 is an explanatory diagram illustrating an example of a display screen according to an embodiment of the present invention. [Figure 4] FIG. 4 is a flowchart illustrating the operation of the digital video camera according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[0010] FIGS. 1(a) and 1(b) show external views of a digital camera 100 as an example of a device to which the present invention can be applied. FIG. 1(a) is a front perspective view of the digital camera 100, and FIG. 1(b) is a rear perspective view of the digital camera 100. In FIG. 1, a display unit 28 is a display unit provided on the back of the camera that displays images and various information. While FIG. 1 shows a display unit provided on the back of the camera, this is not limiting. For example, the display unit may be an external monitor such as an LCD panel or an organic EL panel equipped with an external recording device capable of recording images as files. Furthermore, both the display unit 28 provided on the back of the camera and a display unit (not shown) serving as an external monitor may be connected to the digital camera 100, and a video signal may be supplied to both or only one of the display units.

[0011] The touch panel 70a is a touch-operable operating member, and can detect touch operations on the display surface (operation surface) of the display unit 28. The outside-finder display unit 43 is a display unit provided on the top surface of the camera, and displays various settings of the camera, including the shutter speed and aperture.

[0012] The shutter button 61 is an operation unit for issuing shooting instructions. In still image shooting mode, it is used to issue instructions to prepare for shooting a still image and to issue a shooting instruction, and in video shooting mode, it is used to issue instructions to start and stop video shooting (recording). The mode selector switch 60 is an operation unit for switching between various modes. The terminal cover 40 is a cover that protects a connector (not shown) that connects the digital camera 100 to a connection cable for an external device. The main electronic dial 71 is a rotary operation unit included in the operation unit 70. By turning this main electronic dial 71, settings such as shutter speed and aperture can be changed. The power switch 72 is an operation unit for turning the power of the digital camera 100 on and off. The sub electronic dial 73 is a rotary operation unit included in the operation unit 70. It is used to move the selection frame and advance images. The cross key 74 is an operation unit included in the operation unit 70 with a push button that can be pressed in four directions, and operations can be performed depending on the direction the cross key 74 is pressed. The SET button 75 is included in the operation unit 70 and is a push button that is mainly used to confirm selections. The video button 77 is used to start and stop video shooting (recording). By pressing the shutter button 61 after pressing the AE lock button 78, you can shoot with the AF position fixed, or shoot even when AF is not possible. The playback button 79 is included in the operation unit 70 and is an operation button for switching between shooting mode and playback mode. Pressing the playback button 79 in shooting mode switches to playback mode, and the most recent image recorded on the recording medium 200 can be displayed on the display unit 28. The assign button 95 is included in the operation unit 70 and is a button to which other functions can be assigned. In its initial state, it functions as a button for displaying a status screen, and other functions can be assigned, such as changing settings or status related to video shooting and playback, or starting video shooting (recording). The function of displaying a status screen can also be assigned to an assign button other than the assign button 95.

[0013] The status screen is a screen made up of multiple pages that displays the settings or status related to video recording and playback, the internal status of the digital camera, and the like.

[0014] The communication terminal 10 is a communication terminal through which the digital camera 100 communicates with a lens unit 150 (detachable), which will be described later. The eyepiece 16 is the eyepiece of an eyepiece finder (a peer-type finder), and the user can view an image displayed on an EVF (Electronic View Finder) 29 in the finder display unit through the eyepiece 16. The lid 202 is a lid for a slot that stores a recording medium 200 and a battery. The grip 90 is a holding section shaped to be easily held in the right hand when the user holds the digital camera 100. When the digital camera is held by gripping the grip 90 with the little finger, ring finger, and middle finger of the right hand, the shutter button 61 and main electronic dial 71 are positioned so that they can be operated with the index finger of the right hand. In the same state, the sub electronic dial 73 is positioned so that it can be operated with the thumb of the right hand.

[0015] The intake vent 98 and exhaust vent 99 are air passages for cooling the main body, and when the fan 92 in FIG. 2 rotates, air flows from the intake vent 98 to the exhaust vent 99, making it possible to release heat from the main body. The main body is also equipped with a temperature sensor 93, which can measure the temperature of a specific location on the main body. Depending on the measured temperature, the fan 92 is stopped or its rotation speed is changed. As will be described later, temperature status information is displayed on the screen based on the main body exterior / internal temperatures obtained from the temperature sensor 93. Note that there may be multiple temperature sensors 93 and fans 92.

[0016] FIG. 2 is a block diagram showing an example of the configuration of a digital camera 100 according to this embodiment. In FIG. 2, lens unit 150 is a lens unit equipped with an interchangeable photographic lens. Lens 103 is usually composed of multiple lenses, but here, for simplicity, only a single lens is shown. Communication terminal 6 is a communication terminal that enables lens unit 150 to communicate with digital camera 100. Lens unit 150 communicates with system control unit 50 via communication terminal 6 and the aforementioned communication terminal 10, and controls aperture 1 via aperture drive circuit 2 using an internal lens system control circuit 4. Thereafter, lens 103 is displaced via AF drive circuit 3 to adjust the focus.

[0017] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50.

[0018] The imaging unit 22 is an imaging element that converts an optical image into an electrical signal and is composed of a CCD, CMOS element, etc. The A / D converter 23 is used to convert an analog signal output from the imaging unit 22 into a digital signal.

[0019] The image processing unit 24 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on data from the A / D converter 23 or data from the memory control unit 15 (described later). The image processing unit 24 also performs predetermined arithmetic processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the arithmetic results obtained by the image processing unit 24. This results in TTL (through-the-lens) AF (autofocus) processing, AE (autoexposure) processing, and EF (flash pre-flash) processing. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL AWB (auto white balance) processing based on the arithmetic results obtained.

[0020] The memory control unit 15 controls data transmission and reception between the A / D converter 23, the image processing unit 24, and the memory 32. The output data from the A / D converter 23 is written into the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15.

[0021] The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as image data to be displayed on the display unit 28 and the EVF 29. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio.

[0022] The memory 32 also serves as a memory (video memory) for displaying images. The display image data written to the memory 32 is displayed on the display unit 28 and the EVF 29 via the memory control unit 15. The display unit 28 and the EVF 29 perform display on a display device such as an LCD or an organic EL display in accordance with a signal from the memory control unit 15. A live view display (LV display) can be performed by sequentially transferring and displaying data that has been A / D converted by the A / D converter 23 and stored in the memory 32 to the display unit 28 or the EVF 29. Hereinafter, an image displayed in live view will be referred to as a live view image (LV image).

[0023] Compression unit 26 generates moving image data by compressing the temporally continuous image data stored in memory 32 in a format such as MPEG. The generated moving image data is stored in memory 32 via memory control unit 15, and then multiplexed with audio also stored in memory 32 and written to recording medium 200 as a moving image file.

[0024] Various camera settings such as shutter speed and aperture are displayed on the outside viewfinder display 43 via an outside viewfinder display drive circuit 44 .

[0025] The nonvolatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. The nonvolatile memory 56 stores constants, programs, etc. for the operation of the system control unit 50. The programs referred to here are programs for executing various flowcharts described later in this embodiment.

[0026] The system control unit 50 is a control unit made up of at least one processor and / or at least one circuit, and controls the entire digital camera 100. Each process of this embodiment, which will be described later, is realized by executing a program stored in the nonvolatile memory 56. The system memory 52, for example, is a RAM, and stores constants and variables for the operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 19, the display unit 28, and the like. Display control here includes, for example, an on-screen display (OSD) displayed on the display unit 28.

[0027] The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

[0028] The mode selector switch 60, first shutter switch 62, second shutter switch 64, and operation unit 70 are operating means for inputting various operational instructions to the system control unit 50. The mode selector switch 60 switches the operation mode of the system control unit 50 to one of still image recording mode, video shooting mode, playback mode, etc. Modes included in the still image recording mode include auto shooting mode, auto scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode. There are also various scene modes and custom modes that provide shooting settings for specific shooting scenes. The mode selector switch 60 allows the user to directly switch to one of these modes. Alternatively, the user may first switch to a list screen of shooting modes using the mode selector switch 60, then select one of the displayed modes and switch using other operation members. Similarly, the video shooting mode may also include multiple modes.

[0029] The first shutter switch 62 is turned on and generates a first shutter switch signal SW1 when the shutter button 61 provided on the digital camera 100 is pressed halfway (a shooting preparation command) during operation. The first shutter switch signal SW1 starts operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing.

[0030] The second shutter switch 64 is turned on when the shutter button 61 is fully pressed (photographing instruction) and generates a second shutter switch signal SW2. The system control unit 50 starts a series of photographing processing operations, from reading out a signal from the imaging unit 22 to writing image data to the recording medium 200, in response to the second shutter switch signal SW2.

[0031] Each operating member of the operating unit 70 is assigned a function appropriate for each situation by selecting and operating various function icons displayed on the display unit 28, and acts as various function buttons. The function buttons include, for example, an end button, a back button, an image forward button, a jump button, a filter button, and an attribute change button. For example, when the menu button is pressed, a menu screen on the display unit 28 on which various settings can be made is displayed. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the four directional buttons (up, down, left, and right), and the SET button.

[0032] The operation unit 70 is a variety of operation members that serve as an input unit for accepting operations from the user. The operation unit 70 includes push buttons, rotary dials, touch sensors, and the like, and at least the following operation units: the shutter button 61, the main electronic dial 71, the power switch 72, the sub electronic dial 73, the cross key 74, the SET button 75, the movie button 77, the AE lock button 78, the playback button 79, and the assign button 95.

[0033] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between powered blocks, etc., and detects whether a battery is installed, the battery type, and the remaining battery charge. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage for the required period to each unit, including the recording medium 200. The power supply unit 30 is composed of primary batteries such as alkaline batteries or lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, or Li batteries, an AC adapter, etc.

[0034] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images and video data, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0035] The communication unit 54 is connected wirelessly or via a wired cable, and transmits and receives video signals and audio signals. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can also receive images and various other information from external devices.

[0036] The orientation detection unit 55 detects the orientation of the digital camera 100 with respect to the direction of gravity. Based on the orientation detected by the orientation detection unit 55, it is possible to determine whether an image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the orientation detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the orientation detection unit 55. The acceleration sensor or gyro sensor of the orientation detection unit 55 can also be used to detect movement of the digital camera 100 (panning, tilting, lifting, whether it is stationary, etc.).

[0037] The operation unit 70 includes a touch panel 70a capable of detecting contact with the display unit 28. The touch panel 70a and the display unit 28 can be configured as an integrated unit. For example, the touch panel 70a is configured so that its light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Input coordinates on the touch panel 70a correspond to display coordinates on the display screen of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that allows the user to directly operate the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states on the touch panel 70a: A finger or pen that has not been touching the touch panel 70a touches the touch panel 70a again, that is, the start of touching (hereinafter referred to as touch-down). The touch panel 70a is in a state where it is touched with a finger or a pen (hereinafter referred to as Touch-On). Touching the touch panel 70a with a finger or a pen and moving it (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 70a is released, that is, the touch ends (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 70a (hereinafter referred to as Touch-Off).

[0038] When touch down is detected, touch on is also detected at the same time. After touch down, touch on will usually continue to be detected unless touch up is detected. Touch move is also detected when touch on is detected. Even if touch on is detected, touch move will not be detected unless the touch position moves. Once it is detected that all fingers or pens that were touching have touched up, touch off occurs.

[0039] These operations and states, as well as the coordinates of the position where the finger or pen is touching the touch panel 70a, are notified to the system control unit 50 via the internal bus. The system control unit 50 determines what kind of touch operation was performed on the touch panel 70a based on the notified information. Regarding touch moves, the direction of movement of the finger or pen moving on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on changes in the position coordinates. If a touch move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel, moved quickly for a certain distance, and then released is called a flick. In other words, a flick is an operation in which the finger is quickly traced across the touch panel 70a as if flicking it. If a touch move of a predetermined distance or more at a predetermined speed or more is detected and a touch up is then detected, it is determined that a flick has been performed (it can be determined that a flick occurred following a slide operation).

[0040] Furthermore, a touch operation in which multiple points (for example, two points) are touched simultaneously and the touch positions are brought closer together is called a pinch in, and a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply pinch).

[0041] The touch panel 70a may be any of a variety of touch panel types, including resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor types. Depending on the type, there are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or pen to the touch panel, but either type is acceptable.

[0042] Temperature sensors 93a to 93d are temperature sensors that measure the temperature on / inside the housing of the digital camera 100 and are temperature acquisition means included in the temperature sensor 93. Temperature sensor 93a is a temperature sensor located near the imaging unit 22 and measures the temperature near the imaging unit 22 device. Temperature sensor 93b is a temperature sensor located around the connector protected by the terminal cover 40 and measures the temperature to calculate the temperature of the housing surface of the digital camera 100. This prevents the housing surface from reaching a certain high temperature (a temperature lower than the device protection temperature limit described below, specifically about 46°C) and the user from continuing to take pictures while holding the grip unit 90 at that temperature, thereby preventing the user from suffering low-temperature burns. Temperature sensor 93c is a temperature sensor located near the display unit 28 and measures the temperature near the display unit 28 device. Temperature sensor 93d is a temperature sensor located inside the lid 202 and measures the temperature near the recording medium 200 and the battery. If each device becomes too hot (for example, 80°C or higher), the device may stop functioning properly or the image quality may deteriorate, so temperature measurements are performed to prevent these problems. In this embodiment, four temperature sensors are placed near the four devices, but the number and locations of the sensors are not limited to this.

[0043] The operation of the digital camera 100 according to the embodiment of the present invention will be described below with reference to Fig. 3 and Fig. 4. Fig. 3 shows an example of a screen displayed on the display unit 28 of the digital camera 100. Fig. 4 is a display control flowchart for the digital camera 100. After explaining the display control using the flowchart in Fig. 4, an example of the display will be described using Fig. 3.

[0044] 4 is a flowchart of the control process that starts when digital camera 100 is started (powered on) and in video recording mode while in shooting standby mode. This control process is realized by system control unit 50 loading a program stored in nonvolatile memory 56 into system memory 52 and executing it.

[0045] In S401, the system control unit 50 determines whether or not the screen displayed on the display unit 28 is a composite recording setting screen. If the screen displayed on the display unit 28 is a composite recording setting screen, the process proceeds to S402; if not, the process proceeds to S407. Composite recording refers to combining display elements such as various information with a moving image to be recorded when the user starts video recording and then recording the combined image. Some users may want to combine and record character strings such as date, time, and time code (so-called timestamps) with the moving image to be recorded.

[0046] Furthermore, the timestamp is not limited to a timestamp, and a mark called a watermark, which is added to a video, may also be used. Specifically, the product name or manufacturer of the equipment used to shoot the video, or a character string that the user can register at their discretion to identify the user who shot the video for copyright notices, etc., can be synthesized into the video. Note that a timestamp is defined as something that includes all or at least one of the display elements: time code / date / time.

[0047] In S402, the system control unit 50 determines whether the currently selected setting item is "Off." If the setting item is "Off," the process proceeds to S403; if not, the process proceeds to S404. In this step, if the "Off" setting item is selected or the cursor is on it in the setting screen displayed on the display unit 28 in S401, the result of the determination in S402 is Yes. An example of the display at this time is shown in FIG. 3(a1).

[0048] In S403, the system control unit 50 does not display the display elements. That is, the system control unit 50 does not display the display elements superimposed on the LV image displayed on the display unit 28. An example of the display at this time is shown in Fig. 3(a1).

[0049] In S404, the system control unit 50 displays a preview of a display element corresponding to the setting item on the display unit 28. Since the determination in S402 is No, it is clear that the setting item selected on the setting screen is an item other than "Off." Therefore, the display element corresponding to the currently selected setting item is displayed superimposed on the LV image displayed on the display unit 28. Display examples at this time are shown in FIGS. 3(a2) to (a5).

[0050] In S405, the system control unit 50 determines whether or not an instruction to change the composition position has been received. If an instruction to change has been received, the process proceeds to S406; if not, the process proceeds to S419. The composition position refers to the position of a display element to be recorded together with a moving image. When recording a moving image, the user can arbitrarily set the position at which the display element will be composed and recorded. In this embodiment, for example, the position can be set to the top left, top right, bottom left, or bottom right within the imaging range of the moving image. Examples of the display screen display at this time are shown in FIGS. 3(b1) to 3(b4). For example, this is the composition position setting for display elements such as a watermark or date and time, which will be composed and recorded on the recorded moving image when the moving image is recorded and saved on the recording medium 200. Note that in this step, a method for changing the composition position has been described, but the size, inclination, and transparency may also be changed in a similar manner.

[0051] In S406, the system control unit 50 changes the combining position to the changed position instructed in S405.

[0052] As described using steps S401 to S406, in this embodiment, the display of display elements to be composited into a moving image and recorded can be confirmed only on the setting screen. In other words, even if a setting is made to perform composite recording, the user can only confirm which display elements will be composited into which position in the moving image during shooting standby or moving image recording when the moving image recording is stopped and playback is performed. Therefore, a preview of the display elements is displayed on the setting screen so that the user can reliably view them before starting moving image recording. This reduces the need for re-shooting due to recording failures caused by the display elements interfering with the recorded moving image because the user is unable to recognize the position at which the display elements will be composited.

[0053] In S407, the system control unit 50 determines whether or not an external display device is connected. If it is connected, the process proceeds to S408, and if not (i.e., if no external display device is connected), the process proceeds to S411. The external display device is connected via the communication unit 54. External display devices that can be connected at this time include, for example, HDMI (registered trademark) and SDI.

[0054] In S408, since the determination in S401 is No, the system control unit 50 refers to the nonvolatile memory 56 and determines whether the composite recording setting is "Off." If it is "Off," the process proceeds to S409; if not, the process proceeds to S410.

[0055] In S409, the system control unit 50 does not display the display elements on the internal display unit (display unit 28 in this embodiment), but displays the display elements on the display unit of the external display device. The determination of Yes in S407 indicates that an external display device is connected. The determination of Yes in S408 indicates that the composite recording setting is "off," but the display unit of the external display device often has a larger display area than the internal display unit (display unit 28). Therefore, only the internal display unit follows the composite recording setting, and for the external display unit, if a setting to perform composite recording is set, the display elements are superimposed on the LV image and displayed regardless of the setting. Note that if the display unit of the external display device is smaller than the internal display unit arranged in the digital camera 100, the display elements are not controlled to be superimposed on the LV image regardless of the composite recording setting.

[0056] In S410, the system control unit 50 does not display any display elements on either the internal or external display unit. Since it is determined Yes in S407 and No in S408, it is understood that an external display device is connected, but the composite recording setting is not "off." Therefore, no display elements are displayed on the display unit. At this time, the display elements described above are not displayed, but the LV image, shooting information, etc. are displayed.

[0057] In S411, since the determination in S407 is No, the system control unit 50 determines whether the composite recording setting is "Off" as in S408. If it is "Off", proceed to S417, and if not, proceed to S412.

[0058] In S412, the system control unit 50 controls the process to transition to S413 if the OSD output setting of the display device is "ON", and to transition to S418 if not.

[0059] In S413, the system control unit 50 determines whether an OSD is being output to the display device, and if so, the process proceeds to S414, and if not, the process proceeds to S418.

[0060] In S414, the system control unit 50 controls the process to transition to S415 if the frame display setting of the display device is "off," and transition to S418 if not. The frame display setting is a setting for changing the display area of ​​the captured image displayed on the display unit 28. When the frame display setting is "on," the captured image is displayed narrowly inside the display unit 28, and display elements such as the shooting settings are displayed in the margin area around the captured image.

[0061] In S415, the system control unit 50 determines whether the OSD output to the display unit 28 and the display element to be compositely recorded overlap, and if they overlap, the process proceeds to S416, and if not, the process proceeds to S418.

[0062] In S416, the system control unit 50 displays an icon indicating that composite recording is enabled. An example of this display is shown in FIG. 3(c2). When composite recording is enabled, a display like icon 310 in FIG. 3(c2) is displayed. By displaying this icon, the user can recognize that the display elements will be superimposed on the recorded video when video recording ends and playback is performed. If the display elements to be superimposed on the video and recorded are actually superimposed, the visibility of the LV image may be reduced, which may be annoying to the user. Therefore, the display area of ​​the LV image is made wider by displaying the icon. On the other hand, if the user does not recognize that the display elements will be superimposed and recorded, as described above, when recording is stopped and the video is played back, the display elements may be superimposed on the subject and superimposed. To reduce such inconvenience to the user, icon 310 is displayed.

[0063] In S417, the system control unit 50 does not display the display elements on the internal display unit (display unit 28).

[0064] In S418, the system control unit 50 displays the display elements on the internal display unit (display unit 28). This makes it possible to show the user the display elements to be compositely recorded while ensuring visibility on the shooting screen.

[0065] In S419, the system control unit 50 determines whether or not a command to start video recording has been received. If a command to start has been received, the process proceeds to S322; if not, the process proceeds to S323. A command to start video recording specifically refers to pressing the video button 76 or touching a touch icon (REC icon) that starts video recording and is displayed on the display unit 28. Furthermore, if the external output mode is set to ON, it is also possible to determine that a command to start video recording has been received by operating a video button or video icon provided on a device that can be remotely controlled, such as an external device.

[0066] In S420, the system control unit 50 starts recording processing of the moving image with or without compositing display elements, depending on the settings. The recording processing involves creating a moving image file on the recording medium 200 and recording the moving image captured by the imaging unit 22 on the recording medium 200 using the current settings. At this time, if the settings for composite recording are set to "composite recording," the display elements set for the moving image are composited and recorded. If the settings for composite recording are set to "not composite recording," only the moving image captured by the imaging unit 22 is recorded.

[0067] In S421, the system control unit 50 determines whether an instruction to stop video recording has been given. If an instruction to stop video recording has been given, the process proceeds to S422; if not, the process returns to S421. An instruction to stop video recording specifically refers to pressing the video button 76 or touching a touch icon that has the function of stopping video recording.

[0068] In S422, the system control unit 50 stops recording of the moving image. When recording stops, the system control unit 50 performs a closing process (such as adding attribute information) on the moving image file created on the recording medium 200 or an external device, and transitions to a shooting standby state.

[0069] In S423, the system control unit 50 determines whether the processing has ended. If the processing has ended, the control flowchart in FIG. 4 ends; if not, the process returns to S401. End of processing refers to, for example, turning off the power of the digital camera 100 or transitioning from video mode.

[0070] Although the instruction to stop video recording in S421 has been described as being given by pressing the video button 76 or touching the touch icon, video recording will also be stopped if there is a mode switching operation, pressing the play button 79 (an instruction to transition to playback mode processing), or operating the power switch 72. When there is a mode switching operation, pressing the play button 79, or operating the power switch 72, control processing is performed according to the respective operation.

[0071] An example of what is displayed on the display unit 28 will be described using Fig. 3. Fig. 3 (a1) to (a5) are display examples in a state where a composite recording setting screen is displayed. Fig. 3 (b1) to (b4) are display examples in a state where a setting screen for the display position of the composite recording is displayed. Fig. 3 (c1) to (c4) are display examples in a shooting standby state.

[0072] 3(a1) to (a5) are display examples in which the composite recording setting screen is displayed, and LV300 and setting screen 301 are displayed on the display unit 28. Note that Fig. 3(a1) to (a5) are display examples in which the composite position of the display element to be composite recorded, which will be described later, is set to "upper left."

[0073] Fig. 3(a1) is an example of a display displayed on the display unit 28 in S403 of Fig. 4. In Fig. 3(a1), the current setting item "Off" (setting item 302) is displayed on the setting screen 301. When the user points to either display item 301a or 301b, setting item 302 becomes an item other than "Off." In Fig. 3(a1), since the setting item is displayed as "Off" (selected by the user), no display element is displayed as a preview on the LV300.

[0074] 3(a2) to 3(a5) are examples of displays displayed on the display unit 28 in S404, with LV300, setting screen 301, and display elements displayed on the display unit 28. In Fig. 3(a2) to 3(a5), setting items 303 to 306 are displayed within the setting screen 301. When any of the setting items 303 to 306 is displayed (selected) by the user, the display element superimposed on the LV300 and displayed as a preview changes accordingly.

[0075] In FIG. 3(a2), the setting item "Time Code / Date / Time" (setting item 303) is displayed within setting screen 301. When display item 301b is instructed in the state of FIG. 3(a1), the display transitions to the display example of FIG. 3(a2). At this time, in response to the display of setting item 303, the preview display of the display elements superimposed on LV300 changes. Here, display element 303a is displayed in correspondence with setting item 303. Display element 303a displays, from top to bottom, the date, time, and time code.

[0076] In FIG. 3(a3), the setting item "date" (setting item 304) is displayed within setting screen 301. When display item 301b is instructed in the state of FIG. 3(a2), the display transitions to the display example of FIG. 3(a3). At this time, in response to the display of setting item 304, the preview display of the display element superimposed on LV300 changes. Here, display element 304a (date) is displayed in correspondence with setting item 304.

[0077] In FIG. 3(a4), the setting item "time" (setting item 305) is displayed within the setting screen 301. When an instruction is given to display item 301b in the state of FIG. 3(a3), the display transitions to the display example of FIG. 3(a4). At this time, in response to the display of setting item 305, the preview display of the display element superimposed on LV300 changes. Here, display element 305a (time) is displayed in correspondence with setting item 305.

[0078] In FIG. 3(a5), the setting item "time code" (setting item 306) is displayed within setting screen 301. When display item 301b is instructed in the state of FIG. 3(a4), the display transitions to the display example of FIG. 3(a1). At this time, in response to the display of setting item 306, the preview display of the display element superimposed on LV300 changes. Here, display element 306a (time code) is displayed in correspondence with setting item 306.

[0079] 3(a1) to 3(a5), the composite (display) position of the display elements displayed as a preview corresponding to the setting items in the setting screen is set to the upper left, but if the set position is different, the preview display position of the display elements will be changed according to the set position. Also, the order in which the setting items toggle is not limited to the order described above, and the setting items are not limited to those described above.

[0080] 3(b1) to (b4) are display examples showing a setting screen for the display position of the composite recording, with LV300 and setting screen 311 displayed on the display unit 28. Note that Fig. 3(b1) to (b4) are display examples when the setting items for the display elements to be composite recorded described above are set to "time code / date / time".

[0081] Fig. 3(b1) is an example of a display displayed on the display unit 28 in S405 of Fig. 4. In Fig. 3(b1), the current setting item "upper left" (setting item 312) is displayed on the setting screen 311. When the user points to either display item 301a or 301b, setting item 312 becomes an item other than "upper left." In Fig. 3(b1), the setting item is displayed as "upper left" (selected by the user), so a preview of display element 303a is displayed in the upper left of LV300.

[0082] FIG. 3(b2) is a display example displayed on the display unit 28 in S405 of FIG. 4. In FIG. 3(b2), the current setting item "top right" (setting item 313) is displayed on the setting screen 311. When an instruction is given to the display item 301b in the state of FIG. 3(b2), the display transitions to the display example of FIG. 3(b3). In FIG. 3(b2), the setting item is displayed as "top right" (selected by the user), so a preview of the display element 303a is displayed in the top right of the LVD 300.

[0083] FIG. 3(b3) is an example of a display displayed on the display unit 28 in S405 of FIG. 4. In FIG. 3(b3), the current setting item "bottom right" (setting item 314) is displayed on the setting screen 311. When an instruction is given to the display item 301b in the state of FIG. 3(b3), the display transitions to the example of FIG. 3(b4). In FIG. 3(b3), the setting item is displayed as "bottom right" (selected by the user), so a preview of the display element 303a is displayed at the bottom right of the LV300.

[0084] FIG. 3(b4) is an example of a display displayed on the display unit 28 in S405 of FIG. 4. In FIG. 3(b4), the current setting item "bottom left" (setting item 315) is displayed on the setting screen 311. When an instruction is given to the display item 301b in the state of FIG. 3(b4), the display transitions to the display example of FIG. 3(b1). In FIG. 3(b4), the setting item is displayed as "bottom left" (selected by the user), so a preview of the display element 303a is displayed at the bottom left of the LV300.

[0085] 3(c1) to (c4) are display examples in the shooting standby state, and LV300 is displayed on the display unit .

[0086] Fig. 3(c1) is an example of the display in S417 after the determination in S411 of Fig. 4 is Yes. A recording status 316, remaining recording time 317, F-number 318, ISO sensitivity 319, shutter speed 320, frame rate 321, and audio level meter 322 are displayed superimposed on the LV image 300 displayed on the display unit 28. At this time, the display elements are not displayed superimposed on the LV image.

[0087] Fig. 3(c2) is an example of a display that appears after S416 and S417 have been carried out after a No decision has been made in S411 of Fig. 4 and a Yes decision has been made in all steps S412 to S415. Recording status 316, remaining recording time 317, F-number 318, ISO sensitivity 319, shutter speed 320, frame rate 321, audio level meter 322, and composite recording setting 323 are displayed superimposed on LV 300 displayed on display unit 28. In this case, the display elements are not displayed superimposed on the LV image.

[0088] Fig. 3(c3) is a display example in S418 of Fig. 4. Display element 303a is displayed superimposed on LV300 displayed on display unit 28. Fig. 3(c3) is an example of what is displayed when a No decision is made in any of steps S412 to S415.

[0089] FIG. 3(c4) is a modified example of the display examples shown in FIGS. 3(c1) to 3(c3). In FIG. 3(c4), a black area 324 is provided around the LV 300. As a result, the LV 300 appears slightly smaller than if the area 324 were not provided. However, information display excluding display elements (recording status 316, remaining recording time 317, F-number 318, ISO sensitivity 319, shutter speed 320, frame rate 321, audio level meter 322, etc.) is displayed in the area 324. This allows the user to visually recognize that the information display displayed in the area 324 is simply information display related to shooting, and that only the display element 303a will be compositely recorded together with the moving image. In other words, the display elements and information display that will be compositely recorded with the moving image can be distinguished, reducing the user's misconception that the information display will also be compositely recorded together with the moving image. In addition, it is conceivable that the visibility of LV300 may be improved by displaying information (recording status 316, remaining recording time 317, F-number 318, ISO sensitivity 319, shutter speed 320, frame rate 321, audio level meter 322, etc.) in area 324.

[0090] When a moving image with a combined display element is played back in playback mode, a display example such as that shown in FIG. 3(c3) is displayed.

[0091] The control of this embodiment described above makes it possible to clearly indicate that display elements will be combined with a captured image without impairing the visibility of other display elements, such as shooting settings, during shooting. By superimposing the display elements to be combined with and recorded on a captured image during settings on the captured image, the user can grasp in advance the display elements that will be combined with and recorded on a captured image during shooting. Furthermore, it is possible to reduce the inconvenience of display elements being superimposed and recorded after shooting, which can reduce the visibility of a moving image after shooting, or the need to reshoot due to display elements being recorded in a position unintended by the user.

[0092] The various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0093] Furthermore, although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0094] The present invention is not limited to the imaging device itself, but can also be applied to a control device that communicates with an imaging device (including a network camera) via wired or wireless communication and remotely controls the imaging device. Examples of devices that remotely control an imaging device include smartphones, tablet PCs, and desktop PCs. The imaging device can be remotely controlled by issuing commands from the control device to the imaging device to perform various operations and settings based on operations or processes performed on the control device. A live view image captured by the imaging device may also be received via wired or wireless communication and displayed on the control device. The various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0095] Furthermore, although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0096] Furthermore, in the above-described embodiment, the present invention has been described as being applied to a digital camera, but this is not limited to this example and the present invention can be applied to any electronic device capable of recording moving images. That is, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printers equipped with displays, digital photo frames, music players, game consoles, e-book readers, and the like.

[0097] The present invention is not limited to application to the imaging device itself, but can also be applied to a control device that communicates with an imaging device (including a network camera) via wired or wireless communication and remotely controls the imaging device. Examples of devices that remotely control an imaging device include smartphones, tablet PCs, and desktop PCs. The imaging device can be remotely controlled by issuing commands from the control device to the imaging device to perform various operations and settings based on operations or processes performed on the control device. Furthermore, a live view image captured by the imaging device may be received via wired or wireless communication and displayed on the control device.

[0098] (Other embodiments) The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage media storing the program constitute the present invention.

Claims

1. a setting means for setting a superimposition recording setting regarding whether to superimpose the first display element on a moving image captured by the imaging means and record the superimposed image; while the setting means is setting the superimposed recording setting, the first display element is controlled to be superimposed on the moving image captured by the imaging means; a control means for controlling, in response to completion of setting of the superimposed recording setting by the setting means, to display the moving image captured by the imaging means without superimposing the first display element, even if the superimposed recording setting for recording the first display element in a superimposed manner is set; and A display control device comprising:

2. The control means When the setting means sets the overlay recording setting, a setting screen displaying setting items is displayed; 2. The display control device according to claim 1, further comprising: a display control unit that controls the display of the setting screen so that the moving image captured by the imaging unit is displayed without superimposing the first display element in response to the display of the setting screen being terminated.

3. A recording means for recording a moving image; the control means controls the display device to display the first display element without superimposing it on the moving image captured by the imaging means, even while the recording means is recording a moving image in which the first display element is superimposed on the moving image captured by the imaging means.

3. The display control device according to claim 1, wherein the display control device is a display control device.

4. 4. The display control device according to claim 1, further comprising a display unit, wherein the control means controls the display unit to display the moving image and / or the display element.

5. the display unit is a display unit included in the display control device, Further, a connection part is provided for connection to an external display part different from the display part, The control means When the external display unit is connected via the connection unit, in response to completion of the setting of the superimposed recording setting by the setting unit, the display unit is controlled to display the moving image captured by the imaging means without superimposing the first display element, and the external display unit is controlled to display the moving image captured by the imaging means with the first display element superimposed thereon.

5. The display control device according to claim 4.

6. The display control device according to any one of claims 1 to 5, characterized in that, in response to the setting of the overlay recording setting by the setting means being completed, the control means controls so that the first display element is not displayed, and a second display element indicating that the setting is for recording the display element by superimposing it on a moving image is displayed superimposed on the moving image captured by the imaging means.

7. The display control device according to claim 6 , wherein the second display element is an icon.

8. A display control device as described in claim 6 or 7, characterized in that the display area of ​​the second display element is smaller than the display area of ​​the first display element.

9. A display control device as described in any one of claims 6 to 8, characterized in that the control means controls so that the second display element is not displayed while the overlay recording setting is being set by the setting means, even if a setting for recording a display element by superimposing it on a moving image is selected, and controls so as to display the second display element in response to completion of setting of the overlay recording setting by the setting means.

10. The display control device according to any one of claims 1 to 9, characterized in that when setting by the setting means is completed, if no information regarding the shooting of the moving image is displayed, even if the overlay recording setting by the setting means has not been made, the control means controls to display the first display element superimposed on the moving image captured by the imaging means.

11. The display control device according to any one of claims 1 to 9, characterized in that when the overlay recording setting by the setting means is completed, information regarding the shooting of the moving image is displayed, and when the display positions of the first display element and the information display regarding the shooting do not overlap, the control means controls the first display element to be displayed superimposed on the moving image captured by the imaging means.

12. The setting means is capable of selecting a superimposition position of the first display element in the superimposition recording setting, the control means performs control so that, while the setting means is setting the superimposed recording setting, the first display element is displayed in a superimposed manner at a position corresponding to a selected superimposed position, and, in response to completion of setting the superimposed recording setting by the setting means, performs control so that the first display element is not displayed even if the first display element is set to be recorded in a superimposed manner.

12. The display control device according to claim 1,

13. A display control device as described in any one of claims 1 to 12, characterized in that the setting means is capable of selecting the type of display element to be superimposed on the moving image and recorded as the first display element in the overlay recording setting.

14. The display control device according to claim 13, wherein the types of display elements selectable by the setting means include at least one of a time code, a date, and a time.

15. The display control device described in Claim 14, characterized in that the setting means is capable of selecting a combination of multiple types of display elements as the first display element to be superimposed on a moving image and recorded.

16. a setting step of setting a superimposition recording setting regarding whether to superimpose the first display element on a moving image captured by the imaging means and record the superimposed image; During the setting of the superimposed recording setting in the setting step, the first display element is controlled to be superimposed on the moving image captured by the imaging means, a control step of controlling, in response to completion of the superimposed recording setting by the setting step, to display the moving image captured by the imaging means without superimposing the first display element, even if the superimposed recording setting for recording the first display element in a superimposed manner is set; A control method for a display control device comprising the steps of:

17. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 15.

18. 16. A computer-readable recording medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 15.