Image processing device, marking method, and program

Abstract

To provide a technology that allows for the marking of a video header in an appropriate position.SOLUTION: An image processing device performs marking on a moving image so that the frame of the moving image that is being played back or recorded before the time when a marking instruction is accepted becomes the first frame for the heading when the marking instruction for the heading is accepted during playback or recording of the moving image.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an image processing device, a marking method, and a program. [Background technology]

[0002] Generally, devices that handle moving images have a known marking function that records information specifying a cueing position in order to cue a specific scene during playback of the moving image (Patent Document 1). The marking function provides the convenience of quickly recalling a desired scene during playback and editing of the moving image. In recent years, with the increasing capacity of recording media, a shooting style in which video is shot for long periods of time without stopping so as not to miss a shooting opportunity has become more common. In such cases, it is more laborious for a video editor to search for a scene to use in editing from a long video than for a short video. Therefore, a marking function that allows for quick cueing of a scene is useful for improving the efficiency of editing work and is becoming more important. Furthermore, imaging devices that are capable of recording markings as described above while shooting a video are known. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-153191 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when cue marking is performed during video shooting, the cameraman performs the marking operation only after recognizing that the scene he or she wants to mark will begin. Therefore, if the cue marking is performed to specify the frame at the time the cameraman performs the marking operation, the marking may be performed at a position that is delayed in time from the cue position that the cameraman wants to mark. If the cue position is set at a position that is delayed in time in this way, when cueing and playing back the video, it is necessary to go back in time a little from the marked position before playing back.

[0005] The present invention provides a technique for improving the operability of marking processing for cueing moving images. [Means for solving the problem]

[0006] An image processing device according to one aspect of the present invention comprises the following arrangement: a receiving means for receiving a marking instruction for cueing during at least one of playback and recording of a video; and marking means for marking the video so that a time earlier than the time of the video being played or recorded at the time the marking instruction is received becomes the cue position. [Effects of the Invention]

[0007] According to the present invention, the operability of the marking process for cueing a moving image is improved. [Brief explanation of the drawings]

[0008] [Figure 1] 1A and 1B are diagrams showing the appearance of an imaging device according to an embodiment. [Figure 2] FIG. 1 is a block diagram showing an example of the configuration of an imaging apparatus according to an embodiment. [Figure 3] 4 is a flowchart showing processing in a shooting mode and a playback mode. [Figure 4] 10 is a flowchart showing a marking process. [Figure 5]FIG. 4 is a diagram showing an example of a setting screen of the imaging apparatus according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0010] 1(a) and 1(b) show external views of a digital camera 100 (image capture device) as an example of a device (electronic device) to which the present invention can be applied. Fig. 1(a) is a front perspective view of the digital camera 100, and Fig. 1(b) is a rear perspective view of the digital camera 100.

[0011] The display unit 28 is a display unit provided on the back surface of the digital camera 100, and displays images and various information. The touch panel 70a can detect touch operations on the display surface (touch operation surface) of the display unit 28. The out-of-viewfinder display unit 43 is a display unit provided on the top surface of the digital camera 100, and displays various settings of the digital camera 100, including the shutter speed and aperture. The shutter button 61 is an operation member for issuing shooting instructions. The mode selector switch 60 is an operation member for switching between various modes. The terminal cover 40 is a cover that protects a connector (not shown) for connecting a connection cable or the like that connects the digital camera 100 to an external device.

[0012] The main electronic dial 71 is a rotary operation member, and by turning the main electronic dial 71, settings such as shutter speed and aperture can be changed. The power switch 72 is an operation member that switches the power of the digital camera 100 on and off. The sub electronic dial 73 is a rotary operation member, and by turning the sub electronic dial 73, the selection frame (cursor) can be moved, images can be forwarded, etc. The four-way key 74 is configured so that the up, down, left, and right parts can each be pressed, and processing can be performed according to the part of the four-way key 74 that is pressed. The SET button 75 is a push button, and is mainly used to confirm a selection item, etc.

[0013] The movie button 76 is used to start or stop movie shooting (recording). The AE lock button 77 is a push button, and pressing the AE lock button 77 in shooting standby mode fixes the exposure state. The enlarge button 78 is an operation button for switching the enlargement mode on and off in the live view display (LV display) of the shooting mode. By turning the enlargement mode on and operating the main electronic dial 71, the live view image (LV image) can be enlarged or reduced. In playback mode, the enlargement button 78 functions as an operation button for enlarging the playback image or increasing its magnification. The playback button 79 is an operation button for switching between shooting mode and playback mode. Pressing the playback button 79 in shooting mode switches to playback mode, and the most recent image recorded on the recording medium 200 (described below) can be displayed on the display unit 28. The menu button 81 is a push button used to issue an instruction to display a menu screen. Pressing the menu button 81 displays a menu screen on the display unit 28 that allows various settings to be made. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the four-way key 74, and the SET button 75.

[0014] The touch bar 82 (multifunction bar: M-Fn bar) is a line-shaped touch operation member (line touch sensor) that can receive touch operations. The touch bar 82 is positioned so that it can be touched (touched) with the thumb of the right hand when the grip unit 90 is held in the right hand (holding it with the little finger, ring finger, and middle finger of the right hand) so that the shutter button 61 can be pressed with the index finger of the right hand. In other words, the touch bar 82 is positioned so that it can be operated when the user places his / her eye on the eyepiece unit 16, looks through the viewfinder, and is in a position (shooting posture) so that the shutter button 61 can be pressed at any time. The touch bar 82 is a reception unit that can receive tap operations (operations in which the user touches and then releases the touch bar without moving within a predetermined period of time) and slide operations (operations in which the user touches and then moves the touched position while keeping the touch) on the touch bar 82. The touch bar 82 is an operation member that is different from the touch panel 70a and does not have a display function.

[0015] The marking button 83 is an operating member that allows the user to instruct marking recording. By marking during video recording, it is possible to record time information required for cueing to the beginning of the video being recorded. Also, by marking during image playback, it is possible to record time information required for cueing to the beginning of the video being played back.

[0016] The communication terminal 10 is a communication terminal through which the digital camera 100 communicates with the lens unit 150 (described below; detachable). The eyepiece 16 is the eyepiece of the eyepiece finder 17 (a peer-type finder), and the user can view an image displayed on an internal Electronic View Finder (hereinafter, referred to as EVF 29 (FIG. 2)) through the eyepiece 16. The eyepiece detection unit 57 is an eyepiece detection sensor that detects whether the user (photographer) has placed their eye on the eyepiece 16. The cover 202 is a cover for a slot that stores a recording medium 200 (described below). The grip unit 90 is a holding unit shaped to be easily held with the user's right hand when holding the digital camera 100. The shutter button 61 and main electronic dial 71 are positioned so that they can be operated with the index finger of the right hand when the digital camera 100 is held by gripping the grip unit 90 with the little finger, ring finger, and middle finger of the right hand. In the same state, the sub electronic dial 73 and touch bar 82 are also arranged in positions that can be operated with the thumb of the right hand. The thumb rest 91 (thumb standby position) is a grip member provided on the rear side of the digital camera 100 in a position where it is easy to place the thumb of the right hand that is holding the grip 90 when none of the operation members are being operated. The thumb rest 91 is made of a rubber member or the like to increase the holding strength (grip feeling).

[0017] FIG. 2 is a block diagram showing an example configuration of a digital camera 100. The lens unit 150 is a lens unit equipped with an interchangeable photographic lens. The lens 103 is usually composed of multiple lenses, but FIG. 2 shows only one lens for simplicity's sake. The communication terminal 6 is a communication terminal through which the lens unit 150 communicates with the digital camera 100, and the communication terminal 10 is a communication terminal through which the digital camera 100 communicates with the lens unit 150. The lens unit 150 communicates with the system controller 50 via these communication terminals 6 and 10. The lens unit 150 controls the aperture 1 via the aperture drive circuit 2 by the internal lens system control circuit 4. The lens unit 150 also adjusts the focus by displacing the position of the lens 103 via the AF drive circuit 3 by the lens system control circuit 4.

[0018] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50. The imaging unit 22 is an imaging element (image sensor) formed of a CCD, CMOS element, or the like that converts an optical image into an electrical signal. The imaging unit 22 may have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 23 converts the analog signal output from the imaging unit 22 into a digital signal.

[0019] The image processing unit 24 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion, etc.) on data from the A / D converter 23 or data from the memory control unit 15. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the arithmetic results obtained by the image processing unit 24. This allows for TTL (through-the-lens) type AF (autofocus) processing, AE (autoexposure) processing, EF (flash pre-flash) processing, etc. to be performed. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the arithmetic results obtained.

[0020] The output data from the A / D converter 23 is written to the memory 32 via the image processing unit 24 and the memory control unit 15. Alternatively, the output data from the A / D converter 23 is written to the memory 32 via the memory control unit 15 without going through the image processing unit 24. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as image data to be displayed on the display unit 28 and the EVF 29. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio.

[0021] The memory 32 also serves as a memory (video memory) for image display. The D / A converter 19 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28 or the EVF 29. In this way, the display image data written to the memory 32 is displayed on the display unit 28 or the EVF 29 via the D / A converter 19. The display unit 28 and the EVF 29 are each a display such as an LCD or an organic EL, and perform display according to the analog signal from the D / A converter 19. The digital signal that has been A / D converted by the A / D converter 23 and stored in the memory 32 is converted into an analog signal by the D / A converter 19, and the analog signal is sequentially transferred to and displayed on the display unit 28 or the EVF 29, thereby performing a live view display (LV). Hereinafter, an image displayed in live view display will be referred to as a live view image (LV image).

[0022] The system control unit 50 is a control unit made up of at least one processor and / or at least one circuit, and controls the entire digital camera 100. The system control unit 50 is both a processor and a circuit. The system control unit 50 executes programs recorded in nonvolatile memory 56 to realize each process of this embodiment, which will be described later. The system control unit 50 also performs display control by controlling the memory 32, D / A converter 19, display unit 28, EVF 29, etc.

[0023] The system memory 52 is, for example, a RAM, and the system control unit 50 loads constants and variables for operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like into the system memory 52. ​​The nonvolatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. Constants, programs, and the like for operation of the system control unit 50 are recorded in the nonvolatile memory 56. The programs referred to here are programs for executing various flowcharts, which will be described later in this embodiment.

[0024] The system timer 53 is a timing unit that measures the time used for various controls and the time of a built-in clock. In this embodiment, the system timer 53 is also used to measure the time that the marking button 83 is pressed.

[0025] The communication unit 54 transmits and receives video signals and audio signals to and from external devices connected wirelessly or via a wired cable. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can receive image data and various other information from external devices.

[0026] The orientation detection unit 55 detects the orientation of the digital camera 100 with respect to the direction of gravity. Based on the orientation detected by the orientation detection unit 55, it is possible to determine whether an image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the orientation detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the orientation detection unit 55. The acceleration sensor or gyro sensor of the orientation detection unit 55 can also be used to detect movement of the digital camera 100 (panning, tilting, lifting, whether the digital camera 100 is stationary, etc.).

[0027] The eyepiece detection unit 57 is an eyepiece detection sensor that detects (approach detection) whether an eye (object) approaches (approach) or moves away (away) from the eyepiece 16 of the eyepiece viewfinder 17 (hereinafter simply referred to as the "viewfinder"). The system control unit 50 switches the display unit 28 and the EVF 29 between on (display state) and off (non-display state) depending on the state detected by the eyepiece detection unit 57. More specifically, at least in a shooting standby state and when the display destination switching setting is automatic switching, when the eye is not in contact with the camera, the display is turned on with the display on the display unit 28 and the EVF 29 is hidden. When the eye is in contact with the camera, the display is turned on with the display on the EVF 29 and the display unit 28 is hidden. For example, an infrared proximity sensor can be used as the eyepiece detection unit 57, and it can detect the approach of an object to the eyepiece 16 of the viewfinder 17 that incorporates the EVF 29. When an object approaches, infrared light emitted from a light-emitting unit (not shown) of the eyepiece detection unit 57 is reflected by the object and received by a light-receiving unit (not shown) of the infrared proximity sensor. The amount of received infrared light can also determine the distance the object is approaching the eyepiece 16 (eyepiece distance). In this way, the eyepiece detection unit 57 performs eyepiece detection, which detects the proximity of an object to the eyepiece 16. When an object approaching within a predetermined distance from the eyepiece 16 is detected from a non-eyepiece state (non-approach state), it is detected as being in eye contact. When an object detected as approaching moves away from the eyepiece state (approach state) by more than a predetermined distance, it is detected as being away from the eye. The threshold for detecting eye contact and the threshold for detecting eye separation may be different, for example, by providing hysteresis. Furthermore, after eye contact is detected, the eyepiece remains in the eye contact state until eye separation is detected. After eye separation is detected, the eyepiece remains in the non-eye contact state until eye contact is detected. The infrared proximity sensor is just an example, and other sensors may be used for the eye proximity detector 57 as long as they can detect a state that can be considered as eye proximity.

[0028] Various camera settings such as shutter speed and aperture are displayed on the outside viewfinder display 43 via an outside viewfinder display drive circuit 44 .

[0029] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between powered blocks, etc., and detects whether a battery is installed, the type of battery, and the remaining battery power. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage for the required period to each unit, including the recording medium 200. The power supply unit 30 is composed of primary batteries such as alkaline batteries or lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, or Li batteries, an AC adapter, etc.

[0030] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0031] The operation unit 70 is an input unit that accepts operations from the user (user operations) and is used to input various operational instructions to the system control unit 50. As shown in Fig. 2, the operation unit 70 includes a shutter button 61, a mode selector switch 60, a power switch 72, a touch panel 70a, other operation members 70b, etc. The other operation members 70b include a main electronic dial 71, a sub electronic dial 73, a four-way key 74, a SET button 75, a video button 76, an AE lock button 77, a magnification button 78, a playback button 79, a menu button 81, a touch bar 82, a marking button 83, etc.

[0032] The shutter button 61 includes a first shutter switch 62 and a second shutter switch 64. The first shutter switch 62 is turned on when the shutter button 61 is pressed halfway (a shooting preparation command) during operation, generating a first shutter switch signal SW1. The system control unit 50 starts shooting preparation operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing in response to the first shutter switch signal SW1.

[0033] The second shutter switch 64 is turned on when the shutter button 61 is fully pressed (photographing instruction) and generates a second shutter switch signal SW2. The second shutter switch signal SW2 causes the system control unit 50 to start a series of photographing processing operations, from reading out a signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file.

[0034] The mode selector switch 60 switches the operating mode of the system control unit 50 to one of still image capture mode, video capture mode, playback mode, etc. Modes included in the still image capture mode include auto capture mode, auto scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide capture settings for specific capture scenes. The mode selector switch 60 allows the user to directly switch to one of these modes. Alternatively, after first switching to a list screen of capture modes with the mode selector switch 60, the user may selectively switch to one of the displayed modes using another operating member. Similarly, the video capture mode may also include multiple modes.

[0035] The touch panel 70a is a touch sensor that detects various touch operations on the display surface of the display unit 28 (the operation surface of the touch panel 70a). The touch panel 70a and the display unit 28 can be configured as an integrated unit. For example, the touch panel 70a is configured so that its light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Input coordinates on the touch panel 70a are associated with display coordinates on the display surface of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that allows the user to directly operate the screen displayed on the display unit 28.

[0036] The system control unit 50 can detect the following operations or states on the touch panel 70a. A finger or pen that has not been touching the touch panel 70a touches the touch panel 70a again, that is, the start of touching (hereinafter referred to as touch-down). A state in which the touch panel 70a is touched with a finger or a pen (hereinafter referred to as "touch-on"). A finger or pen is moved while touching the touch panel 70a (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 70a is released from the touch panel 70a, that is, the end of touch (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 70a (hereinafter referred to as Touch-Off).

[0037] When a touch down is detected, a touch on is also detected at the same time. After a touch down, a touch on is usually continued to be detected unless a touch up is detected. If a touch move is detected, a touch on is also detected at the same time. Even if a touch on is detected, a touch move is not detected unless the touch position moves. Once it is detected that all fingers or pens that were touching have touched up, a touch off occurs.

[0038] These operation states and the position coordinates of the finger or pen touching the touch panel 70a are notified to the system control unit 50 via the internal bus. The system control unit 50 then determines what kind of operation (touch operation) was performed on the touch panel 70a based on the notified information. Regarding touch-move, the movement direction of the finger or pen moving on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on changes in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 70a, moved quickly for a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced across the touch panel 70a as if flicking. If a touch-move of a predetermined distance or more at a predetermined speed or more is detected and a touch-up is then detected, it is determined that a flick has been performed (it can be determined that a flick occurred following a slide operation). Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touch) and the touch positions are brought closer together is called a pinch in, and a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply a pinch). The touch panel 70a may be of any of a variety of touch panel types, including resistive film type, capacitive type, surface acoustic wave type, infrared type, electromagnetic induction type, image recognition type, and optical sensor type. There are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or pen to the touch panel, and either type is acceptable.

[0039] In the system control unit 50, various functions are realized by at least one processor executing a predetermined program recorded in the nonvolatile memory 56, by dedicated hardware, or by a combination of these. In this embodiment, the system control unit 50 realizes the functions of a mode setting unit 501, a video shooting unit 502, a video playback unit 503, and a marking processing unit 504. The mode setting unit 501 switches to a mode specified by the mode selector switch 60. The video shooting unit 502 starts and stops video recording in response to operation of the video button 76 in video shooting mode. The video playback unit 503 plays videos in response to operation of the playback button 79 in video shooting mode or playback mode. Videos can be displayed on the display unit 28 or on an external display device. The marking processing unit 504 records information indicating a cue position in the video in response to pressing the marking button 83 during video recording or playback.

[0040] The marking process performed by operating the marking button 83 in the digital camera 100 having the above configuration will now be described. Figure 3 is a flowchart showing the process of executing marking recording during video shooting or video playback after the digital camera 100 according to this embodiment is powered on in video mode. The process described below is realized by the system control unit 50 loading a program stored in the nonvolatile memory 56 into the system memory 52 and executing it after the power switch 72 is turned on.

[0041] The mode setting unit 501 of the system control unit 50 determines whether or not the shooting mode has been set by the mode selector switch 60 (S300). If it is determined that the shooting mode has been set (YES in S300), the video shooting unit 502 determines whether or not the video button 76 has been pressed (S301). If it is determined that the video button 76 has been pressed in the shooting mode (YES in S301), the video shooting unit 502 starts video shooting processing (including marking processing) (S302 to S308). Furthermore, in the shooting mode, when the play button 79 is pressed (YES in S308), the video playback unit 503 starts the playback process of the most recently recorded video (S312 to S318). On the other hand, if it is determined that the shooting mode is not being used (NO in S300), the mode setting unit 501 determines whether the playback mode has been set by the mode selection switch 60 (S310). When the playback mode is set (YES in S310) and the play button 79 is pressed (YES in S311), the video playback unit 503 starts the playback process (including the marking process) of the video selected by the user from the videos recorded on the recording medium 200 (S312 to S318).

[0042] When the video shooting process is started, the video shooting unit 502 starts reading out signals from the image capturing unit 22 and starts video shooting (S302). At this time, the video shooting unit 502 converts the data from the image capturing unit 22 using the A / D converter 23 and stores the data as video image data in the memory 32 via the image processing unit 24 and the memory control unit 15. Next, the video shooting unit 502 instructs the system timer 53 to count the recording time, which is the time elapsed since the start of video shooting in S302, and stores the recording time counted by the system timer 53 in the memory 32 via the memory control unit 15 (S303).

[0043] The marking processing unit 504 determines whether the marking button 83 has been pressed during video shooting (S304). If it is determined that the marking button 83 has been pressed (YES in S304), the marking processing unit 504 executes the marking process (S305). Details of the marking process will be described later with reference to FIG. 4. If it is determined that the marking button 83 has not been pressed (NO in S304), the marking process of S305 is skipped. The video shooting unit 502 determines whether the video button 76 has been pressed (S306). In this embodiment, pressing the video button 76 during video shooting instructs the video shooting in progress to stop. Of course, a separate operating member may be provided to instruct the video shooting to stop. If the video button 76 has not been pressed (NO in S306), the process returns to S304, and video shooting continues. On the other hand, if it is determined that the video button 76 has been pressed (YES in S306), the video shooting unit 502 instructs the system timer 53 to end counting the recording time, which is the time elapsed since the start of video shooting (S307). Then, the video shooting unit 502 ends signal readout from the imaging unit 22 and ends video shooting (S308). At this time, the video shooting unit 502 obtains from the memory 32 the video image data obtained by the video shooting started in S302 and the marking time obtained by the marking process in S305, and records them on the recording medium 200 via the recording medium I / F 18.

[0044] On the other hand, when video playback processing is instructed by operating the play button 79, the video playback unit 503 starts playing the video stored on the recording medium 200 (S312). In playback processing caused by pressing the play button 79 during shooting mode, the video to be played is the video last recorded on the recording medium 200 (the most recent video). On the other hand, in playback mode, the video to be played is the video selected by the user from the videos recorded on the recording medium 200. The video playback unit 503 instructs the system timer 53 to count the playback time, which is the time elapsed since the start of video playback in S312, and stores the playback time counted by the system timer 53 in the memory 32 via the memory control unit 15 (S313).

[0045] The marking processing unit 504 determines whether the marking button 83 has been pressed (S314). If it is determined that the marking button 83 has been pressed (YES in S314), the marking processing unit 504 executes the marking process (S315). Details of the marking process will be described later with reference to FIG. 4. If it is determined that the marking button 83 has not been pressed (NO in S314), S315 is skipped. The video playback unit 503 determines whether the play button 79 has been pressed (S316). In this embodiment, pressing the play button 79 while a video is being played instructs stopping the video playback in progress. Of course, a separate operating member may be provided to instruct stopping video playback. If the play button 79 has not been pressed (NO in S316), the process returns to S314, and video playback continues. On the other hand, if it is determined that the play button 79 has been pressed (YES in S316), the video playback unit 503 instructs the system timer 53 to end counting the playback time (S317). Then, the video playback unit 503 ends playback of the video (S318). At this time, the video playback unit 503 obtains from the memory 32 the marking time obtained by the marking process in S315, and stores it as incidental information of the video data that is the target of video playback in S312. The incidental information is recorded on the recording medium 200 via the recording medium I / F 18.

[0046] The system control unit 50 determines whether a termination operation, such as turning off the power switch 72, has been performed (S321). If it is determined that a termination operation has been performed (EYS in S321), this process ends. On the other hand, if it is determined that a termination operation has not been performed (NO in S321), the process returns to S301, and the above-mentioned process is repeated. Note that if an abnormal operation, such as turning the mode dial, is performed during the process of this flowchart, the flow may be interrupted midway.

[0047] Next, the marking process executed in steps S305 and S315 will be described below with reference to a flowchart of FIG.

[0048] In response to the pressing of the marking button 83, the marking processing unit 504 obtains the recording time (or playback time) from the memory 32 and stores it in the memory 32 via the memory control unit 15 as the time when the marking button 83 started to be pressed (S401). The marking processing unit 504 instructs the system timer 53 to count the time that has elapsed since the marking button 83 was pressed (S402). This process causes the time that has elapsed since the marking button 83 was pressed to be stored in the memory 32 via the memory control unit 15. Thereafter, the marking processing unit 504 determines whether the marking button 83 is still being pressed (S403). When the marking button 83 is released (NO in S403), the marking processing unit 504 instructs the system timer 53 to end counting the time that has elapsed since the marking button 83 was pressed in S306 (S404). In this way, the elapsed time while the marking button 83 is being pressed (while YES is returned in S403) is stored in the memory 32.

[0049] Next, the marking processing unit 504 acquires from the memory 32 the elapsed time from the start to the end of pressing the marking button 83, and determines whether the acquired elapsed time is less than a threshold value (S405). If the elapsed time is less than the threshold value (YES in S405), the marking processing unit 504 determines that the marking button 83 has been short-pressed. On the other hand, if the elapsed time is equal to or greater than the threshold value (NO in S405), the marking processing unit 504 determines that the marking button 83 has been long-pressed. If it is determined that the marking button 83 has been short-pressed, the marking processing unit 504 stores the start time of pressing the marking button 83 acquired in S401 as the marking time in the memory 32 via the memory control unit 15 (S406). If it is determined that the marking button 83 has been pressed and held down, the marking processing unit 504 stores the time going back from the start time of pressing the marking button 83 by the elapsed time determined in S404 as the marking time in the memory 32 via the memory control unit 15 (S407). Note that the marking processing unit 504 can read out the start time of pressing the marking button 83 and the elapsed time from the memory 32 via the memory control unit 15.

[0050] In step S407, the time to go back from the time when the marking button 83 was first pressed is not limited to the elapsed time described above. For example, a time arbitrarily set by the user in advance may be used as the time to go back. This allows a time that goes back longer than the time the marking button 83 was pressed to be recorded as the marking time. Furthermore, the user may be allowed to select either a first method, in which the time to go back when the marking button 83 is pressed and released, or a second method, in which a time arbitrarily set by the user is used. FIG. 5 shows an example of a selection screen that allows the user to select either the first method or the second method. This selection screen may be displayed on the display unit 28 under the control of the system control unit 50, for example. In FIG. 5, the second method is shown selected using a radio button, and a time to go back is set in a box 601. The user can set an arbitrary time in the box 601.

[0051] As described above, according to the embodiment, marking is performed so that the cue position is a time that goes back in time from the time of the marking operation during shooting or playback. Therefore, when a user instructs marking while checking the screen during video shooting or playback, even if the user's marking operation is delayed, the marking is performed at the position intended by the user. Furthermore, when marking is performed during video shooting or playback, it is possible to switch between recording the marking at the time of the operation (S406) and recording the marking at a time earlier than the time of the operation (S407) depending on the mode of the marking operation. That is, according to the embodiment, the user can easily record the marking by selectively recording the marking at the time of the operation or at a time earlier than the time of the operation. Furthermore, in the marking process that records the marking at a time earlier than the time of the operation, the cue position to be set is determined according to the duration of the marking operation, so the user can mark at the desired marking position.

[0052] In the above embodiment, the marking process that sets the time of operation as the cue position and the marking process that sets a time before the time of operation as the cue position are switched in accordance with whether the marking button 83 is pressed for a long time or a short time, but this is not limited to this. For example, separate operating members may be provided, and which of the two types of marking processes to execute may be determined depending on which operating member is operated.

[0053] Furthermore, the marking position may be determined so that the cue position is a time going back in time determined based on the duration of the marking instruction operation. In other words, in the above embodiment, the cue position is a time going back by the duration of the operation of the marking button 83 (pressing time), but this is not limited to this, and the duration of the operation and the time going back in time do not have to be equal. For example, the duration of the operation may be divided into multiple stages, and a time may be assigned to each stage, and the marking position may be a time going back by the time assigned to the stage to which the actual duration belongs. Also, for example, an upper limit may be set for the time going back. Furthermore, the operating member for issuing a marking instruction is not limited to a push button switch such as the marking button 83, and any type of operating member may be used as long as it can determine whether or not a user operation is continuing.

[0054] Furthermore, in the above embodiment, the digital camera 100 is used as an example of an image processing device that marks a video for cueing, but the present invention is not limited to this. For example, it is clear that the present invention can be applied to marking processes during recording and playback by a recording device that records broadcast programs, etc. Furthermore, in the above embodiment, marking processes can be performed both during video capture and video playback, but marking processes may be performed only in one of these modes.

[0055] As described above, according to the above embodiment, depending on the method of marking operation during video shooting, it is possible to easily record markings at the time of operation or at a time before the time of operation, and therefore, it is possible to shorten the time required for video editing by directly and quickly cueing to a desired scene.

[0056] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0057] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0058] 100: Digital camera, 50: System control unit, 60: Mode changeover switch, 76: Video button, 79: Playback button, 83: Marking button, 501: Mode setting unit, 502: Video shooting unit, 503: Video playback unit, 504: Marking processing unit

Claims

1. a receiving means for receiving a marking instruction for cueing during at least one of playback and recording of a video; and a marking means for marking the video so that the cue position is a time earlier than the time of the video being played or recorded at the time the marking instruction is accepted.

2. The device further includes a determination unit that determines whether a first operation or a second operation different from the first operation has been performed as the marking instruction, The marking means is When the determination means determines that the first operation has been performed, marking is performed so that the cue position is a time earlier than the time of the video at the time the marking instruction was accepted, The image processing device according to claim 1, characterized in that, when the determination means determines that the second operation has been performed, marking is performed so that the time of the video at the time the marking instruction is accepted becomes the cue position.

3. 3. The image processing apparatus according to claim 2, wherein the first operation and the second operation are different operations performed on the same operating member.

4. The image processing device according to claim 2, characterized in that the determination means determines that the first operation has been performed when the continuous time of operation of a specified operating member for instructing the marking is equal to or longer than a threshold, and determines that the second operation has been performed when the continuous time is less than the threshold.

5. the marking instruction is an operation of pressing the predetermined operation member, 5. The image processing apparatus according to claim 4, wherein the continuous time is a time during which the predetermined operation member is kept pressed.

6. 3. The image processing apparatus according to claim 2, wherein the first operation and the second operation are performed on different operation members.

7. The image processing device according to any one of claims 2 to 6, characterized in that the marking means marks the video so that the cue position is a time that is a predetermined time before the time when the marking instruction was accepted.

8. 8. The image processing apparatus according to claim 7, further comprising a setting unit for allowing a user to set the predetermined time period.

9. The image processing device according to any one of claims 2 to 6, characterized in that the marking means marks the video so that a cue position is a time going back a time determined based on the duration of the first operation.

10. 10. The image processing apparatus according to claim 9, wherein the marking means marks the video so that a cue position is a time going back the same amount of time as the continuous time.

11. The image processing device according to claim 1, characterized in that the marking means marks the video so that the cue position is a time going back a time determined based on the duration of the marking instruction operation from the time the marking instruction was accepted.

12. The image processing device according to claim 11, characterized in that the marking means marks the video so that the cue position is a time that goes back a period of time equal to the duration of the marking instruction operation from the time the marking instruction was accepted.

13. A marking method for recording a cue position of a video, comprising: a receiving step of receiving a marking instruction for cueing during at least one of playback and recording of the video; a marking step of marking the video so that the cue position is a time earlier than the time of the video being played or recorded at the time the marking instruction is accepted.

14. A program for causing a computer to function as the means of the image processing device according to any one of claims 1 to 12.

Images