Imaging device

Abstract

To attain control of memorandum recording and control of main moving image recording by a single operation.SOLUTION: An imaging apparatus comprises: a receiving unit which receives an input concerning recording of voice data and moving image data; and a control unit which when the receiving part receives the input during at least one of first recording which records at least the voice data from among the voice data and the moving image data and second recording which records the voice data and the moving image data, completes the one recording and starts the other recording.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an image pickup apparatus. [Background Art]

[0002] The following Patent Document 1 discloses a video data processing apparatus with audio that associates video data with audio data. [Prior Art Literature] [Patent Documents]

[0003] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2007-104405 [Summary of the Invention]

[0004] An image pickup apparatus according to the technique of the present disclosure includes: a reception unit that receives an input related to recording of audio data and moving image data, wherein at least the audio data among the audio data and the moving image data to write is a first recording to be recorded, and the audio data and the moving image data to write is a second recording to be recorded, and The control unit has a control unit that controls the second when the reception unit receives the input during recording, the 2nd recording is ended, and The First recording is starte ru . [Brief Description of the Drawings]

[0005] [Figure 1] FIG. 1 is a block diagram showing an example hardware configuration of an image pickup apparatus. [Figure 2] FIG. 2 is an explanatory diagram showing an example control of memo recording and a full moving image. [Figure 3] FIG. 3 is an explanatory diagram showing a first example reception of memo recording and a full moving image. [Figure 4] FIG. 4 is an explanatory diagram showing a second example reception of memo recording and a full moving image. [Figure 5] FIG. 5 is a block diagram showing an example functional configuration of an image pickup apparatus. [Figure 6] Figure 6 is an explanatory diagram showing an example of a settings screen. [Figure 7] Figure 7 is a flowchart 1 showing an example of the processing procedure for memo recording and video recording by the imaging device. [Figure 8] Figure 8 is flowchart 2, which shows an example of the processing procedure for memo recording and video recording by the imaging device. [Figure 9] Figure 9 is flowchart 3, which shows an example of the processing procedure for memo recording and video recording by the imaging device. [Figure 10] Figure 10 is an explanatory diagram showing an example configuration of the camera system according to Embodiment 2. [Figure 11] Figure 11 is a flowchart showing an example of the video recording processing procedure using the first imaging device. [Figure 12] Figure 12 is a flowchart showing an example of the memo recording processing procedure by the second imaging device. [Modes for carrying out the invention] [Examples]

[0006] <Example of hardware configuration for imaging device> Figure 1 is a block diagram showing an example of the hardware configuration of an imaging device. The imaging device 100 is a device capable of capturing still images or videos, and specifically includes, for example, a digital camera, a digital video camera, a smartphone, a tablet, a personal computer, or a game console. In Figure 1, a digital camera is used as an example of an imaging device for explanation.

[0007] The imaging device 100 includes a processor 101, a memory device 102, a drive unit 103, an optical system 104, an image sensor 105, an AFE (Analog Front End) 106, an LSI (Large Scale Integration) 107, an operating device 108, a microphone 109, a sensor 110, a display device 111, a communication interface 112, a speaker 113, and a bus 114. The processor 101, memory device 102, drive unit 103, LSI 107, operating device 108, microphone 109, sensor 110, display device 111, communication interface 112, and speaker 113 are connected to the bus 114.

[0008] The processor 101 controls the imaging device 100. The memory device 102 serves as the work area for the processor 101. The memory device 102 is a non-temporary or temporary recording medium that stores various programs and data. Examples of the memory device 102 include ROM (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disk Drive), and flash memory. Multiple memory devices 102 may be mounted on the imaging device 100, and at least one of them may be detachable from the imaging device 100.

[0009] The drive unit 103 drives and controls the optical system 104. The drive unit 103 has a drive circuit 103a and a drive source 103b. The drive circuit 103a controls the drive source 103b by instructions from the processor 101. The drive source 103b is, for example, a motor, and under the control of the drive circuit 103a, it moves the zooming lens 141b and focusing lens 141c in the optical system 104 in the optical axis direction, and controls the opening and closing of the aperture 142.

[0010] The optical system 104 includes a plurality of lenses (lens 141a, zooming lens 141b, and focusing lens 141c) arranged in the optical axis direction, and an aperture 142. The optical system 104 collects subject light and emits it to the image sensor 105.

[0011] The image pickup device 105 receives subject light from the optical system 104 and converts the received light into electrical signals. The image pickup device 105 may be, for example, an XY address type solid-state image pickup device (for example, CMOS (Complementary Metal-Oxide Semiconductor)), or may be a progressive scan type solid-state image pickup device (for example, CCD (Charge Coupled Device)).

[0012] A plurality of light receiving elements (pixels) are arranged in a matrix on the light receiving surface of the image pickup device 105. A plurality of types of color filters that respectively transmit light of different color components are arranged on the pixels of the image pickup device 105 according to a predetermined color array (for example, a Bayer array). Therefore, each pixel of the image pickup device 105 outputs an analog electrical signal corresponding to each color component through color separation performed by the color filters.

[0013] The AFE 106 is an analog front-end circuit that performs signal processing on analog electrical signals output from the image pickup device 105. The AFE 106 sequentially executes gain adjustment of electrical signals, analog signal processing (correlated double sampling, black level correction, etc.), A / D conversion processing, and digital signal processing (defective pixel correction, etc.) to generate RAW image data, and outputs the generated RAW image data to the LSI 107. The aforementioned driving unit 103, optical system 104, image pickup device 105, and AFE 106 constitute the image pickup unit 120.

[0014] The LSI 107 is an integrated circuit that performs specific processing on RAW image data from the AFE 106, including image processing such as color interpolation, white balance adjustment, contour enhancement, gamma correction, and gradation conversion, as well as encoding processing, decoding processing, compression / decompression processing, recording processing, and reproduction processing. Specifically, the LSI 107 may be implemented by, for example, a PLD (Programmable Logic Device) such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

[0015] The operation device 108 inputs commands and data. Examples of the operation device 108 include various buttons including a release button, switches, dials, and a touch panel. The microphone 109 inputs voice and generates voice data. The sensor 110 is a device that detects information, and examples thereof include an AF (Automatic Focus) sensor, an AE (Automatic Exposure) sensor, a gyro sensor, an acceleration sensor, and a temperature sensor. The display device 111 displays image data and setting screens. The display device 111 includes a rear monitor provided on a rear surface of the imaging apparatus 100, and an electronic viewfinder. The communication IF 112 connects to a network and transmits and receives data. The speaker 113 outputs voice.

[0016] Note that the processor 101, the storage device 102, the LSI 107, the operation device 108, the microphone 109, the sensor 110, the display device 111, the communication IF 112, the speaker 113, and the bus 114 are referred to as an image processing unit 130. Further, an apparatus including the image processing unit 130 obtained by removing the imaging unit 120 from the imaging apparatus 100 is referred to as an image processing apparatus.

[0017] <Example of memo recording and control of the main moving image> FIG. 2 is an explanatory diagram showing an example of memo recording and control of the main moving image. Memo recording is recording at least voice data among voice data and moving image data as a memo before and / or after main shooting. Further, at least voice data among voice data and moving image data recorded by memo recording is referred to as memo data. That is, the memo data is either only voice data, or both voice data and moving image data, and which of the two options is to be adopted is set in the imaging apparatus 100 in advance. Further, main shooting is shooting that a user who is a photographer originally intends to perform, and voice data and moving image data recorded by main shooting are referred to as main moving image data. Further, recording of the main moving image data is referred to as main moving image recording.

[0018] Furthermore, the memo recording performed before this video recording will be referred to as Memo Recording A, and the memo recording performed after this video recording will be referred to as Memo Recording B. If Memo Recording A and B are not distinguished, they will simply be referred to as Memo Recording. The memo data recorded by Memo Recording A will be referred to as Memo Data A, and the memo data recorded by Memo Recording B will be referred to as Memo Data B. If Memo Data A and B are not distinguished, they will simply be referred to as Memo Data.

[0019] When the imaging device 100 receives a notification to start memo recording A at time t1 (reception 201), it starts memo recording A and records memo data A in the storage device 102 until memo recording A is finished. Subsequently, when the imaging device 100 receives a notification to finish memo recording A at time t2 (reception 202), it finishes memo recording A and starts main video recording, recording main video data in the storage device 102 until main video recording is finished. Subsequently, when the imaging device 100 receives a notification to finish main video recording at time t3 (reception 203), it finishes main video recording and starts memo recording B, recording memo data B in the storage device 102 until memo recording B is finished. Subsequently, when the imaging device 100 receives a notification to finish memo recording B at time t4 (reception 204), it finishes memo recording B.

[0020] In Figure 2, the imaging device 100 performed memo recording A and memo recording B before and after the main video recording, but it is also possible to perform only memo recording A or only memo recording B.

[0021] If only memo recording A is performed, the imaging device 100 will terminate the video recording when it receives a signal to end the video recording at time t3.

[0022] If only memo recording B is performed, the imaging device 100, upon receiving a request to start the main video recording at time t2, starts the main video recording and records the main video data to the storage device 102 until the main video recording is finished. Subsequently, upon receiving a request to finish the main video recording at time t3, the imaging device 100 finishes the main video recording and starts memo recording B, recording memo data B of memo recording B to the storage device 102 until memo recording B is finished. Subsequently, upon receiving a request to finish memo recording B at time t4, the imaging device 100 finishes memo recording B.

[0023] Thus, the imaging device 100 can control both memo recording and main video recording with a single recording request at times t2 and t3. Therefore, the user does not need to perform separate reception operations for memo recording and main video recording, thereby improving convenience.

[0024] In particular, it is the video recording, not the still image recording, that is controlled simultaneously with the memo recording. In the case of still images, the user adjusts the composition of the main subject, the degree of blur of surrounding subjects, exposure, etc., and takes a picture of the main subject at a split second. Therefore, the end time of memo recording A (time t2) and the start time of memo recording B (time t3) do not necessarily coincide with the shooting timing. Consequently, if memo data is prioritized and still image shooting is accepted simultaneously with memo recording, still images unintended by the user will be taken.

[0025] In contrast, videos have a duration rather than just a single moment, and can be edited after shooting, such as deleting unnecessary parts, so strict timing for shooting, as with still images, is not necessary. For example, even if a user simultaneously ends memo recording A and starts the main video recording at the moment they determine that memo recording A no longer needs to be done, the main video recording will start without any interruption to the memo data A.

[0026] In this way, by controlling the video recording simultaneously with memo recording instead of still image recording, the imaging device 100 can save information about the user (photographer), subject, and shooting location before the video recording (for example, points that the user or subject should pay attention to before shooting, and the conditions of the shooting location) as memo data A, and information about the user, subject, and shooting location during or after the video recording (for example, points for improvement or reflection on the user's or subject's behavior during shooting, and the conditions of the shooting location after shooting) as memo data B.

[0027] Furthermore, on the display screen 200 of the display device 111, the display information indicating that memo recording is in progress and the display information indicating that video recording is in progress may be displayed with different content or in different positions. In Figure 2, "●MEMO REC" is displayed when memo recording is in progress, and "●REC" is displayed when video recording is in progress. This allows the user to confirm whether the current recording is memo recording or video recording. Furthermore, the same string of characters may be displayed in different colors during memo recording and video recording.

[0028] Figure 3 is an explanatory diagram showing memo recording and reception example 1 for this video. Reception example 1 is an example where receptions 201 to 204 are the press of the memo button. (a) is a timing chart showing reception examples for memo recordings A and B, (b) is a timing chart showing reception example for memo recording A only, and (c) is a timing chart showing reception example for memo recording B only. In (a) to (c), the OFF→ON→OFF pulse indicates reception of the start or end of recording.

[0029] The memo button is configured, for example, by an operating device 108. When the memo button is pressed, the imaging device 100 accepts the start or end of recording. Therefore, even if the user continues to press the memo button or the user stops pressing it and the memo button is released, the imaging device 100 will not accept the end or start of recording unless the button is pressed again from the released state.

[0030] In (a), when the memo button is pressed at time t1, memo recording A begins. Then, when the memo button is pressed again at time t2, memo recording A ends and the main video recording begins. Then, when the memo button is pressed again at time t3, the main video recording ends and memo recording B begins. Then, when the memo button is pressed again at time t4, memo recording B ends.

[0031] In (b), when the memo button is pressed at time t1, memo recording A begins. Then, when the memo button is pressed again at time t2, memo recording A ends and the main video recording begins. Then, when the memo button is pressed again at time t3, the main video recording ends.

[0032] In (c), when the memo button is pressed at time t2, this video recording begins. Then, when the memo button is pressed again at time t3, this video recording ends and memo recording B begins. Then, when the memo button is pressed again at time t4, memo recording B ends.

[0033] Figure 4 is an explanatory diagram showing example 2 of memo recording and video reception. Reception example 2 is an example where receptions 201 to 204 are the press or release of the memo button. (d) is a timing chart showing examples of reception for memo recordings A and B, (e) is a timing chart showing an example of reception for memo recording A only, and (f) is a timing chart showing an example of reception for memo recording B only. In (d) to (f), the rising edge of OFF→ON indicates reception for the start of memo recording, the falling edge of ON→OFF indicates reception for the end of recording, and the pulse OFF→ON→OFF indicates reception for the start or end of video recording.

[0034] In (d), when the memo button is pressed, the imaging device 100 accepts the start of memo recording and continues to perform memo recording until the memo button is released. Specifically, for example, if the memo button is pressed at time t1, memo recording A starts. If the button is held down and released at time t2, memo recording A ends and the main video recording starts. If the button is held down again and pressed at time t3, the main video recording ends and memo recording B starts. Then, if the memo button is released again at time t4, memo recording B ends.

[0035] In (e), if the memo button is pressed at a time other than t3, the imaging device 100 accepts the start of memo recording and continues to perform memo recording until the memo button is released. Specifically, for example, if the memo button is pressed at time t1, memo recording A starts. If the button is held down and released at time t2, memo recording A ends and the main video recording starts. Then, if the memo button is pressed again at time t3, the main video recording ends.

[0036] In (f), if the memo button is pressed at a time other than t2, the imaging device 100 accepts the start of memo recording and continues to perform memo recording until the memo button is released. Specifically, for example, if the memo button is pressed at time t2, the main video recording starts. Then, if the memo button is pressed again at time t3, the main video recording ends and memo recording B starts. If the button is held down thereafter and the memo button is released at time t4, memo recording B ends.

[0037] In Example 1, it is sufficient that memo recording and video recording can be controlled with a single operation at times t2 and t3 in (a) and (d), time t2 in (b) and (e), and time t3 in (c) and (f). Therefore, the memo button may be a recording button that accepts the start and end of recording, or it may be any other button besides the recording button. For example, if the memo button and recording button are positioned so that the user can press them simultaneously while holding the imaging device 100, the imaging device 100 may be configured to have a memo button separate from the recording button that accepts the start and end of recording when pressed.

[0038] Furthermore, the imaging device 100 may be set in advance to a memo recording mode in which at least one of memo recording A or B is performed by user operation, and the recording button may function as a memo button when in memo recording mode. The operation buttons may also be buttons on a touch panel, i.e., a graphic user interface. In addition to operation buttons, the start or end of recording may be accepted by voice recognition.

[0039] For example, the imaging device 100 stores text data indicating the start of recording (e.g., "Start") in the storage device 102. When voice indicating the start of recording (e.g., "Start") is input to the microphone 109, voice recognition converts it into the text data "Start". The imaging device 100 accepts the start of recording if the text data indicating the start of recording in the storage device 102 matches the text data resulting from voice recognition. The same applies to the end of recording.

[0040] <Example of functional configuration of imaging device 100> Figure 5 is a block diagram showing an example of the functional configuration of the imaging device 100. The imaging device 100 includes a recording unit 501, a receiving unit 502, a control unit 503, a setting unit 504, and a recording medium 505.

[0041] The recording unit 501 converts the audio input from the microphone 109 into audio data and records it on the recording medium 505. The recording unit 501 also generates video frames based on the image data from the imaging unit 120 and records them on the recording medium 505.

[0042] Specifically, for example, when the recording unit 501 receives a control signal from the control unit 503 to start recording memo data only, it records the memo data on the recording medium 505. When it receives a control signal from the control unit 503 to end memo recording, it stops recording the memo data. As a result, an audio file, which is memo data containing the audio from the start to the end of memo recording, is generated on the recording medium 505.

[0043] Furthermore, when the recording unit 501 receives a control signal from the control unit 503 to start recording memo data, which includes audio data and video data, it records the memo data on the recording medium 505. When it receives a control signal from the control unit 503 to end recording, it terminates the recording of the memo data. As a result, a video file, which is memo data containing audio and video recorded from the start to the end of recording, is generated on the recording medium 505.

[0044] Similarly, when the recording unit 501 receives a control signal from the control unit 503 to start recording the video data, which includes audio and video data, it records the video data on the recording medium 505. When it receives a control signal from the control unit 503 to end recording, it terminates the recording of the video data. As a result, a video file, which is the video data containing the audio and video recorded from the start to the end of recording, is generated on the recording medium 505.

[0045] The recording unit 501 saves memo data A, memo data B, and the main video data as separate files on the recording medium 505.

[0046] Specifically, the recording unit 501 is implemented, for example, by having the processor 101 execute a program stored in the storage device 102 shown in Figure 1, or by the LSI 107.

[0047] The reception unit 502 receives the start or end of recording from the operating device 108 or the microphone 109. Specifically, for example, the reception unit 502 has an operating unit 520. The operating unit 520 receives input related to data recording. Input related to recording is, for example, an input to start data recording or an input to end data recording.

[0048] The operation unit 520 consists of a first operation unit 521 and a second operation unit 522. The first operation unit 521 receives input related to memo recording. Input related to memo recording includes, for example, the start input for memo recording or the end input for memo recording. The second operation unit 522 receives input related to the main video recording. Input related to the main video recording includes, for example, the start input for the main video recording or the end input for the main video recording.

[0049] Specifically, the reception unit 502 is implemented, for example, by causing the processor 101 to execute a program stored in the memory device 102 shown in Figure 1, or by the LSI 107.

[0050] When the control unit 503 receives input from the reception unit 502 during the recording of either the memo recording or the main video recording, it controls the recording unit 501 to terminate the recording of one and start the recording of the other. As a result, the data related to one recording is finished being recorded to the recording medium 505, and the data related to the other recording is recorded to the recording medium 505. In this way, memo data A and B and the main video data are recorded.

[0051] Specifically, for example, in the cases of Figure 3(a) and Figure 4(d), when the control unit 503 receives notification from the reception unit 502 that memo recording A has started, it outputs a control signal for the start of memo recording A to the recording unit 501. When the reception unit 502 receives notification that memo recording A has ended, it outputs a control signal for the end of memo recording A and the start of this video recording to the recording unit 501.

[0052] Furthermore, when the control unit 503 receives notification from the reception unit 502 that the video recording has ended, it outputs a control signal to the recording unit 501 indicating the end of the video recording and the start of memo recording B.

[0053] Furthermore, when the control unit 503 receives notification from the reception unit 502 that memo recording B has ended, it outputs a control signal for the end of memo recording B to the recording unit 501.

[0054] In the cases of Figure 3(b) and Figure 4(e), specifically, for example, when the control unit 503 receives notification from the reception unit 502 that memo recording A has started, it outputs a control signal for the start of memo recording A to the recording unit 501, and when the reception unit 502 receives notification that memo recording A has ended, it outputs a control signal for the end of memo recording A and the start of this video recording to the recording unit 501.

[0055] Furthermore, when the control unit 503 receives notification from the reception unit 502 that the video recording has ended, it outputs a control signal to the recording unit 501 indicating the end of the video recording.

[0056] In the cases of Figure 3(c) and Figure 4(f), specifically, for example, when the control unit 503 receives notification from the reception unit 502 to start the video recording, it outputs a control signal for the start of the video recording to the recording unit 501, and when the reception unit 502 receives notification for the end of the video recording, it outputs a control signal for the end of the video recording and the start of memo recording B to the recording unit 501.

[0057] Furthermore, when the control unit 503 receives notification from the reception unit 502 that memo recording B has ended, it outputs a control signal for the end of memo recording B to the recording unit 501.

[0058] Alternatively, the control unit 503 may control the recording unit 501 to combine memo data A, memo data B, and the video data into a single file and save it to the recording medium 505.

[0059] For example, in the cases of Figure 3(a) and Figure 4(d), memo data A, main video data, and memo data B are combined into a single file. Specifically, for example, the control unit 503 controls the recording unit 501 to set chapter delimiters at the playback position of the connection point (boundary) between memo data A and main video data, and at the playback position of the connection point (boundary) between main video data and memo data B, treating memo data A, main video data, and memo data B as one chapter each.

[0060] Similarly, in the cases of Figure 3(b) and Figure 4(e), memo data A and the main video data are combined into a single file. Specifically, for example, the control unit 503 controls the recording unit 501 to set the chapter delimiter position at the playback position of the connection point (boundary) between memo data A and the main video data, treating each of the memo data A and the main video data as a single chapter.

[0061] Similarly, in the cases of Figure 3(c) and Figure 4(f), the main video data and memo data B are combined into a single file. Specifically, for example, the control unit 503 controls the recording unit 501 to set the playback position at the connection point (boundary) between the main video data and memo data B, and the chapter delimiter position, treating each of the main video data and memo data B as a single chapter. This allows the user to skip the playback position of the combined file to the delimiter position.

[0062] Furthermore, the control unit 503 may control the recording unit 501 to assign the time (playback position) from the start of recording of the first recorded data to the subsequent recorded data as the time (playback position) from the start of playback of the subsequent recorded data.

[0063] For example, in Figure 3(a) and Figure 4(d), if memo data A, memo data B, and the main video data are separate files, the control unit 503 controls the recording unit 501 to assign the time (playback position) from the start of recording of memo data A to each of memo data A, the main video data, and memo data B.

[0064] Specifically, for example, the control unit 503 controls the recording unit 501 to embed the playback time of memo data A into the video data. As a result, when the video data is played back, the playback time of memo data A is added to the playback position of the video data itself, which becomes the time (playback position) from the start of recording of memo data A. Therefore, the playback position of the video data itself and the time (playback position) from the start of recording of memo data A at that playback position can be displayed.

[0065] Furthermore, the control unit 503 controls the recording unit 501 to embed the total playback time of memo data A and the main video data into memo data B. As a result, when memo data B is played back, the total playback time of memo data A and the main video data is added to the playback position of memo data B itself, which becomes the time (playback position) from the start of recording of memo data A. Therefore, the playback position of memo data B itself and the time (playback position) from the start of recording of memo data A at that playback position can be displayed.

[0066] Similarly, in the cases of Figure 3(b) and Figure 4(e), the control unit 503 controls the recording unit 501 to add the time (playback position) from the start of recording of memo data A to the video data.

[0067] Specifically, for example, the control unit 503 controls the recording unit 501 to embed the playback time of memo data A into the video data. As a result, when the video data is played back, the playback time of memo data A is added to the playback position of the video data itself, which becomes the time (playback position) from the start of recording of memo data A. Therefore, the playback position of the video data itself and the time (playback position) from the start of recording of memo data A at that playback position can be displayed.

[0068] Similarly, in the cases of Figure 3(c) and Figure 4(f), the control unit 503 controls the recording unit 501 to assign the time (playback position) from the start of recording of memo data A to memo data B.

[0069] Specifically, for example, the control unit 503 controls the recording unit 501 to embed the playback time of the main video data into memo data B. As a result, when memo data B is played back, the playback time of the main video data is added to the playback position of memo data B itself, which becomes the time (playback position) from the start of recording of the main video data. Therefore, the playback position of memo data B itself and the time (playback position) from the start of recording of the main video data at that playback position can be displayed.

[0070] Furthermore, the control unit 503 may control the recording unit 501 to record one set of data recorded by either the memo recording or the main video recording, and the other set of data recorded by the other recording, on the recording medium 505 at different bitrates.

[0071] Specifically, for example, the control unit 503 can reduce the amount of data in memo data A and B by controlling the recording unit 501 to lower the bitrate of memo data A and B to a lower bitrate of the main video data, and it can also reduce the amount of data in the main video data by lowering the bitrate of the main video data to a lower bitrate of memo data A and B.

[0072] Furthermore, if the memo data includes video data, the control unit 503 may control the recording unit 501 to record one set of data recorded by either the memo recording or the main video recording, and the other set of data recorded by the other recording, on the recording medium 505 at different resolutions.

[0073] Specifically, for example, the control unit 503 can reduce the data volume of memo data A and B by controlling the recording unit 501 to lower the resolution of memo data A and B to a lower resolution than the resolution of the main video data, and it can also reduce the data volume of the main video data by lowering the resolution of the main video data to a lower resolution than the resolution of memo data A and B.

[0074] Specifically, the control unit 503 is implemented, for example, by causing the processor 101 to execute a program stored in the memory device 102 shown in Figure 1, or by the LSI 107.

[0075] The setting unit 504 allows the user to select whether to start memo recording before the start of the main video recording, when the main video recording ends, or both before and after the start of the main video recording.

[0076] Figure 6 is an explanatory diagram showing an example of a settings screen. The imaging device 100 has a display device 111 on its back. The display device 111 also functions as a touch panel. The display device 111 displays the settings screen 600. The settings screen 600 has a first setting button 601, a second setting button, and a third setting button 603.

[0077] The first setting button 601 is a user interface for starting note recording before the start of the video recording and at the end of the video recording. The second setting button 602 is a user interface for starting note recording before the start of the video recording. The third setting button 603 is a user interface for starting note recording at the end of the video recording.

[0078] When the first setting button 601 is pressed, the operating device 108 becomes capable of receiving memo recording A, main video recording, and memo recording B, as shown in Figure 3(a) and Figure 4(d) (hereinafter referred to as the first setting). When the second setting button 602 is pressed, the operating device 108 becomes capable of receiving memo recording A and main video recording, as shown in Figure 3(b) and Figure 4(e) (hereinafter referred to as the second setting). Figure 6 shows the state when the second setting button 602 is pressed. When the third setting button 603 is pressed, the operating device 108 becomes capable of receiving main video recording and memo recording B, as shown in Figure 3(c) and Figure 4(f) (hereinafter referred to as the third setting).

[0079] Although not shown in the diagram, the setting unit 504 can also be configured to allow selection of whether the memo recording A and B will be audio data only, or audio data and video data.

[0080] Specifically, the setting unit 504 is implemented, for example, by having the processor 101 execute a program stored in the memory device 102 shown in Figure 1, or by the LSI 107.

[0081] Returning to Figure 5, the recording medium 505 records memo data and the main video data. The recording medium 505 is implemented by the storage device 102. The recording medium 505 may be configured to be detachably attached to the imaging device 100.

[0082] <Example of recording and processing procedure> Figure 7 is a flowchart 1 showing an example of the processing procedure for memo recording and video recording by the imaging device 100. As shown in Figure 3(a) and Figure 4(d), Figure 7 shows an example of the processing procedure performed in the first setting.

[0083] The imaging device 100 waits for the start of memo recording A (step S701: No). If it receives notification of the start of memo recording A (step S701: Yes), the imaging device 100 starts memo recording A (step S702). Next, the imaging device 100 waits for the start of the main video recording (step S703: No). If it receives notification of the start of the main video recording (step S703: Yes), the imaging device 100 ends memo recording A and starts the main video recording (step S704).

[0084] Next, the imaging device 100 waits for the end of the video recording (Step S705: No). If it receives confirmation that the video recording has ended (Step S705: Yes), the imaging device 100 terminates the video recording and starts memo recording B (Step S706).

[0085] Next, the imaging device 100 waits for the end of memo recording B (step S707: No). If it receives confirmation that memo recording B has ended (step S707: Yes), the imaging device 100 terminates memo recording B (step S708).

[0086] Figure 8 is flowchart 2, which shows an example of the processing procedure for memo recording and video recording by the imaging device 100. Figure 8 shows an example of the processing procedure in the second setting, as shown in Figure 3(b) and Figure 4(e). The same steps are used for the same processing as in Figure 7.

[0087] In Figure 8, the imaging device 100 executes steps S701 to S705. If it receives confirmation that the video recording has ended (step S705: Yes), the imaging device 100 terminates the video recording (step S806).

[0088] Figure 9 is flowchart 3, which shows an example of the processing procedure for memo recording and video recording by the imaging device 100. Figure 9 shows an example of the processing procedure in the third setting, as shown in Figure 3(c) and Figure 4(f). The same step numbers are used for the same processing as in Figure 7.

[0089] The imaging device 100 waits for the start of this video recording (Step S901: No). If it receives a signal to start this video recording (Step S901: Yes), the imaging device 100 starts this video recording (Step S903).

[0090] Next, the imaging device 100 waits for the start of memo recording B (step S903: No). If it receives confirmation that memo recording B has started (step S903: Yes), the imaging device 100 executes steps S706 to S708.

[0091] As described above, the imaging device 100 according to Embodiment 1 performs memo recording A before recording the main video, and then, when a specific operation is performed, memo recording A ends and the main video recording begins. This makes it possible to end memo recording A and start the main video recording with a single operation. In other words, there is no need to perform the operation to end memo recording A and the operation to start the main video recording separately. Therefore, the user can switch from memo recording A to main video recording with a single operation, and the time lag between the end of memo recording A and the start of main video recording can be shortened.

[0092] Similarly, if you perform the main video recording before memo recording B, and then perform a specific operation, the main video recording will end and memo recording B will start. This allows you to end the main video recording and start memo recording B with a single operation. In other words, there is no need to perform separate operations for ending the main video recording and starting memo recording B. Therefore, the user can switch from the main video recording to memo recording B with a single operation, and the time lag between the end of the main video recording and the start of memo recording B can be reduced.

[0093] In particular, when memo data consists only of audio data, the processing time for ending memo recording is shorter compared to when it includes video data. Therefore, it is possible to shorten the time lag between the end of memo recording A and the start of this video recording.

[0094] Furthermore, by viewing the memo data, users can easily understand the content of the main video data without having to play and watch it. [Examples]

[0095] Example 2 will now be described. Example 2 is an example of performing memo recording and main video recording using two imaging devices 100. Figure 10 shows an example of application to a video shooting site. Note that in Example 2, the explanation will focus on the differences from Example 1, so the same reference numerals will be used for the same parts as in Example 1, or the explanation will be omitted.

[0096] Figure 10 is an explanatory diagram showing an example configuration of a camera system according to Embodiment 2. The camera system 1000 includes a first imaging device 1001, a second imaging device 1002, a first monitor 1010, and a second monitor 1020. The hardware configuration example of the first imaging device 1001 and the second imaging device 1002 is the same as the configuration shown in Figure 1, for example. Furthermore, the functional configuration example of the first imaging device 1001 includes, for example, a configuration used for at least this video recording, and the functional configuration example of the second imaging device 1002 includes, for example, a configuration used for at least memo recording.

[0097] The first imaging device 1001 and the second imaging device 1002 are connected in a communication manner. The first imaging device 1001 and the first monitor 1010 are also connected in a communication manner. Furthermore, the second imaging device 1002 and the second monitor 1020 are also connected in a communication manner.

[0098] The first imaging device 1001 is operated by the first photographer P1. The first imaging device 1001 captures images of actors AC1 and AC2 and performs video recording. The first imaging device 1001 transmits the video data to the first monitor 1010.

[0099] The second imaging device 1002 is operated remotely by the first photographer P1 or directly by the second photographer P2. In this example, the first photographer P1 remotely controls the input operations for starting and ending memo recording from the first imaging device 1001. The second photographer P2 controls the orientation of the second imaging device 1002 and determines the field of view. The second imaging device 1002 images the director D and performs memo recording. The second imaging device 1002 transmits the memo data to the second monitor 1020.

[0100] The first monitor 1010 receives the video data from the first imaging device 1001 and displays and outputs audio for the video. The video is viewed by director D.

[0101] The second monitor 1020 receives memo data from the second imaging device 1002 and displays or outputs audio about the memo. This video is viewed by actors AC1 and AC2.

[0102] Next, the video recording processing procedure for the camera system 1000 will be explained using Figures 11 and 12.

[0103] Figure 11 is a flowchart showing an example of the video recording process procedure using the first imaging device 1001, and Figure 12 is a flowchart showing an example of the memo recording process procedure using the second imaging device 1002. In Figures 11 and 12, it is assumed that the first setting has been set by pressing the first setting button 601 on the first imaging device 1001.

[0104] In Figure 11, the first imaging device 1001 waits for an input to start memo recording A from the first photographer P1 (step S1101: No). Upon receiving the input to start memo recording A (step S1101: Yes), the first imaging device 1001 transmits a control signal to start memo recording A to the second imaging device 1002 (step S1102).

[0105] In Figure 12, the second imaging device 1002 awaits the control signal to start memo recording A in step S1102 (step S1201: No). Upon receiving the control signal to start memo recording A (step S1201: Yes), the second imaging device 1002 starts memo recording A using the recording unit 501 and transmits memo data A to the second monitor 1020 (step S1202).

[0106] Specifically, for example, the second imaging device 1002 records video of director D's instructions, gestures, and facial expressions as memo data A, and transmits it to the second monitor 1020 as memo data A. The second monitor 1020 then outputs the received memo data A for viewing. Actors AC1 and AC2 can view the contents of director D's memo data A on the second monitor 1020 before filming the video, allowing them to pre-confirm their acting.

[0107] Returning to Figure 11, the first imaging device 1001 awaits the input to start recording the video from the first photographer P1 (step S1103: No). For example, when the first photographer P1 receives an instruction from director D to start shooting the video, the first photographer P1 performs the operation to input the start of video recording to the first imaging device 1001.

[0108] Upon receiving the input to start this video recording (step S1103: Yes), the first imaging device 1001 transmits a control signal to the second imaging device 1002 indicating the end of memo recording A (step S1104), and simultaneously outputs a control signal from the control unit 503 to the recording unit 501 to start this video recording, and transmits the video data to the first monitor 1010 (step S1105). As a result, the performances of actors AC1 and AC2 are captured.

[0109] Returning to Figure 12, the second imaging device 1002 waits for the control signal to terminate memo recording A in step S1104 (step S1203: No). Upon receiving the control signal to terminate memo recording A (step S1203: Yes), the second imaging device 1002 terminates memo recording A using the recording unit 501 and saves the memo data A from the start to the end of memo recording A to the recording medium 505 (step S1204).

[0110] Returning to Figure 11, the first imaging device 1001 awaits an input from the first photographer P1 to end the video recording (step S1106: No). For example, when the first photographer P1 receives an instruction from director D to end the video recording, the first photographer P1 performs the operation to input the end of the video recording to the first imaging device 1001. Upon receiving the input to end the video recording (step S1106: Yes), the first imaging device 1001 transmits a control signal to the second imaging device 1002 to start memo recording B (step S1107), and outputs a control signal from the control unit 503 to the recording unit 501 to end the video recording, and saves the video data from the start to the end of the video recording to the recording medium 505 (step S1108).

[0111] Returning to Figure 12, the second imaging device 1002 awaits the control signal to start memo recording B in step S1107 (step S1205: No). Upon receiving the control signal to start memo recording B (step S1205: Yes), the second imaging device 1002 starts memo recording B using the recording unit 501 and transmits memo data B to the second monitor 1020 (step S1206).

[0112] Specifically, for example, the second imaging device 1002 records video of director D's speech, gestures, and facial expressions as memo data B, and transmits it to the second monitor 1020 as memo data B. The second monitor 1020 then outputs the received memo data B for viewing. After the video is filmed, actors AC1 and AC2 can view the contents of director D's memo data B on the second monitor 1020 to review their performance afterward.

[0113] Returning to Figure 11, the first imaging device 1001 awaits an input from the first photographer P1 to end memo recording B (step S1109: No). For example, when the first photographer P1 receives an instruction from the director D to end memo recording B, the first photographer P1 performs the operation to input the end of memo recording B to the first imaging device 1001. Upon receiving the input to end memo recording B (step S1109: Yes), the first imaging device 1001 transmits a control signal to the second imaging device 1002 to end memo recording B (step S1110).

[0114] Returning to Figure 12, the second imaging device 1002 waits for the control signal to terminate memo recording B in step S1110 (step S1207: No). Upon receiving the control signal to terminate memo recording B (step S1207: Yes), the second imaging device 1002 terminates memo recording B using the recording unit 501 and saves the memo data B from the start to the end of memo recording B to the recording medium 505 (step S1208).

[0115] Next, the second imaging device 1002 transmits memo data A and B to the first imaging device 1001 (step S1209). With this, the second imaging device 1002 terminates its processing.

[0116] Returning to Figure 11, the first imaging device 1001 receives memo data A and B from the second imaging device 1002 and saves them to the recording medium 505 (step S1111). With this, the first imaging device 1001 terminates its processing. After this, as described in Example 1, the first imaging device 1001 may combine the memo data A and B with the main video data into files in the order of playback: memo data A, main video data, and memo data B.

[0117] Note that Figures 11 and 12 illustrate the process when the first setting is performed. However, when the second setting is performed, steps S1107, S1109, and S1110 become unnecessary in Figure 11, and only memo data A is received in step S1111. Also, in Figure 12, steps S1206 to S1208 become unnecessary, and only memo data A is transmitted in step S1209.

[0118] Furthermore, if the third setting is performed, steps S1101, S1102, and S1104 become unnecessary in Figure 11, and only memo data B is received in step S1111. Also, in Figure 12, steps S1201 to S1204 become unnecessary, and only memo data B is transmitted in step S1209.

[0119] Thus, according to the camera system 1000 of Embodiment 2, even when the location for recording memo data and the location for recording the main video are different, the end of memo recording A and the start of the main video recording can be achieved with a single operation by remotely controlling the second imaging device 1002 from the first imaging device 1001. In other words, there is no need to perform the operation to end memo recording A and the operation to start the main video recording separately. Therefore, the first photographer P1 can switch from memo recording A to main video recording with a single operation, and the time lag between the end of memo recording A and the start of main video recording can be shortened.

[0120] Similarly, if the main video recording is performed before memo recording B, and then a specific operation is performed, the main video recording will end and memo recording B will start. This allows the end of the main video recording and the start of memo recording B to be achieved with a single operation. In other words, there is no need to perform the operation to end the main video recording and the operation to start memo recording B separately. Therefore, the first photographer P1 can switch from the main video recording to memo recording B with a single operation, and the time lag between the end of the main video recording and the start of memo recording B can be shortened.

[0121] In particular, when memo data consists only of audio data, the processing time for ending memo recording is shorter compared to when it includes video data. Therefore, it is possible to shorten the time lag between the end of memo recording A and the start of this video recording.

[0122] Furthermore, by viewing memo data A, actors AC1 and AC2 can easily pre-check their acting before the actual filming, and by viewing memo data B, they can smoothly review their acting after the actual filming. [Examples]

[0123] Next, Example 3 will be described. Example 3 shows a modification common to Examples 1 and 2. The following will be explained in two parts: during recording and during playback and editing. Note that playback and editing may be performed on other computers, not just the imaging devices 100, 1001, and 1002, as long as memo data and the main video data are available.

[0124] <During recording> (1) When recording only audio data, the control unit 503 may record the audio data of the audio portion as memo data on the recording medium 505 while deleting silent sections. This can reduce the data size of the memo data. The control unit 503 may also delete silent sections if the audio level remains below a threshold for a predetermined period of time.

[0125] (2) The operating device 108 may be an infrared sensor or an image sensor, or any other device that can detect the start or end of recording input without contact by waving a hand over it. Alternatively, the operating device 108 may be a device that can detect the start or end of recording input by the user's gaze input. This eliminates shaking and operation noise of the imaging devices 100 and 1001 caused by button presses, thereby improving the quality of memo data and main video data.

[0126] (3) The control unit 503 may control the recording unit 501 so that the compression ratio of the memo data and the compression ratio of the main video data are different. For example, the higher the compression ratio of the memo data is than that of the main video data, the more free space there is on the recording medium 505, and the larger the data size of the main video data can be. Also, since the playback time of the main video data is generally longer than that of the memo data, the higher the compression ratio of the main video data is than that of the memo data, the more free space there is on the recording medium 505 can be increased.

[0127] (4) The control unit 503 may control the recording unit 501 so that the frame rate of the memo data and the frame rate of the main video data are different. For example, the lower the frame rate of the memo data is compared to the main video data, the more free space is available on the recording medium 505, and the larger the data size of the main video data can be. Also, since the playback time of the main video data is generally longer than that of the memo data, the lower the frame rate of the main video data is compared to that of the memo data, the more free space can be available on the recording medium 505.

[0128] (5) If a predetermined time has elapsed since the start of memo recording B, the control unit 503 may terminate memo recording B by outputting a control signal for the termination of memo recording B to the recording unit 501, even if the termination of memo recording B has not been accepted.

[0129] (6) The control unit 503 may convert the audio data in memo data A into text data using speech recognition and display it as a caption on the display device 111 (Example 1) or the first monitor 1010 (Example 2) while the video data is being recorded. This makes it possible to check memo data A while watching the video.

[0130] (7) The control unit 503 may convert the audio data in memo data A into text data using speech recognition and translate it into another language specified in advance.

[0131] <During playback and editing> (8) The control unit 503 may convert the audio data in the memo data into text data using speech recognition and display it as a caption on the display device 111 (Example 1) or the first monitor 1010 (Example 2) while the video data is being played back. This makes it possible to check the memo data while watching the video.

[0132] (9) The control unit 503 may control the display device 111 to play and display the memo data and the main video data with different colors. This makes it possible to intuitively understand whether the memo data or the main video data is being played.

[0133] (10) The control unit 503 may control the system to read aloud the audio in the specified file and output it from the speaker 113 by specifying an icon representing the memo data or video data file on the operating device 108. Similarly, the control unit 503 may convert the audio in the specified file into text and display it in a speech bubble by specifying an icon representing the memo data or video data file on the operating device 108. This allows the user to check what kind of audio will be output before opening the file.

[0134] (11) When the control unit 503 plays back memo data, it may control the audio playback speed to be greater than 1x in advance to output the audio.

[0135] (12) The control unit 503 may add text data, which is text generated by speech recognition of the audio in the file, to the memo data or the video data file. This allows the imaging devices 100, 1001, and 1002 to search for files containing the search string by inputting the text data as a search string. Furthermore, if the text data contains a specific string that has been registered in advance (for example, an NG word), the control unit 503 may control the system to read out the specific string as a self-censorship sound.

[0136] (13) The control unit 503 may control the transmission of memo data and video data to another computer. Specifically, for example, the control unit 503 may control the transmission of memo data and video data in order from the data with the smallest data size. This can improve file transfer efficiency.

[0137] (14) The imaging devices 100, 1001 may have dual slots, each of which may have a recording medium 505. In this case, the control unit 503 controls the recording unit 501 to save memo data to the recording medium 505 of one slot and the video data to the recording medium 505 of the other slot. The control unit 503 may save both the memo data and the video data to the recording medium 505 of both slots for data backup.

[0138] (15) The imaging devices 100 and 1001 may add sound effect data to the playback position of the linking point (boundary) of the combined file, which is a combination of memo data and main video data. As a result, when the playback position of the linking point (boundary) is played during playback of the combined file, the sound effect will be output as audio. Therefore, viewers can recognize the switch from memo data A to main video data and the switch from main video data to memo data B by the sound effect.

[0139] (16) The imaging devices 100 and 1001 may display a thumbnail image of the video data when outputting audio of memo data containing only audio data.

[0140] (17) The imaging devices 100 and 1001 convert the audio of the video data into text data by speech recognition, and if the text data contains a specific string at a specific playback position, they may set a specific flag on the video data. For example, if the pre-registered string "OK" is present in the playback section towards the end of the video, the imaging devices 100 and 1001 set a flag indicating that the video data has passed. The imaging devices 100 and 1001 may also display information indicating that the video data has passed on the file icon. This allows the user to confirm that the data has passed without having to play the video data.

[0141] Furthermore, it is believed that memo data A, recorded before the main video data that passed the test, contains information that contributed to the passing result. For this reason, imaging devices 100 and 1001 may set a flag indicating that the data contributed to the passing result in memo data A, in conjunction with setting a flag indicating that the data passed. Alternatively, imaging devices 100 and 1001 may display information indicating that the data contributed to the passing result on the file icon of memo data A.

[0142] Similarly, it is assumed that memo data A, recorded after the main video data that passed, contains positive feedback on the successful performance. For this reason, imaging devices 100 and 1001 may set a flag indicating positive feedback in memo data A in conjunction with setting a flag indicating passing. Furthermore, imaging devices 100 and 1001 may display information indicating positive feedback on the file icon of memo data A.

[0143] Conversely, if, for example, the pre-registered string "cut" exists in the playback section towards the end of the video, the imaging devices 100 and 1001 set a flag indicating that the video data is unacceptable. The imaging devices 100 and 1001 may also display information indicating that the video data is unacceptable on the file icon. This allows the user to confirm that the data is unacceptable without having to play the video data.

[0144] Furthermore, it is assumed that memo data B, recorded after the failing main video data, contains information regarding the reasons for the failure, points for reflection, and points for improvement. For this reason, imaging devices 100 and 1001 may set a flag indicating the cause of failure in memo data B in conjunction with setting a flag indicating failure. Alternatively, imaging devices 100 and 1001 may display information indicating the cause of failure on the file icon of memo data A.

[0145] It should be noted that the present invention is not limited to the above, and may be combined in any way. Furthermore, other embodiments that can be conceivable within the scope of the technical idea of ​​the present invention are also included in the scope of the present invention. [Explanation of Symbols]

[0146] 100, 1001, 1002 Imaging device, 501 Recording unit, 502 Reception unit, 503 Control unit, 504 Setting unit, 505 Recording medium, 520 Operation unit, 521 First operation unit, 522 Second operation unit, 600 Setting screen

Claims

1. A reception desk that accepts inputs regarding the recording of audio and video data, The system includes a first recorder that records at least the audio data from the audio data and the video data, and a control unit that controls the second recorder that records the audio data and the video data. When the receiving unit receives the input during the second recording, the control unit terminates the second recording and starts the first recording. Imaging device.

2. The imaging apparatus according to claim 1, The control unit terminates the first recording and starts the second recording when the receiving unit receives the input during the first recording.

3. The imaging apparatus according to claim 1, The first recorder is an imaging device that records only the audio data from among the audio data and the video data.

4. The imaging apparatus according to claim 1, The receiving unit is an operating unit operated for the first and second records, in the imaging device.

5. The imaging apparatus according to claim 1, The receiving unit comprises a first operating unit operated for the first recording and a second operating unit operated for the second recording, wherein the imaging device has these functions.

6. The imaging apparatus according to claim 1, The control unit is an imaging device that records the data from the second recording and the data from the first recording separately.

7. The imaging apparatus according to claim 1, The control unit records the data from the second recording and the data from the first recording in association with each other.

8. The imaging apparatus according to claim 7, The control unit is an imaging device that records the data from the second recording and the data from the first recording as a single data set.

9. The imaging apparatus according to claim 8, The control unit records data that divides the data from the second recording and the data from the first recording into a single data unit, as an imaging device.

10. The imaging apparatus according to claim 1, The control unit adds time data from the start of the second recording to the data from the second recording and the data from the first recording, in this imaging device.

11. The imaging apparatus according to claim 1, An imaging device having a selection unit that allows the user to select whether to start the first record before the start of the second record, start it at the end of the second record, or start it both before and after the start of the second record.

12. The imaging apparatus according to claim 1, The control unit controls another imaging device to initiate the first recording.

13. The imaging apparatus according to claim 1, The control unit is an imaging device that records the data from the second recording and the data from the first recording at different bit rates.

14. The imaging apparatus according to claim 1, An imaging device having a transmitting unit that transmits data from the first recording to an output device capable of outputting at least the audio data and communicating with the imaging device, among the audio data and the video data.

15. The imaging apparatus according to claim 1, The recording unit records at least one of the aforementioned audio data and video data onto a recording medium. The control unit controls the start and end of recording of at least one of the audio data and the video data onto the recording medium by the recording unit in the imaging device.

16. The imaging apparatus according to claim 15, The recording unit is an imaging device that continuously records at least one of the audio data and the video data on the recording medium from the time it receives a start instruction from the control unit until it receives a stop instruction from the control unit.

Images