Imaging device, imaging instruction method, and recording medium
By realizing flexible switching of camera parameters and parallel recording in a camera device, the problem of loss of image unity caused by camera parameter changes in the prior art is solved, and shooting flexibility and editing efficiency are improved.
Patent Information
- Application Number
- CN202180053362.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-08-28
- Filing Date
- 2021-08-23
- Publication Date
- 2025-10-21
- Estimated Expiration
- 2041-08-23
AI Technical Summary
Existing technologies make it difficult to flexibly change camera parameters when shooting dynamic images, resulting in a loss of unity in the work and making it difficult for users to make correct judgments during real-time shooting.
By realizing flexible switching of camera parameters in the camera device, dynamic images with original settings are recorded and retained, and dynamic images with different camera parameters are separately retained in the same recording medium, supporting parallel recording and display of multiple dynamic images.
Users can select appropriate camera parameter settings when editing to maintain a unified image and improve shooting flexibility and efficiency.
Smart Images

Figure CN115989670B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a camera device for shooting dynamic images, a camera instruction method and a recording medium. Background Art
[0002] Regarding technology for capturing moving images, for example, Patent Document 1 describes an imaging device that displays a menu screen for changing settings of imaging conditions on a display unit.
[0003] Previous technical literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2006-94145 Summary of the Invention
[0006] One embodiment of the technology according to the present invention provides an imaging device, an imaging instruction method, and a recording medium capable of easily recording a plurality of moving images having different imaging parameters.
[0007] Means for solving technical problems
[0008] The camera device involved in the first embodiment of the present invention is a camera device including a camera unit and a processor, wherein the processor performs the following processing: while the camera unit is capturing a first dynamic image based on a first camera parameter, the processor receives a first instruction indicating the setting of a second camera parameter different from the first camera parameter; after receiving the first instruction, the processor receives a second instruction to start capturing a second dynamic image based on the second camera parameter, and causes the camera unit to start capturing the second dynamic image; when the second instruction is received, the camera unit is caused to capture the first dynamic image until a third instruction to end the capturing of the first dynamic image is received; when the third instruction is received, the camera unit is caused to end the capturing of the first dynamic image.
[0009] In the imaging device according to the second aspect, in the first aspect, the processor receives, as the third instruction, an instruction from the user and situation data that is regarded as the third instruction when a predetermined condition is satisfied.
[0010] In the camera device involved in the third embodiment, in the second embodiment, the processor performs scene detection on the dynamic image captured by the camera unit, and generates status data by judging that the specified conditions are met when a first time has passed after the scene is switched and / or when the scene after switching continues for a second time.
[0011] In the imaging device according to the fourth aspect, in the third aspect, the processor determines that the scene has been switched when a predetermined parameter exceeds a threshold value.
[0012] The imaging device according to the fifth aspect is configured such that, in any one of the second to fourth aspects, the processor generates the status data when the remaining capacity of the recording medium recording the first moving image is smaller than the data size required to record the first moving image for the remaining scheduled imaging time.
[0013] In the imaging device according to a sixth aspect, in any one of the first to fifth aspects, the processor causes the imaging unit to terminate imaging of the first moving image and record the second moving image as the first moving image after receiving the third instruction.
[0014] In the imaging device according to a seventh aspect, in any one of the first to sixth aspects, the processor causes the imaging unit to terminate imaging of the second moving image.
[0015] The imaging device according to the eighth aspect is one of the first to seventh aspects, wherein the processor causes the imaging unit to terminate imaging of the second moving image and record the second moving image in association with the first moving image recorded after receiving the second instruction and before receiving the third instruction.
[0016] In the camera device involved in the 9th mode, in any one of the 1st to 8th modes, the processor performs image processing and compression processing based on the first camera parameter on the single dynamic image data output from the camera unit to generate the first dynamic image data about the first dynamic image, and performs image processing and compression processing based on the second camera parameter on the single dynamic image data to generate the second dynamic image data about the second dynamic image.
[0017] In the imaging device according to the tenth aspect, in the ninth aspect, the processor generates and records one frame as the first moving image data and the second moving image data while the first moving image and the second moving image are being recorded in parallel.
[0018] In the imaging device according to an eleventh aspect, in any one of the first to tenth aspects, the processor records the first moving image and the second moving image in a single recording medium.
[0019] The camera device according to the 12th aspect is one of the first to 11th aspects, wherein the processor causes the remaining recording time when only one of the first and second moving images is recorded and the remaining recording time when both the first and second moving images are recorded to be displayed on the display device.
[0020] In the imaging device according to a thirteenth aspect, in any one of the first to twelfth aspects, the processor causes the display device to display the first moving image and the second moving image.
[0021] The camera indication method involved in the 14th embodiment of the present invention is a camera indication method based on a camera indication device having a processor for performing camera indication on a camera portion of the camera device, wherein the processor performs the following processing: in the camera portion's camera recording of a first dynamic image based on a first camera parameter, the processor receives a first instruction for indicating the setting of a second camera parameter different from the first camera parameter, and indicates the received first instruction to the camera portion; after receiving the first instruction, the processor receives a second instruction for starting the camera recording of a second dynamic image based on the second camera parameter, and causes the camera portion to start the camera recording of the second dynamic image; when the second instruction is received, causes the camera portion to capture the first dynamic image until the processor receives a third instruction for ending the camera recording of the first dynamic image; when the processor receives the third instruction, causes the camera portion to end the camera recording of the first dynamic image.
[0022] The imaging instruction program according to the fifteenth aspect of the present invention is a program for causing a processor of an imaging instruction device to execute an imaging instruction to an imaging unit of the imaging device, wherein the program causes the processor to execute the following functions: receiving a first instruction for setting a second imaging parameter different from the first imaging parameter while the imaging unit is capturing a first moving image based on first imaging parameters, and instructing the imaging unit to execute the received first instruction; after receiving the first instruction, receiving a second instruction for starting the capture of a second moving image based on the second imaging parameter, and causing the imaging unit to start capturing the second moving image; upon receiving the second instruction, causing the imaging unit to capture the first moving image until receiving a third instruction for terminating the capture of the first moving image; and upon receiving the third instruction, causing the imaging unit to terminate the capture of the first moving image. The imaging instruction program according to the fifteenth aspect can cause a processor (computer) to execute the same configuration as the second to thirteenth aspects. Furthermore, as an aspect of the present invention, a non-transitory recording medium on which a computer-readable code of the imaging instruction program of these aspects is recorded can also be cited. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Figure 1 It is a front perspective view of the imaging device according to the first embodiment.
[0024] Figure 2 It is a rear view of the camera device.
[0025] Figure 3 It is a partial top view of the camera device.
[0026] Figure 4 This is a block diagram showing a schematic configuration of an imaging device.
[0027] Figure 5 This is a diagram showing the functional structure of a processor.
[0028] Figure 6 This is a flowchart showing the processing of the imaging instruction method in the first embodiment.
[0029] Figure 7 This is a flowchart showing the processing of the imaging instruction method in the first embodiment.
[0030] Figure 8 This diagram shows the processing when recording I frames and P frames during the parallel recording period of moving images.
[0031] Figure 9 This is a diagram showing a process when only one frame is recorded during the parallel recording period of moving images.
[0032] Figure 10 This is a diagram showing the display status of moving images and remaining recording time.
[0033] Figure 11 This is a diagram showing how the first and second moving images are recorded in a file.
[0034] Figure 12 This is a flowchart showing the processing of the imaging instruction method in the second embodiment.
[0035] Figure 13 This is a flowchart showing the processing of the imaging instruction method in the second embodiment.
[0036] Figure 14 This is a diagram showing the state of parallel recording before and after switching of the imaging scene.
[0037] Figure 15 This is a flowchart showing the processing of the imaging instruction method in the third embodiment.
[0038] Figure 16 This is a diagram showing how the imaging device is controlled using a remote controller.
[0039] Figure 17 It is a diagram showing the structure of a remote control.
[0040] Figure 18 This is an external view of a smartphone according to the second embodiment.
[0041] Figure 19 This is a diagram showing a schematic structure of a smartphone. DETAILED DESCRIPTION
[0042] An embodiment of the imaging device, imaging instruction method, and imaging instruction program according to the present invention is as follows.
[0043] <First embodiment>
[0044] <Overall Structure of the Camera Device>
[0045] Figure 1 is a front perspective view of an imaging device 100 according to a first embodiment of the present invention. Figure 2 is a rear view of the camera device 100, Figure 3 This is a partial top view of the camera device 100. The camera device 100 is composed of a camera body 300 and an interchangeable lens 200 mounted on the camera body 300. The camera body 300 and the interchangeable lens 200 are attached by coupling a bayonet mount 301 provided in the camera body 300 with a bayonet mount (not shown) on the interchangeable lens 200 side corresponding to the bayonet mount 301, and are removed by releasing this coupling. The bayonet mount 301 is provided with a terminal 302, and the bayonet mount on the interchangeable lens 200 side is also provided with a terminal (not shown). When the interchangeable lens 200 is coupled to the camera body 300, these terminals come into contact with each other, enabling communication. Furthermore, in addition to the bayonet mount 301 and the terminal 302, a viewfinder 303 and the like are provided on the front surface of the camera body 300.
[0046] like Figure 2 As shown, the back of the camera body 300 primarily includes the viewfinder eyepiece 304, the display 370, a MENU / OK key 356, a cross key 357 (directional indicator button), a BACK key 355, and a Q button 358 (Q: Quick). The MENU / OK key 356 is an operation key that combines the following functions: it functions as a menu button for displaying a menu on the display 370 screen, and as an OK button for confirming and executing selected content. The cross key 357 is an operation unit for inputting instructions in four directions: up, down, left, and right. It functions as a button (cursor movement mechanism) for selecting items from menu screens or selecting various setting items from each menu. Furthermore, the up and down keys of the cross key 357 function as a zoom switch for shooting and a playback zoom switch in playback mode, while the left and right keys function as a frame forward (forward or reverse) button in playback mode. The BACK key 355 is used to delete a desired item, such as a selected item, cancel an instruction, or return to the previous operation state. Q button 358 also functions as a button for issuing an instruction to display a menu screen on the screen of display 370 .
[0047] And, as Figure 3As shown, the top surface of the camera body 300 includes a release button 351, a dial 352 for setting the shooting mode or shutter speed, a function button 353 to which a desired function can be assigned, and an exposure correction dial 354. The release button 351 is a two-stage push-button that can be pressed halfway (referred to as a "half-press") or fully pressed (referred to as a "full-press"). Using these buttons and dials on the top and back surfaces of the camera body 300, the user can perform operations (first to third instructions) such as starting and ending recording of the first and second moving images, and setting first and second recording parameters, as described later.
[0048] Figure 4 This is a block diagram schematically illustrating the configuration of an imaging device 100 (imaging device). The imaging device 100 comprises an interchangeable lens 200 and an imaging device body 300. The imaging lens system, including a zoom lens 210 and a focus lens 230 (described later), forms a subject image (optical image) on a light-receiving portion 312 of an imaging element 310 (imaging element). While the first embodiment describes an imaging device 100 equipped with the interchangeable lens 200, the lens system (optical system) may be fixed to the camera body.
[0049] Interchangeable lens structure
[0050] The interchangeable lens 200 includes a zoom lens 210, an aperture 220, a focus lens 230, and a lens driving unit 240. The lens driving unit 240 drives the lens according to the signal from the processor 330 ( Figure 5 The lens drive control unit 346 (processor) drives the zoom lens 210 and focus lens 230 forward and backward in the direction of the optical axis L to perform zoom (optical zoom) and focus adjustments. In addition to being performed based on instructions from the processor 330, zoom and focus adjustments can also be performed based on zoom and focus operations performed by the user (such as rotation of the zoom and focus rings (not shown)). Furthermore, the lens drive unit 240 controls the aperture 220 based on instructions from the processor 330 to adjust exposure. Meanwhile, information such as the positions of the zoom lens 210 and focus lens 230 and the degree of aperture 220 opening is input to the processor 330.
[0051] <Structure of the Camera Body>
[0052] The camera body 300 includes an imaging element 310 (imaging unit), a digital signal processing unit 320, a processor 330 (processor), an operating unit 350, a recording device 360 (recording device, memory), a display 370 (display device), and a speaker 380. The camera body 300 may also include a shutter (not shown) for blocking light passing through the imaging element 310. The shutter may be either a mechanical shutter or an electronic shutter. In the case of an electronic shutter, the exposure time (shutter speed) can be adjusted by controlling the charge accumulation period of the imaging element 310 via the processor 330.
[0053] <Structure of Imaging Element>
[0054] The imaging element 310 includes a light receiving portion 312, an analog amplifier portion 314, an A / D converter 316, and an imaging element driving portion 318. The light receiving portion 312 includes a light receiving surface on which a plurality of light receiving elements are arranged in a matrix. The subject light that has passed through the zoom lens 210, the aperture 220, and the focusing lens 230 is imaged on the light receiving surface of the light receiving portion 312 and is converted into an electrical signal by each light receiving element. Color filters of R (red), G (green), or B (blue) are provided on the light receiving surface of the light receiving portion 312, and a color image of the subject can be obtained based on the signals of each color. In addition, in this embodiment, a CMOS (Complementary Metal-Oxide Semiconductor) type color image sensor can be used as the imaging element 310.
[0055] In one example of a CMOS image sensor configuration, an analog amplifier 314 is provided for each pixel or pixels constituting the light-receiving unit 312. After being amplified by the analog amplifier 314, the pixel signal is read out row by row and supplied to an A / D converter 316 (Analog-to-Digital Converter). The A / D converter 316 converts the supplied pixel signal into a digital pixel signal and supplies it to a digital signal processing unit 320. The digital signal processing unit 320 performs digital correlated double sampling, digital gain processing, correction processing, and other processing on the digital pixel signal to convert it into a digital image signal. The imaging element driver 318 drives the imaging element 310 based on instructions from the processor 330 (imaging control unit 336; processor).
[0056] In the case where the imaging element 310 is a CMOS type image sensor, as shown in FIG. Figure 4 The imaging element driving section, analog amplifier section, and A / D converter are often included in the imaging element package, but an image sensor having a structure different from this may also be used.
[0057] In addition, as the imaging element 310 , a color image sensor of an XY address type, a CCD (Charge-Coupled Device) type, or the like can be used in addition to a CMOS type.
[0058] Processor Structure
[0059] Figure 5 This diagram shows the functional structure of processor 330 (processor, computer). Processor 330 functions as a receiver 332, an imaging parameter setting unit 334, an imaging control unit 336, an image processing unit 338, a compression processing unit 340, a recording control unit 342, a display control unit 344, a communication control unit 345, and a lens drive control unit 346. Processor 330 performs processing such as capturing, processing, compressing, and recording moving images based on the digital image signal input from digital signal processing unit 320. Details of the processing using processor 330 will be described later.
[0060] The functions of the processor 330 described above can be implemented using various processors. Among the various processors, for example, a general-purpose processor that executes software (programs) to implement various functions is included, namely, a CPU (Central Processing Unit). Furthermore, among the various processors described above, a processor specifically used for image processing is included, namely, a GPU (Graphics Processing Unit). Furthermore, among the various processors described above, processors such as FPGA (Field Programmable Gate Array) whose circuit structure can be changed after manufacture, namely, a PLD (Programmable Logic Device). Furthermore, processors such as ASIC (Application Specific Integrated Circuit) that have a circuit structure specially designed to perform specific processing, namely, dedicated circuits, are also included in the various processors described above.
[0061] Furthermore, each function of processor 330 may be implemented by a single processor or by multiple processors. Furthermore, a single processor may correspond to multiple functions. Furthermore, each function of processor 330 may be implemented by circuits, or a portion of each function may be implemented by circuits, with the remainder implemented by the processor.
[0062] When the above-mentioned processor or circuit executes software (program), the processor (computer) readable code of the executed software or the data required to execute the software is stored in a non-temporary recording medium such as flash memory, and the processor refers to the software or data. The software stored in the non-temporary recording medium includes a camera instruction program (a program that causes the camera device to operate) for executing the camera instruction method involved in this embodiment. Code or data can also be recorded in a non-temporary recording medium using various magneto-optical recording devices, semiconductor memories, etc. instead of flash memory. Here, "semiconductor memory" includes ROM (Read Only Memory) or EEPROM (Electronically Erasable and Programmable ROM) in addition to flash memory. When performing processing using software, for example, RAM (Random Access Memory) is used as a temporary storage area.
[0063] like Figure 5 As shown, the processor 330 includes a flash memory 348 (a non-temporary recording medium or memory). Flash memory 348 stores codes readable by a computer (e.g., various processors constituting the processor 330) that stores programs required for capturing, recording, and displaying images (including programs for executing the imaging instruction method according to this embodiment), as well as data required for executing the programs (e.g., frame compression and recording modes, and data for the first and second times described below). Furthermore, the processor 330 includes a RAM 349 (memory) that serves as a temporary storage area and work area.
[0064] <Operation Department>
[0065] The operation unit 350 is composed of Figure 2 、 3 The user can perform various operations such as setting the recording mode, setting the recording parameters for moving images (e.g., image processing such as white balance, shutter speed, frame rate, compression type, film simulation, etc.; first recording parameters, second recording parameters), and instructing the recording of moving images and still images. Furthermore, the processor 330 can receive these user instructions. Furthermore, the display 370 (display device) can be formed of a touch panel device and can be used as an operating unit.
[0066] <Recording device>
[0067] The recording device 360 (recording device, memory) is composed of various non-temporary recording media such as magneto-optical recording media, semiconductor memories, and their control circuits, and can save dynamic images, still images, etc. The first dynamic image or the second dynamic image can be recorded in the recording device 360. As the recording medium constituting the recording device 360, a type that can be loaded and unloaded relative to the camera body 300 can be used. It can be set to a structure that can send the captured image (dynamic image, still image) to an external recording medium or recording device (such as a recording device on the cloud, etc., other than the recording device 360) through wired and / or wireless communication via the antenna 390 under the control of the recording control unit 342 and the communication control unit 345, and can be recorded in these recording media or recording devices.
[0068] <Display and speakers>
[0069] The display 370 (display device) is composed of, for example, a touch-panel liquid crystal display panel, and can display a screen for setting imaging parameters, set imaging parameters, moving images, still images, remaining recording time, warning messages to the user, etc. These messages can be output as audio from the speaker 380.
[0070] <Moving Image Capture Condition Change and Method of the Present Invention>
[0071] When scenes are switched during the recording of a moving image or when the addition or subtraction of light (type of light source, brightness, etc.) changes, the user sometimes wants to change the recording conditions (camera parameters) such as white balance. However, changing these settings during recording, for example, presents the following problems. First, if the settings are changed, there is a risk of losing the sense of unity of the work (image), and it is sometimes difficult for the user to judge whether to change the settings. Especially when shooting in real time, the judgment time is limited, making it difficult to make a correct judgment. In addition, the time point at which the setting change is reflected in the moving image may deviate from the desired time point. The above-mentioned prior art such as Patent Document 1 does not take this situation into consideration.
[0072] In light of this situation, the inventors of this application conducted extensive research and developed a concept for recording and preserving the original settings of a moving image based on a trigger mid-shoot (e.g., a user operation or device instruction that initiates and terminates the process), while also retaining separate moving images captured using the same imaging element under different shooting conditions (shooting parameters). This allows users to edit moving images with more appropriate settings for the scene. The following describes the specifics of this method.
[0073] <Processing of Image Capture Instruction Method (Example 1)>
[0074] <Setting the first imaging parameter>
[0075] Figure 6 、 7 This is a flowchart showing the processing of the camera instruction method in Example 1. In addition, it is assumed that at the moment of starting the processing of the flowchart, the camera conditions (first camera parameters) of the first dynamic image are set. The "first camera parameters" are, for example, the content and degree of image processing such as shutter speed (exposure time), frame rate, aperture, white balance (type of light source), film simulation, etc., but are not limited to these. The receiving unit 332 (processor) receives the setting operation of the first camera parameter performed by the user, and the camera parameter setting unit 334 (processor) sets the content of the parameter according to the received content. The user can perform the setting operation through the above-mentioned buttons or switches, and the display control unit 344 (processor) can display the setting screen on the display 370 (display device).
[0076] <Image Data Acquisition>
[0077] The camera control unit 336 (processor) obtains the dynamic image data (single dynamic image data) output from the imaging element 310 (camera unit) according to the user's operation (0th operation) (step S100). That is, the camera control unit 336 causes the imaging element 310 to start capturing the first dynamic image. In addition, "recording" includes image processing, compression processing, and recording processing. And, for example, the full press operation of the release button 351 can be used as the "0th operation". And, for example, the RAW data (dynamic image data before development processing) output from the imaging element 310 can be used as the "single dynamic image data". The image processing unit 338 and the compression processing unit 340 (processor) can generate image data of the first dynamic image (1st dynamic image data) and image data of the second dynamic image (2nd dynamic image data) from the single dynamic image data.
[0078] <Recording and Displaying the First Moving Image>
[0079] The image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) perform image processing and compression processing based on the first imaging parameters and record the processed image data (first moving image data) in the recording device 360 (step S102). While recording only the first moving image, the compression processing unit 340 may generate only I frames, or may generate I frames, P frames, and / or B frames. Furthermore, the display control unit 344 (processor) causes the first moving image to be displayed on the display 370 (step S102). Furthermore, as will be described in detail later, while the first and second moving images are being recorded in parallel, the display control unit 344 can simultaneously display these moving images on the display 370.
[0080] The receiving unit 332 (processor) determines whether the third instruction to end the recording of the first dynamic image has been received (step S104). The receiving unit 332 can accept the end instruction operation performed by the user (for example, pressing the release button 351; the third operation) as the third instruction. If the receiving unit 232 accepts the third instruction ("Yes" in step S104), the image processing unit 338, the compression processing unit 340 and the recording control unit 342 (processor) end the recording of the first dynamic image (step S106). In this case, the recording of the first dynamic image is ended before the recording of the second dynamic image is started. In addition, as described in Example 2 below, status data that is automatically generated and regarded as the third instruction when the specified conditions are met and is independent of the third operation can also be accepted as the third instruction.
[0081] <Setting the second imaging parameter>
[0082] During the recording of the first dynamic image, the receiving unit 332 (processor) determines whether a first operation (first instruction) performed by the user has been received (step S108). The first operation is an operation to instruct the setting of a second imaging parameter that is different from the first imaging parameter. The receiving unit 332 can make a positive judgment when the above-mentioned button or switch (for example, the function button 353) is operated. If the judgment is positive ("yes" in step S108), the receiving unit 332 and the imaging parameter setting unit 334 (processor) set the content of the second imaging parameter according to the received content (step S110). The display control unit 344 can display a screen for setting the second imaging parameter on the display 370 (display device), and the user can operate the above-mentioned buttons or switches while observing the screen to set the second imaging parameter. If the display 370 is a touch panel display device, the user can perform the setting operation via the display 370.
[0083] <Recording and Displaying the Second Moving Image>
[0084] After receiving the first operation (first instruction) described above, the receiving unit 332 (processor) determines whether a second operation (second instruction) performed by the user has been received (step S112). The second operation is an operation to cause the imaging element 310 and the camera control unit 336 (camera unit) to begin capturing (including image processing, compression, and recording) a second dynamic image based on second camera parameters. The receiving unit 332 (processor) can simultaneously receive both the first operation and the second instruction. The image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) perform image processing and compression based on the second camera parameters on the "single dynamic image data" (the same image data as the first dynamic image) and record the second dynamic image data in the recording device 360 (step S114). The second dynamic image can be recorded in the same recording medium as the first dynamic image (a single recording medium) or in a different recording medium (such as a different memory card or a recording device on a network) than the first dynamic image.
[0085] <Control during parallel recording>
[0086] In the first embodiment, depending on the user's operation, there may be a period during which the first moving image and the second moving image are recorded in parallel. Figure 8 This diagram illustrates the processing within the camera control unit 336, image processing unit 338, compression processing unit 340, and recording control unit 342 (processor) when recording intra frames (I frames) and reference frames (P frames) during this parallel recording period. When processing, compressing, and recording I frames and P frames, P frame compression generates differential information between the previous frame and the input frame as the P frame. For example, for image 1 (frame 1), a moving image file for process 1 (image processing based on the first camera parameter) and a moving image file for process 2 (image processing based on the second camera parameter) must be generated. To generate the P frame, the difference between process 1 for image 1 and process 1 for image 2 must be compressed.
[0087] However, if the frame "Image 1, Process 2" is input during blanking period ΔT1, the compression processing unit 340 generates difference information between the previous frame and the input frame as a P-frame. This results in the difference between "Image 1, Process 2" and "Image 2, Process 1," preventing the acquisition of appropriate image data. Therefore, "Image 1, Process 2" is not input immediately, but rather waits until "Image 2, Process 1" is generated before inputting "Image 1, Process 2." Furthermore, the recording control unit 342 cannot record the compressed P-frame until compression (P-frame) of "Image 2, Process 1" is complete in the compression processing unit 340, resulting in blanking period ΔT2. Thus, when P-frames are generated in addition to I-frames during parallel recording, blanking periods occur during compression and recording, and image data during these periods must be stored in memory, requiring a large memory capacity.
[0088] on the other hand, Figure 9 This figure shows the processing when only one frame is compressed and recorded during the parallel recording of the first and second moving images. In this case, no blank period is generated and the limit on the memory capacity is low.
[0089] Considering this situation, the image processing unit 338, the compression processing unit 340 and the recording control unit 342 (processor) record the first and second moving images in parallel. Figure 9 As shown, I frames are generated and recorded as the first and second moving image data. Furthermore, if the processor 330 includes multiple compression processing units, the image for "Process 1" and the image for "Process 2" can be assigned to each compression processing unit, so there is no problem in using reference frames (P frames).
[0090] <Display of dynamic images>
[0091] The display control unit 344 (processor) displays the second moving image on the display 370 (step S114). The display control unit 344 can simultaneously display the first moving image and the second moving image while the first moving image and the second moving image are being recorded in parallel. Figure 10 This is an example of such simultaneous display, showing a state where the second moving image is displayed within the first moving image. Alternatively, the first moving image may be displayed in half of the display area of display 370, and the second moving image in the remaining half. This simultaneous display allows the user to visually recognize the first and second moving images, each with different camera parameters, simultaneously and terminate recording of unnecessary moving images.
[0092] And, similarly Figure 10As shown, the recording control unit 342 and the display control unit 344 (processor) are capable of displaying on the display 370 (display device) the remaining recording time when only the first dynamic image and one of the second dynamic image are recorded (the “remaining recording time for single recording” in the figure) and the remaining recording time when both the first dynamic image and the second dynamic image are recorded (the “remaining recording time for simultaneous recording” in the figure).
[0093] <Recording of the first moving image is completed>
[0094] The receiving unit 332 (processor) determines whether a third instruction to terminate the recording of the first moving image has been received (step S116). The receiving unit 332 receives, as the third instruction, the third instruction from the user and, when predetermined conditions are met, status data that is deemed to constitute the third instruction. In the first embodiment, the receiving unit 332 can receive, as the third instruction, an operation of the release button 351 or other button or dial (the third operation). Furthermore, in the second embodiment described below, information indicating the third instruction is generated and received in response to a change in the recording scene.
[0095] If the determination in step S116 is affirmative, the image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) terminate the recording of the first moving image (including image processing and compression processing), and cancel the association between the third operation of the button or switch and the third instruction (step S118). For example, the association with "when the release button 351 is pressed, the recording of the first moving image is terminated" is canceled.
[0096] Furthermore, if the image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) receive the third instruction (instruction to end recording of the first moving image) without receiving the fourth instruction (instruction to end recording of the second moving image), they end recording of the first moving image and record the second moving image as the first moving image after receiving the third instruction (step S120). For example, the following can be performed: recording the second moving image subsequent to the image file of the first moving image; setting the image file file name so that it can be recognized as a successor to the first moving image; making the association between button or switch operations and processing (recording start, end), etc. the same as for the first moving image; and making the display of the moving image and other user interfaces the same as for the first moving image.
[0097] Furthermore, in step S120, if the association between the button or switch operation and the processing (recording start, end) for the second moving image is the same as that for the first moving image, if the user continues to issue a trigger (third instruction) to end recording due to an operation (for example, by continuously pressing a button assigned to end recording), the recording of the second moving image that was started as the first moving image may be immediately ended. Therefore, in step S118, the association between the third operation and the third instruction is temporarily released.
[0098] In addition, the image processing unit 338, the compression processing unit 340 and the recording control unit 342 (processor) can generate and record only I frames during the period of recording only the second dynamic image after the recording of the first dynamic image is completed, or can generate and record I frames, P frames and / or B frames.
[0099] <Recording of the second moving image ends>
[0100] On the other hand, if there is no instruction to end recording of the first moving image in step S116, the receiving unit 332 (processor) determines whether a fourth instruction to end recording of the second moving image has been received (step S122) and continues recording the second moving image until the determination is affirmative (during the "Yes" period). The receiving unit 332 can accept user operation of a specified button or switch, such as pressing the function button 353, as the fourth instruction. If the determination in step S122 is affirmative, the image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) end recording (including image processing and compression processing) and display of the second moving image (step S124). Similar to the case of the first moving image (step S118), the association between the user operation and the fourth instruction (the instruction to end recording of the second moving image; the end trigger) can be released (step S124).
[0101] Through the processing of steps S122 and S124 , the user can end the recording of only the second moving image during the parallel recording of the first and second moving images.
[0102] Figure 11 This is a diagram showing a situation where the first dynamic image and the second dynamic image are recorded in a file (in addition, the display of the dynamic image can be Figure 10 proceed in the same way). Figure 11Part (a) shows that a first recording folder 364 and a second recording folder 366 are created on a memory card 362 (a non-transitory recording medium, a form of "single recording medium") installed in a recording device 360, and that the moving image files "0001.MOV" and "SUB_0001.MOV" are recorded therein, respectively. These moving image files share a portion of the file name (the "0001" portion), allowing the user to easily understand the relationship between the moving image files.
[0103] and, Figure 11 Part (b) shows the recorded contents of the file during each period. During the period (1) from time t0 to time t1, the image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) generate a dynamic image (first dynamic image) based on the first imaging parameter and record it in the dynamic image file "0001.MOV". At time t1 (the time point when the second instruction is received), these units start recording the second dynamic image in the dynamic image file "SUB_0001.MOV" (step S114). During the period (2) from time t1 to time t2, the dynamic image (first dynamic image) based on the first imaging parameter ("setting 1") is recorded in the dynamic image file "0001.MOV", and the dynamic image (second dynamic image) based on the second imaging parameter ("setting 2") is recorded in the dynamic image file "0001.MOV". The image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) complete recording of the first moving image at time t2 (the time point at which the third instruction is received) (step S118), and during the period (3) from time t2 to time t3, they record the second moving image as the first moving image (step S112). Specifically, during the period (3) from time t2 to time t3, the above-mentioned units record the second moving image based on the second imaging parameter in the moving image file "0001.MOV" in which the first moving image was recorded until time t2. That is, the image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) record the second moving image in association with the first moving image recorded from the second instruction at time t1 to the third instruction at time t2.
[0104] in addition, Figure 11 In the example shown, the moving image file "0001.MOV" that records the moving image based on the first camera parameter until time t2 records the moving image based on the second camera parameter after time t2. However, the image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) can also continue recording the second moving image in the moving image file "SUB_0001.MOV" after time t2 (refer to FIG. Figure 14 for example).
[0105] Thus, according to the first embodiment, before and after the switching of the imaging parameters ( Figure 11 In the example of (2), the first and second dynamic images are recorded in parallel during the period (2). Therefore, the dynamic image with the original settings (the first dynamic image based on the first camera parameters) can be retained while the dynamic image with different settings (the second dynamic image based on the second camera parameters) can be retained separately. Thus, when editing dynamic images, the user can select a dynamic image with better settings that suits the camera scene. Specifically, for example, the user can combine the first and second dynamic images at a desired time.
[0106] As described above, according to the first embodiment, the user can easily record a plurality of moving images having different imaging parameters.
[0107] <Processing of Image Capture Instruction Method (Example 2)>
[0108] Next, refer to Figure 12 、 13 , while explaining the processing of the camera instruction method in Example 2. In Example 2, as described below, the status data regarded as the user operation when the prescribed conditions are met is accepted as the third instruction, and the recording of the first dynamic image is terminated. Figure 12 、 13 Flowchart of Figure 6 、 7 Steps that perform the same processing are assigned the same step numbers, and detailed descriptions are omitted.
[0109] The receiving unit 332 (processor) receives a setting indicating the end of recording of the second moving image based on a scene change (step S111). The receiving unit 332 can receive user operations related to, for example, the setting of imaging conditions (predetermined parameters) that serve as a basis for scene changes or the setting of the first time, the second time, etc., which will be described later.
[0110] If the receiving unit 332 receives the recording start instruction (second operation performed by the user; second instruction) for the second dynamic image ("Yes" in step S112), the image processing unit 338, the compression processing unit 340 and the recording control unit 342 (processor) start recording the second dynamic image (including image processing, compression, and recording) (step S114). Figure 14 In the diagram (showing the state of parallel recording before and after switching of the imaging scene), this corresponds to time t1. Figure 14 In the example, the period from time t1 to time t3 is a period in which the first and second moving images are recorded in parallel. As described above, only I frames (intra-frames) are recorded for both the first and second moving images.
[0111] The image processing unit 338 (processor) performs scene detection of the dynamic image and determines whether a scene change occurs ( Figure 13 Step S115). When the image processing unit 338 determines that a predetermined parameter (such as the brightness of the scene being photographed) exceeds a threshold value ( Figure 14 At time t2, it can be determined that a scene change has occurred. For example, if the light source changes from a fluorescent lamp to an incandescent lamp indoors, if one moves from a relatively dark indoor to a bright outdoor during the day, or even if one moves from a sunny to a shady outdoor setting, the brightness of the captured scene may change significantly, and thus a "scene change" may be determined. Furthermore, the image processing unit 338 may use parameters other than brightness to determine a scene change.
[0112] If a scene switch occurs ("Yes" in step S115), the recording control unit 342 (processor) determines whether "parallel recording can be performed sufficiently for the period before and after the scene switch" (whether a predetermined condition is satisfied) (step S117). For example, if the recording control unit 342 determines that the first time has passed after the scene switch ( Figure 14 At time t3 (in the middle), it is determined that "parallel recording is sufficient" (prescribed conditions are satisfied), and data for ending the recording of the first moving image is generated regardless of the user's operation (deemed as status data of the third instruction). As a result, the image processing unit 338, the compression processing unit 340, and the recording control unit 342 (processor) are connected to the video recording unit 338. Figure 7 Similarly to the flowchart of , the recording of the first moving image is ended, and the end condition (“predetermined condition” as the end condition) is released (step S118).
[0113] Thus, in the third embodiment, the recording of the first dynamic image is automatically terminated according to the scene switching, so the user can focus on the recording without performing unnecessary operations. In addition, the user can use the first dynamic image ( Figure 14 The first dynamic image ("Main2" in the figure) and the second dynamic image ("Sub1" in the figure) are combined into one dynamic image at an appropriate (desired) time point.
[0114] Then, the above-mentioned components record the second moving image as the first moving image (step S120). Furthermore, the recording control unit 342 may determine that "parallel recording is sufficient" ("prescribed conditions are satisfied") if the scene after the switch continues for the second time. This determination based on the duration of the scene is made because processing may not keep up immediately after the scene switch, resulting in unstable brightness or color tone.
[0115] If a scene change does not occur ("No" in step S115), the image processing unit 338, compression processing unit 340, recording control unit 342, and display control unit 344 continue recording and displaying the second moving image until the receiving unit 332 receives an instruction to end recording of the second moving image (during "No" in step S122). If the receiving unit 332 receives an instruction to end recording of the second moving image, the recording and display are terminated (step S124). In step S124, the association between the user operation and the fourth instruction (the instruction to end recording of the second moving image; the end trigger) can be released.
[0116] As described above, according to the second embodiment, similarly to the first embodiment, the user can easily record a plurality of moving images having different imaging parameters.
[0117] <Processing of Image Capture Instruction Method (Example 3)>
[0118] Figure 15 This is a flowchart showing the processing of the imaging instruction method in Example 3 (processing from step S100 to step S114 and Figure 6 (The flowcharts are the same as those in the flowcharts of , and therefore their description is omitted.) In the third embodiment, as described below, status data for terminating the recording of the first moving image is generated based on the remaining capacity of the recording medium, regardless of the user's operation.
[0119] In step S116A, the recording control unit 342 (processor) determines whether the remaining capacity of the recording medium for recording the first dynamic image is sufficient. For example, when the remaining capacity of the memory card installed in the recording device 360 is greater than the data size when recording the remaining scheduled shooting time of the first dynamic image, the recording control unit 342 can determine that "the remaining capacity is sufficient" ("Yes" in step 116A; in this case, the processing enters step S122). In addition, when there is no capacity limit (or very low) on the recording device on the cloud, etc., the recording control unit 342 can determine that "the remaining capacity of the recording medium is sufficient." In addition, the recording control unit 342 can grasp the scheduled shooting time by using a predetermined value, allowing the user to input it before the shooting starts, and other methods. In addition, the recording control unit 342 can calculate the data size based on the scheduled shooting time or compression rate, etc.
[0120] If the remaining capacity of the recording medium for recording the first moving image is insufficient (for example, if the remaining capacity of the memory card is less than the data size required to record the first moving image for the remaining scheduled shooting time; "No" in step S116A), the recording control unit 342 determines that the "predetermined condition" has been satisfied and generates status data for terminating the recording of the first moving image (terminating parallel recording) regardless of user operation. This reduces the possibility that insufficient capacity on the recording medium will prevent the desired shooting time.
[0121] As described above, according to the third embodiment, similarly to the first and second embodiments, the user can easily record a plurality of moving images having different imaging parameters.
[0122] In addition, in the first embodiment described above, a single dynamic image data (RAW data, etc.) is processed (image processing, compression processing) based on the first camera parameter and the second camera parameter and recorded, but two imaging elements may be provided, and the dynamic image data output from these two imaging elements may be processed (image processing, compression processing) based on the first camera parameter and the second camera parameter and recorded.
[0123] <Modifications of Operations and Instructions to the Imaging Device>
[0124] In the above-described first to third embodiments, the user directly sets imaging parameters or gives imaging instructions to the imaging device 100 . However, the operation or instruction of the imaging device 100 may also be performed using a remote controller. Figure 16 1 is a diagram showing a situation in which the imaging device 100 is controlled using a remote controller 700 (imaging pointing device). Figure 17 It is a diagram showing the structure of the remote control 700.
[0125] like Figure 17As shown, the remote control 700 includes a processor 710 (processor), a receiving unit 712, and a communication control unit 714; a flash memory 720; a RAM 722; an operation unit 730; and a wireless communication antenna 740. The user operates the operation unit 730 (buttons, switches, etc.) to perform various operations (such as instructions for setting imaging parameters or instructions for starting / ending video recording), and the reception unit 712 receives these operations. The communication control unit 714 issues instructions to the imaging device 100 based on the imaging instruction program according to the present invention stored in the flash memory 720 (non-transitory recording medium, memory). The imaging instruction program causes the processor 710 to execute imaging instructions (first through third instructions; various processes of the imaging instruction method according to the present invention) to the imaging unit of the imaging device 100 (specifically, the imaging element 310 and various components of the processor 330). During these processes, the RAM 722 is used as a work area and a temporary storage area. The various processes of the imaging instruction method are the same as those of Embodiments 1 through 3. In addition, the communication between the remote controller 700 and the camera 100 may be wired communication.
[0126] According to this configuration, as in the above-described first to third embodiments, the user can easily record a plurality of moving images having different imaging parameters.
[0127] <Second embodiment>
[0128] In the first embodiment, the imaging device 100 is described as a digital camera, but the configuration of the imaging device is not limited thereto. Other imaging devices may be, for example, a built-in or external PC camera (PC: Personal Computer) or a portable terminal device having an imaging function as described below.
[0129] Examples of portable terminal devices that are embodiments of the imaging device of the present invention include mobile phones, smartphones, PDAs (Personal Digital Assistants), portable game consoles, and smart watches. A smartphone will be described in detail below with reference to the accompanying drawings, taking it as an example.
[0130] Figure 18 1 is an external view of a smartphone 1 (camera device) according to Embodiment 2. Part (a) of the figure is a front view, and part (b) is a rear view. Figure 18The illustrated smartphone 1 includes a flat-plate housing 2. A display panel 21 (display device) serving as a display unit and an operation panel 22 (operation unit) serving as an input unit are integrated into a display-input unit 20 on one side of the housing 2. The housing 2 also includes a speaker 31 (speaker), a microphone 32, an operation unit 40 (operation unit), cameras 41 and 42 (imaging devices), and a flash 43. The structure of the housing 2 is not limited to this; for example, the display unit and input unit may be separate, or a structure having a folding structure or a sliding mechanism may be employed.
[0131] Figure 19 1 is a diagram showing a schematic structure of a smart phone 1. Figure 19 As shown, smartphone 1 includes a wireless communication unit 11, a display input unit 20, a call unit 30, an operation unit 40, camera units 41 and 42, a flash 43, a storage unit 50, an external input / output unit 60, a GPS receiver 70 (GPS: Global Positioning System), a motion sensor unit 80, and a power supply unit 90. Furthermore, smartphone 1 includes a main control unit 101 (processor). Furthermore, smartphone 1 primarily includes a wireless communication function for performing mobile wireless communications via a base station device and a mobile communication network.
[0132] The wireless communication unit 11 performs wireless communication with a base station device included in the mobile communication network according to the instruction of the main control unit 101. This wireless communication is used to transmit and receive various file data such as voice data and image data, email data, and receive web data and streaming data.
[0133] The display input unit 20 is a so-called touch panel and includes a display panel 21 and an operation panel 22. The touch panel displays images (still images and / or dynamic images) or character information, etc. under the control of the main control unit 101 to visually transmit information to the user, and detects the user's operation on the displayed information.
[0134] In the display panel 21, LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. are used as display devices. The operation panel 22 is mounted in a manner that allows visual recognition of the image displayed on the display surface of the display panel 21, and is a device that detects one or more coordinates operated by a conductor such as a user's finger or a pen. If such a device is operated by a conductor such as a user's finger or a pen, the operation panel 22 outputs a detection signal generated by the operation to the main control unit 101. Then, the main control unit 101 detects the operation position (coordinates) on the display panel 21 based on the received detection signal.
[0135] like Figure 18 As shown, the display panel 21 and operation panel 22 of the smartphone 1, illustrated as one embodiment of the imaging device of the present invention, integrally constitute the display input unit 20. However, the operation panel 22 is configured to completely cover the display panel 21. With this configuration, the operation panel 22 can also have the function of detecting user operations in areas outside the display panel 21. In other words, the operation panel 22 can have a detection area for the overlapping portion with the display panel 21 (hereinafter referred to as the display area) and a detection area for the other outer edge portions that do not overlap with the display panel 21 (hereinafter referred to as the non-display area).
[0136] The communication unit 30 includes a speaker 31 or a microphone 32, and can convert the user's voice input through the microphone 32 into voice data that can be processed by the main control unit 101 and output it to the main control unit 101. It can also decode the voice data received through the wireless communication unit 11 or the external input / output unit 60 and output it from the speaker 31. Figure 18 As shown, for example, the speaker 31 can be mounted on the same surface as the surface where the display input unit 20 is provided, and the microphone 32 can be mounted on the side surface of the housing 2 .
[0137] The operation unit 40 is a hardware key using a key switch, etc., and is a device that receives instructions from the user. Figure 18 As shown, the operation unit 40 is mounted on the side surface of the housing 2 of the smartphone 1 and is a push-button switch that is turned on when pressed by a finger or the like and is turned off by the restoring force of a spring or the like when the finger is released.
[0138] The storage unit 50 (recording device, memory) stores the control program for the main control unit 101 (for example, the camera instruction program that causes the main control unit 101 to execute the camera instruction method of this embodiment), control data (which may include information such as the first time and second time mentioned above), application software, address data that associates the name and phone number of the communication partner, data of sent and received emails, web data downloaded through a web browser, and downloaded content data, and temporarily stores streaming data. Furthermore, the storage unit 50 stores moving images (the first moving image and the second moving image) captured using the camera instruction method of this embodiment. Furthermore, the storage unit 50 is composed of an internal storage unit 51 built into the smartphone and an external storage unit 52 that is removable and has a slot for external memory. Each of the internal storage unit 51 and the external storage unit 52 that constitute the storage unit 50 is implemented using known storage media.
[0139] The external input / output unit 60 functions as an interface with all external devices connected to the smartphone 1. The smartphone 1 is connected to other external devices directly or indirectly via the external input / output unit 60 through communication or the like. As means of communication, for example, a universal serial bus (USB), IEEE1394, a network (e.g., a wired LAN, a wireless LAN) can be cited. In addition, as means of communication, for example, Bluetooth (a registered trademark), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association) (a registered trademark) can be cited. Moreover, as means of communication, for example, UWB (Ultra Wide Band) (a registered trademark), ZigBee (a registered trademark) can also be cited.
[0140] As external devices connected to the smartphone 1, for example, wired / wireless headphones, wired / wireless external chargers, and wired / wireless data ports can be cited. In addition, as external devices, a memory card or a SIM (Subcriber Identity Module: User Identification Module) / UIM (User Identity Module Card) card connected via a card slot can also be cited. In addition, external audio and video devices connected via audio and video I / O (Input / Output: Input / Output) terminals, wirelessly connected external audio and video devices, wired / wireless connected smartphones, wired / wireless connected PDAs, wired / wireless connected personal computers, headphones and other external devices can also be connected. The external input and output unit 60 can transmit data received from such external devices to the various components inside the smartphone 1, or transmit data inside the smartphone 1 to external devices.
[0141] The motion sensor unit 80 includes, for example, a three-axis accelerometer or a tilt sensor, and detects the physical movement of the smartphone 1 in accordance with instructions from the main control unit 101. By detecting the physical movement of the smartphone 1, the direction of movement, acceleration, and posture of the smartphone 1 can be detected. These detection results are output to the main control unit 101. The power supply unit 90 supplies power stored in a battery (not shown) to various components of the smartphone 1 in accordance with instructions from the main control unit 101.
[0142] The main control unit 101 includes a microprocessor and memory (memory) such as RAM or flash memory. It operates according to a control program or control data stored in the storage unit 50, centrally controlling various components of the smartphone 1, including the camera unit 41. Information such as the repetition pattern of I-frames and P-frames may also be stored in the memory of the main control unit 101. Furthermore, the main control unit 101 includes mobile communication control functions and application processing functions for controlling various components of the communication system in order to facilitate voice and data communications via the wireless communication unit 11.
[0143] The main control unit 101 also includes an image processing function for displaying an image on the display input unit 20 based on image data (still or moving image data) such as received data or downloaded streaming data. The image processing function is a function in which the main control unit 101 decodes image data, performs image processing on the decoded result, and displays the image on the display input unit 20.
[0144] The camera units 41 and 42 are digital cameras (imaging devices) that electronically capture images using imaging elements such as CMOS or CCD. Furthermore, under the control of the main control unit 101, the camera units 41 and 42 are capable of converting image data (moving images, still images) obtained through imaging into compressed image data such as MPEG or JPEG, and storing the data in the storage unit 50 or outputting the data via the external input / output unit 60 or the wireless communication unit 11. (During such compression or recording, the imaging instruction method of this embodiment enables the setting of first and second imaging parameters, the capture of first and second moving images, the determination of scene changes, and the compression, recording, and display of image data, etc., to be performed in the same manner as in the first embodiment.) Figure 18 、 19 In the illustrated smartphone 1 , it is possible to take a picture using either one of the camera units 41 and 42 or to take a picture using both the camera units 41 and 42. When the camera unit 42 is used, the flash 43 can be used.
[0145] Furthermore, the cameras 41 and 42 can be utilized for various functions of the smartphone 1. For example, the smartphone 1 can display images captured by the cameras 41 and 42 on the display panel 21. Furthermore, the smartphone 1 can use images from the cameras 41 and 42 as one of the operational inputs for the operation panel 22. Furthermore, when the GPS receiver 70 detects location based on positioning information from GPS satellites ST1, ST2, ..., STn, the smartphone 1 can also refer to the images from the cameras 41 and 42 to detect location. Furthermore, the smartphone 1 can also refer to the images from the cameras 41 and 42 to determine the optical axis direction of the smartphone's camera 41 or the current usage environment, either without using a three-axis accelerometer or in conjunction with a three-axis accelerometer. Of course, the smartphone 1 can also utilize images from the cameras 41 and 42 within applications. Furthermore, the smartphone 1 can also add location information acquired by the GPS receiving unit 70, voice information acquired by the microphone 32 (which can also be converted into text information by the main control unit, etc.), posture information acquired by the motion sensor unit 80, etc. to the image data of still images or moving images, and record them in the storage unit 50. Furthermore, the smartphone 1 can also output the image data of these still images or moving images via the external input / output unit 60 or the wireless communication unit 11.
[0146] The smartphone 1 having the above structure can also execute the processing of the imaging instruction method according to this embodiment (setting of the first / second imaging parameters, capturing of the first / second dynamic images, determination of scene switching, compression, recording, and display of image data, etc.) similarly to the imaging device 100 according to the first embodiment. Specifically, the smartphone 1 can mainly execute the processing of the imaging instruction method according to the first embodiment by the processor 330 ( Figure 5 The functions of the operation unit 350, recording device 360, display 370, and speaker 380 in the first embodiment can be implemented in the smartphone 1 by the operation unit 40, storage unit 50 and operation panel 22, display panel 21 and operation panel 22, and speaker 31, respectively.
[0147] Thus, the smartphone 1 according to the second embodiment can also achieve the same effects as those of the imaging device 100 according to the first embodiment (capability of easily changing the imaging conditions of moving images).
[0148] While the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present invention.
[0149] Explanation of symbols
[0150] 1-Smartphone, 2-Frame, 11-Wireless Communication Unit, 20-Display Input Unit, 21-Display Panel, 22-Operation Panel, 30-Call Unit, 31-Speaker, 32-Microphone, 40-Operation Unit, 41-Camera Unit, 42-Camera Unit, 43-Flash, 50-Storage Unit, 51-Internal Storage Unit, 52-External Storage Unit, 60-External Input / Output Unit, 70-GPS Receiver, 80-Motion Sensor Unit, 90-Power Supply Unit, 100-Camera Device, 101-Main Control Unit, 116A-Step , 200-interchangeable lens, 210-zoom lens, 220-aperture, 230-focusing lens, 232-receiving part, 240-lens driving part, 300-camera body, 301-mount, 302-terminal, 303-viewfinder, 304-viewfinder eyepiece, 310-imaging element, 312-light receiving part, 314-analog amplifier, 316-A / D converter, 318-imaging element driving part, 320-digital signal processing part, 330-processor, 332-receiving part, 334-camera parameter Number setting unit, 336-Camera control unit, 338-Image processing unit, 340-Compression processing unit, 342-Recording control unit, 344-Display control unit, 345-Communication control unit, 346-Lens drive control unit, 348-Flash memory, 349-RAM, 350-Operation unit, 351-Release button, 352-Dial, 353-Function button, 354-Exposure correction dial, 355-BACK button, 356-MENU / OK button, 357-Cross key, 358-Q button, 360-Recording device , 362-memory card, 364-first recording folder, 366-second recording folder, 370-display, 380-speaker, 390-antenna, 700-remote control, 710-processor, 712-receiving unit, 714-communication control unit, 720-flash memory, 722-RAM, 730-operating unit, 740-antenna, L-optical axis, S100~S124-each step of the camera instruction method, ST1-GPS satellite, ST2-GPS satellite, ΔT1-blank period, ΔT2-blank period.
Claims
1. A camera device comprising a camera unit and a processor, wherein: The processor performs the following processing: receiving a first instruction for instructing setting of a second imaging parameter different from the first imaging parameter while the imaging unit is capturing a first moving image based on a first imaging parameter; After receiving the first instruction, receiving a second instruction to start capturing a second moving image based on the second imaging parameter, and causing the imaging unit to start capturing the second moving image; when the second instruction is received, causing the imaging unit to capture the first moving image until a third instruction to end the capturing of the first moving image is received; receiving, as the third instruction, an instruction from a user and, if a predetermined condition is satisfied, status data deemed to be the third instruction; When the third instruction is received, the imaging unit ends imaging of the first moving image; Scene detection is performed on the moving image captured by the camera unit, and when a first time has passed after the scene is switched and / or when the switched scene continues for a second time, it is determined that the predetermined condition is satisfied and the status data is generated.
2. The imaging device according to claim 1, wherein When a predetermined parameter exceeds a threshold, the processor determines that the scene has been switched.
3. The imaging device according to claim 1 or 2, wherein: The processor generates the status data when the remaining capacity of the recording medium recording the first moving image is smaller than the data size required to record the first moving image for the remaining scheduled imaging time.
4. The imaging device according to claim 1 or 2, wherein: The processor causes the imaging unit to end imaging of the first moving image and to record the second moving image as the first moving image after receiving the third instruction.
5. The imaging device according to claim 1 or 2, wherein: The processor causes the imaging unit to terminate imaging of the second moving image.
6. The imaging device according to claim 1 or 2, wherein: The processor causes the imaging unit to terminate imaging of the second moving image and to record the second moving image in association with the first moving image recorded between receipt of the second instruction and receipt of the third instruction.
7. The imaging device according to claim 1 or 2, wherein: The processor performs image processing and compression processing based on the first camera parameters on the single dynamic image data output from the camera unit to generate first dynamic image data about the first dynamic image, and performs image processing and compression processing based on the second camera parameters on the single dynamic image data to generate second dynamic image data about the second dynamic image.
8. The imaging device according to claim 7, wherein: The processor generates and records one frame as the first moving image data and the second moving image data while the first moving image and the second moving image are being recorded in parallel.
9. The imaging device according to claim 1 or 2, wherein: The processor records the first moving image and the second moving image in a single recording medium.
10. The imaging device according to claim 1 or 2, wherein: The processor displays on a display device a remaining recording time when only one of the first moving image and the second moving image is recorded, and a remaining recording time when both the first moving image and the second moving image are recorded.
11. The imaging device according to claim 1 or 2, wherein: The processor causes a display device to display the first moving image and the second moving image.
12. The imaging device according to claim 1 or 2, wherein: The processor executes image processing based on the first imaging parameter and image processing based on the second imaging parameter at different timings.
13. The imaging device according to claim 1 or 2, wherein: The image processing based on the first imaging parameter and the image processing based on the second imaging parameter are executed by the same processor.
14. A method for instructing an image capture, comprising: The processor performs the following processing: receiving a first instruction for instructing setting of a second imaging parameter different from the first imaging parameter while the imaging unit is capturing a first moving image based on a first imaging parameter, and instructing the imaging unit to execute the received first instruction; After receiving the first instruction, receiving a second instruction to start capturing a second moving image based on the second imaging parameter, and causing the imaging unit to start capturing the second moving image; when the second instruction is received, causing the imaging unit to capture the first moving image until a third instruction to end the capturing of the first moving image is received; receiving, as the third instruction, an instruction from a user and, if a predetermined condition is satisfied, status data deemed to be the third instruction; When the third instruction is received, the imaging unit ends imaging of the first moving image; Scene detection is performed on the moving image captured by the camera unit, and when a first time has passed after the scene is switched and / or when the switched scene continues for a second time, it is determined that the predetermined condition is satisfied and the status data is generated.
15. The imaging instruction method according to claim 14, wherein: When a predetermined parameter exceeds a threshold, the processor determines that the scene has been switched.
16. The imaging instruction method according to claim 14 or 15, wherein: The processor causes the imaging unit to end imaging of the first moving image and to record the second moving image as the first moving image after receiving the third instruction.
17. The imaging instruction method according to claim 14 or 15, wherein: The processor executes image processing based on the first imaging parameter and image processing based on the second imaging parameter at different timings.
18. The imaging instruction method according to claim 14 or 15, wherein: The image processing based on the first imaging parameter and the image processing based on the second imaging parameter are executed by the same processor. 19 . A non-transitory computer-readable recording medium having recorded thereon a program for causing a computer included in an imaging instruction device to execute the imaging instruction method according to claim 14 .
Citation Information
Patent Citations
Photographing device and its program
JP2006094145A
Imaging apparatus and imaging method
JP2007037050A
Imaging apparatus and playback device
JP2017055388A