Camera device, camera method and recording medium

By controlling the switching of camera parameters within the camera device so that the changes are only reflected in the live view image, the problem of erroneous recording caused by switching camera parameters is solved, resulting in a more accurate and efficient recording process.

CN116249936BActive Publication Date: 2026-04-17FUJIFILM CORP
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
FUJIFILM CORP
Filing Date
2021-09-28
Publication Date
2026-04-17

AI Technical Summary

Technical Problem

In existing technologies, when users switch camera parameters such as white balance or exposure, the switching results are easily reflected in the live view image, leading to incorrect dynamic image recording and resulting in shooting conditions that do not meet expectations.

Method used

By incorporating a processor into the camera device, the switching of camera parameters is controlled to be reflected only in the live view image, and only reflected in the recorded video image after the user confirms that it is appropriate, thus avoiding incorrect recording of camera parameters.

Benefits of technology

It reduces the recording of erroneous dynamic images caused by switching camera parameters, making it easier for users to capture the desired camera conditions and improving the accuracy and efficiency of video recording.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116249936B_ABST
    Figure CN116249936B_ABST
Patent Text Reader

Abstract

This invention provides a camera device, camera method, and camera program that enable a user to easily capture moving images under desired camera conditions. In one embodiment of the invention, the camera device includes a camera unit and a processor, wherein the processor performs the following processing: setting first camera parameters applied to moving image data captured by the camera unit; before a first operation performed by a user of the camera device, causing a recording device to record first moving image data captured according to the first camera parameters; if the first operation is received, setting second camera parameters applied to the moving image data; and if a second operation performed by the user is received after the first operation, causing the recording device to record second moving image data captured according to the second camera parameters.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to a camera device, camera method, and camera program for capturing moving images. Background Technology

[0002] Regarding technologies for capturing moving images, for example, Patent Document 1 describes a camera device that displays a preview image in the selected shooting mode when shooting conditions are set. Furthermore, Patent Document 2 describes a camera device that displays multiple real-time view images with different white balances.

[0003] Previous technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2009-159616

[0006] Patent Document 2: Japanese Patent Application Publication No. 2011-066752 Summary of the Invention

[0007] The technical problem to be solved by the invention

[0008] One embodiment of the present invention provides a camera device, camera method, and camera program that enable a user to easily capture moving images under desired camera conditions.

[0009] means for solving technical problems

[0010] The imaging device according to the first aspect of the present invention includes an imaging unit and a processor, wherein the processor performs the following processing: setting a first imaging parameter applied to moving image data captured by the imaging unit; before accepting a first operation, outputting the first moving image data captured according to the first imaging parameter to a recording destination; if the first operation is accepted, setting a second imaging parameter applied to the moving image data; from the time the first operation is accepted until the time the second operation is accepted, outputting the first moving image data to the recording destination; and if the second operation is accepted, outputting the second moving image data captured according to the second imaging parameter to the recording destination instead of the first moving image data captured according to the first imaging parameter.

[0011] The imaging apparatus according to the second aspect of the present invention includes: an imaging unit; a processor; and a memory for temporarily storing motion image data output from the imaging unit. The processor performs the following processing: setting a first imaging parameter applied to the motion image data captured by the imaging unit; outputting the first motion image data captured according to the first imaging parameter to a recording destination before accepting a first operation; setting a second imaging parameter applied to the motion image data after accepting the first operation; storing the motion image data in the memory during the period from accepting the first operation to accepting the second operation; and outputting second motion image data generated based on the stored motion image data to the recording destination after accepting the second operation.

[0012] In the second method, the processor of the camera device involved in the third method performs the following processing: if the remaining capacity of the memory is below a threshold before accepting the second operation, the camera generates motion image data by applying the first camera parameter to the motion image data stored in the memory as the first motion image data and outputs it to the recording destination; if the second operation is accepted, the camera generates the second motion image data by applying the second camera parameter to the motion image data after the first acquired motion image data stored in the memory, and outputs the generated second motion image data to the recording destination.

[0013] In any of the first to third methods, the processor of the camera device involved in the fourth method performs the following processing: before accepting the first operation, outputting the first dynamic image data to the display destination; and after accepting the first operation, outputting at least the second dynamic image data to the display destination.

[0014] In the fourth method, the camera device involved in the fifth method is processed by the processor as follows: during the period from accepting the first operation to accepting the second operation, the first dynamic image data is further output to the display destination.

[0015] In the sixth method, the camera device, in the fourth or fifth method, is processed by the processor as follows: after accepting the second operation, only the second dynamic image data is output to the display destination.

[0016] In any of the 4th to 6th methods, the processor of the camera device involved in the 7th method performs the following processing: during the period from accepting the first operation to accepting the second operation, a portion of the dynamic image data is output as the first dynamic image data to the display destination, and another portion of the dynamic image data is output as the second dynamic image data to the display destination.

[0017] In any of the 5th to 7th methods, the processor of the camera device involved in the 8th method performs the following processing: during the period from after accepting the first operation to before accepting the second operation, outputting the first moving image data to a portion of the area of ​​the second moving image data.

[0018] In any of the 5th to 8th methods, the processor of the camera device involved in the 9th method performs the following processing: during the period from accepting the first operation to accepting the second operation, the first dynamic image data and the second dynamic image data are output in parallel.

[0019] In the fifth method, the processor of the camera device involved in the tenth method performs the following processing: upon receiving the first operation, it outputs a list of dynamic image data based on a plurality of selectable camera parameters to a display destination; it accepts the operation of selecting one dynamic image data from the list of output dynamic image data as the second operation; and it sets the camera parameter corresponding to the selected dynamic image data as the second camera parameter.

[0020] In any of the 1st to 10th methods, the processor of the camera device involved in the 11th method performs the following processing: repeatedly changes the first camera parameter to switch to the second camera parameter; and outputs the dynamic image data corresponding to the camera parameter during the switching period as the second dynamic image data to the recording destination.

[0021] In the 12th method, the camera device involved in any one of the 1st to 11th methods, the first camera parameter and the second camera parameter are camera parameters related to white balance.

[0022] In any of the 1st to 12th methods, the first and second camera parameters of the imaging device in the 13th method are exposure-related camera parameters, and the processor performs the following processing: when exposure correction that darkens the moving image data is received through the first operation, during the period from receiving the first operation to receiving the second operation, the sensitivity of the moving image data captured by the camera unit is reduced compared to before the exposure correction, and the moving image data is read; the moving image data generated by applying the second camera parameter to the read moving image data is output as the second moving image data to the display destination; the moving image data with the same brightness as before the exposure correction is generated by multiplying the read moving image data by a gain; and the generated moving image data is output as the first moving image data to the recording destination.

[0023] In the 13th aspect, the camera device according to the 14th aspect of the present invention performs the following processing: when it is impossible to reduce the sensitivity during reading, the dynamic image data is darkened by shortening the exposure time when capturing the dynamic image data.

[0024] In the 14th method, the camera device involved in the 15th method has the processor performing the following processing: increasing the frame rate of the dynamic image data and shortening the exposure time compared to before exposure correction to acquire multiple frames of dynamic image data; displaying the dynamic image data generated by averaging the multiple frames of dynamic image data as a second dynamic image data on the display destination; and outputting the dynamic image data generated by multiplying the generated dynamic image data by a gain or by adding the multiple frames of dynamic image data as a first dynamic image data to the recording destination.

[0025] In any of the 5th to 15th methods, the processor of the camera device involved in the 16th method performs the following processing: when exposure correction to brighten the moving image data is accepted through the first operation, during the period from accepting the first operation to accepting the second operation, the moving image data generated by multiplying the moving image data captured by the camera unit by a gain is output as the second moving image data to the display destination.

[0026] The camera device according to the 17th method, in any one of the 1st to 16th methods, further includes a recording unit and / or a first connection unit connected to an external recording device, and the processor performs the following processing: recording the first moving image data and the second moving image data as the recording destination using the recording unit, and / or recording the first moving image data and the second moving image data via the first connection unit as the recording destination using an external recording device.

[0027] In any one of the 4th to 10th and 13th to 16th embodiments, the camera device involved in the 18th embodiment further includes a display unit and / or a second connection unit connected to an external display device, and the processor performs the following processing: displays the first dynamic image data and / or the second dynamic image data as the display unit as the display destination, and / or displays the first dynamic image data and / or the second dynamic image data via the second connection unit as the display destination of the external display device.

[0028] The imaging method according to the 19th aspect of the present invention is based on an imaging device having an imaging unit and a processor, wherein the processor performs the following processing: setting a first imaging parameter applied to moving image data captured by the imaging unit; before accepting a first operation, outputting the first moving image data captured according to the first imaging parameter to a recording destination; if the first operation is accepted, setting a second imaging parameter applied to the moving image data; from the time the first operation is accepted until the time the second operation is accepted, outputting the first moving image data to the recording destination; if the second operation is accepted, outputting the second moving image data captured according to the second imaging parameter to the recording destination instead of the first moving image data captured according to the first imaging parameter.

[0029] The imaging program according to the 20th aspect of the present invention causes the processor of an imaging device equipped with an imaging unit and a processor to execute each step of the imaging method, wherein the processor executes the following steps: setting a first imaging parameter applied to moving image data captured by the imaging unit; outputting the first moving image data captured according to the first imaging parameter to a recording destination before accepting a first operation; setting a second imaging parameter applied to the moving image data when the first operation is accepted; outputting the first moving image data to the recording destination from after accepting the first operation to before accepting the second operation; and outputting the second moving image data captured according to the second imaging parameter to the recording destination instead of the first moving image data captured according to the first imaging parameter when the second operation is accepted. Attached Figure Description

[0030] Figure 1 This is a front perspective view of the camera device according to the first embodiment.

[0031] Figure 2 This is a rear view of the camera device.

[0032] Figure 3 This is a partial top view of the camera device.

[0033] Figure 4 It is a block diagram showing the general structure of the camera device.

[0034] Figure 5 It is a diagram representing the functional structure of a processor.

[0035] Figure 6 It is a diagram showing the white balance switching and the recording of dynamic images.

[0036] Figure 7 This is a diagram showing the white balance switching and the display of the live view image.

[0037] Figure 8 This is another diagram showing the white balance switching and the recording of dynamic images.

[0038] Figure 9 This is a diagram illustrating an example of the display of a live view image in Embodiment 2.

[0039] Figure 10 This is a diagram illustrating another example of the display of a live view image in Embodiment 2.

[0040] Figure 11 This is another example of the display of a live view image in Embodiment 2.

[0041] Figure 12 This is a diagram illustrating an example of the display of a live view image in Embodiment 3.

[0042] Figure 13 This is a diagram illustrating an example of a buffer for a moving image.

[0043] Figure 14 This is another example of a buffer for a moving image.

[0044] Figure 15 This diagram illustrates a situation where a camera device is controlled using a remote control.

[0045] Figure 16 This is a diagram showing the structure of a remote control.

[0046] Figure 17 This is an external view of the smartphone according to the second embodiment.

[0047] Figure 18 This is a diagram showing the general structure of a smartphone. Detailed Implementation

[0048] One embodiment of the imaging device, imaging method, and imaging program involved in this invention is as follows. The accompanying drawings are provided for reference as needed.

[0049] <First Embodiment>

[0050] <Overall Structure of the Camera Device>

[0051] Figure 1 This is a front perspective view of the camera device 100 according to the first embodiment of the present invention. Figure 2 This is a rear view of the camera device 100. Figure 3 This is a partial top view of the camera device 100. The camera device 100 consists of a camera device body 300 and an interchangeable lens 200 mounted on the camera device body 300. The camera device body 300 and the interchangeable lens 200 are mounted by engaging a bayonet 301 provided in the camera device body 300 and a bayonet (not shown) on the interchangeable lens 200 side corresponding to the bayonet 301, and can be removed by disengaging this engagement. A terminal 302 is provided in the bayonet 301, and a terminal (not shown) is also provided in the bayonet on the interchangeable lens 200 side. When the interchangeable lens 200 is attached to the camera device body 300, these terminals come into contact with each other and are in a communicative state. Furthermore, in addition to the bayonet 301 and the terminal 302, a viewfinder 303 is provided on the front surface of the camera device body 300.

[0052] like Figure 2As shown, the rear of the camera unit 300 mainly includes a viewfinder eyepiece 304, a display 370, a MENU / OK button 356, a crosshair 357 (directional indicator button), a BACK button 355, and a Q button 358 (Q: Quick). The MENU / OK button 356 functions as a menu button for displaying instructions on the display 370 screen, and as an OK button for confirming and executing selected instructions (such as switching white balance or exposure). The crosshair 357 is an input button for pointing in four directions (up, down, left, and right), functioning as a button for selecting items from the menu screen (e.g., specific white balance or exposure settings) or indicating various settings from each menu (cursor movement mechanism). Furthermore, the up and down buttons of the crosshair 357 function as a zoom switch during shooting or a playback zoom switch in playback mode, while the left and right buttons function as frame transfer (forward or reverse transfer) buttons in playback mode. The BACK button 355 is used to delete desired items, cancel indicated content, or return to the previous operation state. The Q button 358 also functions as a button to issue commands to display the menu screen on the display 370.

[0053] And, as Figure 3 As shown, on the upper surface of the camera device body 300, there is a release button 351, a shooting mode or shutter speed setting dial 352, a function button 353 that can be assigned the desired function, and an exposure correction dial 354. The release button 351 is a two-stage travel button that can be pressed to the middle of its travel (referred to as a "half-press" operation) and pressed to the full travel (referred to as a "full-press" operation). The user can use these buttons or dials provided on the upper surface and back of the camera device body 300 to perform operations such as starting / ending video recording, white balance, or exposure (first video parameter, second video parameter), as described later (operation 1 to operation 2).

[0054] Figure 4 This is a block diagram showing the general structure of the imaging device 100 (camera device). The imaging device 100 consists of an interchangeable lens 200 and an imaging device body 300. An image of the subject (optical image) is formed on the light-receiving portion 312 of the imaging element 310 (imaging element) through an imaging lens including a zoom lens 210 and a focusing lens 230 (described later). In the first embodiment, the imaging device 100 is described with an interchangeable lens 200, but the lens assembly (optical system) can be fixed to the camera body.

[0055] <Interchangeable lens structure>

[0056] The interchangeable lens 200 includes a zoom lens 210, an aperture 220, a focusing lens 230, and a lens drive unit 240. The lens drive unit 240 is based on data from a processor 330. Figure 5 The lens drive control unit 346 (processor) drives the zoom lens 210 and focusing lens 230 forward and backward in the direction of the optical axis L to perform zoom (optical zoom) adjustment and focus adjustment. Zoom and focus adjustments can be performed not only according to instructions from the processor 330, but also according to zoom and focus operations performed by the user (rotation of the zoom ring, focus ring, etc., not shown). Furthermore, the lens drive unit 240 controls the aperture 220 and adjusts the exposure according to instructions from the processor 330. On the other hand, information such as the position of the zoom lens 210 and focusing lens 230 and the opening degree of the aperture 220 is input to the processor 330.

[0057] <Structure of the main body of the camera device>

[0058] The camera device main body 300 includes an imaging element 310 (camera unit), a digital signal processing unit 320, a processor 330, an operation unit 350, a recording device 360 ​​(recording unit, recording destination), a display 370 (display unit, display destination), a speaker 380, an antenna 390, and an external output unit 395 (first connection unit, second connection unit). The camera device main body 300 may also have a shutter (not shown) for blocking light transmitted through the imaging element 310. Furthermore, the shutter can be a mechanical shutter or an electronic shutter. In the case of an electronic shutter, the exposure time (shutter speed) can be adjusted by controlling the charge accumulation period of the imaging element 310 by the processor 330.

[0059] <Structure of Imaging Element>

[0060] The imaging element 310 includes a light-receiving section 312, an analog amplification section 314, an A / D converter 316, and an imaging element driving section 318. The light-receiving section 312 has a light-receiving surface with multiple light-receiving elements arranged in a matrix. Subject light transmitted through the zoom lens 210, aperture 220, and focusing lens 230 is imaged onto the light-receiving surface of the light-receiving section 312 and converted into electrical signals by each light-receiving element. Color filters of R (red), G (green), or B (blue) are provided on the light-receiving surface of the light-receiving section 312, enabling the acquisition of a color image of the subject based on the signals of each color. Furthermore, in this embodiment, a CMOS (Complementary Metal-Oxide Semiconductor) type color image sensor can be used as the imaging element 310.

[0061] In one example of the structure of a CMOS image sensor, an analog amplification unit 314 is provided for each pixel or multiple pixels constituting the light-receiving unit 312. After the pixel signal is amplified in the analog amplification unit 314, it is read in row units and supplied to an A / D converter 316 (Analog-to-Digital Converter). The A / D converter 316 converts the supplied pixel signal into a digital pixel signal and supplies it to a digital signal processing unit 320. The digital signal processing unit 320 performs digital correlation double sampling processing, digital gain processing, correction processing, etc., on the digital pixel signal to convert it into a digital image signal. The imaging element driving unit 318 drives the imaging element 310 according to instructions from the processor 330 (camera control unit 336; processor).

[0062] When the imaging element 310 is a CMOS image sensor, such as Figure 4 In many cases, the imaging element driver, analog amplification unit, and A / D converter are contained within the imaging element package, but image sensors with different structures can also be used.

[0063] In addition, as the imaging element 310, besides the CMOS type, color image sensors such as XY address type and CCD (Charge-Coupled Device) type can be used.

[0064] <Processor Architecture>

[0065] Figure 5 This diagram illustrates the functional structure of the processor 330 (processor, computer). The processor 330 functions as a receiving unit 332, a camera parameter setting unit 334, a camera control unit 336, an image processing unit 338, a compression processing unit 340, a recording control unit 342, a display control unit 344, a communication control unit 345, and a lens drive control unit 346. The processor 330 performs dynamic image capture, image processing, compression, and recording based on the digital image signal input from the digital signal processing unit 320. Detailed descriptions of the processing using the processor 330 will follow.

[0066] The functions of the aforementioned processor 330 can be implemented using various processors. These processors include, for example, general-purpose processors that execute software (programs) to implement various functions, namely CPUs (Central Processing Units). Furthermore, the aforementioned processors include processors specifically designed for image processing, namely GPUs (Graphics Processing Units). Also included are processors such as FPGAs (Field Programmable Gate Arrays) whose circuit structures can be modified after manufacturing, namely PLDs (Programmable Logic Devices). Moreover, processors with circuit structures specifically designed for performing specific processes, such as ASICs (Application Specific Integrated Circuits), are also included among the aforementioned processors.

[0067] Furthermore, the functions of processor 330 can be implemented by one processor or by multiple processors. One processor can also correspond to multiple functions. Moreover, the functions of processor 330 can be implemented by circuitry, or a portion of each function can be implemented by circuitry while the remainder is implemented by the processor.

[0068] When the aforementioned processor or circuit executes software (program), it stores the processor-readable code of the executed software or the data required to execute the software in a non-transitory recording medium such as flash memory, and the processor references the software or data. The software stored in the non-transitory recording medium includes an imaging program (a program that enables the imaging device to operate) for executing each step of the imaging method according to this embodiment. Code or data may also be recorded in a non-transitory recording medium that uses various magneto-optical recording devices, semiconductor memories, etc., instead of flash memory. Here, "semiconductor memory" includes ROM (Read Only Memory) or EEPROM (Electrically Erasable and Programmable ROM) in addition to flash memory. When processing using software, RAM (Random Access Memory) is used as a temporary storage area.

[0069] like Figure 5As shown, the processor 330 includes a flash memory 348 (a non-temporary recording medium, or memory). The flash memory 348 stores code that can be read by a computer (e.g., various processors constituting the processor 330) for programs required for image capture, recording, display, etc. (including programs for executing each step of the image capture method according to this embodiment (image capture program)), or data required for executing the program (e.g., frame compression and recording modes). Furthermore, the processor 330 includes a RAM 349 (memory) serving as both a temporary storage area and a working area. The RAM 349 can be used for buffering dynamic image data (described later).

[0070] <Operations Department>

[0071] Operation unit 350 is composed of Figure 2 , 3 The device comprises buttons, keys, dials, etc., allowing users to perform various operations such as setting camera modes, adjusting camera parameters for moving images (e.g., white balance, exposure, shutter speed, frame rate, compression format, compression ratio, film simulation, etc.; first camera parameter, second camera parameter), and providing instructions for moving image and still image recording. The processor 330 can also process these user instructions. Furthermore, the display 370 (display unit) can be configured using a touch panel type device and can be used as an operation unit.

[0072] <Recording device>

[0073] The recording device 360 ​​(recording unit, recording destination) is composed of various magneto-optical recording media, semiconductor memory, and other non-transitory recording media and their control circuits, and is capable of storing moving images, still images, etc. The recording device 360 ​​can record first moving image data or second moving image data. The recording medium constituting the recording device 360 ​​can be of a type that can be attached to and detached from the camera device body 300. The processor 330 (recording control unit 342, communication control unit 345, etc.) can transmit the captured images (including first moving image data and second moving image data) via antenna 390 or via external output unit 395 (first connection unit, second connection unit) to external recording devices (external recording devices, recording destinations; for example, magneto-optical recording devices or semiconductor recording devices of personal computers, cloud recording devices, etc.) and record them in these external recording devices.

[0074] <Monitors and Speakers>

[0075] The display 370 (display unit) is, for example, composed of a touch panel type liquid crystal display panel, capable of displaying a screen for setting camera parameters, the set camera parameters, moving images, still images, remaining recording time, warning messages to the user, etc. This message can be output as voice from the speaker 380. Furthermore, the processor 330 (display control unit 344, etc.) can display the captured images (including first moving image data and / or second moving image data) on an external display device (external display device, display destination) connected via an external output unit 395 (first connection unit, second connection unit).

[0076] <Switching Camera Parameters for Dynamic Images and the Method of This Invention>

[0077] In video recording, when changes occur in light (type of light source, brightness, etc.), users sometimes want to change recording parameters related to white balance or exposure. In such cases, if switching exposure or white balance settings during video recording is immediately reflected in the recorded video, the user may switch to an incorrect (inappropriate) exposure or white balance, resulting in an incorrect video recording, requiring a reshoot or missing the opportunity to film.

[0078] In light of this situation, the inventors of this application conducted further research and arrived at the concept of "in recording moving images, the switching results of camera parameters (exposure or white balance, etc.) are not reflected in the recorded moving image, but only in the live view image. After the user confirms the reflection result in the live view image and instructs the reflection to be executed, the switching result is then reflected in the recorded moving image." This reduces the risk of capturing moving images with incorrect camera parameters such as exposure or white balance, and allows users to easily capture moving images under the desired camera conditions. The specific method is described below.

[0079] <Processing of the camera method (Example 1)>

[0080] Figure 6 This is a diagram showing the white balance switching and the recording of moving images. In addition, the camera parameter setting unit 334 (processor) is set as follows: "Sunny day" is set as the first camera parameter (here, "light source" as a camera parameter related to white balance) applied to the moving image data captured by the camera unit (imaging element 310, etc.).

[0081] <Capturing, Recording, and Displaying the First Moving Image>

[0082] The processor 330 (including the receiving unit 332, camera control unit 336, image processing unit 338, compression processing unit 340, recording control unit 342, etc.) initiates the recording, image processing, compression, and recording of the moving image data based on the first camera parameters to the recording device 360 ​​(recording unit, recording destination) according to the operation of the release button 351, etc. Meanwhile, the display control unit 344 (processor) displays the live view image on the display 370 (display unit, display destination). Up to time t1, the first moving image data is displayed as a live view image. Figure 7 This diagram illustrates the white balance switching and the display of the live view image. Figure 7 Part (a) is an example of a live view image with white balance set to "sunny".

[0083] Furthermore, live view images refer to images captured by the camera unit that are displayed on a display device without being recorded on a recording medium, allowing the photographer to confirm the field of view or the subject before shooting and recording. The processor 330 can repeatedly generate and record I-frames, P-frames, and B-frames in a defined pattern according to image quality or compression rate settings.

[0084] <Setting the second camera parameters (operation 1)>

[0085] Figure 6 In the example, the camera location is outdoors on a sunny day up to time t1. At time t1, the user moves from outdoors to indoors. As the camera location moves, at time t2, the user switches the white balance (light source) selection from "sunny" to "fluorescent" (operation of the operation unit 350, function button 353, MENU / OK button 356, D-pad 357, etc.: first operation). When the receiving unit 332 receives the first operation, the camera parameter setting unit 334 (processor) sets the second camera parameters applied to the aforementioned moving image data. Furthermore, time t2 may not be exactly the same as time t1.

[0086] <Camera, display, and recording after the first operation>

[0087] The image processing unit 338 and the display control unit 344 (processor) generate a real-time view image (second dynamic image data) starting from time t3 (after time t2) based on the set second camera parameters (at this time, the light source is a "fluorescent lamp"). Figure 7As illustrated in section (b), the image is displayed on monitor 370 (display device). As shown in section one, the selected white balance (light source) can also be displayed via text, symbols, graphics, etc. Furthermore, the live view image can be displayed on an external display device via external output unit 395 (the same applies in the following examples). Through this display, the user can confirm the dynamic image (second dynamic image data) under the changed white balance and easily determine whether the switch was appropriate.

[0088] On the other hand, the processor 330 (image processing unit 338, compression processing unit 340, recording control unit 342, etc.; processor) continues to record the moving image (first moving image data) under the white balance before the switch (at this time, "sunny day") from time t3 until time t4 (when the second operation is accepted) described later. This prevents the recording of inappropriate moving images when the switching of camera parameters (the "light source" which is a camera parameter related to white balance) is inappropriate.

[0089] <Camera, display and recording after the second operation>

[0090] If the user confirms that the white balance is appropriate after switching, then operate the control unit 350 (function button 353, MENU / OK button 356, D-pad 357, Q button 358, etc.); see reference Figures 1-4 The operation involves determining the white balance selection (operation 2). The operation of instructing to switch camera parameters (operation 1) and confirming the switch (operation 2) can be set to operate on different components. Furthermore, the operation 2 is set to be performed at time t4 (after the aforementioned operation 1).

[0091] When the processor 330 (including the receiving unit 332, camera control unit 336, image processing unit 338, compression processing unit 340, recording control unit 342, etc.) receives the second operation, after time t5, it records the moving image (second moving image data) captured according to the changed white balance (at this time the light source is "fluorescent lamp") into the recording device 360 ​​(recording destination), replacing the moving image (first moving image data) captured according to the white balance before the change. The moving image recorded here is a moving image with the white balance confirmed to be appropriate, so there is no problem even if it is recorded. Furthermore, after receiving the second operation, the processor 330 (including the display control unit 344, etc.) displays the moving image (second moving image data) captured according to the changed white balance on the display 370.

[0092] Thus, according to Embodiment 1, the user can easily capture moving images under the desired camera conditions.

[0093] <Recording Formats of Moving Images>

[0094] Furthermore, when recording moving images (first moving image data, second moving image data), it is preferable to be able to determine whether the moving image is before or after the switching of camera parameters. For example, the processor 330 (image processing unit 338, compression processing unit 340, recording control unit 342, etc.) can continuously record the first moving image data and the second moving image data in a single file. When recording to different files, the following processing can also be performed: the file name includes the white balance name (type of light source) (e.g., "20200901-0001_shine.mov" and "20200901-0001_fluorescent1.mov"); the identification number is marked ("20200901-0001_01.mov" and "20200901-0001_02.mov"); the moving image files before and after the switching are recorded in the same folder.

[0095] <Processing of Camera Methods (Example 2)>

[0096] In the above-described embodiment 1, from the selection operation (first operation) to the confirmation operation (second operation), only the dynamic image (second dynamic image data) based on the white balance after selection confirmation is displayed. However, as... Figure 8 (As shown in another diagram illustrating the white balance switching and motion image recording), during this period (time t3 to time t4), the motion image based on the white balance before the switch (first motion image data) can also be displayed on the display 370 and / or an external display device. This allows the user to simultaneously visually identify the motion image based on the white balance before and after the switch, thus easily confirming whether the switch is appropriate and reducing the possibility of selection errors. An example of this display is described below.

[0097] <Example 1 in Example 2>

[0098] Figure 9 This is a diagram illustrating an example of the display of a live view image in Embodiment 2. Figure 9In the example shown, the processor 330 (display control unit 344, etc.) displays a portion of a single dynamic image data (the left half of the display 370) as a dynamic image (first dynamic image data) based on the white balance (light source) before the switch, and displays another portion of the dynamic image data (the right half of the display 370) as a dynamic image (second dynamic image data) based on the white balance (light source) after the switch, during the period from accepting the first operation to accepting the second operation. Thus, the user can simultaneously visually identify the dynamic image based on the white balance before and after the switch. Furthermore, as described above, the processor 330 (display control unit 344, etc.) preferably identifies which area corresponds to which white balance in the dynamic image using text, graphics, symbols, etc. (this is also the case in other display examples).

[0099] <Example 2 in Example 2 (2)>

[0100] Figure 10 This is a diagram illustrating another example of the display of a live view image in Embodiment 2. Figure 10 In the example shown, during the period from accepting the first operation to accepting the second operation, the processor 330 (display control unit 344, etc.) simultaneously displays the dynamic image 510 (first dynamic image data) based on the white balance before the switch in a portion of the area of ​​the dynamic image 500 (second dynamic image data) based on the white balance after the switch (Picture-in-Picture mode). Through this display, the user can simultaneously visually distinguish the dynamic image based on the white balance (light source) before and after the switch, and the possibility of selection errors can be reduced. Furthermore, the processor 330 (display control unit 344, etc.) displays the white balance of the dynamic image 500 as "fluorescent lamp (fluorescent lamp 3)" using text and symbols in areas 500A and 500B, and displays the white balance of the dynamic image 510 as "sunny" using text in area 510A.

[0101] <Example 3 in Example 2>

[0102] Figure 11 This is another example of the display of a live view image in Embodiment 2. Figure 11 In the example shown, during the period from accepting the first operation to accepting the second operation, the processor 330 (display control unit 344, etc.) simultaneously displays, side-by-side, a dynamic image based on the white balance before the switch (first dynamic image data) and a dynamic image based on the white balance after the switch (second dynamic image data) (Picture by Picture mode). Furthermore, the processor 330 (display control unit 344, etc.) and Figure 10Similarly, in area 520A, the white balance of the moving image 520 is displayed as "sunny" using text, and in areas 530A and 530B, the white balance of the moving image 530 is displayed as "fluorescent lamp (fluorescent lamp 3)" using text and symbols.

[0103] This display also allows users to visually identify dynamic images based on white balance before and after the switch, reducing the possibility of incorrect selection.

[0104] <Processing of Camera Methods (Example 3)>

[0105] Figure 12 This is a diagram illustrating an example of the display of a live view image in Embodiment 3. Figure 12 In the example shown, the processor 330 (receiving unit 332, display control unit 344, etc.) outputs (displays) a combined view of dynamic images 542-552 based on selectable white balance (light source) and dynamic image 540 based on the current (previous) white balance (light source: sunny) on the display 370 (or an external display device) according to the first operation. Furthermore, the processor 330 (display control unit 344, etc.) displays the white balance of each dynamic image in text in areas 540A-552A. The user can then view the white balance at time t2 (reference). Figure 6 , 8 The process performs a view output operation. In addition, while in the view output state, the processor 330 (recording control unit 342, etc.) continues to record the dynamic image (first dynamic image data) based on the white balance before the switch.

[0106] If the user selects any animated image (operation 2) (time t4; reference) Figure 6 , 8 If the processor 330 (acceptance unit 332, camera parameter setting unit 334, etc.) sets the white balance (light source) corresponding to the selected moving image as the second camera parameter, and outputs the moving image (second moving image data) based on the selected white balance to the recording destination (recording device 360) to replace the moving image (first moving image data) based on the white balance before switching.

[0107] This display allows users to simultaneously visually recognize dynamic images based on the white balance before and after the switch, reducing the possibility of selection errors. Alternatively, in embodiment 3, the display 370 can be constructed from a touch panel type device, enabling direct selection of dynamic images via touch panel operation. This direct selection reduces the risk of misselection due to operational errors.

[0108] <Buffering of moving images>

[0109] In the above embodiments, a motion image (first motion image data) based on the original camera parameters (first camera parameters) is recorded until the user confirms the selection of a new camera parameter (second camera parameter). However, in this invention, by buffering the motion image, it is possible to trace back to the point in time when the user begins to select the new camera parameter to record the motion image.

[0110] Figure 13 This diagram illustrates an example of buffering a moving image. If the user performs a white balance (light source) selection operation (first operation) at time t2, the processor 330 stops recording the moving image to the recording device 360 ​​and temporarily saves (buffers) the RAW data (moving image data) output from the imaging element 310 (camera unit) in RAM 349 (memory). This temporary saving occurs from the time the processor 330 (receiving unit 332, etc.) receives the first operation until the time it receives the second operation. After receiving the second operation (time t4) that determines the white balance selection... Figure 13 At time t5, the processor 330 develops the RAW data according to the determined white balance to generate second motion image data, which is then recorded in the recording device 360. This allows for tracing back to the time point initially selected by the user, recording a motion image (second motion image data) reflecting the new white balance.

[0111] In addition, the preferred processor 330 performs RAW data development at a speed of real-time or higher (frame rate or higher for dynamic images) and gradually reduces the amount of RAW data stored in memory.

[0112] Figure 14 This is another example of a buffer for moving images. (The diagram is based on...) Figure 13 The above processing can trace back to the point in time when the user begins selecting the color to record a dynamic image reflecting the new white balance. However, depending on the memory capacity, it is sometimes impossible to save all the RAW data from the start of selection (time t2) to the final selection (time t4). Therefore, Figure 14In the illustrated method, if the remaining capacity of the memory falls below a threshold before the user determines the white balance selection (i.e., before the processor 330 performs the second operation), the RAW data is developed sequentially from the old data using the white balance (first imaging parameter) before the selection, and the recording of the moving image (first moving image data) is restarted. New RAW data is overwritten in the free areas of the memory that are no longer needed due to development (First In First Out processing). Then, if the user determines the white balance selection (i.e., if the processor 330 performs the second operation), the processor 330 applies the determined white balance to the data after the first moving image data acquired in the RAW data (moving image data) stored in the memory (generating second moving image data and recording it in the recording device 360). This allows for tracing back the time corresponding to the memory capacity, recording a moving image reflecting the determined white balance. Furthermore, it is preferable that the processor 330 notifies the user of the time up to the point where the remaining memory capacity falls below a threshold via a display 370 or a speaker 380.

[0113] <Phase-wise changes in white balance>

[0114] In the above-described method, when reflecting the selected white balance in the recorded motion image, instead of switching abruptly (all at once) before and after confirmation, the original white balance (light source; first camera parameter) can be changed multiple times to switch to a new white balance (light source; second camera parameter), and the motion image data corresponding to the white balance camera parameters during the switching period can be recorded in the recording device 360 ​​as the second motion image data. For example, when the color temperature of "sunny day" and "shaded day" is set to 5500K and 7500K respectively, the processor 330 can also reflect the change in the recorded motion image gradually, such as 5500K, 6000K, 6500K, 7000K, and 7500K, instead of switching abruptly from 5500K before and after confirmation. In this case, the amount of change for each change can be switched according to the final amount of change in the white balance. Furthermore, the processor 330 can also set the amount of change by switching the white balance within a specified time (e.g., 1 second). In this way, by changing the white balance in stages, the unnatural appearance (drastic changes) of moving images can be reduced.

[0115] <Exposure settings changes>

[0116] The above method describes the selection and determination of the light source as a camera parameter related to white balance. However, this invention is also applicable to camera parameters related to exposure, such as EV value (Exposure Value). That is, before the selection is determined, the changed exposure is only reflected in the live view image. The specific method for exposure correction is described below.

[0117] <Expression correction that darkens moving images>

[0118] When the processor 330 performs exposure correction to darken the moving image data via the first operation, it reads the RAW data (moving image data) captured by the camera unit at a lower sensitivity than before the exposure correction during the period from the acceptance selection operation (first operation) to the acceptance confirmation operation (second operation). For live view images, the processor 330 displays the generated moving image data as the second moving image data as the second moving image data displayed on the display device by applying the corrected exposure (second imaging parameter) to the read RAW data. On the other hand, for recorded moving images, the processor 330 creates moving image data with the same brightness as before the exposure correction by multiplying the read RAW data by a gain, and records the created moving image data as the first moving image data in the recording device. In addition, if the processor 330 cannot reduce the sensitivity during reading, it can darken the moving image data by shortening the exposure time when capturing the moving image data.

[0119] Furthermore, shortening the exposure time alters the blur level of the moving image, potentially leading to a discrepancy with the user's intent. Therefore, the processor 330 can perform the following processing: increase the frame rate of the moving image data compared to before exposure correction, shorten the exposure time to acquire multiple frames of moving image data, and display the resulting moving image data (averaged from the multiple frames) as a second moving image data display on the display device. On the other hand, the processor 330 can also record the resulting moving image data (multiplied by a gain or generated by adding the multiple frames) as first moving image data in a recording device.

[0120] Specifically, for example, when wanting to reduce the exposure by one stop when using an exposure of "60fps, 1 / 60s" (in the case of exposure correction that makes the moving image one stop darker in EV value), by reading RAW data at "120fps, 1 / 120s" and averaging the two frames of the obtained RAW data, it is possible to achieve an exposure equivalent to a 1 / 120s live view image (reduced by one stop) with the same amount of blur as 1 / 60s. Thus, it is possible to reduce the effective ISO while maintaining the exposure time.

[0121] <Expression correction that brightens moving images>

[0122] On the other hand, when the processor accepts the exposure correction that brightens the moving image data through the first operation, it can display the moving image data generated by multiplying the moving image data captured by the camera unit by a gain as the second moving image data on the display device during the period from accepting the first operation to accepting the second operation.

[0123] In this way, even if the user chooses an unintentional exposure correction, it will not be immediately reflected in the recorded video, thereby preventing the reshooting of the video and allowing the user to easily capture video under the desired shooting conditions.

[0124] <Examples of variations in the operation and indication of the camera device>

[0125] In Implementation 1, the user can directly set the camera parameters or give camera instructions to the camera device 100, but the operation or instructions of the camera device 100 can also be performed using a remote control. Figure 15 This diagram illustrates the use of remote control 700 (camera indicator device) to control camera device 100. Figure 16 This is a diagram showing the structure of the remote control 700.

[0126] like Figure 16 As shown, the remote control 700 includes: a processor 710 (processor) with a receiving unit 712 and a communication control unit 714; a flash memory 720; a RAM 722; an operation unit 730; and a wireless communication antenna 740. The user operates the operation unit 730 (buttons, switches, etc.) to perform various operations (such as camera parameter setting instructions or video recording start / end instructions), and the receiving unit 712 receives these operations. The communication control unit 714 instructs the camera device 100 according to the camera program stored in the flash memory 720 (a non-temporary recording medium, memory). The camera instruction program causes the processor 710 to execute camera instructions (first to third instructions; each process of the camera method according to the present invention) for the camera unit of the camera device 100 (specifically, each part of the imaging element 310 and the processor 330). During processing, the RAM 722 is used as a working area and a temporary recording area (including an area used as memory). The processes of the camera method are the same as in Embodiments 1 to 3. In addition, the communication between the remote control 700 and the camera device 100 can be wired communication.

[0127] With this structure, and in the same way as described above, users can easily capture moving images under the desired camera conditions.

[0128] <Second Implementation>

[0129] In the first embodiment, a camera device 100 as a digital camera has been described, but the structure of the camera device is not limited thereto. Other camera devices may include, for example, a built-in or external PC camera (PC: Personal Computer) or a portable terminal device with camera function as described below.

[0130] Portable terminal devices that are embodiments of the camera apparatus of the present invention include, for example, mobile phones or smartphones, PDAs (Personal Digital Assistants), portable game consoles, and smartwatches. Hereinafter, a smartphone will be used as an example, and a detailed description will be provided with reference to the accompanying drawings.

[0131] Figure 17 This is an external view of the smartphone 1 (camera device) according to the second embodiment. Part (a) of the figure is a front view, and part (b) is a rear view. Figure 17 The smartphone 1 shown has a flat frame 2. On one side of the frame 2, a display panel 21 (display device) serving as the display unit and an operation panel 22 (operation unit) serving as the input unit are integrated into a display input unit 20. Furthermore, the frame 2 includes a speaker 31, a microphone 32, an operation unit 40, camera units 41 and 42 (camera units), and a flash 43. However, the structure of the frame 2 is not limited to this; for example, it can have a separate display unit and input unit structure, or it can have a folding structure or a sliding mechanism.

[0132] Figure 18 This is a diagram showing the general structure of smartphone 1. (Example) Figure 18 As shown, smartphone 1 includes a wireless communication unit 11, a display input unit 20, a call unit 30, an operation unit 40, camera units 41 and 42, a flash 43, a storage unit 50, an external input / output unit 60, a GPS receiver 70 (GPS: Global Positioning System), a motion sensor unit 80, and a power supply unit 90. Furthermore, smartphone 1 includes a main control unit 101 (processor). As a primary function of smartphone 1, it possesses wireless communication capabilities, enabling mobile wireless communication via a base station device and a mobile communication network.

[0133] The wireless communication unit 11 performs wireless communication with the base station device housed in the mobile communication network according to the instructions of the main control unit 101. Using this wireless communication, it performs the sending and receiving of various types of data such as voice data, image data, and email data, or the receiving of Web data or streaming data.

[0134] The display input unit 20 is a so-called touch panel, and includes a display panel 21 and an operation panel 22. The touch panel displays images (still images and / or moving images) or character information to visually convey information to the user under the control of the main control unit 101, and detects the user's operation on the displayed information.

[0135] In the display panel 21, LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode) are used as display devices. The operation panel 22 is mounted in a manner that allows visual recognition of images displayed on the display surface of the display panel 21, and detects one or more coordinates operated by a user's finger or pen. If such a device is operated by a user's finger or pen, the operation panel 22 outputs a detection signal generated by the operation to the main control unit 101. Then, the main control unit 101 detects the operation position (coordinates) on the display panel 21 based on the received detection signal.

[0136] like Figure 17 As shown, in a smartphone 1 exemplified as one embodiment of the camera device of the present invention, the display panel 21 and the operation panel 22 are integrally formed into a display input unit 20, but the operation panel 22 is configured to completely cover the display panel 21. With this configuration, the operation panel 22 can detect user operations even in areas outside the display panel 21. In other words, the operation panel 22 can have a detection area (hereinafter referred to as the display area) for the overlapping portion that overlaps with the display panel 21 and a detection area (hereinafter referred to as the non-display area) for the outer edge portion that does not overlap with the display panel 21.

[0137] The communication unit 30 includes a speaker 31 or a microphone 32, capable of converting user voice input through the microphone 32 into voice data that can be processed by the main control unit 101 and outputting it to the main control unit 101. It can also decode audio data received through the wireless communication unit 11 or the external input / output unit 60 and output it from the speaker 31. Furthermore, as... Figure 17 As shown, for example, the speaker 31 can be mounted on the same surface as the surface where the display input section 20 is provided, and the microphone 32 can be mounted on the side of the frame 2.

[0138] The operation unit 40 uses hardware keys such as key switches and is a device that receives instructions from the user. For example, Figure 17 As shown, the operation unit 40 is mounted on the side of the frame 2 of the smartphone 1, and is a button-type switch that is turned on when pressed with a finger or the like, and turned off when the finger is released by the restoring force of a spring or the like.

[0139] The storage unit 50 (recording unit, recording destination, memory) stores the control program of the main control unit 101 (e.g., a camera instruction program that causes the main control unit 101 to execute the camera instruction method of this embodiment) and control data (which may include the first time, second time, etc. information mentioned above), application software, address data that establishes corresponding associations between the names and phone numbers of communication objects, data of emails sent and received, web data downloaded through web browsing and downloaded content data, and temporarily stores streaming data, etc. Furthermore, the storage unit 50 stores the moving image data (first moving image data, second moving image data) captured by the camera method of this embodiment. The storage unit 50 is composed of an internal storage unit 51 built into the smartphone and an external storage unit 52 having a slot for easily removable external storage. Moreover, each of the internal storage units 51 and the external storage units 52 constituting the storage unit 50 is implemented using a known storage medium.

[0140] The external input / output unit 60 (first connection unit, second connection unit) serves as an interface to all external devices (including external recording devices and external display devices) connected to the smartphone 1. The smartphone 1 connects directly or indirectly to other external devices via the external input / output unit 60 through communication or the like. Examples of communication methods include Universal Serial Bus, IEEE 1394, and networks (e.g., wired LAN, wireless LAN). Furthermore, examples of communication methods include Bluetooth (registered trademark), RFID (Radio Frequency Identification), and Infrared Data Association (registered trademark). Moreover, examples of communication methods include UWB (Ultra Wide Band) (registered trademark) and ZigBee (registered trademark).

[0141] External devices that connect to the smartphone 1 can include, for example, wired / wireless headphones, wired / wireless external chargers, and wired / wireless data ports. Furthermore, external recording devices (external recording devices, recording destinations) such as memory cards or SIM (Subscriber Identity Module) / UIM (User Identity Module) cards connected via card slots can also be connected. Additionally, external audio and video devices connected via audio and video I / O (Input / Output) terminals, wirelessly connected external audio and video devices, wired / wireless connected smartphones, wired / wireless connected PDAs, wired / wireless connected personal computers, and headphones can also be connected. The external input / output unit 60 can transmit data received from such external devices to various components within the smartphone 1, or transmit data from within the smartphone 1 (including first dynamic image data and second dynamic image data) to external devices. Furthermore, the external input / output unit 60 can also display dynamic images (first dynamic image data, second dynamic image data) on an external display device (large display, etc.; external display device, display destination) connected to the smartphone 1.

[0142] The motion sensor unit 80, for example, includes a 3-axis accelerometer or a tilt sensor, and detects the physical movement of the smartphone 1 according to the instructions of the main control unit 101. By detecting the physical movement of the smartphone 1, the direction of movement, acceleration, or posture of the smartphone 1 can be detected. This detection result is output to the main control unit 101. The power supply unit 90 supplies power stored in the battery (not shown) to various parts of the smartphone 1 according to the instructions of the main control unit 101.

[0143] The main control unit 101 includes a microprocessor and a memory such as RAM or flash memory. It operates according to the control program or control data stored in the storage unit 50, and uniformly controls all parts of the smartphone 1, including the camera unit 41. Information such as the repeating patterns of I-frames and P-frames can also be stored in the memory of the main control unit 101. Furthermore, the main control unit 101 has mobile communication control functions and application processing functions for controlling various parts of the communication system in order to perform voice or data communication via the wireless communication unit 11.

[0144] Furthermore, the main control unit 101 has an image processing function that displays images on the display input unit 20 based on image data (still image or moving image data) such as received data or downloaded streaming data. The image processing function refers to the function of the main control unit 101 to decode the image data, perform image processing on the decoding result, and display the image on the display input unit 20.

[0145] Camera units 41 and 42 are digital cameras (video recording devices) that use imaging elements such as CMOS or CCD for electronic video recording. Furthermore, under the control of the main control unit 101, camera units 41 and 42 can convert image data (moving images, still images) acquired through video recording into compressed image data such as MPEG or JPEG, and record it in the storage unit 50, or output it through the external input / output unit 60 or the wireless communication unit 11. (During this compression or recording, according to the video recording instruction method of this embodiment, the setting of the first / second video recording parameters, the recording of the first / second moving image data, the compression, recording, and display of image data can be performed in the same manner as in the first embodiment.) Figure 17 , 18 In the smartphone 1 shown, one of the camera units 41 and 42 can be used for taking pictures, or both camera units 41 and 42 can be used simultaneously. When using camera unit 42, the flash 43 can be used.

[0146] Furthermore, camera units 41 and 42 can utilize various functions of the smartphone 1. For example, the smartphone 1 can display images acquired by camera units 41 and 42 on the display panel 21. The smartphone 1 can also use images from camera units 41 and 42 as one of the operation inputs for the operation panel 22. When the GPS receiver 70 detects its location based on positioning information from GPS satellites ST1, ST2, ..., STn, the smartphone 1 can also detect its location by referring to images from camera units 41 and 42. Moreover, the smartphone 1 can determine the optical axis direction of camera unit 41 or the current usage environment by referring to images from camera units 41 and 42, either without using a 3-axis accelerometer or by using it simultaneously with a 3-axis accelerometer. Of course, the smartphone 1 can also utilize images from camera units 41 and 42 within application software. Furthermore, the smartphone 1 can add location information acquired by the GPS receiver 70, voice information acquired by the microphone 32 (which can also be converted into text information by the main control unit, etc.), and posture information acquired by the motion sensor 80 to the image data of still images or moving images, and record them in the storage unit 50. Moreover, the smartphone 1 can also output this image data of still images or moving images through the external input / output unit 60 or the wireless communication unit 11.

[0147] The smartphone 1 with the above-described structure, like the camera device 100 according to the first embodiment, is capable of executing the imaging method and imaging program processing (setting the first / second imaging parameters, capturing the first / second moving image data, compressing, recording, and displaying image data, etc.) according to this embodiment. Specifically, the smartphone 1 is mainly able to execute the processing of the imaging method and imaging program according to the first embodiment by the camera unit 41, 42 and the main control unit 101. Figure 5 The processing performed by each of the shown parts. In addition, the functions of the operation unit 350, recording device 360, display 370 and speaker 380 in the first embodiment can be realized in the smartphone 1 by the operation unit 40, storage unit 50 and operation panel 22, display panel 21 and operation panel 22, speaker 31 respectively.

[0148] Therefore, the smartphone 1 according to the second embodiment can also achieve the same effect as the camera device 100 according to the first embodiment (the user can easily capture dynamic images under the desired camera conditions).

[0149] The embodiments of the present invention have been described above, but the present invention is not limited to the above-described manner, and various modifications can be made without departing from the spirit of the present invention.

[0150] Symbol Explanation

[0151] 1-Smartphone, 2-Frame, 11-Wireless communication unit, 20-Display input unit, 21-Display panel, 22-Operation panel, 30-Talk unit, 31-Speaker, 32-Microphone, 40-Operation unit, 41-Camera unit, 42-Camera unit, 43-Flash, 50-Storage unit, 51-Internal storage unit, 52-External storage unit, 60-External input / output unit, 70-GPS receiver, 80-Motion sensor unit, 90-Power supply unit, 100-Camera device, 101-Main control unit, 200-Changeable lens, 210-Zoom lens, 220-Aperture, 230-Focusing lens, 240-Transparent lens 300-Camera device main body, 301-Mount, 302-Terminal, 303-Viewfinder window, 304-Viewfinder eyepiece, 310-Imaging element, 312-Light receiving unit, 314-Analog magnification unit, 316-A / D converter, 318-Imaging element drive unit, 320-Digital signal processing unit, 330-Processor, 332-Receiver unit, 334-Camera parameter setting unit, 336-Camera control unit, 338-Image processing unit, 340-Compression processing unit, 342-Recording control unit, 344-Display control unit, 345-Communication control unit, 346-Lens drive control unit, 348-Flash 349-RAM, 350-Operating Unit, 351-Release Button, 352-Dial, 353-Function Button, 354-Exposure Correction Dial, 355-BACK Button, 356-MENU / OK Button, 357-D-pad, 358-Q Button, 360-Recording Device, 370-Display, 380-Speaker, 390-Antenna, 395-External Output Unit, 500-Motion Image, 500A-Area, 500B-Area, 510-Motion Image, 510A-Area, 520-Motion Image, 520A-Area, 530-Motion Image, 530A-Area, 530B- Area, 540-Motion Image, 540A-Area, 542-Motion Image, 542A-Area, 544-Motion Image, 544A-Area, 546-Motion Image, 546A-Area, 548-Motion Image, 548A-Area, 550-Motion Image, 550A-Area, 552-Motion Image, 552A-Area, 700-Remote Control Unit, 710-Processor, 712-Receiver Unit, 714-Communication Control Unit, 720-Flash Memory, 722-RAM, 730-Operator Unit, 740-Antenna for Wireless Communication, L-Optical Axis, ST1-GPS Satellite, ST2-GPS Satellite.

Claims

1. A camera device comprising a camera unit and a processor, wherein, The processor performs the following processing: Set a first camera parameter applied to the moving image data captured by the camera unit; Before accepting the first operation, the first dynamic image data captured according to the first camera parameters will be output to the recording destination; Upon receiving the first operation, a second camera parameter is set for the dynamic image data; From the time the first operation is accepted until the time the second operation is accepted, the first dynamic image data is output to the recording destination; Upon acceptance of the second operation, the second dynamic image data captured according to the second camera parameters is output to the recording destination, replacing the first dynamic image data captured according to the first camera parameters. The first and second camera parameters are exposure-related camera parameters. The processor performs the following processing: When an exposure correction that darkens the moving image data is received through the first operation, during the period from receiving the first operation to receiving the second operation, The reading is performed by reducing the photosensitivity when reading the moving image data captured by the camera unit compared to before the exposure correction; The dynamic image data generated by applying the second camera parameters to the read dynamic image data is output as the second dynamic image data to the display destination; By multiplying the read dynamic image data by a gain, dynamic image data with the same brightness as before the exposure correction is produced; The generated motion image data is output as the first motion image data to the recording destination.

2. A camera device comprising: a camera unit; a processor; and a memory for temporarily storing dynamic image data output from the camera unit, wherein, The processor performs the following processing: Set a first camera parameter applied to the moving image data captured by the camera unit; Before accepting the first operation, the first dynamic image data captured according to the first camera parameters will be output to the recording destination; Upon receiving the first operation, a second camera parameter is set for the dynamic image data; During the period from the time the first operation is accepted to the time the second operation is accepted, the dynamic image data is stored in the memory; After accepting the second operation, the second dynamic image data generated based on the saved dynamic image data will be output to the recording destination. Specifically, during the period from accepting the first operation to accepting the second operation, the first dynamic image data captured according to the first camera parameters is output to the recording destination, and the dynamic image data output from the camera unit is stored in the memory.

3. The camera device according to claim 2, wherein, The processor performs the following processing: If the remaining capacity of the memory falls below a threshold before the second operation is performed, The dynamic image data generated by applying the first camera parameters to the dynamic image data stored in the memory is output as the first dynamic image data to the recording destination; If the second operation is accepted, the second camera parameters are applied to the dynamic image data following the first acquired dynamic image data stored in the memory to generate the second dynamic image data, and the generated second dynamic image data is output to the recording destination.

4. The camera device according to claim 2 or 3, wherein, The processor performs the following processing: Before accepting the first operation, the first dynamic image data is output to the display destination; After accepting the first operation, at least the second dynamic image data is output to the display destination.

5. The camera device according to claim 4, wherein, The processor performs the following processing: During the period from the acceptance of the first operation to the acceptance of the second operation, the first dynamic image data is further output to the display destination.

6. The camera device according to claim 4, wherein, The processor performs the following processing: After accepting the second operation, only the second dynamic image data is output to the display destination.

7. The camera device according to claim 4, wherein, The processor performs the following processing: During the period from the acceptance of the first operation to the acceptance of the second operation, a portion of the dynamic image data is output as the first dynamic image data to the display destination, and another portion of the dynamic image data is output as the second dynamic image data to the display destination.

8. The camera device according to claim 5, wherein, The processor performs the following processing: During the period from the time the first operation is accepted to the time the second operation is accepted, a portion of the area of ​​the first motion image data is output to the second motion image data.

9. The camera device according to claim 5, wherein, The processor performs the following processing: During the period from the acceptance of the first operation to the acceptance of the second operation, the first dynamic image data and the second dynamic image data are output in parallel.

10. The camera device according to claim 5, wherein, The processor performs the following processing: Upon acceptance of the first operation, a summary of dynamic image data based on multiple selectable camera parameters is output to the display destination; The second operation is to accept the operation of selecting one dynamic image data from the dynamic image data output in the overview; The camera parameters corresponding to the selected dynamic image data are set as the second camera parameters.

11. The camera device according to claim 2 or 3, wherein, The processor performs the following processing: The first camera parameter is changed multiple times to switch to the second camera parameter, and the dynamic image data corresponding to the camera parameter during the switching period is output as the second dynamic image data to the recording destination.

12. The camera device according to claim 2 or 3, wherein, The first and second camera parameters are camera parameters related to white balance.

13. The camera device according to claim 2 or 3, wherein, The first and second camera parameters are exposure-related camera parameters. The processor performs the following processing: When an exposure correction that darkens the moving image data is received through the first operation, during the period from receiving the first operation to receiving the second operation, The reading is performed by reducing the photosensitivity when reading the moving image data captured by the camera unit compared to before the exposure correction; The dynamic image data generated by applying the second camera parameters to the read dynamic image data is output as the second dynamic image data to the display destination; By multiplying the read dynamic image data by a gain, dynamic image data with the same brightness as before the exposure correction is produced; The generated motion image data is output as the first motion image data to the recording destination.

14. The camera device according to claim 13, wherein, The processor performs the following processing: If it is not possible to reduce the light sensitivity during reading, the dynamic image data is darkened by shortening the exposure time when capturing the dynamic image data.

15. The camera device according to claim 14, wherein, The processor performs the following processing: The frame rate of the dynamic image data is increased and the exposure time is shortened compared to before the exposure correction to acquire multiple frames of the dynamic image data; The dynamic image data generated by averaging the dynamic image data of the multiple frames is displayed as the second dynamic image data on the display destination; The first dynamic image data is output to the recording destination as the first dynamic image data, generated by multiplying the generated dynamic image data by a gain or by adding the dynamic image data of the multiple frames.

16. The camera device according to claim 5, wherein, The processor performs the following processing: When an exposure correction to brighten the moving image data is received through the first operation, during the period from receiving the first operation to receiving the second operation, The second dynamic image data, generated by multiplying the dynamic image data captured by the camera by a gain, is output to the display destination.

17. The camera device according to claim 2 or 3, The camera device also includes a recording unit and / or a first connection unit for connecting to an external recording device. The processor performs the following processing: recording the first motion image data and the second motion image data with the recording unit as the recording destination, and / or recording the first motion image data and the second motion image data via the first connection unit with the external recording device as the recording destination.

18. The camera device according to claim 4, The camera device also includes a display unit and / or a second connection unit for connecting to an external display device. The processor performs the following processing: displays the first dynamic image data and / or the second dynamic image data as the display unit as the display destination, and / or displays the first dynamic image data and / or the second dynamic image data via the second connection unit as the external display device as the display destination.

19. A camera method based on a camera device comprising a camera unit, a processor, and a memory for temporarily storing dynamic image data output from the camera unit, wherein, The processor performs the following processing: Set a first camera parameter applied to the moving image data captured by the camera unit; Before accepting the first operation, the first dynamic image data captured according to the first camera parameters will be output to the recording destination; Upon receiving the first operation, a second camera parameter is set for the dynamic image data; During the period from the time the first operation is accepted to the time the second operation is accepted, the dynamic image data is stored in the memory; as well as After accepting the second operation, the second dynamic image data generated based on the saved dynamic image data will be output to the recording destination. Specifically, during the period from accepting the first operation to accepting the second operation, the first dynamic image data captured according to the first camera parameters is output to the recording destination, and the dynamic image data output from the camera unit is stored in the memory.

20. A recording medium that is non-volatile and computer-readable, and having a program recorded thereon that causes the processor of a camera device having a camera unit, a processor, and a memory for temporarily storing moving image data output from the camera unit to perform the camera method of claim 19.

Citation Information

Patent Citations

  • Camera apparatus, and method of displaying through image and program thereof

    JP2009159616A

  • Imaging apparatus

    JP2011066752A

  • Method and apparatus for editing images, and method and apparatus for reproducing the edited images

    US20040136689A1

  • Display controlling apparatus, control method thereof and recording medium

    US20130042178A1

  • Parameter-recording control apparatus and control method for same

    US20160182815A1