Imaging element and imaging device

Abstract

An imaging element includes a first pixel having a first photoelectric conversion section and outputting a first signal for image generation based on charges generated by the first photoelectric conversion section, a second pixel having a second photoelectric conversion section and outputting a second signal for controlling the first pixel based on charges generated by the second photoelectric conversion section, a first signal line outputting the first signal, and a second signal line outputting the second signal for controlling a frame rate for reading out the first signal from the first pixel.

Description

Technical Field

[0001] This invention relates to imaging elements and imaging devices. Background Technology

[0002] A camera device is desired that, when capturing moving images, can capture a desired moment of the subject at a high frame rate (e.g., Patent Document 1). Existing technical documents Patent documents

[0003] Patent Document 1: Japanese Patent Application Publication No. 2003-87630. Summary of the Invention

[0004] According to a first disclosed aspect, a camera element includes: a first pixel having a first photoelectric conversion unit that outputs a first signal for image generation based on a charge generated by the first photoelectric conversion unit; a second pixel having a second photoelectric conversion unit that outputs a second signal for controlling the first pixel based on a charge generated by the second photoelectric conversion unit; a first signal line that outputs the first signal; and a second signal line that outputs the second signal; the second signal being used to control a frame rate for reading the first signal from the first pixel.

[0005] According to the second disclosed aspect, a camera device includes: the aforementioned camera element; a detection unit that detects motion of a subject based on the second signal; and a control unit that controls a frame rate for reading the first signal from the first pixel based on the detection result of the detection unit.

[0006] According to the third disclosed aspect, a camera device includes: a camera unit that captures images of a subject; a detection unit that detects motion of the subject; and a control unit that, when the detection unit outputs a first detection result, controls the frame rate of the camera unit to a first frame rate, and when the detection result of the detection unit changes from the first detection result to a second detection result, controls the frame rate of the camera unit to a second frame rate higher than the first frame rate.

[0007] According to the fourth disclosed aspect, a camera device includes: a camera unit that captures images of a subject; a detection unit that detects the movement of the subject; and a recording unit that records image data output from the camera unit after the first detection result is output when the detection result of the detection unit changes from a first detection result to a second detection result.

[0008] Furthermore, the structure of the embodiments described later can be appropriately modified, or at least a portion can be replaced with other structures. Moreover, there are no particularly limited structural requirements regarding its configuration; it is not limited to the configuration disclosed in the embodiments and can be configured in a position that enables its function. Attached Figure Description

[0009] Figure 1 This is a schematic diagram illustrating a structural example of a digital camera equipped with the imaging element according to the first embodiment. Figure 2 This is a diagram illustrating an example of pixel configuration in a camera element according to the first embodiment. Figure 3 This is a diagram showing the schematic structure of the imaging element according to the example of the first embodiment. Figure 4 (A) and Figure 4 (B) is a circuit diagram showing the structure of the camera pixel and the detection pixel respectively. Figure 5 This is a flowchart illustrating an example of the processing performed by the fuselage control unit according to the first embodiment. Figure 6 This is a timeline used to explain the processes performed by the fuselage control unit according to the first embodiment. Figure 7 This is a flowchart illustrating an example of the processing performed by the fuselage control unit according to the second embodiment. Figure 8 This is a flowchart illustrating the details of frame rate control process 1. Figure 9 This is a flowchart showing the details of frame rate control process 2. Figure 10 This is a flowchart illustrating the details of frame rate control processing 3. Figure 11 This is a timeline used to explain the processes performed by the fuselage control unit according to the second embodiment. Detailed Implementation

[0010] Implementation Method 1 The following is for reference Figures 1-6A digital camera 1 (hereinafter referred to as camera 1) as an example of an imaging device according to the first embodiment will be described. Furthermore, in the following figures, an orthogonal XYZ coordinate system is appropriately set up for ease of explanation and understanding. In this coordinate system, in the camera position when the photographer keeps the optical axis OA horizontal to capture a horizontally elongated image (hereinafter referred to as the upright position), the direction from the subject toward the camera body 2 is defined as the +Z direction. Furthermore, in the upright position, the direction toward the right when viewed from the camera body 2 is defined as the +X direction. Furthermore, in the upright position, the direction toward the upward is defined as the +Y direction. In addition, the scale of the shapes, lengths, thicknesses, etc., of the various parts shown in the embodiment may not be consistent with the actual object; furthermore, in each figure, for ease of understanding, illustrations of some elements are sometimes omitted.

[0011] Figure 1 This diagram schematically illustrates a structural example of a digital camera 1 (hereinafter referred to as camera 1) equipped with the imaging element 21 according to the first embodiment. Camera 1 includes an interchangeable lens 3 and a camera body 2. The interchangeable lens 3 is mounted to the camera body 2 via a lens mount (not shown). Alternatively, camera 1 may be configured as a lens-integrated camera instead of an interchangeable lens type.

[0012] The interchangeable lens 3 includes, for example, a camera optical system 31, which includes a zoom lens, a focusing lens, an aperture stop, an image-stabilized lens, etc.; and a lens control unit 32. The lens control unit 32 includes peripheral components such as a CPU (Central Processing Unit) and memory. The lens control unit 32 performs drive control of the focusing lens and aperture stop, position detection of the zoom lens or focusing lens, sending lens information to the camera body 2, and receiving camera information from the camera body 2.

[0013] The camera body 2 includes, for example, an image sensor 21, an image processing unit 22, a body control unit 23, a display unit 24, an operation unit 25, and a recording unit 26.

[0014] The operation unit 25 includes a shutter button, operating components for various settings, etc. The display unit 24 is, for example, an LCD screen (also called a rear display) mounted on the back of the camera body 2.

[0015] The camera body control unit 23 includes peripheral components such as a CPU and memory. The camera body control unit 23 performs actions such as driving control of the image sensor 21, reading pixel signals from the image sensor 21, performing focus detection calculations, adjusting the focus of the interchangeable lens 3, and displaying and recording image data. Furthermore, the camera body control unit 23 communicates with the lens control unit 32, performing tasks such as receiving lens information and sending camera information (defocus amount, aperture value, etc.).

[0016] Furthermore, the camera control unit 23 includes a detection unit 231 and a frame rate control unit 232. The detection unit 231 detects the motion (state of the subject) of the subject within the viewing angle based on detection image data output from the second image processing unit 22B (described later). Additionally, the detection unit 231 detects the presence or absence of the subject within the viewing angle based on dynamic image data output from the first image processing unit 22A (described later).

[0017] The frame rate control unit 232 controls the frame rate, which is used to define the time interval for reading pixel signals from the camera pixel 51a of the camera element 21, based on the detection result of the detection unit 231.

[0018] The recording unit 26 has a card slot for installing non-volatile recording media such as memory cards. In addition, the recording unit 26 has volatile memory such as RAM (random access memory).

[0019] The recording unit 26 stores image data and various data generated in the image processing unit 22 into a recording medium installed in the card slot. Furthermore, the recording unit 26 stores image data and various data generated in the image processing unit 22 into volatile memory. Additionally, the recording unit 26 stores image data and other data stored in the volatile memory into a non-volatile recording medium. Alternatively, the recording unit 26 may have internal memory. In this case, the recording unit 26 may also record image data and various data generated in the image processing unit 22 into internal memory. The volatile memory may also be incorporated into the fuselage control unit 23.

[0020] The image processing unit 22 is an image processing engine that performs various image processing on pixel data input from the imaging element 21. In this embodiment, the image processing unit 22 includes a first image processing unit 22A and a second image processing unit 22B.

[0021] The first image processing unit 22A performs various image processing operations on the pixel data input from the imaging element 21 to generate image data (moving image data) stored in a recording medium such as a memory card. Under the control of the body control unit 23, the generated image data is stored by the recording unit 26 into a volatile memory such as RAM or a non-volatile recording medium such as a memory card.

[0022] The second image processing unit 22B uses pixel data input from the imaging element 21 to generate detection image data for detecting the motion (state of the subject) of the subject within the field of view. The generated detection image data is input to the detection unit 231 of the body control unit 23.

[0023] The first image processing unit 22A and the second image processing unit 22B can perform processing independently (asynchronously).

[0024] An imaging element 21 is disposed on a predetermined imaging plane (predetermined focal plane) of the interchangeable lens 3, and performs photoelectric conversion on the image of the subject imaged by the interchangeable lens 3. The imaging element 21 in this embodiment is a stacked imaging element. Specifically, the imaging element 21 includes: an imaging chip that outputs a pixel signal corresponding to the incident light; a signal processing chip that processes the pixel signal; and a memory chip that stores the pixel signal. The imaging chip, signal processing chip, and memory chip are stacked and electrically connected to each other through conductive bumps such as Cu.

[0025] Figure 2 This diagram illustrates an example of the pixel configuration in the imaging element 21 according to this embodiment. The imaging element 21 includes a pixel array 50, which includes: an imaging pixel 51a that performs photoelectric conversion on received light in a photoelectric conversion unit and outputs a signal for image generation; and a detection pixel 51b that performs photoelectric conversion on received light in a photoelectric conversion unit and outputs a signal for controlling the imaging pixel 51a.

[0026] The camera pixel 51a includes: a pixel having a filter (hereinafter referred to as an R pixel) having a light-splitting characteristic of splitting light (red (R) light) from incident light into a first wavelength region; a pixel having a filter (hereinafter referred to as a G pixel) having a light-splitting characteristic of splitting light (green (G) light) from incident light into a second wavelength region; and a pixel having a filter (hereinafter referred to as a B pixel) having a light-splitting characteristic of splitting light (blue (B) light) from incident light into a third wavelength region.

[0027] In pixel array 50, a first pixel set 400 and a second pixel set 400' are arranged. The first pixel set 400 includes a first pixel group 401 in which R pixels 51a and G pixels 51a are alternately arranged in the ±X direction (row direction), and a second pixel group 402 in which G pixels 51a and B pixels 51a are alternately arranged in the row direction. Multiple units of the first pixel set 400 are continuously arranged in the ±Y direction (column direction). Thus, the first pixel group 401 and the second pixel group 402 are alternately arranged in the ±Y direction (column direction). The camera pixels 51a are configured according to a Bayer array.

[0028] Furthermore, the second pixel set 400' includes a first pixel group 401 and a third pixel group 403 consisting of multiple detection pixels 51b (D pixels) arranged in the row direction. Figure 2In the example, two first pixel sets 400 are provided between the second pixel sets 400' in the Y direction. Furthermore, the number of first pixel sets 400 provided between the second pixel sets 400' is not limited to two; it can be one or more than three. In this embodiment, as a plurality of detection pixels 51b, a D pixel, different from the R, G, and B pixels, is provided, configured to receive light in a wavelength region wider than any one of the first, second, and third wavelength regions. In this embodiment, the second pixel set 400' is configured by replacing the second pixel group 402 in the first pixel group 401 and the second pixel group 402 included in the first pixel set 400 with a D pixel, but the first pixel group 401 can also be replaced with a D pixel. Alternatively, instead of the D pixel, the R, G, and B pixels can be used as detection pixels 51b in a Bayer array configuration.

[0029] Figure 3 This is a diagram illustrating the schematic structure of the camera element 21 involved in this embodiment. Figure 4 (A) and Figure 4 (B) are circuit diagrams showing the structure of the camera pixel 51a and the detection pixel 51b, respectively.

[0030] like Figure 3 As shown, the camera element 21 includes a pixel array 50, a vertical drive unit 42, a drive control unit 43, a horizontal drive unit 44, a signal processing unit 45, and a memory unit 46.

[0031] like Figure 4 (A) and Figure 4 As shown in (B), the camera pixel 51a and the detection pixel 51b each have a photoelectric conversion unit 62, such as a photodiode (PD), and a reading unit 60.

[0032] The photoelectric conversion unit 62 has the function of converting incident light into electric charge and storing the electric charge obtained after photoelectric conversion. The reading unit 60 includes a transmission unit 63, an emission unit 64, a floating diffusion unit (FD) 65, an amplification unit 66, and a selection switch unit 67.

[0033] like Figure 4 As shown in (A), in the camera pixel 51a, the transmission unit 63 is controlled by the signal Tx_a to transmit the charge obtained by photoelectric conversion by the photoelectric conversion unit 62 to the floating diffusion unit 65. Furthermore, as... Figure 4 As shown in (B), in the detection pixel 51b, the transmission unit 63, controlled by the signal Tx_b, transmits the charge obtained by photoelectric conversion by the photoelectric conversion unit 62 to the floating diffusion unit 65. That is, the transmission unit 63 forms a charge transmission path between the photoelectric conversion unit 62 and the floating diffusion unit 65. The floating diffusion unit 65 retains (accumulates) the charge.

[0034] The amplification unit 66 amplifies the signal of the charge held by the floating diffusion unit 65 and outputs it. For example... Figure 4 As shown in (A), in the camera pixel 51a, the magnification section 66 is connected to the first vertical signal line 52A via the selection switch section 67. Furthermore, as... Figure 4 As shown in (B), in the detection pixel 51b, the magnification section 66 is connected to the second vertical signal line 52B via the selection switch section 67.

[0035] like Figure 4 As shown in (A), in the camera pixel 51a, the discharge section (reset section) 64 is controlled by the signal Rst_a to discharge the charge of the floating diffuser section 65 and reset the potential of the floating diffuser section 65 to the reset potential (reference potential). Furthermore, as... Figure 4 As shown in (B), in the detection pixel 51b, the discharge section (reset section) 64 is controlled by the signal Rst_b to discharge the charge of the floating diffusion section 65 and reset the potential of the floating diffusion section 65 to the reset potential (reference potential).

[0036] like Figure 4 As shown in (A), in the camera pixel 51a, the selection switch 67 is controlled by the signal Sel_a, and outputs the signal from the amplification unit 66 to the first vertical signal line 52A. Furthermore, as... Figure 4 As shown in (B), in the detection pixel 51b, the selection switch 67 is controlled by the signal Sel_b and outputs the signal from the amplification unit 66 to the second vertical signal line 52B.

[0037] The transmission section 63, the discharge section 64, the amplification section 66, and the selection switch section 67 respectively include transistors M1, M2, M3, and M4.

[0038] In the camera pixel 51a, the reading unit 60 reads the signal (noise signal) when the discharge unit 64 resets the potential of the floating diffusion unit 65 to the reset potential and sends it to the first vertical signal line 52A via the selection switch unit 67. Furthermore, in the camera pixel 51a, the reading unit 60 reads the signal (photoelectric conversion signal) corresponding to the charge transmitted from the photoelectric conversion unit 62 to the floating diffusion unit 65 by the transmission unit 63 and sends it to the first vertical signal line 52A via the selection switch unit 67.

[0039] In the detection pixel 51b, the reading unit 60 reads the signal (noise signal) when the potential of the floating diffusion unit 65 is reset to the reset potential by the discharge unit 64 and sends it to the second vertical signal line 52B via the selection switch unit 67. Furthermore, in the detection pixel 51b, the reading unit 60 reads the signal (photoelectric conversion signal) corresponding to the charge transmitted from the photoelectric conversion unit 62 to the floating diffusion unit 65 by the transmission unit 63 and sends it to the second vertical signal line 52B via the selection switch unit 67.

[0040] Thus, since the camera pixel 51a is connected to the first vertical signal line 52A and the detection pixel 51b is connected to the second vertical signal line 52B, signal reading from the camera pixel 51a and signal reading from the detection pixel 51b can be performed simultaneously.

[0041] Back Figure 3 The drive control unit 43 generates clock signals, control signals, etc., which serve as the operation references for the vertical drive unit 42, signal processing unit 45, memory unit 46, and horizontal drive unit 44, based on the master clock input from the outside and the control signals input from the fuselage control unit 23, and provides them to the vertical drive unit 42, signal processing unit 45, memory unit 46, and horizontal drive unit 44.

[0042] The vertical drive unit 42 supplies control signals such as Rst_a, Tx_a, and Sel_a to the imaging pixels 51a to control the operation of each imaging pixel 51a. Similarly, the vertical drive unit 42 supplies control signals such as Rst_b, Tx_b, and Sel_b to the detection pixels 51b to control the operation of each detection pixel 51b. Furthermore, in Figure 3 In the signals Rst_a(n), Tx_a(n), Sel_a(n), Rst_b(n), Tx_b(n), and Sel_b(n), "(n)" represents the row number.

[0043] The signal processing unit 45 includes analog-to-digital converters (ADCs) 451a1~451am and 451b1~451bm, and correlated double sampling units (CDS) 452a1~452am and 452b1~452bm. ADCs 451a1~451am convert noise signals and photoelectric conversion signals input via the first vertical signal lines 52A(1)~52A(m) into digital signals, and output them to CDSs 452a1~452am respectively. ADCs 451b1~451bm convert noise signals and photoelectric conversion signals input via the second vertical signal lines 52B(1)~52B(m) into digital signals, and output them to CDSs 452b1~452bm respectively. Furthermore, in Figure 3 In the first vertical signal line 52A(m) and the second vertical signal line 52B(m), "(m)" indicates the column number.

[0044] CDS452a1~CDS452am and 452b1~452bm perform correlation double sampling on the input digital signal, remove noise from the digital signal based on the input noise signal, and output the noise-removed digital signal (hereinafter referred to as pixel signal) to the memory unit 46.

[0045] The memory unit 46 includes memories 461a1 to 461am and 461b1 to 461bm. Memories 461a1 to 461am store pixel signals output from CDS 452a1 to 452am, respectively, and memories 461b1 to 461bm store pixel signals output from CDS 452b1 to 452bm, respectively.

[0046] The horizontal drive unit 44 outputs a set of pixel signals stored in memory 461a1 to 461am as imaging pixel data to the first image processing unit 22A based on the scan signal from the drive control unit 43. Furthermore, the horizontal drive unit 44 outputs a set of pixel signals stored in memory 461b1 to 461bm as detection pixel data to the second image processing unit 22B based on the scan signal from the drive control unit 43.

[0047] The output of pixel signals stored in memories 461a1~461am and the output of pixel signals stored in memories 461b1~461bm can be performed asynchronously. The output of pixel signals stored in memories 461a1~461am and the output of pixel signals stored in memories 461b1~461bm can be performed simultaneously or at different times.

[0048] Next, the processing performed by the fuselage control unit 23 according to the first embodiment will be described. Figure 5 This is a flowchart illustrating an example of the processing performed by the fuselage control unit 23 according to the first embodiment. Figure 6 This is a timeline diagram used to explain the processing of the fuselage control unit 23 according to the first embodiment.

[0049] Figure 5 The processing begins, for example, when an instruction to capture a moving image is given (e.g., pressing the moving image capture button). First, the frame rate control unit 232 of the camera control unit 23 sets the frame rate, which specifies the time interval for reading signals from the camera pixel 51a, as frame rate R1 (step S11). Here, the frame rate R1 can be set by the user via the operation unit 25, or it can be set automatically by the camera control unit 23. The value of frame rate R1 can be set, for example, in the range of 3 to 120 fps, and preferably in the range of 15 to 60 fps.

[0050] Therefore, for example Figure 6As shown, signals from camera pixel 51a are read at time intervals T1, and camera pixel data (e.g., MI1) is output to the first image processing unit 22A. That is, the time interval T1 is the time interval corresponding to the set frame rate R1. The first image processing unit 22A generates motion image data (MI1) based on the camera pixel data (MI1). The generated motion image data (e.g., MI1) is recorded on a non-volatile recording medium via the recording unit 26 under the control of the body control unit 23, and displayed on the display unit 24.

[0051] On the other hand, signals are read from the detection pixel 51b at time intervals T3, and the detection pixel data (e.g., DI1) is output to the second image processing unit 22B. Here, the time interval T3 is preset, for example, set to a time interval corresponding to the frame rate R2 described later. The second image processing unit 22B generates detection image data (DI1) for detecting the state (motion) of the subject within the viewing angle based on the detection pixel data (DI1).

[0052] Back Figure 5 The detection unit 231 of the fuselage control unit 23 obtains the motion vector based on the difference (inter-frame difference) between two consecutive detection image data input from the second image processing unit 22B, and determines whether the calculated motion vector is above the threshold TVa (step S13). Furthermore, if there is only one detection image data input from the second image processing unit 22B, the determination in step S13 is negative, and step S13 is executed again.

[0053] Here, for example, suppose a user wants to capture the moment of a lightning strike at a high frame rate. The user adjusts the position and orientation of camera 1 so that the view includes the thundercloud, and begins capturing motion images at a frame rate R1 (step S11). Here, when the sky is momentarily illuminated by the lightning strike, if the motion vector obtained from the difference between two consecutive detection image data (inter-frame difference) reaches or exceeds the threshold TVa, the determination in step S13 is affirmative. That is, the detection unit 231 detects the motion (state of the subject) of the subject within the view in step S13. Furthermore, in the following description, the processing performed by the detection unit 231 will be referred to as the subject state detection processing.

[0054] During the period when the motion vector is less than the threshold TVa (step S13 / No), the processing of step S13 is repeated.

[0055] Then, when the motion vector reaches or exceeds the threshold TVa (step S13 / Yes), the frame rate control unit 232 sets the frame rate, which specifies the time interval for reading signals from the camera pixel 51a, to a frame rate R2 that is higher than the frame rate R1 (step S15). Here, the frame rate R2 can be set by the user via the operation unit 25, or it can be set automatically by the body control unit 23. The value of the frame rate R2 can be set in the range of 120 to 2000 fps, for example, and preferably in the range of 480 to 960 fps.

[0056] For example, in Figure 6 In the subject state detection processing DP12 (shown in shaded lines) performed using the detection image data DI11 and DI12 generated by the second image processing unit 22B, the motion vector reaches or exceeds the threshold TVa (step S13 / Yes). In this case, the frame rate control unit 232 sets the frame rate to frame rate R2 at the moment t1 when the vertical synchronization signal for the next moving image is output (step S15). As a result, the signal can be read from the camera pixel 51a at a time interval T2 that is shorter than the time interval T1. That is, the moving image is captured at a frame rate R2 that is higher than the frame rate R1.

[0057] The first image processing unit 22A generates motion image data based on camera pixel data. The generated motion image data is recorded on a non-volatile recording medium via the recording unit 26 under the control of the camera body control unit 23, and displayed on the display unit 24. In this way, when the motion vector reaches a threshold TVa or higher, by setting the frame rate to a frame rate R2 that is higher than the frame rate R1, it is possible to capture changes in the state of the subject (such as the occurrence of lightning strikes) within the field of view at a high frame rate.

[0058] Since the frame rate changes based on the inter-frame difference (motion vector) of the detection image data generated from the signal output from the detection pixel 51b, it can be said that the signal output from the detection pixel 51b is used to control the frame rate for reading signals from the camera pixel 51a. Furthermore, since the motion of the subject (the state of the subject) is detected based on the inter-frame difference (motion vector) of the detection image data generated from the signal output from the detection pixel 51b, it can also be said that the signal output from the detection pixel 51b is used to detect the motion of the subject (the state of the subject).

[0059] Back Figure 5 When the frame rate is set to frame rate R2, the detection unit 231 determines whether the motion vector is above the threshold TVa (step S17). In step S17, for example, it determines whether the lightning strike is still ongoing. When the lightning strike ends, the motion vector is less than the threshold TVa.

[0060] Before the motion vector is less than the threshold TVa, the processing of step S17 is repeated (step S17 / Yes). When the motion vector is less than the threshold TVa (step S17 / No), the frame rate control unit 232 sets the frame rate to a frame rate R1 that is lower than the frame rate R2 (step S19) and returns to step S13. Figure 5 The processing is repeated until the capture of the moving image ends.

[0061] For example, in Figure 6 In the subject state detection processes DP13-DP32, the motion vector is above the threshold TVa (step S17 / Yes), and in the subject state detection process DP33 (shown as a crosshair), the motion vector is below the threshold TVa (step S17 / Yes). In this case, the camera control unit 23 sets the frame rate to frame rate R1 from the moment t2 when the next vertical synchronization signal is output. Therefore, signals are read from the imaging pixel 51a at time intervals T1 longer than the time interval T2. Thus, during the period from when the motion vector reaches or falls below the threshold TVa, moving images can be captured at a high frame rate (frame rate R2), allowing for high frame rate capture of the desired moment. Furthermore, at times other than the desired moment, moving images are captured at a frame rate R1 lower than frame rate R2, thus reducing the amount of moving image data stored on the recording medium compared to capturing moving images at frame rate R2 even at times other than the desired moment.

[0062] As detailed above, according to the first embodiment, the imaging element 21 includes: an imaging pixel 51a, which includes a photoelectric conversion unit 62 and outputs a signal for image generation based on the charge generated by the photoelectric conversion unit 62; a detection pixel 51b, which includes a photoelectric conversion unit 62 and outputs a signal for controlling the imaging pixel 51a based on the charge generated by the photoelectric conversion unit 62; a first vertical signal line 52A, which outputs a signal from the imaging pixel 51a; and a second vertical signal line 52B, which outputs a signal from the detection pixel 51b; the signal from the detection pixel 51b is used to control the frame rate for reading signals from the imaging pixel 51a. Therefore, it is possible to transition from a normal frame rate to a high-speed frame rate at a more appropriate time, thereby optimizing memory capacity. The camera 1 includes: an imaging element 21; a detection unit 231, which detects the motion (state of the subject) of a subject within the viewing angle based on the signal from the detection pixel 51b; and a frame rate control unit 232, which controls the frame rate for reading signals from the imaging pixel 51a based on the detection result of the detection unit 231. Therefore, it is possible to control the frame rate when capturing the desired moment of the subject based on the subject's movement (state).

[0063] Furthermore, in the first embodiment, the output of the signal from the camera pixel 51a and the output of the signal from the detection pixel 51b are executed in parallel. Therefore, it is possible to execute the generation of dynamic image data based on the signal from the camera pixel 51a and the generation of detection image data based on the signal from the detection pixel 51b in parallel.

[0064] Furthermore, in the first embodiment, when the motion vector obtained based on the inter-frame difference of the detection image data reaches a threshold TVa or higher ( Figure 5 Step S13 / Yes), the frame rate control unit 232 controls the frame rate to frame rate R2 ( Figure 5 (Step S15). Thus, it is possible to capture moving images at a frame rate R2 that is higher than the frame rate R1 set before the change of the subject's state within the field of view (the moment lightning strikes), starting from the instant the state of the subject changes (the instant lightning strikes).

[0065] Furthermore, in the first embodiment, when the motion vector obtained from the inter-frame difference of the detection image data becomes less than the threshold TVa after reaching or exceeding the threshold TVa ( Figure 5 (Step S17 / Yes) The frame rate control unit 232 controls the frame rate to a frame rate R1 that is smaller than the frame rate R2 (Step S19). As a result, since the moving image is captured at a low frame rate after the desired moment of shooting ends, the amount of moving image data stored on the recording medium can be reduced.

[0066] Implementation Method 2 In the second embodiment, the processing performed by the camera control unit 23 differs from that in the first embodiment. In the second embodiment, the timing of changing the frame rate differs from that in the first embodiment to avoid missing the initial movement of the desired moment of capture. For example, if the goal is to capture the moment an insect walking on a plant takes flight, and the frame rate is changed from frame rate R1 to frame rate R2 (> frame rate R1) by detecting wing movement during flight, the frame rate change can only occur after the actual moment the wing flapping begins. Therefore, the moment the insect unfolds its wings cannot be captured at frame rate R2. To capture the moment the insect unfolds its wings at frame rate R2, it is desirable to also film the insect at frame rate R2 during its movement.

[0067] Therefore, in the second embodiment, two thresholds are used for motion vectors to control the timing of frame rate changes in order to avoid missing the initial motion of the desired moment of shooting.

[0068] Figures 7-10 This is a flowchart illustrating an example of the processing performed by the fuselage control unit 23 according to the second embodiment. Figure 11 This is a timeline used to explain the processes performed by the fuselage control unit 23 according to the second embodiment.

[0069] Figure 7 The processing begins, for example, at the start of capturing a moving image. First, the frame rate control unit 232 of the camera control unit 23 sets the frame rate, which specifies the time interval for reading signals from the camera pixel 51a, to frame rate R1 (step S51).

[0070] Next, the camera control unit 23 confirms the dynamic image capture settings set on the camera body 2 (step S53). The dynamic image capture settings are made by the user via the operation unit 25. Furthermore, the dynamic image capture setting method in this embodiment is only one example and is not limited to the setting method of this embodiment.

[0071] When the motion picture shooting setting is configured to ensure that the initial movement of the second movement is not missed when a subject already in the field of view performs a first movement followed by a second movement (set to setting 1), the camera control unit 23 executes frame rate control processing 1 (step S100). For example, suppose an insect is already in the field of view, and you want to capture an image of the insect taking flight. In this case, if you do not start shooting from when the insect is moving slowly (e.g., walking), you will miss the moment when the insect begins its flight. Setting 1 is suitable for this situation.

[0072] Figure 8 This is a flowchart showing the details of frame rate control processing 1 (step S100). When frame rate control processing 1 starts, the detection unit 231 determines whether the motion vector obtained from the inter-frame difference of the image data to be detected is above the threshold TVb (step S101). At this time, the threshold TVb is a threshold used to detect minute movements of the subject, so it is set to a relatively small value.

[0073] The process of step S101 is repeated until the motion vector reaches or exceeds the threshold TVb (step S101 / No). In addition, the motion image data captured at frame rate R1 is stored in a non-volatile recording medium.

[0074] When the motion vector reaches or exceeds the threshold TVb (step S101 / Yes), the frame rate control unit 232 sets the frame rate, which specifies the time interval for reading signals from the camera pixel 51a, to a frame rate R2 that is higher than the frame rate R1 (step S103). Furthermore, under the control of the camera control unit 23, the recording unit 26 begins storing the motion image data captured at frame rate R2 into RAM (volatile memory) (step S105). At this time, the camera control unit 23 stops storing the motion image data into a non-volatile recording medium.

[0075] For example, in Figure 11In this case, assuming that the motion vector in the subject state detection processing DP4 reaches or exceeds the threshold TVb (step S101 / Yes), the frame rate control unit 232 changes the frame rate from frame rate R1 to frame rate R2 (> frame rate R1) at the moment t11 ​​when the next dynamic image is output with a vertical synchronization signal (step S103). Since the dynamic image data captured at frame rate R2 is temporarily stored in RAM, the dynamic image data MI2~MI4 are also stored in RAM.

[0076] Back Figure 8 The detection unit 231 determines whether the motion vector is above or below the threshold TVb (step S107). When the motion vector is above or below the threshold TVb (step S107 / Yes), the detection unit 231 determines whether the motion vector is above or below the threshold TVc (step S109). In setting 1, the threshold TVc is set to a value greater than the threshold TVb. Thus, for example, it is possible to determine whether the insect, as the subject, has moved from a walking state (a state where the motion vector is above or below the threshold TVb) to a movement in preparation for flight (whether the motion vector reaches or exceeds the threshold TVc).

[0077] When the motion vector is less than the threshold TVc (step S109 / No), return to step S107. Here, in step S107, when the motion vector is less than the threshold TVb (step S107 / No), it can be determined, for example, that the subject has stopped. That is, it can be determined that the insect stopped before unfolding its wings to take off, starting from the walking state. In this case, under the control of the camera control unit 23, the recording unit 26 performs frame extraction on the motion image data captured at frame rate R2 stored in RAM and stores it in a non-volatile recording medium (step S119). As a frame extraction process for motion image data, for example, a process of removing a portion of the frames can be performed. Afterwards, the frame rate control unit 232 restores the frame rate to frame rate R1 (step S117) and returns to step S101. Furthermore, in step S107, if the state of the motion vector being less than the threshold TVb continues for a long time, a process of deleting old data can be performed according to the capacity of RAM.

[0078] For example, in Figure 11 In the subject state detection process DP4, it is assumed that the motion vector reaches or exceeds the threshold TVb (step S101 / Yes). In the subject state detection processes DP5 and DP6, although the motion vector is above the threshold TVb (step S107 / Yes), it is less than the threshold TVc (step S109 / No). In the subject state detection process DP7, the motion vector is less than the threshold TVb (step S107 / No).

[0079] In this case, the recording unit 26 stores, for example, dynamic image data MI3 of the dynamic image data MI2~MI4 captured at frame rate R2 stored in RAM in a non-volatile recording medium (step S119). In addition, the frame rate control unit 232 sets the frame rate from frame rate R2 to frame rate R1 at the moment t12 when the next dynamic image is output with a vertical synchronization signal (step S117).

[0080] Back Figure 8 When the motion vector reaches or exceeds the threshold TVc (step S109 / Yes), the frame rate control unit 232 sets the frame rate to frame rate R3, which is higher than frame rate R2 (step S111). Frame rate R3 can be higher than frame rate R2, or it can be the same as frame rate R2. The frame rate control unit 232 can also keep the frame rate at frame rate R2.

[0081] Then, under the control of the camera control unit 23, the recording unit 26 begins to store the motion images stored in RAM into a non-volatile recording medium (step S113). Thus, it is possible to store motion images captured at a high frame rate, including the moment when the insect, as the subject, takes flight, into a non-volatile recording medium.

[0082] For example, in Figure 11 In the subject state detection processing DP17, if the motion vector reaches or exceeds the threshold TVb (step S101 / Yes), then the frame rate control unit 232 changes the frame rate from frame rate R1 to frame rate R2 (> frame rate R1) at the time t13 when the next dynamic image is output with the vertical synchronization signal (step S103).

[0083] Suppose that in the subject state detection processing DP18~DP23, the motion vector is above the threshold TVb (step S107 / Yes) but below the threshold TVc (step S109 / No), and in the subject state detection processing DP24, the motion vector reaches the threshold TVc or above (step S109 / Yes).

[0084] In this case, at the moment t14 when the next dynamic image is output with a vertical synchronization signal, the fuselage control unit 23 sets the frame rate to a frame rate R3 that is higher than the frame rate R2 (step S111).

[0085] Furthermore, starting from time t14, the recording unit 26 begins to store dynamic image data stored in RAM into the recording medium (step S113).

[0086] Back Figure 8After setting the frame rate to frame rate R3 and starting to store dynamic image data stored in RAM into the recording medium, the detection unit 231 determines whether the motion vector is above the threshold TVc (step S115). In step S115, for example, it determines whether the insect being photographed is still taking off.

[0087] The process of step S115 is repeated until the motion vector is less than the threshold TVc (step S115 / Yes). Then, when the motion vector is less than the threshold TVc (step S115 / No), the frame rate control unit 232 restores the frame rate to frame rate R1 (step S117) and returns to step S101. The process of step S100 is repeated until the capture of the moving image ends. Here, when the motion vector is less than the threshold TVc, the storage of the moving image to RAM and the storage of the moving image data stored in RAM to the recording medium can also be terminated.

[0088] For example, in Figure 11 In this process, assuming the motion vector in the subject state detection processes DP25-DP31 is above the threshold TVc (step S115 / Yes), but the motion vector in the subject state detection process DP32 is below the threshold TVc (step S115 / No), then at the moment t15 when the next dynamic image is output with the vertical synchronization signal, the frame rate control unit 232 changes the frame rate to frame rate R1 (step S117). Therefore, dynamic images can be captured at frame rate R1 after moment t15.

[0089] In this way, by using frame rate control processing 1, it is possible to capture the moment when the subject's motion changes from the first motion to the second motion at a high frame rate.

[0090] Back Figure 7 When the setting for capturing dynamic images is, for example, a setting for capturing the moment when a subject (e.g., a bird) enters the field of view at a high frame rate (set to setting 2), the camera control unit 23 executes frame rate control processing 2 (step S200).

[0091] Figure 9 This is a flowchart illustrating the details of frame rate control processing 2. When frame rate control processing 2 begins, the detection unit 231 determines whether the motion vector obtained from the inter-frame difference of the detection image data is above the threshold TVd (step S201). At this time, the threshold TVd is a threshold used to determine whether the subject has entered the field of view, and is set to a relatively large value.

[0092] Repeat step S201 until the motion vector reaches or exceeds the threshold TVd (step S201 / No).

[0093] When the motion vector reaches or exceeds the threshold TVd (step S201 / Yes), the frame rate control unit 232 sets the frame rate, which specifies the time interval for reading pixel signals from the camera pixel 51a, to a frame rate R2 that is higher than the frame rate R1 (step S203). Furthermore, under the control of the body control unit 23, the recording unit 26 begins saving the motion image data captured at frame rate R2 into the RAM (step S205). At this time, the recording unit 26 stops storing motion image data into the non-volatile recording medium.

[0094] Next, the detection unit 231 determines whether the motion vector is above the threshold TVd (step S207). Before the motion vector is below the threshold TVd, the process of step S207 is repeated (step S207 / Yes). Step S207 determines whether the motion of the subject entering the viewing angle is to a degree sufficient to identify the subject. When the motion of the subject is to a degree sufficient to identify the subject, the motion vector is less than the threshold TVd.

[0095] When the motion vector is less than the threshold TVd (step S207 / No), the detection unit 231 determines whether the motion vector is greater than or equal to the threshold TVe (step S209). In setting 2, the threshold TVe is set to a value smaller than the threshold TVd. Thus, for example, it is possible to determine whether a subject flying into the field of view is still within the field of view and is moving.

[0096] When the motion vector is above the threshold TVe (step S209 / Yes), the detection unit 231 determines whether a subject (e.g., a bird) can be identified (step S211). The detection unit 231 uses, for example, motion image data captured at a frame rate R2 to determine whether a subject can be identified. While this embodiment uses motion image data captured at a frame rate R2 for subject identification, it is not limited to this; other motion image data can also be used for subject identification.

[0097] When the motion vector is less than the threshold TVe (step S209 / No), or when the subject cannot be identified (step S211 / No), the recording unit 26 extracts frames of the motion image data captured at frame rate R2 stored in RAM and stores them in a non-volatile recording medium (step S221). Then, the frame rate control unit 232 sets the frame rate to frame rate R1 (step S219). After setting the frame rate to frame rate R1, the process returns to step S201.

[0098] For example, if a subject enters the view from outside the view and leaves the view without stopping, its motion vector is less than the threshold TVe, and the judgment in step S209 is negative. Furthermore, for example, if a subject (e.g., a bird) enters the view from outside the view, temporarily stops (on a tree), and then takes off and flies out of the view, its motion vector reaches or exceeds the threshold TVe due to the swaying of the tree (step S209 / Yes), but the subject (bird) cannot be identified, so the judgment in step S211 is negative. Thus, in the state where there is no subject in the view, in order to switch the frame rate to a frame rate R1 that is lower than frame rate R2, the judgments in steps S209 and S211 are executed.

[0099] Here, for example, in Figure 11 In this case, assuming that the motion vector in the subject state detection processing DP4 reaches or exceeds the threshold TVd (step S201 / Yes), the frame rate control unit 232 changes the frame rate from frame rate R1 to frame rate R2 (> frame rate R1) at the moment t11 ​​when the next dynamic image is output with a vertical synchronization signal (step S203). Since the dynamic image data captured at frame rate R2 is temporarily stored in RAM, the dynamic image data MI2~MI4 are stored in RAM.

[0100] Subsequently, assuming that the motion vector in the subject state detection processes DP5 and DP6 is above the threshold TVd (step S207 / Yes), and the motion vector in the subject state detection process DP7 is below the threshold TVd (step S207 / No) and below the threshold TVe (step S209 / No). Alternatively, assuming that the motion vector in the subject state detection process DP7 is below the threshold TVd (step S207 / No) and above the threshold TVe (step S209 / Yes), but the subject cannot be detected (step S211 / No). In this case, the recording unit 26 stores, for example, the motion image data MI3 of the motion image data MI2~MI4 captured at frame rate R2 stored in RAM into a non-volatile recording medium (step S221). Furthermore, the frame rate control unit 232 sets the frame rate to frame rate R1 at the moment t12 when the next motion image is output with a vertical synchronization signal (step S219).

[0101] Back Figure 9 When a subject is detected (step S211 / Yes), the frame rate control unit 232 sets the frame rate to a frame rate R3 that is higher than or equal to frame rate R2 (step S213). The frame rate control unit 232 may also maintain the frame rate at frame rate R2. That is, while the subject is within the field of view, the subject is continuously filmed at a frame rate of R2 or higher.

[0102] Then, the recording unit 26 begins to store the motion image data stored in RAM into a non-volatile recording medium (step S215). Thus, it is possible to store the motion image captured at a high frame rate at the moment the subject enters the field of view into a non-volatile recording medium.

[0103] Next, the camera control unit 23 determines whether the subject can be recognized (step S217). While the subject can be recognized, the process of step S217 is repeated (step S217 / Yes). When the subject can no longer be recognized (step S217 / No), the frame rate control unit 232 restores the frame rate to frame rate R1 (step S219) and returns to step S201. The process of step S200 is repeated until the capture of the moving image ends.

[0104] For example, in Figure 11 In the subject state detection processing DP17, if the motion vector reaches or exceeds the threshold TVd (step S201 / Yes), then the frame rate control unit 232 changes the frame rate from frame rate R1 to frame rate R2 at the moment t13 when the next dynamic image is output with the vertical synchronization signal (step S203).

[0105] Assuming that the motion vector in the subject state detection processing DP18~DP23 is above the threshold TVd (step S207 / Yes), and the motion vector in the subject state detection processing DP24 is less than the threshold TVd (step S207 / No) and above the threshold TVe (step S209 / Yes), and the subject is identified (step S211 / Yes).

[0106] In this case, at the moment t14 when the next dynamic image is output with a vertical synchronization signal, the frame rate control unit 232 sets the frame rate to a frame rate R3 that is higher than the frame rate R2 (step S213).

[0107] Furthermore, starting from time t14, the recording unit 26 begins to store dynamic image data stored in RAM into the recording medium (step S215).

[0108] Then, assuming that a subject is detected in the subject state detection processes DP25~DP31 (step S217 / Yes), but becomes undetectable in the subject state detection process DP32 (step S217 / No), the frame rate control unit 232 changes the frame rate to frame rate R1 at the time t15 when the next motion image is output with the vertical synchronization signal (step S219). Thus, motion images are captured at frame rate R1 after time t15.

[0109] Thus, according to frame rate control processing 2, the subject can be photographed at a high frame rate from the moment it enters the field of view until it leaves the field of view.

[0110] Back Figure 7 When the dynamic image capture setting is, for example, as described in the first embodiment, a setting for capturing the moment when a specified event (e.g., lightning) occurs within the field of view at a high frame rate (set to setting 3), the body control unit 23 executes frame rate control processing 3 (step S300).

[0111] Figure 10 This is a flowchart illustrating an example of frame rate control processing 3. Figure 10 The processing due to Figure 5 The processing is basically similar, therefore the same reference numerals are used for the same processing steps, and detailed descriptions are omitted. Step S300 is repeated until the capture of the moving image is completed.

[0112] As detailed above, according to the second embodiment, in the frame rate control process 1, when the motion vector obtained from the inter-frame difference of the detection image data changes from a state where the motion vector is above a threshold TVb to a state where the motion vector is above a threshold TVc, which is greater than the threshold TVb ( Figure 8 In step S109 / , the frame rate control unit 232 controls the frame rate to a frame rate R3 that is higher than or equal to frame rate R2. Figure 11 At time t14). Thus, before the subject begins the prescribed movement, it is possible to capture the moment the subject begins the prescribed movement at a frame rate R2, which is higher than the normal frame rate R1. This prevents the initial movement of the desired moment from being missed. Furthermore, in frame rate control processing 2, when the motion vector obtained from the inter-frame difference of the detected image data changes from a state where the motion vector is above the threshold TVd to a state where the motion vector is below the threshold TVd and above the threshold TVe (< threshold TVd) (step S207 / No and step S209 / Yes), the frame rate control unit 232 controls the frame rate to a frame rate R3, which is above frame rate R2 ( Figure 11 (Time t14). Thus, for example, it is possible to capture the moment when the subject enters the field of view at a frame rate R2 that is higher than the usual frame rate R1.

[0113] Furthermore, in the second embodiment, for example in frame rate control processing 1, when the motion vector changes from a state where the motion vector is above a threshold TVb to a state where the motion vector is above a threshold TVc that is greater than the threshold TVb ( Figure 8 In step S109, the recording unit 26 records image data (moving image data) generated from the signal output from the camera pixel 51a after the motion vector reaches or exceeds a threshold TVb into a non-volatile recording medium. More specifically, the recording unit 26 records image data generated from the signal output from the camera pixel 51a after the motion vector reaches or exceeds a threshold TVb and stored in RAM into a non-volatile recording medium. Thus, it is possible to record a moving image of the desired moment captured at a high frame rate into a non-volatile recording medium.

[0114] Furthermore, in the second embodiment, for example in frame rate control processing 1, when the motion vector becomes less than the threshold TVb after reaching or exceeding the threshold TVb (step S101 / Yes) (step S107 / Yes), the recording unit 26 performs frame extraction on the dynamic image data stored in RAM and stores it in a non-volatile recording medium (step S119). That is, image data generated based on the signal output from the camera pixel 51a after the motion vector reaches or exceeds the threshold TVb is recorded. Figure 11 MI3 is a part of MI2~MI4. This allows for a reduction in the amount of data in moving images that do not contain the desired moment of capture.

[0115] Furthermore, in the second embodiment described above, during frame rate control processing 1, when the motion vector changes from exceeding a threshold TVb to falling below the threshold TVb, the motion image data stored in RAM is frame-by-frame extracted and stored in a non-volatile recording medium (step S119), but this is not limited to this. For example, when the motion vector changes from exceeding a threshold TVb to falling below the threshold TVb, the motion image data stored in RAM may not be stored in the non-volatile recording medium; that is, it may be discarded.

[0116] Furthermore, in the first and second embodiments described above, the interchangeable lens 3 is a zoom lens capable of changing the focal length, but the interchangeable lens 3 may also be a single-focus lens.

[0117] Furthermore, in the first and second embodiments described above, the frame rate control unit 232 controls the frame rate based on motion vectors, but is not limited thereto. In addition to the frame rate, the camera control unit 23 can also control at least one of the following: the exposure time (time for charge to be stored in the photoelectric conversion unit) of the camera pixel 51a and the ISO sensitivity. That is, the signal from the detection pixel 51b can also be used to control the shooting conditions (settings during shooting) of the moving image.

[0118] Furthermore, in the first and second embodiments described above, the motion images captured at frame rate R1 are stored in a non-volatile recording medium, but this is not a limitation. For example, the motion images captured at frame rate R1 may not be stored in the non-volatile recording medium, and only the motion images captured at frame rates R2 and R3, which are higher than frame rate R1, may be stored in the non-volatile recording medium. This reduces the amount of motion image data stored in the non-volatile recording medium.

[0119] The above-described implementation methods are not limited to these, and various modifications can be made without departing from the main idea. Explanation of reference numerals in the attached figures

[0120] 1...Camera 2...Camera body 3... Interchangeable lenses 21...Camera element 23...Fuselage Control Department 22...Image Processing Department 26...Records Department 51a... camera pixels 51b...detection pixels 52A...First Vertical Signal Line 52B...Second Vertical Signal Line 62... Photoelectric conversion unit 231... Testing Department 232... Frame Rate Control Unit.

Claims

1. A camera element, characterized in that, have: The first pixel has a first photoelectric conversion unit and outputs a first signal for image generation based on the charge generated by the first photoelectric conversion unit; The second pixel has a second photoelectric conversion unit and outputs a second signal for controlling the first pixel based on the charge generated by the second photoelectric conversion unit; The first signal line, which outputs the first signal; and The second signal line outputs the second signal; The second signal is used to control the frame rate at which the first signal is read from the first pixel.

2. The imaging element according to claim 1, characterized in that, The output of the first signal from the first pixel is executed in parallel with the output of the second signal from the second pixel.

3. A camera device, characterized in that, have: The imaging element as described in claim 1 or claim 2; The detection unit detects the motion of the subject based on the second signal; and The control unit controls the frame rate for reading the first signal from the first pixel based on the detection result of the detection unit.

4. The camera device according to claim 3, characterized in that, When the detection unit outputs the first detection result, the control unit controls the frame rate to the first frame rate.

5. The camera device according to claim 4, characterized in that, When the detection result of the detection unit changes from the first detection result to the second detection result, the control unit controls the frame rate to a second frame rate that is higher than the first frame rate.

6. The camera device according to claim 5, characterized in that, When the detection result of the detection unit changes from the first detection result to a third detection result that is different from the second detection result, the control unit controls the frame rate to a third frame rate that is less than the first frame rate.

7. The camera device according to claim 5 or claim 6, characterized in that, have: The recording unit records an image generated based on the first signal output from the first pixel after the detection unit outputs the first detection result when the detection result of the detection unit changes from the first detection result to the second detection result.

8. The camera device according to claim 7, characterized in that, When the detection result of the detection unit changes from the first detection result to a third detection result that is different from the second detection result, the recording unit records a portion of the image generated based on the first signal output from the first pixel after the first detection result is output from the detection unit, or does not record the image generated based on the first signal output from the first pixel after the first detection result is output from the detection unit.

9. The camera device according to any one of claims 5 to 8, characterized in that, The first detection result represents the first movement of the subject, and the second detection result represents the second movement of the subject that is different from the first movement.

10. The camera device according to any one of claims 4 to 9, characterized in that, The first frame rate is higher than the frame rate before the first detection result is output from the detection unit.

11. A camera device, characterized in that, have: The camera department is responsible for filming the subjects. The detection unit detects the movement of the subject; and When the detection unit outputs a first detection result, the control unit controls the frame rate of the camera unit to a first frame rate. When the detection result of the detection unit changes from the first detection result to a second detection result, the control unit controls the frame rate of the camera unit to a second frame rate higher than the first frame rate.

12. The camera device according to claim 11, characterized in that, When the detection result of the detection unit changes from the first detection result to a third detection result that is different from the second detection result, the control unit controls the frame rate of the camera unit to a third frame rate that is less than the first frame rate.

13. A camera device, characterized in that, have: The camera department is responsible for filming the subjects. The detection unit detects the movement of the subject; as well as When the detection result of the detection unit changes from the first detection result to the second detection result, the recording unit records the image data output from the camera unit after outputting the first detection result into a non-volatile memory.

14. The camera device according to claim 13, characterized in that, When the detection unit outputs the first detection result, the recording unit begins to record the image data output from the camera unit into the volatile memory. When the detection result of the detection unit changes from the first detection result to the second detection result, the recording unit begins to record the image data stored in the volatile memory into the non-volatile memory.

Images