Image capture device and image capture processing method

Abstract

To provide an imaging device and an imaging processing method capable of generating display image information for appropriately displaying horizontally long imaging information on a vertically long display device.SOLUTION: An imaging device includes an imaging unit configured to change the shooting magnification, and a distribution information generation unit. In a case in which partial imaging information cut out from each frame shot and acquired at the first shooting magnification by the imaging unit in a preset first cutout range is enlarged at the first magnification to generate the distribution image information, when the shooting magnification changes to the second shooting magnification which is lower than the first shooting magnification, the distribution information generation unit generates partial imaging information of a second cutout range which is smaller than the size of the first cutout range from each acquired frame, and enlarges the partial imaging information in the second cutout range at the second magnification higher than the first magnification, and switches to generate the distribution image information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image capturing apparatus and an image processing method. [Background technology]

[0002] Conventionally, the mainstream of high-definition imaging devices that are widely used have a screen aspect ratio (horizontal size: vertical size) of 16: 9 for the imaging information to be processed. This imaging device has a high affinity with devices that have a horizontally long screen with an aspect ratio of 16: 9, such as personal computers and home TV devices, and the imaging information captured by this imaging device can be efficiently displayed on the screen of these devices.

[0003] On the other hand, even in smartphones, which have rapidly spread in recent years, there are increasing opportunities to view imaging information streamed using SNS (social networking service) and the like. Smartphones are often used with their display screens in a portrait state, that is, with a horizontal size: vertical size ratio of 9:16. Therefore, when imaging information captured by the above-mentioned imaging device is viewed on a smartphone, the imaging information is displayed in a landscape manner in a part of the portrait display screen, for example, in the center, and blank spaces or black bars are generated at the top and bottom of the screen. When blank spaces or black bars are generated on the screen, the display size of the imaging information is correspondingly reduced, which causes a problem that it is difficult for smartphone users to view the imaging information.

[0004] In response to such technical issues, Patent Document 1 discloses a technology in which a video distribution device that streams zoomed video of captured imaging information determines zoom conditions so as to expand an important area extracted from a frame of the imaging information to the minimum size of the distribution aspect ratio, and distributes the zoomed video cut out based on the determined zoom conditions. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 5594842 Summary of the Invention [Problem to be solved by the invention]

[0006] However, when video information captured by an imaging device is being distributed, if the optical zoom of the imaging device is changed to the WIDE side, the angle of view of the image information being distributed becomes wider, so the size of the subject in the image information to be distributed becomes relatively smaller. In other words, there is a problem in that the image of the subject is distributed at a position not intended by the photographer.

[0007] The present invention has been made in consideration of the above circumstances, and has as its object to provide an imaging device and an imaging processing method that are capable of generating display image information for continuing distribution with the original distribution angle of view that was set even if the shooting angle of view is changed by optical zoom. [Means for solving the problem]

[0008] In order to achieve the above object, an imaging device according to the present invention comprises: The present invention is characterized in that the information generation unit is configured to generate image information for distribution by enlarging, at a first magnification ratio, partial image information cut out in a predetermined first cut-out range from each of the frames captured by the imaging unit at a first imaging magnification ratio, and when the imaging magnification ratio is changed to a second imaging magnification ratio lower than the first imaging magnification ratio, the information generation unit switches to generate partial image information of a second cut-out range having a size smaller than the size of the first cut-out range from each of the frames captured by the imaging unit at a first imaging magnification ratio and enlarging the partial image information of the second cut-out range at a second magnification ratio higher than the first magnification ratio to generate the image information for distribution.

[0009] In addition, an imaging processing method of the present invention is characterized in that an imaging device having an imaging unit that is capable of changing the shooting magnification and performs video shooting processing at a set shooting magnification sequentially acquires frames captured and generated by the imaging unit at a first shooting magnification, extracts partial imaging information of a predetermined first cut-out range from each of the frames, and enlarges the extracted partial imaging information at a first magnification ratio to generate image information for distribution, and when the shooting magnification changes to a second shooting magnification lower than the first shooting magnification, the range to be cut out from each of the acquired frames is changed to a second cut-out range that is smaller than the size of the first cut-out range, and the partial imaging information of the second cut-out range is enlarged at a second magnification ratio higher than the first magnification ratio to generate the image information for distribution. Effect of the Invention

[0010] According to the imaging device and imaging processing method of the present invention, even if the angle of view for shooting is changed by optical zoom, it is possible to generate display image information for continuing distribution while maintaining the original angle of view for distribution that was set. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing the overall configuration of an imaging device according to a first embodiment of the present invention. [Diagram 2] 2 is a block diagram showing a configuration of a distribution information generating unit in an imaging device according to a first embodiment of the present invention. FIG. [Diagram 3] 5 is a flowchart showing the operation of the imaging apparatus according to the first embodiment of the present invention. [Figure 4] FIG. 1A is a diagram showing an example of a state in which GUI information for specifying a cut-out position is superimposed on image information captured by an imaging device according to a first embodiment of the present invention, and FIG. 1B is a diagram showing an example of image information for distribution generated by cutting out a range specified by the GUI information. [Diagram 5] 1A is a diagram showing an example of imaging information captured by an imaging device according to a first embodiment of the present invention after the shooting magnification has been changed to a higher value, and FIG. 1B is an example of image information for distribution that has been extracted and generated from the imaging information after the shooting magnification has been changed. [Figure 6] FIG. 1(a) is a diagram showing an example of imaging information captured after the shooting magnification has been changed to a lower value using an imaging device according to a first embodiment of the present invention, and FIG. 1(b) is an example of image information for distribution that has been extracted and generated from the imaging information after the shooting magnification has been changed. [Figure 7] FIG. 1(a) is a diagram showing an example of imaging information captured after the shooting magnification has been changed to a lower value using an imaging device according to a first embodiment of the present invention, and FIG. 1(b) is an example of image information for distribution that has been extracted and generated from the imaging information after the shooting magnification has been changed. [Figure 8] FIG. 11 is a block diagram showing the configuration of a distribution information generating unit in an imaging device according to a second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Below, as an embodiment of the present invention, we will explain an imaging device that generates image information that can be suitably displayed on a portrait (aspect ratio 9:16) display screen of a smartphone when distributing captured landscape (aspect ratio 16:9) imaging information on a social networking site.

[0013] First Embodiment Configuration of the imaging device according to the first embodiment The configuration of an imaging device 1A according to a first embodiment of the present invention will be described with reference to Fig. 1. The imaging device 1A according to this embodiment is a device for capturing moving images, and includes a zoom lens 2 and a CMOS (Complementary MOS) sensor 3 as an imaging section, an input section 4, a video storage section 5, a network IF section 6, an external monitor IF section 7, a display section 8, a storage section 9, an image processing section 10, a codec section 20, and a CPU (Central Processing Unit) 30.

[0014] The zoom lens 2 is a lens configured to be able to change the shooting magnification, and allows subject light to enter at a magnification set by a user using a zoom lever (not shown) or the like. The CMOS sensor 3 is an imaging element that converts the subject light entering through the zoom lens 2 into an electrical signal. The CMOS sensor 3 outputs the converted electrical signal as an image signal such as MIPI (Mobile Industry Processor Interface), sLVDS (sub Low Voltage Differential Signaling), or HiSPi (High-Speed ​​Pixel Interface).

[0015] The input unit 4 is composed of key buttons or a touch panel, and inputs user operation information, such as information for specifying a shooting magnification, information for instructing the generation of a video for SNS distribution, or information for specifying an image cropping range, which will be described later. In this embodiment, a touch panel is provided on the display unit 8. The video storage unit 5 is a storage medium for storing information generated by the image processing unit 10 and information generated by the codec unit 20, which will be described later, and is composed of, for example, an SD memory or an SSD (Solid State Drive). The network IF unit 6 is an interface for connecting to a predetermined LAN (Local Area Network).

[0016] The external monitor IF unit 7 is an interface for connecting to an external television device or display device (not shown), and uses, for example, the HDMI (High-Definition Multimedia Interface) or SDI (Serial Digital Interface) standard. The display unit 8 is a small monitor for checking captured video information, and is, for example, a touch panel LCD (Liquid Crystal Display) or EL display. The storage unit 9 is a storage medium used when the image processing unit 10 and the codec unit 20 execute processing, and is, for example, composed of a DDR4 (Double-Data-Rate4) memory, a hard disk, or the like.

[0017] The image processing unit 10 has a sensor IF unit 11, a scratch correction / NR (Noise reduction) processing unit 12, a debayer processing unit 13, a color reproduction unit 14, a motion detection unit 15, a shooting magnification information acquisition unit 16, and a display information generation unit 17.

[0018] The sensor IF unit 11 receives the image signal output from the CMOS sensor 3, converts the serial data into parallel data, and sequentially generates the data as frames. The sensor IF unit 11 also extracts a horizontal sync signal and a vertical sync signal from the received signal, and replaces them with sync signals within the imaging device 1A. The storage unit 9 may be used to execute this process.

[0019] The defect correction / NR processing unit 12 acquires the data converted by the sensor IF unit 11 for each frame as information to be processed, and performs an interpolation process for so-called defect data included in the corresponding frame, and a noise reduction process. The noise reduction process may be either 2DNR (2-dimensional noise reduction) that performs processing for each frame, or 3DNR (3-dimensional noise reduction) that analyzes consecutive frames and performs processing. The memory unit 9 may be used when performing this process.

[0020] If the CMOS sensor 3 supports the Bayer structure of R, Gr, Gb, B, the debayer processing unit 13 converts the frame acquired from the CMOS sensor 3 into an R, G, B structure by debayer processing. If the CMOS sensor 3 supports monochrome or a 3-CMOS structure, the debayer processing is not performed on the acquired frame. The color reproduction unit 14 performs gamma correction processing and color management processing according to a preset white balance on the acquired frame.

[0021] The motion detection unit 15 detects motion information of the subject from video information for distribution generated by a distribution information generation unit 19A of the display information generation unit 17. The shooting magnification information acquisition unit 16 acquires information on the shooting magnification set in the zoom lens 2 via the CPU 30.

[0022] Display information generating unit 17 has main information generating unit 18 and distribution information generating unit 19A. Main information generating unit 18 generates display image information with an aspect ratio of 16:9 compatible with high definition and the like from the acquired frames. The generated display image information is sequentially sent by CPU 30 from storage unit 9 to video storage unit 5 and recorded as main moving image information.

[0023] The information for distribution generating unit 19A generates image information for distribution from the acquired frames as display information with an aspect ratio of 9:16 to be displayed on a portrait display screen such as a smartphone (not shown) for distribution via SNS, etc. The generated image information for distribution is sequentially sent by the CPU 30 from the storage unit 9 to the video storage unit 5 and recorded as video information for distribution.

[0024] The detailed configuration of information for delivery generation unit 19A will be described with reference to Fig. 2. Information for delivery generation unit 19A has a GUI (Graphical User Interface) display control unit 191, a cutout range setting unit 192, a cutout unit 193, a resizing processing unit 194, and a setting change unit 195.

[0025] When an instruction to generate GUI information for SNS distribution is input from the input unit 4, the GUI display control unit 191 causes the display unit 8 to display GUI information for specifying a rectangular cut-out range of a specified size with an aspect ratio of 9:16 from the captured video information.

[0026] The cut-out range setting unit 192 sets, as a first cut-out range, the cut-out range within the frame specified by the user using GUI information displayed under the control of the GUI display control unit 191. Furthermore, the cut-out range setting unit 192 changes the cut-out range based on an instruction from a setting change unit 195, which will be described later.

[0027] The cropping unit 193 crops out, as partial imaging information, imaging information of the first cropping range set by the cropping range setting unit 192 from a frame photographed at a predetermined first imaging magnification. The resizing processing unit 194 resizes the partial imaging information cropped by the cropping unit 193 for SNS distribution to generate image information for distribution.

[0028] When the setting change unit 195 detects that the shooting magnification has been changed to a second shooting magnification lower than the first shooting magnification during shooting based on the information on the shooting magnification of the zoom lens 2 acquired by the shooting magnification information acquisition unit 16, it changes the cut-out range in the frame to a second cut-out range smaller than the size of the first cut-out range in the cut-out range setting unit 192.

[0029] Furthermore, when the setting change unit 195 detects that the shooting magnification of the zoom lens 2 has been returned to the first shooting magnification after changing the cut-out range to the second cut-out range, it sets the cut-out range setting unit 192 to return the cut-out range to the first cut-out range. Furthermore, when the setting change unit 195 detects a subject movement of a predetermined value or more in the image information for distribution generated after changing the cut-out range to the second cut-out range, it instructs the cut-out range setting unit 192 to change the cut-out range in the frame to a third cut-out range that is larger than the second cut-out range and smaller than the first cut-out range.

[0030] Returning to FIG. 1, the codec unit 20 has a main codec unit 21 and a distribution codec unit 22. The main codec unit 21 encodes the main moving image information generated and stored by the main information generation unit 18 for storage in the video storage unit 5, and stores the encoded information temporarily in the storage unit 9. The CPU 30 then stores the data temporarily stored in the storage unit 9 in a file format in the video storage unit 5. The main codec unit 21 also encodes the encoded main moving image information when transmitting the information to an external server device or the like via the network IF unit 6. Furthermore, the main codec unit 21 decodes the encoded main moving image information when the encoded main moving image information is to be played on a display device or the like from the external monitor IF unit 7, or when the encoded main moving image information is to be played on the display unit 8.

[0031] The distribution codec unit 22 encodes the distribution video information generated by the distribution information generation unit 19B in order to transmit the information to an external display device, and stores the encoded information in the storage unit 9. The distribution codec unit 22 also decodes the encoded distribution video information when playing it back.

[0032] The CPU 30 controls the operations of the zoom lens 2, CMOS sensor 3, input unit 4, video memory unit 5, network IF unit 6, external monitor IF unit 7, display unit 8, memory unit 9, image processing unit 10, and codec unit 20 described above.

[0033] <Operation of the imaging device according to the first embodiment> Next, the operation of the imaging device 1A according to this embodiment will be described with reference to the flowchart in Fig. 3. First, when the user performs an operation to instruct the start of moving image shooting from the input unit 4, moving image shooting processing is started by the zoom lens 2 set to the first shooting magnification Z1, the CMOS sensor 3, and the image processing unit 10. Information on the shot moving image is displayed on the display unit 8 by the CPU 30.

[0034] Next, when the user performs an operation from the input unit 4 to instruct the creation of a video for distribution on SNS ("YES" in S1), the GUI display control unit 191 in the image processing unit 10 superimposes GUI information for specifying a rectangular cut-out range (first cut-out range) of a first size with an aspect ratio of 9:16 from a frame of the captured video information on the display unit 8 (S2).

[0035] Fig. 4(a) shows an example of GUI information superimposed on video information displayed on the display unit 8. In Fig. 4(a), the GUI information is displayed on video information of a mother and child monkey. The GUI information has frame information G1 with an aspect ratio of 9:16, a horizontal screen center line G2 of the display unit 8, a vertical screen center line G3, a left arrow button G4 for horizontally moving the frame information G1 to the left, a right arrow button G5 for horizontally moving the frame information G1 to the right, a position determination button G7 for determining the horizontal position of the frame information G1, and message information G8 for encouraging a position determination operation by sliding the frame information G1.

[0036] The user operates the left arrow button G4 or the right arrow button G5 on the input unit 4 to move the frame information G1 to a desired position, that is, the position of the subject to be distributed, and operates the position determination button G7. When the position determination button G7 is operated to determine the horizontal position of the frame information G1 ("YES" in S3), the cut-out range setting unit 192 sets the first cut-out range A1 indicated by the frame information G1 as the cut-out range within the frame (S4).

[0037] When setting the first cropping range A1 to process captured video information, the cropping range setting unit 192 first specifies a predetermined position (e.g., the left edge position) of the frame information G1 as the horizontal cropping start position H1. In addition, as the vertical cropping start position V1 of the cropping range, the cropping range is specified to be 1080 pixels vertically from the top or bottom edge of the frame if the video information to be processed is of HD quality, or 2160 pixels vertically if the video information is of 4K quality, i.e., the top or bottom edge of the frame.

[0038] Next, the cropping unit 193 crops out partial imaging information of the first cropping range A1 set by the cropping range setting unit 192 from the frame F1 of the moving image information to be processed. Then, the resizing processing unit 194 enlarges (resizes) the partial imaging information cropped by the cropping unit 193 at a predetermined first enlargement ratio for SNS distribution to generate distribution image information D1 of a predetermined size as shown in Fig. 4(b). Thereafter, based on the first cropping range A1 set in step S4, distribution image information is generated for each frame sequentially acquired by shooting (S5).

[0039] During shooting, when the user operates the input unit 4 to change the shooting magnification of the zoom lens 2 from the first shooting magnification Z1 to the second shooting magnification Z2 ("YES" in S6, "YES" in S7), the shooting magnification information acquisition unit 16 acquires information on the first shooting magnification Z1 before the change and information on the shooting magnification Z2 after the change. A frame F2 acquired on the display unit 8 after the shooting magnification is changed is shown in FIG. 5(a).

[0040] The setting change unit 195 recognizes that the change in the shooting magnification is a change in the Wide direction by calculating the zoom magnification ratio Z1 / Z2>1 from the information acquired by the shooting magnification information acquisition unit 16. The setting change unit 195 changes the cut-out range set by the cut-out range setting unit 192 to a second cut-out range A2 whose size is calculated by Z2 / Z1 and is smaller than the size of the first cut-out range A1, as shown in FIG.

[0041] Here, the second cut-out range A2 is changed in conjunction with the first cut-out range A1 in accordance with the zoom magnification ratio.

[0042] If the number of horizontal pixels of the video information to be processed is H pixels and the cut-out start position within the first cut-out range A1 is H1 counting from the top left of the screen, the cut-out start position H2 in the horizontal direction of the second cut-out range A2 is expressed by the following equation (1).

[0043] H2 = Hpixel / 2 × (1 - Z2 / Z1) + H1 × Z2 / Z1 (1) For example, Hpixel is 1,920 for HD quality and 3,840 for 4K quality.

[0044] If the number of vertical pixels of the moving image information to be processed is Vpixel, then the cut-out start position V2 in the vertical direction of the second cut-out range A2 is given by the following formula (2).

[0045] V2 = Vpixel / 2 × (1 - Z2 / Z1) (2) For example, Vpixel is 1,080 for HD quality and 2,160 for 4K quality.

[0046] Of course, Hpixel and Vpixel can be calculated using formulas (1) and (2) by referring to the number of horizontal pixels and the number of vertical pixels of the video information to be processed, regardless of the screen size such as HD quality or 4K quality. When the shooting magnification is changed, the first shooting magnification Z1 at the time when the user set the first cropping range A1 is fixed, and the second shooting magnification Z2, which is the changed shooting magnification, is changed and recalculated.

[0047] Then, the cropping unit 193 switches the cropping range from the subsequently acquired frame F2 to the second cropping range A2. The resizing processing unit 194 enlarges the partial imaging information cropped in the second cropping range A2 at a second magnification ratio calculated as Z1 / Z2, which is higher than the first magnification ratio. Then, as shown in Fig. 5(b), the resizing processing unit 194 generates image information for delivery of the same size as the image information for delivery generated in step S5. Thereafter, based on the changed second cropping range A2, image information for delivery D2 is generated for each frame acquired sequentially by shooting (S8).

[0048] Thereafter, when the user performs an operation to return the magnification of the zoom lens 2 to the first magnification Z1, that is, to change it to the Tele direction, from the input unit 4 ("YES" in S9, "YES" in S10), the magnification information acquisition unit 16 acquires information on the change. Then, based on the information on the change, the setting change unit 195 returns the setting of the cutout range to the first cutout range A1 (S11).

[0049] Then, the cropping unit 193 switches the range to be cropped from the subsequently acquired frame F3 to the first cropping range A1. The resizing processing unit 194 enlarges the partial imaging information cropped in the first cropping range A1 at a first magnification ratio to generate image information for distribution D3 of the same range as in the process of step S5. Thereafter, image information for distribution is generated for each frame sequentially acquired by shooting in the changed first cropping range A1 (S11).

[0050] Furthermore, after the cropping range is changed to the second cropping range A2, when the shooting magnification of the zoom lens 2 is not returned to the first shooting magnification Z1 ("NO" in S9), the motion detection unit 15 detects the motion of the subject in the generated image information for distribution. The motion of the subject is detected using existing technology, for example, the amount of change in luminance between previous and next frames, or motion vector information of the subject.

[0051] Here, when the motion detection unit 15 detects motion of a predetermined value or more from the image information for distribution ("YES" in S12), the setting change unit 195 changes the set cut-out range to a third cut-out range A3 that is larger than the second cut-out range A2 and smaller than the first cut-out range A1, as shown in Figure 6(a).

[0052] Then, the cropping unit 193 switches the cropping range from the subsequently acquired frame F4 to a third cropping range A3. The resizing unit 194 enlarges the partial imaging information cropped in the third cropping range A3 at a third magnification rate lower than the second magnification rate to generate image information for distribution D4 of the same size as the image information for distribution generated in step S5. Thereafter, image information for distribution is generated for each frame sequentially acquired by shooting, using the changed cropping range (S13).

[0053] Thereafter, returning to step S9, if the magnification of the zoom lens 2 has not been returned to the first magnification Z1 ("NO" in S9), and further movement of a predetermined value or more is detected from the changed image information for distribution ("YES" in S12), the setting change unit 195 changes the set cut-out range to a fourth cut-out range A4 that is larger than the third cut-out range A3 and smaller than the first cut-out range A1. Thereafter, the process of step S13 is executed in the same manner as the process described above.

[0054] In step S7 of the above process, if the user changes the shooting magnification of the zoom lens 2 in the Tele direction during shooting to change the shooting angle of view as shown in Fig. 7(a) ("NO" in S7), the range to be cut out from the frame F5 acquired thereafter remains the first cut out range A1. As a result, from the cut out partial imaging information, image information for distribution D5 is generated in which the subject is enlarged more than the image information for distribution D1 as shown in Fig. 6(b).

[0055] Furthermore, when the imaging magnification is further changed in the wide direction in step S10 ("NO" in S10), the process returns to step S8, where the setting change unit 195 changes the cropping range to an even smaller size.

[0056] According to the first embodiment described above, when streaming video of horizontally long image information with an aspect ratio of 16:9 captured by a general imaging device to a vertically long display device with an aspect ratio of 9:16 on a smartphone, even if the angle of view for shooting is changed by optical zoom, streaming can be continued with the original angle of view for distribution that was set, and even if the subject moves, streaming and shooting can be continued without the subject being lost from the image for distribution.

[0057] Second Embodiment Configuration of the imaging device according to the second embodiment The configuration of the imaging device 1B according to the second embodiment of the present invention is similar to the configuration of the imaging device 1A described in the first embodiment, except that the imaging device 1B has a distribution information generation unit 19B instead of a distribution information generation unit 19A within the display information generation unit 17 of the image processing unit 10. Therefore, detailed descriptions of parts having the same functions will be omitted.

[0058] In this embodiment, as shown in FIG. 8, distribution information generation unit 19B has an MTF information storage unit 196 and an image correction unit 197 in addition to the configuration of distribution information generation unit 19A described in the first embodiment.

[0059] The MTF information storage unit 196 pre-stores MTF (Modulation Transfer Function) information for each shooting magnification set in the zoom lens 2. When the image correction unit 197 detects that the shooting magnification set in the zoom lens 2 has been changed, it performs correction so as to emphasize the edge portions of the subject in the generated image information for distribution, based on the difference between the MTF information for the shooting magnification before the change and the MTF information for the shooting magnification after the change.

[0060] <Operation of the imaging device according to the second embodiment> In the imaging device 1B according to this embodiment, image information for distribution related to captured video information is generated by the same process as in the imaging device 1A described in the first embodiment. At that time, when the imaging magnification set in the zoom lens 2 is changed from the first imaging magnification Z1 to the second imaging magnification Z2, the image correction unit 197 detects this.

[0061] When the image correction unit 197 detects that the magnification has been changed, it corrects the image to emphasize the edge of the subject in the image information for distribution generated in step S8 based on the difference between the MTF information of the first magnification Z1 and the MTF information of the second magnification Z2 stored in the MTF information storage unit. Specifically, when the difference between the MTF information of the second magnification Z2 and the MTF information of the first magnification Z1 is large, good image quality is obtained, so the degree of emphasis of the edge is corrected to be weak. Conversely, when the difference is small or in the negative direction, image quality is deteriorated, so the degree of emphasis of the edge is corrected to be strong. In addition, the emphasis of the edge may be further strengthened as the second magnification Z1 / Z2 increases in conjunction with the ratio between the second magnification Z2 and the first magnification Z1.

[0062] In addition, in order to reduce costs, the memory capacity of the MTF information storage unit 196 may be minimized or omitted. In this case, since the MTF performance of a lens generally deteriorates toward the periphery of the screen, the degree of edge enhancement may be controlled according to the position of the horizontal cut-out start position H2 of the second cut-out range A2. For example, if H2 is near the center of the screen, the edge enhancement may be weakened, and the closer H2 is to the left or right edge of the screen, the stronger the edge enhancement. In conjunction with the ratio between the second shooting magnification Z2 and the first shooting magnification Z1, the larger the magnification Z2 / Z1, the stronger the edge enhancement may be.

[0063] According to the second embodiment described above, even when the extracted image information is enlarged, it is possible to generate clear image information for distribution. [Explanation of symbols]

[0064] 1A, 1B Imaging device 2 Zoom Lens 3 CMOS sensor 4 Input section 5. Video storage section 6 Network Interface Section 9 Storage section 10 Image processing section 11 Sensor IF section 12 Scratch correction / NR processing section 13 Debayer processing 14 Color Reproduction Section 15 Motion detection section 16 Shooting magnification information acquisition section 17 Display information generation section 18 Main information generation unit 19A, 19B Distribution information generation unit 20 Codec section 21 Main Codec Section 22 Distribution codec section 191 GUI display control unit 192 Cutout range setting section 193 Cut-out section 194 Resize processing section 195 Setting change section 196 MTF information storage section 197 Image Correction Section

Claims

1. an imaging unit that is capable of changing a shooting magnification and that outputs an image signal by performing moving image shooting processing at a set shooting magnification; a distribution information generating unit that sequentially acquires frames from the image signal, generates partial image information of a predetermined cutout range from each of the acquired frames, and enlarges the generated partial image information at a predetermined enlargement rate to generate distribution image information; Equipped with when the imaging magnification is changed to a second imaging magnification lower than the first imaging magnification while the information-for-distribution generation unit is generating the image information for distribution by enlarging, at a first magnification ratio, partial imaging information cut out in a preset first cropping range from each of the frames photographed and acquired by the imaging unit at a first imaging magnification, the information-for-distribution generation unit switches to generate partial imaging information of a second cropping range having a size smaller than the size of the first cropping range from each of the acquired frames and enlarging the partial imaging information of the second cropping range at a second magnification ratio higher than the first magnification ratio; When a motion of a subject equal to or greater than a predetermined value is detected in the image information for distribution generated after the range to be cut out from the acquired frame is changed from the first cut-out range to the second cut-out range, the range to be cut out from the acquired frame is changed to a third cut-out range that is larger than the second cut-out range and smaller than the first cut-out range, and then the display image information is generated by changing the range to be cut out from the acquired frame to a third cut-out range that is larger than the second cut-out range and smaller than the first cut-out range.

1. An imaging device comprising:

2. The imaging device according to claim 1 , wherein the second cropping range is set based on a ratio between the first imaging magnification and the second imaging magnification.

3. An imaging device having an imaging unit capable of changing a shooting magnification and performing a moving image shooting process at a set shooting magnification, while sequentially acquiring frames photographed and generated by the imaging unit at a first photographing magnification, cutting out partial image information of a preset first cropping range from each of the frames, and enlarging the partial image information at a first magnification ratio to generate image information for distribution, if the photographing magnification ratio changes to a second photographing magnification ratio lower than the first photographing magnification ratio, the range to be cropped from each of the acquired frames is changed to a second cropping range having a size smaller than the size of the first cropping range, and the partial image information of the second cropping range is enlarged at a second magnification ratio higher than the first magnification ratio to generate the image information for distribution; When a motion of a subject equal to or greater than a predetermined value is detected in the image information for distribution generated after the range to be cut out from the acquired frame is changed from the first cut-out range to the second cut-out range, the range to be cut out from the acquired frame is changed to a third cut-out range that is larger than the second cut-out range and smaller than the first cut-out range, and then the display image information is generated by changing the range to be cut out from the acquired frame to a third cut-out range that is larger than the second cut-out range and smaller than the first cut-out range.

4. An imaging processing method comprising:

Images