Image processing apparatus and image processing method

Abstract

To provide a technique that can appropriately execute, for example, processing requiring cut-out processing and resize processing such as a crop and zoom function and a magnify function even if the resize processing is restricted.SOLUTION: An image processing apparatus has: first cut-out means that can cut out an area of a part of an input image and output the cut-out area; second cut-out means that can cut out an area of a part of the input image and output the cut-out area; and magnifying means that is used together with one of the first and second cut-out means, and magnifies the area cut out by the first or second cut-out means. When a transition is made from a first state where the magnifying means is used together with the first cut-out means to a second state where the magnifying means is used together with the second cut-out means, the first cut-out means cuts out, from the input image, an area in a predetermined size including the area that has been cut out by the first cut-out means in the first state, and outputs the cut-out area.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an image processing device and an image processing method, and more particularly to a technique for performing image output using a crop function and an image output using a Magnify function. [Background technology]

[0002] There are two types of cropping functions that cut out part of an image: a simple crop function that cuts out any 2K area from a 4K image, and a crop zoom function that cuts out any area from a 4K image and resizes it to a 2K image. There is also a Magnify function that cuts out any area from a 4K image and resizes it to a 2K image as an auxiliary function for focus adjustment. The crop zoom function and Magnify function operate in the same way, but have different uses, so some imaging devices have both the crop zoom function and the Magnify function.

[0003] Patent Document 1 discloses a technology related to a crop function. In the technology disclosed in Patent Document 1, a simple crop function is used when the zoom magnification is on the wide side, and a crop zoom function is used when the zoom magnification is on the telephoto side. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2020-48191 Summary of the Invention [Problem to be solved by the invention]

[0005] In studio shooting, it is conceivable that the entire studio is shot in 4K, an image for on-air use is obtained using the crop zoom function, and an image for focus adjustment is obtained using the Magnify function. The image for on-air and the image for focus adjustment are, for example, images obtained by cropping a portion of the 4K area and resizing it to 2K. The cropped areas of the image for on-air and the image for focus adjustment may differ.

[0006] It is also possible to use a crop zoom function to obtain a first image corresponding to the first area and a second image corresponding to the second area as images to be output to the switcher equipment, and have the switcher equipment switch between the first image and the second image to be aired.

[0007] As described above, there are cases where multiple processes using a crop zoom function or a Magnify function are desired to be performed in parallel. Using multiple resizing circuits allows these processes to be performed in parallel, but this increases the circuit size. In recent years, the size of each resizing circuit has increased as the resolution of captured images has increased. Therefore, using multiple resizing circuits significantly increases the circuit size. Furthermore, as various devices, such as imaging devices, have become smaller, the space available for mounting circuits has decreased, making it impossible to mount multiple resizing circuits. Even when resizing is performed using a general-purpose circuit or software processing rather than a dedicated circuit, the resizing process places a heavy processing load on multiple images, making it impossible to perform the resizing process simultaneously.

[0008] The present invention aims to provide a technology that can appropriately execute processes that require cropping and resizing, such as a crop zoom function or a Magnify function, even if there are limitations on the resizing process. [Means for solving the problem]

[0009] The first image processing device of the present invention comprises a first cut-out means capable of cutting out and outputting a partial area of an input image, a second cut-out means capable of cutting out and outputting a partial area of the input image, and an enlargement means used together with either the first cut-out means or the second cut-out means and enlarging the area cut out by the first cut-out means or the second cut-out means, and is characterized in that when the enlargement means transitions from a first state in which it is used together with the first cut-out means to a second state in which it is used together with the second cut-out means, the first cut-out means cuts out and outputs an area of a predetermined size from the input image that includes the area that was cut out by the first cut-out means in the first state.

[0010] The second image processing device of the present invention comprises a first cut-out means capable of cutting out and outputting a partial area of an input image, a second cut-out means capable of cutting out and outputting a partial area of the input image, and an enlargement means used together with either the first cut-out means or the second cut-out means for enlarging the area cut out by the first cut-out means or the second cut-out means, and is characterized in that when the device transitions from a first state in which the area cut out by the first cut-out means is enlarged by the enlargement means and output to an external device to a second state in which the enlargement means is used together with the second cut-out means, the first cut-out means outputs an image including the area cut out by the first cut-out means in such a way that the area can be identified. [Effects of the Invention]

[0011] According to the present invention, even if there are limitations on the resizing process, it is possible to appropriately execute processes that require clipping and resizing, such as a crop zoom function or a Magnify function. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram showing a configuration of an imaging device. [Figure 2] FIG. 2 is a schematic diagram illustrating the flow of image data in an imaging device. [Figure 3] FIG. 10 is a schematic diagram showing a specific example of a partial enlargement function. [Figure 4] FIG. 2 is a schematic diagram illustrating the flow of image data in an imaging device. [Figure 5] FIG. 10 is a schematic diagram showing a specific example of processing by a crop circuit. [Figure 6] FIG. 2 is a schematic diagram illustrating the flow of image data in an imaging device. [Figure 7] 10A and 10B are schematic diagrams showing specific examples of processing by a cropping circuit and an OSD generating circuit. [Figure 8A] 10 is a flowchart of an image output process. [Figure 8B] 10 is a flowchart of a crop zoom setting change process. [Figure 8C] 10 is a flowchart of a Magnify setting change process. [Figure 9] FIG. 10 is a schematic diagram showing a specific example of the operation of the imaging device. [Figure 10] FIG. 10 is a schematic diagram showing a specific example of the operation of the imaging device. DETAILED DESCRIPTION OF THE INVENTION

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will now be described. Fig. 1 is a block diagram showing the configuration of an image capturing apparatus 100 as an example of an apparatus (image processing apparatus) to which the present invention can be applied.

[0014] The lens unit 101 has a fixed lens group for focusing light, a variable magnification lens group, an aperture, a variable magnification lens group, and a correction lens group, and by controlling these, the image formation position is corrected and the focus is adjusted. The lens unit 101 forms an image of a subject on the imaging plane of the image sensor 102.

[0015] The image sensor 102 converts light into an electric charge to generate an image signal. The image signal is output to an image processing unit 103. The image sensor 102 is an imaging element such as a CCD image sensor or a CMOS image sensor. Note that a so-called dual pixel type imaging element may be used in which all pixels on the imaging surface are each composed of a pair of light receiving elements, and a pair of optical images formed by a microlens at each pixel can be converted into an electrical signal by the pair of light receiving elements.

[0016] The image processing unit 103 converts the imaging signal input from the image sensor 102 into RAW data (RAW image). Thereafter, the image processing unit 103 performs RAW development processing including interpolation processing and image quality adjustment processing on the RAW data to generate image data in YUV format corresponding to the RAW data, and stores the generated image data in the RAM 111.

[0017] Each of the crop circuits 104 and 105 generates display image data by performing crop processing on YUV format image data (input image) stored in the RAM 111, and stores the generated display image data in the RAM 111. Cropping is processing to cut out a partial area of an image. The entire YUV format image data stored in the RAM 111 may also be stored in the RAM 111 as display image data.

[0018] An on-screen display (OSD) generation circuit 106 generates OSD data representing graphics such as various setting menus, titles, and time codes, and stores the OSD data in the RAM 111. The stored OSD data can be combined with display image data stored in the RAM 111.

[0019] The enlargement circuit 107 (resizing circuit) is a circuit that resizes (enlarges or reduces) an image, and is used in the crop zoom function or the Magnify function. Resizing can be performed on display image data stored in the RAM 111. Both the crop zoom function and the Magnify function are partial enlargement functions that cut out and resize (enlarge) any area from an image. The Magnify function is an auxiliary function for focus adjustment, while the crop zoom function is not. Note that a function that cuts out any area from an image but does not enlarge it is called a simple crop function (crop function).

[0020] The settings of these functions can be changed by operating the operation switch group 109. The Magnify function is executed by operating the MAGN button of the operation switch group 109. The user can select in advance from a menu which external output unit (output terminal) of the external output units 114 and 115 will use the Magnify function. In response to the operation of the MAGN button, the Magnify function is executed on the image input to the external output unit (output terminal) selected in the menu. When the MAGN button is operated, the Magnify function is executed using the AF area as the area to be cropped. The position and size of the area to be cropped can then be changed by touch operation, etc. If the MAGN button is operated again while the Magnify function is being executed, the Magnify function is turned OFF, and the output image of the external output unit (output terminal) that is the target of the Magnify function is switched to the entire image. Note that the Magnify function is also turned OFF when the external output unit (output terminal) that will use the Magnify function is switched from the menu. The crop function and crop zoom function can be executed in response to an instruction to execute the crop function / crop zoom function from a menu. The crop function can change the position of the area to be cropped, but cannot change the size of the area. The crop function can be set for each of the external output units 114 and 115. The crop zoom function can change the position and size of the area to be cropped. The crop function may be switched to the crop zoom function in response to an instruction to change the size of the area to be cropped in the crop function. In addition, the crop function / crop zoom function can change the size of the area to be cropped. When the area is switched to the whole image, the execution of the crop function / crop zoom function is stopped (function OFF) and the whole image is output.

[0021] In the above description, the settings of the Magnify function, crop zoom function, and crop function are changed by operating the operation switch group 109 of the imaging device 100. However, when the imaging device 100 is communicatively connected to an external terminal via a communication unit (not shown) and configured to be controllable by the external terminal, the settings of these functions may be configured to be changeable by operating the external terminal.

[0022] The microcomputer 108 controls the entire imaging device 100 .

[0023] The operation switch group 109 includes a plurality of operation members that accept operations from a user. For example, the operation switch group 109 includes a switch for switching the mode of the imaging device 100 among a plurality of modes, including a camera mode for taking pictures with a camera, a playback mode for playing back images, and a power-off mode in which the power of the imaging device 100 is turned off.

[0024] The ROM 110 is a flash ROM, and stores various data including programs executed by the microcomputer 108. A portion of the ROM 110 is used to hold (back up) various information such as system status information.

[0025] The RAM 111 is a volatile memory used as a work memory, for example, by the microcomputer 108, the image processing unit 103, the cropping circuits 104 and 105, and the OSD generating circuit 106.

[0026] The external output units 114 and 115 are output interfaces (output terminals) of a standard such as HDMI (registered trademark) or SDI, and output the display image data stored in the RAM 111 to the outside. The external output units 114 and 115 can output the display image data at a quality such as 4K60P or 2K60P. In this embodiment, the external output unit 114 is described as an HDMI output interface, and the external output unit 115 is described as an SDI output interface, but they may also be interfaces of other standards. Furthermore, the external output units 114 and 115 may be output interfaces of the same standard.

[0027] The external display 116 is a display (external device) connected to the external output unit 114, and displays the display image data output from the external output unit 114.

[0028] The external switcher 117 is a switcher (external device) connected to the external output unit 115 and displays the display image data output from the external output unit 115 .

[0029] 1 shows an example in which an external display 116 is connected to the external output unit 114 and an external switcher 117 is connected to the external output unit 115, but the external devices connected to the external output units 114 and 115 are not limited to these. An external display may be connected to the external output unit 115, and an external switcher may be connected to the external output unit 114.

[0030] The bus 118 connects the above-mentioned components of the imaging device 100 so that they can communicate with each other.

[0031] FIG. 2 is a schematic diagram showing the flow of image data in the imaging device 100. As shown in FIG.

[0032] A subject image 201 is formed on an image sensor 102 via a lens unit 101. The image sensor 102 performs photoelectric conversion on the subject image 201 to generate an image signal 202. The image signal 202 is input to the image processing unit 103. The image processing unit 103 performs various image processes on the image signal 202 to generate image data 203 in 4K and YUV format. The image processing unit 103 then stores the image data 203 in 4K and YUV format in the RAM 111.

[0033] The crop circuit 105 performs crop processing to crop a portion of image data from the 4K YUV format image data 203, and stores the cropped image data in the RAM 111 as display image data 207. The enlargement circuit 107 performs resizing (enlargement processing) on the display image data 207 to generate 2K display image data 208. The enlargement circuit 107 stores the 2K display image data 208 in the RAM 111. The 2K display image data 208 is output to the outside via the external output unit 115 as display image data 209, and is displayed as video 211 by the external switcher 117.

[0034] At the same time, the crop circuit 104 converts the entire 4K YUV format image data 203 into 2K display image data 204, and stores the display image data 204 in the RAM 111. The 2K display image data 204 is output to the outside via the external output unit 114 as display image data 205, and is displayed as video 210 on the external display 116.

[0035] Although an example has been described in which the enlargement circuit 107 is used together with the crop circuit 105, when the enlargement circuit 107 is not used together with the crop circuit 105, the enlargement circuit 107 can be used together with the crop circuit 104. When the enlargement circuit 107 is used together with the crop circuit 104, the enlargement circuit 107 is disposed after the crop circuit 104. The crop circuit 104 performs cropping to crop a portion of image data from the 4K YUV format image data 203, and stores the cropped image data in the RAM 111. The enlargement circuit 107 generates 2K display image data by resizing (enlarging) the image data obtained by the cropping process of the crop circuit 104.

[0036] 3 is a schematic diagram showing a specific example of the partial enlargement function (crop zoom function or Magnify function). The crop circuit 105 (or the crop circuit 104) acquires 4K YUV format image data generated by the image processing unit 103, and cuts out an image 303 of an area 302 designated by the user from an input image 301 represented by the image data. The enlargement circuit 107 enlarges the image 303 to generate display image data 304.

[0037] As described above, the imaging device 100 can use the enlargement circuit 107 together with the crop circuit 104, or can use the enlargement circuit 107 together with the crop circuit 105. However, the imaging device 100 has only one enlargement circuit 107, and cannot use the enlargement circuit 107 together with both the crop circuit 104 and the crop circuit 105. For this reason, the imaging device 100 can output image data generated by the partial enlargement function from only one of the two external output units 114 and 115.

[0038] In this embodiment, even if there is only one resizing circuit, it is possible to give the user the feeling that a plurality of processes using the crop zoom function or the Magnify function have been performed in parallel.

[0039] Figure 4 is a schematic diagram showing the flow of image data in the imaging device 100, and shows a transition from a state in which the enlargement circuit 107 is used together with the crop circuit 105 (the state in Figure 2) to a state in which the enlargement circuit 107 is used together with the crop circuit 104.

[0040] The crop circuit 104 performs crop processing to crop a portion of image data from 4K YUV format image data 401, and stores the cropped image data in the RAM 111 as display image data 402. The enlargement circuit 107 performs resizing (enlargement processing) on the display image data 402 to generate 2K display image data 403. The enlargement circuit 107 stores the 2K display image data 403 in the RAM 111. The 2K display image data 403 is output to the outside via the external output unit 114 as display image data 404, and is displayed as video 410 on the external display 116.

[0041] The crop circuit 105 crops image data of a 2K region from 4K YUV format image data 401 and stores it in the RAM 111 as display image data 405. The 2K display image data 405 is output to the outside via the external output unit 115 as display image data 406, and is displayed as video 411 by the external switcher 117.

[0042] FIG. 5 is a schematic diagram showing a specific example of the above processing by the crop circuit 105.

[0043] The crop circuit 105 acquires YUV image data generated by the image processing unit 103. Here, it is assumed that in the state before transition to the state of Fig. 4 (the state of Fig. 2), the crop circuit 105 has cropped an image of an area 502 designated by the user from an input image 501 (401) represented by the acquired YUV image data. It is also assumed that the enlargement circuit 107 has enlarged the image of the area 502 to a 2K image 503.

[0044] In the state of Fig. 4, the crop circuit 105 crops out a 2K (predetermined size) area 504, which includes the area 502 cropped by the crop circuit 105 in the state of Fig. 2, from the input image 501 (401) as an image 505 (406). By doing so, in the state of Fig. 4, the angle of view of the image data output from the external output unit 115 can be made substantially the same as in the state of Fig. 2, and the user can be given the feeling that the partial enlargement function is still being used for the image output from the external output unit 115.

[0045] If the size of region 502 is larger than 2K, the entire input image 501 (4K image) may be output without cropping the image by crop circuit 105. If the size of region 502 is smaller than HD, crop circuit 105 crops the HD region including region 502 from input image 501. Sizes (resolutions) such as 4K, 2K, and HD are merely examples and do not limit the present invention.

[0046] Figure 6 is a schematic diagram showing the flow of image data in the imaging device 100, and shows a transition from a state in which the enlargement circuit 107 is used together with the crop circuit 104 (the state in Figure 4) to a state in which the enlargement circuit 107 is used together with the crop circuit 105.

[0047] The crop circuit 105 performs crop processing to crop a portion of image data from 4K YUV format image data 601, and stores the cropped image data in the RAM 111 as display image data 604. The enlargement circuit 107 performs resizing (enlargement processing) on the display image data 604 to generate 2K display image data 605. The enlargement circuit 107 stores the 2K display image data 605 in the RAM 111. The 2K display image data 605 is output to the outside via the external output unit 115 as display image data 606, and is displayed as video 611 by the external switcher 117.

[0048] The crop circuit 104 converts the entire 4K YUV format image data 601 into 2K image data. At this time, the crop circuit 104 makes the area that the crop circuit 104 cut out in the state before the transition to the state of FIG. 6 (the state of FIG. 4) identifiable using the OSD generation circuit 106. The 2K image data, some of which are made identifiable, is used as the display image data. The 2K display image data 602 is stored in the RAM 111 as display image data 602. The 2K display image data 602 is output to the outside via the external output unit 114 as display image data 603, and an image based on the 2K display image data 602 is displayed on the external display 116. The external display 116 displays an image 610 in which the identifiable area is enlarged based on the 2K display image data 603.

[0049] 7 is a schematic diagram showing a specific example of the above-described processing by the crop circuit 104 and the OSD generation circuit 106. The crop circuit 104 acquires and outputs YUV format image data (input image 701 (601)) generated by the image processing unit 103. The OSD generation circuit 106 generates an image 703 (602) by superimposing a frame 702 indicating the area cropped by the crop circuit 104 in the state of FIG. 4 on the input image 701. This allows the external device to automatically enlarge and display the area enclosed by the frame 702, giving the user the feeling that the partial enlargement function is being continuously used for the image output from the external output unit 114.

[0050] It should be noted that the external device does not have to automatically enlarge the area of frame 702. For example, the external device may display image 703 and enlarge the area of frame 702 in response to an enlargement instruction from the user. The user may specify the area to be enlarged when issuing an enlargement instruction. Displaying frame 702 allows the user to easily specify the area of frame 702.

[0051] The image on which the frame 702 is superimposed may be a part of the input image as long as it includes the area of the frame 702. For example, the cropping circuit 104 may crop a part of the input image 701 from the input image 701, and the OSD generating circuit 106 may superimpose the frame 702 on the area cropped by the cropping circuit 104.

[0052] The method for making an area identifiable is not limited to the superimposition of a frame. For example, the brightness or color of the area may be changed, the area may be masked, the start and end points of the area may be emphasized, or metadata indicating the area (for example, coordinate information of the start and end points of the area) may be added to the image data.

[0053] The area to be cropped by crop circuit 104 after transition from the state of Fig. 4 to the state of Fig. 6 may be set. If an area that does not include the area of frame 702 is set as the area to be cropped by crop circuit 104, an image of the set area may be output to an external device without frame 702 being superimposed (without making the area of frame 702 discernible). Alternatively, an image of the set area may be output to an external device with frame 702 being superimposed (making the area of frame 702 discernible).

[0054] FIG. 8A is a flowchart of image output processing performed by the imaging device 100. The image output processing of FIG. 8A is realized by the microcomputer 108 loading a program stored in the ROM 110 into the RAM 111 and executing it. For example, when an external device is connected to the imaging device 100, the microcomputer 108 starts the image output processing of FIG. 8A. Here, the external output unit 114 will be described as the first terminal and the external output unit 115 as the second terminal. The image output processing is processing in which the image processing unit 103 performs various image processes on the imaging signal generated by the image sensor 102, and the 4K YUV format image data stored in the RAM 111 is output from the first terminal and the second terminal to the external device. In the image output processing, output images to be output from the first terminal and the second terminal are determined, and display image data, which is an output image, is generated from the image data 203 using the crop circuits 104 and 105, the enlargement circuit 107, etc., and stored in the RAM 111. Then, the external output units 114 and 115 perform processing to output the display image data stored in the RAM 111 from the first terminal and the second terminal, respectively.

[0055] In S801, the microcomputer 108 sets the entire image data 203, which is the input image, as the initial setting, as the output image of the first terminal and the second terminal. If the entire input image is determined as the output image, the 4K image data 203, which is the input image, becomes the output image without processing in the crop circuits 104 and 105 and the enlargement circuit 107. Then, in S802, the microcomputer 108 outputs the output image determined in S801 from the first terminal and the second terminal, which are the external output unit 114 and the external output unit 115, respectively.

[0056] In S803, the microcomputer 108 determines whether an operation to change the setting of the crop zoom function has been performed, and if it is determined that an operation to change the setting of the crop zoom function has been performed, the process proceeds to S804, where the crop zoom setting change process is performed; otherwise, the process proceeds to S805. The crop zoom setting change process in S804 will be described in detail later with reference to FIG. 8B.

[0057] In S805, the microcomputer 108 determines whether an operation to change the setting of the Magnify function has been performed, and if it is determined that an operation to change the setting of the Magnify function has been performed, the microcomputer 108 proceeds to a Magnify setting change process in S806, and if not, the microcomputer 108 proceeds to S807. The Magnify setting change process in S806 will be described in detail later with reference to FIG. 8C.

[0058] In S807, the microcomputer 108 determines whether an operation to change the crop function setting for the output of the first terminal has been performed. If it is determined that an operation to change the crop function setting for the first terminal has been performed, the process proceeds to S808; otherwise, the process proceeds to S809. In S808, the microcomputer 108 determines an output image according to the crop function setting changed in S807. If the crop function has been changed to ON, the microcomputer 108 determines a central 2K crop area of the 4K input image as the output image. If the crop area has been changed, the microcomputer 108 determines the changed crop area as the output image. When the crop area is to be the output image, the microcomputer 108 controls the crop circuit 104 to crop the determined crop area from the 4K input image, generate 2K display image data, and output the data from the first terminal. If the crop function has been changed to OFF, the microcomputer 108 determines the entire 4K input image as the output image, and controls the 4K input image to be output from the first terminal.

[0059] In S809, the microcomputer 108 determines whether an operation to change the crop function setting for the output of the second terminal has been performed. If it is determined that an operation to change the crop function setting for the second terminal has been performed, the process proceeds to S810. If not, the process proceeds to S811 without changing the output image. In S810, the microcomputer 108 executes the same process as in S808 for the second terminal. That is, the microcomputer 108 determines the output image according to the crop function setting changed in S809. If the crop function is changed to ON, the microcomputer 108 determines the central 2K crop area of the 4K input image as the output image. If the crop area is changed, the microcomputer 108 determines the changed crop area as the output image. When the crop area is to be the output image, the microcomputer 108 controls the crop circuit 105 to crop the determined crop area from the 4K input image, generate 2K display image data, and output the 2K display image data from the second terminal. When the crop function is changed to OFF, the microcomputer 108 determines the entire 4K input image as the output image, and performs control so that the 4K input image is output from the second terminal.

[0060] In S811, the microcomputer 108 generates the output image determined by the processes of S801 to S810 through the processes of the image processing unit 103, crop circuits 104 and 105, and enlargement circuit 107. Then, the generated output image is output from the first terminal and the second terminal, which are the external output units 114 and 115, respectively. 08 repeatedly executes the processes of S803 to S811.

[0061] Next, the crop zoom setting change processing of S804 will be described with reference to FIG. 8B.

[0062] In S821, the microcomputer 108 determines whether the operation to change the crop zoom function setting determined in S803 was an operation to change the image to be output to the first terminal. If it was an operation to change the crop zoom function setting of the first terminal, the process proceeds to S822, and if it was an operation to change the crop zoom function setting of the second terminal, the process proceeds to S833.

[0063] In S822, the microcomputer 108 determines whether the Magnify function is ON for the second terminal, that is, whether the Magnify function has been used. If the Magnify function has been used, the process proceeds to S823; if not, the process proceeds to S829. The process proceeds to S823 when, for example, a transition occurs from the state of FIG. 2 to the state of FIG. 4.

[0064] In S823, the microcomputer 108 automatically switches from the Magnify function to the simple crop function for the second terminal. That is, as shown in Fig. 2, the microcomputer 108 switches from a state in which the enlargement circuit 107 is used to generate display image data (output image) for the external output unit 115 (second terminal) to a state in which the enlargement circuit 107 is not used to generate display image data for the external output unit 115, as shown in Fig. 4. By switching to the simple crop function for the second terminal and not using the enlargement circuit 107, the enlargement circuit 107 becomes available for the first terminal, and an output image can be generated for the first terminal using the crop zoom function.

[0065] In S829, the microcomputer 108 determines whether the crop zoom function is ON for the second terminal, that is, whether the crop zoom function is being used. If the crop zoom function is being used, the process proceeds to S830; if not, the process proceeds to S831. The process proceeds to S830 when, for example, a transition is made from the state in FIG. 2 to the state in FIG. 4, as in the case of proceeding to S823.

[0066] In S830, the microcomputer 108 automatically switches from the crop zoom function to the simple crop function for the second terminal. That is, as shown in Fig. 2, the microcomputer 108 switches from a state in which the enlargement circuit 107 is used to generate display image data (output image) for the external output unit 115 (second terminal) to a state in which the enlargement circuit 107 is not used to generate display image data for the external output unit 115, as shown in Fig. 4. By switching to the simple crop function and not using the enlargement circuit 107 for the second terminal, the enlargement circuit 107 becomes available for the first terminal, and an output image can be generated for the first terminal using the crop zoom function.

[0067] In S831, the microcomputer 108 does not change the output image of the second terminal, and proceeds to S832.

[0068] In S824, the microcomputer 108 determines whether the size of the area (crop area) cropped by the crop circuit corresponding to the second terminal before switching to the simple crop function in S823 or S830 is greater than 2K (threshold value). If the size of the crop area is greater than 2K, proceed to S828; if not, proceed to S825.

[0069] In step S825, the microcomputer 108 determines whether the area that was cropped by the crop circuit corresponding to the second terminal before switching to the simple crop function in step S823 or S830 is the area that was cropped by the crop circuit corresponding to the second terminal. It is determined whether the size of the crop area (cropping area) is larger than HD (threshold value). If the size of the cropping area is larger than HD, the process proceeds to S827, and if not, the process proceeds to S826.

[0070] In S826, the microcomputer 108 determines the output image of the second terminal so as to crop and output an HD area including the area (crop area) that was cropped by the crop circuit corresponding to the second terminal before switching to the simple crop function in S823 or S830, and then controls the crop circuit 105 corresponding to the second terminal so as to crop the determined output image.

[0071] In S827, the microcomputer 108 determines the output image of the second terminal so as to crop and output a 2K area including the area (crop area) that was cropped by the crop circuit corresponding to the second terminal before switching to the simple crop function in S823 or S830, and then controls the crop circuit 105 corresponding to the second terminal so as to crop the determined output image.

[0072] In S828, the microcomputer 108 determines the output image of the second terminal so as to output the entire 4K YUV format image data (input image). Then, it controls the crop circuit 105 corresponding to the second terminal so as to crop the determined output image. To output the entire input image, the 4K YUV format input image stored in the RAM 111 may be output by the external output unit 115 without going through the crop circuit.

[0073] For the output image output from the second terminal, the image data output from the crop circuit 105 is stored in the RAM 111. The image data output from the crop circuit 105 is read out from the RAM 111, output to the outside via the external output unit 115, and displayed by the external switcher 117.

[0074] In S832, the microcomputer 108 determines an output image for the first terminal in response to the operation for changing the setting of the crop zoom function determined in S803. To execute the crop zoom function, the microcomputer 108 generates display image data (output image) from 4K YUV format image data (input image) using the crop circuit 104 and the enlargement circuit 107, as shown in FIG. 4, and controls the image data to be stored in the RAM 111. That is, the crop circuit 104 is controlled to cut out a portion of the image data from the 4K YUV format image data (input image), and the enlargement circuit 107 is controlled to be used together with the crop circuit 104. As a result, the crop circuit 104 cuts out a portion of the image data from the 4K YUV format image data through crop processing and stores the cut-out image data in the RAM 111. The enlargement circuit 107 resizes (enlarges) the image data cut out by the crop circuit 104, thereby generating 2K display image data, and stores the 2K display image data in the RAM 111. The 2K display image data is output to the outside via the external output unit 114 by the process of S811, and is displayed on the external display .

[0075] In S832, after the crop zoom setting change processing in S804 is completed, the process proceeds to S811 in FIG. 8A.

[0076] 9 is a schematic diagram showing a specific example of the operation of the imaging device 100. It is assumed that the image processing unit 103 generates an input image 900.

[0077] If the area (cropped area) cut out by the crop circuit 105 before switching to the simple crop function is an area 901 smaller than the HD, steps S824 to S825 are performed. The process proceeds from S825 to S826. Under the control of S826, the crop circuit 105 crops an HD area 902 including the area 901 from the input image 900, and outputs it as an image 903. Then, under the control of S811, the image 903 is displayed on the external switcher 117 as video 904.

[0078] If the area (crop area) that the crop circuit 105 had cropped before switching to the simple crop function was area 911 that was larger than HD and smaller than 2K, the process proceeds from S824 to S825, and from S825 to S827. Under the control of S827, the crop circuit 105 crops a 2K area 912 that includes area 911 from the input image 900, and outputs it as image 913. Then, under the control of S811, the image 913 is displayed on the external switcher 117 as video 914.

[0079] If the area (crop area) that the crop circuit 105 had cropped before switching to the simple crop function was an area 921 larger than 2K, the process proceeds from S824 to S828. Under the control of S828, the crop circuit 105 outputs the entire input image 900. Then, under the control of S811, the input image 900 is displayed on the external switcher 117 as video 924.

[0080] According to the above operation, the angle of view of the image output from the second terminal can be roughly maintained from before switching to the simple crop function (when the crop zoom function or Magnify function was in use), which in turn makes it easier for the user to check and adjust the focus.

[0081] Next, the processing (S833 to S846) when an operation to change the setting of the crop zoom function of the second terminal is performed will be described. This processing basically corresponds to the processing (S822 to S832) when an operation to change the setting of the crop zoom function of the second terminal is performed. In the processing of S822 to S832, the first terminal and the second terminal are interchanged, and the crop circuit 104 corresponding to the first terminal and the crop circuit 105 corresponding to the second terminal are also interchanged. The processing that simply interchanges the terminals and crop circuits will not be described here, as it is the same processing, and the differences from S822 to S832 will be mainly described.

[0082] S833 to S841 correspond to S822 to S830, respectively, and S845 and S846 correspond to S831 and S832, respectively. After the crop zoom function of the first terminal is released in S841, the process proceeds to S842.

[0083] In S842, the microcomputer 108 acquires EDID information, including information on whether the external device has a function for enlarging an image (partial enlargement function), from the external device connected to the first terminal via the first terminal. EDID information is information that can be acquired according to the HDMI standard. In this embodiment, the first terminal is an HDMI-standard terminal, and the second terminal is not an HDMI-standard terminal. Therefore, when an operation to change the setting of the crop zoom function of the second terminal is performed and the crop zoom function of the first terminal is to be released, the microcomputer 108 executes the processes of S842 to S844.

[0084] The method for acquiring information about external devices is not limited to the above method, and other information may be used instead of EDID information of the HDMI standard for information about whether an external device has a function for enlarging an image. For example, the information may be acquired from a manufacturer's website via a network. If the information about whether an external device has a function for enlarging an image can be acquired, the processing corresponding to S842 to S844 may be executed even when the crop zoom function of the second terminal is disabled in S830. The information about external devices may be stored in advance in the imaging device 100.

[0085] In S843, the microcomputer 108 determines whether the external device connected to the first terminal has a function for enlarging an image (partial enlargement function) according to the information acquired in S842. If the external device has the partial enlargement function, the process proceeds to S844; otherwise, the process proceeds to S839. If the external device does not have the partial enlargement function, the process may proceed to S835.

[0086] In S844, the microcomputer 108 identifies the area that was output to the first terminal before the crop zoom function was released in S841, i.e., the area (crop area) that was cropped by the crop circuit 104 corresponding to the first terminal. Then, the microcomputer 108 performs control so that 4K YUV format image data (input image) is output so that the identified crop area can be identified. The microcomputer 108 controls the crop circuit 104 corresponding to the first terminal so that the entire 4K YUV format image data (input image) is output. Then, the microcomputer 108 controls the OSD generation circuit 106 so that a frame (crop frame) indicating the crop area is superimposed on the image output from the crop circuit 104 corresponding to the first terminal.

[0087] In S844, the cropping circuit 104 is controlled to output image data (input image) in 4K and YUV format. Then, the OSD generation circuit 106 is controlled to superimpose a cropping frame on the image output from the cropping circuit 104. As a result, display image data representing the image on which the cropping frame is superimposed is stored in the RAM 111. This display image data is output to the outside via the external output unit 114 by the processing of S811, and is displayed on the external display 116.

[0088] 10 is a schematic diagram showing a specific example of the operation of the imaging device 100. It is assumed that the image processing unit 103 generates an input image 1000.

[0089] If the external display 116 has a partial enlargement function, the process proceeds from S843 to S844. Under the control of S844, an image 1002 is generated by superimposing a cropping frame 1001 on the input image 1000. Here, the cropping frame is a frame indicating the area that was output from the first terminal before the crop zoom function of the first terminal was released in S841, that is, the area that was cropped by the crop circuit 104 (crop area). Then, under the control of S811, the image 1002 is output to the external switcher 117. On the external display 116, an image 1003 in which the cropping area (the area of the cropping frame 1001) is enlarged is displayed.

[0090] If the external display 116 does not have a partial enlargement function, the process proceeds from S843 to S839. Under the control of S839, the crop circuit 104 outputs the entire input image 1000. Then, under the control of S811, the input image 1000 is displayed on the external display 116 as the video 1013.

[0091] According to the above operation, if the external device connected to the first terminal has a partial enlargement function, the external device can display an image with the same angle of view as before the crop zoom function of the first terminal was released in S841.

[0092] Next, the Magnify setting change process in S806 will be described with reference to FIG. 8C.

[0093] In S851, the microcomputer 108 determines whether the crop zoom function is being executed. That is, it determines whether the enlargement circuit 107 is being used by executing the crop zoom function at the first terminal or the second terminal. If it is determined that the crop zoom function is being used, the process proceeds to S852; otherwise, the process proceeds to S853.

[0094] In S852, the microcomputer 108 notifies the user that the Magnify function cannot be executed because the crop zoom function is currently being executed. The notification is made by, for example, displaying a message to that effect on a display unit (not shown) of the imaging device. In this embodiment, the crop zoom function takes priority over the Magnify function. Therefore, if the crop zoom function is already being executed, the Magnify function cannot be executed. If the crop zoom function is being executed for the same terminal as the terminal set as the target for the Magnify function, the crop zoom function may be switched to the Magnify function.

[0095] In S853, the microcomputer 108 determines whether the operation to change the setting of the Magnify function determined in S805 was a press of the MAGN button, that is, an operation to switch the Magnify function ON / OFF. If it is determined to be an operation to switch the Magnify function ON / OFF, the process proceeds to S854, and if it is determined to be an operation to change the position or size of the crop area in the Magnify function rather than an operation to switch the Magnify function ON / OFF, the process proceeds to S855.

[0096] In S854, the microcomputer 108 performs ON / OFF switching processing for the Magnify function. For a terminal set in the menu as the target of the Magnify function, switching is performed between outputting an image using the Magnify function or outputting the entire input image. When switching to outputting an image using the Magnify function, the microcomputer 108 determines the AF area as the output image. Then, of the crop circuits 104 and 105, the microcomputer 108 controls the crop circuit corresponding to the terminal set as the target of the Magnify function so as to crop the area set as the AF area as a crop area. Then, the microcomputer 108 controls the enlargement circuit 107 so as to resize the image cropped by the crop circuit and generate 2K display image data. When switching the Magnify function OFF, the microcomputer 108 controls the crop circuit corresponding to the terminal set as the target of the Magnify function so as to output the entire 4K YUV format image data (input image). To output the entire input image, the 4K YUV format input image stored in the RAM 111 may be output without going through the crop circuit.

[0097] In S855, the microcomputer 108 performs processing to change the output image in accordance with the change operation of the position or size of the area by the Magnify function determined in S805 and S853. That is, the microcomputer 108 controls the crop circuit corresponding to the terminal targeted by the Magnify function so as to change the crop area to the position / size changed by the change operation. The microcomputer 108 then controls the enlargement circuit 107 so as to resize the image cropped by the crop circuit and generate 2K display image data.

[0098] After the processing of S854 or S855 is executed, the Magnify setting change processing ends and the process returns to Fig. 8A, and the display image data generated under the control of S854 or S855 is output to the outside from the terminal set as the target of the Magnify function by the processing of S811. When the processing of S852 is executed, the output image is not changed in the Magnify setting change processing. After the processing of S852 is executed, the Magnify setting change processing ends and the process returns to Fig. 8A, and the display image data of the same area as before the Magnify setting change processing is output to the outside from the terminal set as the target of the Magnify function by the processing of S811.

[0099] In the above description, the various controls described as being performed by microcomputer 108 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0100] Furthermore, although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. The above-described embodiments merely illustrate embodiments of the present invention, and various embodiments may be combined as appropriate. For example, although different processing is performed for terminals that have not been changed when the crop zoom setting is changed depending on whether the Magnify function is being used or the crop zoom function is being used, this is not necessarily the case. In either of these two cases, for terminals that have not been changed, the processing may be switched to the simple crop function before proceeding to S824 / S835, or the processing may be switched to the simple crop function before proceeding to S842. When the crop zoom setting is changed, if the Magnify function is being used for terminals that have not been changed, the processing may proceed to S841, and if the crop zoom function is being used, the processing may proceed to S823 / S834. Furthermore, the present invention may be applied to devices that perform cropping and resizing using general-purpose circuits or software processing, rather than devices with two crop circuits and one resizing circuit. The resizing process requires a high processing load, and therefore the effects of the present invention are particularly evident when multiple resizing processes cannot be performed simultaneously. In the above-described embodiment, the two functions of cropping and resizing an input image to generate an output image, namely, the Magnify function and the Crop Zoom function, have been described. However, the Magnify function and the Crop Zoom function may be treated as the same function.

[0101] Furthermore, in the above-described embodiment, the present invention has been described as being applied to an imaging device (digital camera), but this is not limited to this example and can be applied to any electronic device (image processing device) that can input and output images. For example, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printers, digital photo frames, music players, game consoles, e-book readers, etc. Furthermore, the present invention can be applied to video players, display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances, in-vehicle devices, etc.

[0102] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0103] The disclosure of this embodiment includes the following configuration, method, program, and medium. (Configuration 1) a first cutout means capable of cutting out and outputting a partial area of an input image; a second cutout means capable of cutting out and outputting a partial area of the input image; an enlargement means used together with one of the first cutout means and the second cutout means, for enlarging the area cut out by the first cutout means or the second cutout means; and When the enlargement means transitions from a first state in which it is used together with the first cropping means to a second state in which it is used together with the second cropping means, the first cropping means crops out from the input image an area of a predetermined size including the area cropped by the first cropping means in the first state and outputs the area. 1. An image processing device comprising: (Configuration 2) When the state transitions from the first state to the second state, if the size of the area cut out by the first cut-out means in the first state is larger than a first threshold, the first cut-out means outputs the input image. 2. The image processing device according to configuration 1, (Configuration 3) When the first state is transitioned to the second state, if the size of the area cut out by the first cutout means in the first state is smaller than the first threshold value and larger than the second threshold value, the first cutout means cuts out an area of a first size from the input image and outputs it; If the size of the area cut out by the first cutout means in the first state is smaller than the second threshold, the first cutout means cuts out an area of a second size smaller than the first size from the input image and outputs it. 3. The image processing device according to configuration 2. (Configuration 4) The device further includes a control means for controlling the device to notify the user that the second function cannot be executed when an instruction is given to use the enlargement means together with the second extraction means for a second function while the enlargement means is being used together with the first extraction means for a first function. 4. The image processing device according to any one of configurations 1 to 3. (Configuration 5) The first cutout means performs different processes in the following cases: (1) when the enlargement means is used together with the first cutout means for a first function and the state transitions to the second state; and (2) when the enlargement means is used together with the first cutout means and the state transitions to the second state and the state transitions to the second state. 5. The image processing device according to any one of configurations 1 to 4. (Configuration 6) a first cutout means capable of cutting out and outputting a partial area of an input image; a second cutout means capable of cutting out and outputting a partial area of the input image; an enlargement means used together with one of the first cutout means and the second cutout means, for enlarging the area cut out by the first cutout means or the second cutout means; and When a transition is made from a first state in which the area cut out by the first cutout means is enlarged by the enlargement means and output to an external device to a second state in which the enlargement means is used together with the second cutout means, the first cutout means outputs an image including the area cut out by the first cutout means in the first state so that the area can be identified. 1. An image processing device comprising: (Configuration 7) When the state transitions from the first state to the second state, the first cropping means outputs the input image in such a way that the region cropped by the first cropping means in the first state can be identified. 7. The image processing device according to configuration 6, (Configuration 8) When the external device transitions from the first state to the second state, if the external device does not have a function for enlarging an image, the first cropping means outputs an image including the area cropped by the first cropping means in the first state without making the area identifiable. 8. The image processing device according to configuration 6 or 7, (Configuration 9) An acquisition means for acquiring information on whether the external device has a function for enlarging an image. Further having 9. The image processing device according to configuration 8, (Configuration 10) The acquiring means includes the information on whether the external device has a function to enlarge an image. Obtain EDID information from the external device 10. The image processing device according to configuration 9, (Configuration 11) an area to be cut out by the first cutout means after transition from the first state to the second state can be set; When the state transitions from the first state to the second state, if an area that does not include the area that the first cropping means had cropped in the first state is set as the area to be cropped by the first cropping means after the state transitions from the first state to the second state, the first cropping means outputs an image of the set area without making the area that the first cropping means had cropped in the first state identifiable; When the state transitions from the first state to the second state, if an area including the area cut out by the first cut-out means in the first state is set as an area to be cut out by the first cut-out means after the state transitions from the first state to the second state, the first cut-out means outputs an image of the set area so that the area cut out by the first cut-out means in the first state can be identified. 11. The image processing device according to any one of configurations 6 to 10. (Method 1) a first cutout means capable of cutting out and outputting a partial area of an input image; a second cutout means capable of cutting out and outputting a partial area of the input image; an enlargement means used together with one of the first cutout means and the second cutout means, for enlarging the area cut out by the first cutout means or the second cutout means; A control method for an image processing device having controlling a state of the image processing device so as to transition from a first state in which the enlargement means is used together with the first cut-out means to a second state in which the enlargement means is used together with the second cut-out means; a step of controlling processing of the first cropping means so that, when transitioning from the first state to the second state, a region of a predetermined size including the region cropped by the first cropping means in the first state is cropped from the input image and outputted; A control method comprising: (Method 2) a first cutout means capable of cutting out and outputting a partial area of an input image; a second cutout means capable of cutting out and outputting a partial area of the input image; an enlargement means used together with one of the first cutout means and the second cutout means, for enlarging the area cut out by the first cutout means or the second cutout means; A control method for an image processing device having controlling a state of the image processing device so that the state transitions from a first state in which the area cut out by the first cutout means is enlarged by the enlargement means and output to an external device to a second state in which the enlargement means is used together with the second cutout means; when transitioning from the first state to the second state, controlling processing of the first cropping means so as to output an image including the area cropped by the first cropping means in the first state in a manner that makes the area identifiable; A control method comprising: (program) A program for causing a computer to execute each step of the control method according to Method 1 or 2. (medium) A computer-readable storage medium storing a program for causing a computer to execute each step of the control method according to Method 1 or 2. [Explanation of symbols]

[0104] 100: Imaging device 104, 105: Crop circuit 107: Enlargement circuit

Claims

1. a first cutout means capable of cutting out and outputting a partial area of an input image; a second cutout means for cutting out a partial area of the input image and outputting the cutout area; an enlargement means used together with one of the first cutout means and the second cutout means, for enlarging the area cut out by the first cutout means or the second cutout means; and When the enlargement means transitions from a first state in which it is used together with the first cut-out means to a second state in which it is used together with the second cut-out means, the first cut-out means cuts out an area of a predetermined size including the area cut out by the first cut-out means in the first state from the input image and outputs it.

1. An image processing device comprising:

2. When the state transitions from the first state to the second state, if the size of the area cut out by the first cutout means in the first state is larger than a first threshold, the first cutout means outputs the input image.

2. The image processing device according to claim 1, wherein:

3. When the first state is transitioned to the second state, if the size of the area cut out by the first cutout means in the first state is smaller than the first threshold value and larger than the second threshold value, the first cutout means cuts out an area of a first size from the input image and outputs it; If the size of the area cut out by the first cutout means in the first state is smaller than the second threshold, the first cutout means cuts out an area of a second size smaller than the first size from the input image and outputs it.

3. The image processing device according to claim 2.

4. The image processing device further includes control means for controlling the image processing device so that, when an instruction is given to use the enlargement means together with the second extraction means for a second function while the enlargement means is being used together with the first extraction means for a first function, a notification is given that the second function cannot be executed.

2. The image processing device according to claim 1, wherein:

5. (1) When the enlargement means is used together with the first extraction means for a first function and the state transitions to the second state, and (2) when the enlargement means is used together with the first extraction means and the state transitions to the second state for a second function, the first extraction means performs different processing.

2. The image processing device according to claim 1, wherein:

6. a first cutout means capable of cutting out and outputting a partial area of an input image; a second cutout means for cutting out a partial area of the input image and outputting the cutout area; an enlargement means used together with one of the first cutout means and the second cutout means, for enlarging the area cut out by the first cutout means or the second cutout means; and When the state transitions from a first state in which the area cut out by the first cutout means is enlarged by the enlargement means and output to an external device to a second state in which the enlargement means is used together with the second cutout means, the first cutout means outputs an image including the area cut out by the first cutout means in such a way that the area cut out by the first cutout means in the first state can be identified. Output 1. An image processing device comprising:

7. When the state transitions from the first state to the second state, the first cropping means outputs the input image in such a way that the region cropped by the first cropping means in the first state can be identified.

7. The image processing device according to claim 6,

8. When the external device transitions from the first state to the second state, if the external device does not have a function for enlarging an image, the first cropping means outputs an image including the area cropped by the first cropping means in the first state without making the area identifiable.

8. The image processing device according to claim 6, wherein the image processing device is a computer.

9. An acquisition means for acquiring information on whether the external device has a function for enlarging an image. Further having 9. The image processing device according to claim 8,

10. The acquiring means acquires, from the external device, EDID information including the information as to whether the external device has a function for enlarging an image.

10. The image processing device according to claim 9,

11. an area to be cut out by the first cutout means after transition from the first state to the second state can be set; When the state transitions from the first state to the second state, if an area that does not include the area that the first cropping means had cropped in the first state is set as the area to be cropped by the first cropping means after the state transitions from the first state to the second state, the first cropping means outputs an image of the set area without making the area that the first cropping means had cropped in the first state identifiable; When the state transitions from the first state to the second state, if an area including the area cut out by the first cut-out means in the first state is set as an area to be cut out by the first cut-out means after the state transitions from the first state to the second state, the first cut-out means outputs an image of the set area so that the area cut out by the first cut-out means in the first state can be identified.

8. The image processing device according to claim 6, wherein the image processing device is a computer.

12. a first cutout means capable of cutting out and outputting a partial area of an input image; a second cutout means for cutting out a partial area of the input image and outputting the cutout area; an enlargement means used together with one of the first cutout means and the second cutout means, for enlarging the area cut out by the first cutout means or the second cutout means; A control method for an image processing device having controlling a state of the image processing device so as to transition from a first state in which the enlargement means is used together with the first cutout means to a second state in which the enlargement means is used together with the second cutout means; a step of controlling processing by the first cropping means so that, when transitioning from the first state to the second state, a region of a predetermined size including the region cropped by the first cropping means in the first state is cropped from the input image and output. A control method comprising:

13. a first cutout means capable of cutting out and outputting a partial area of an input image; a second cutout means for cutting out a partial area of the input image and outputting the cutout area; an enlargement means used together with one of the first cutout means and the second cutout means, for enlarging the area cut out by the first cutout means or the second cutout means; A control method for an image processing device having controlling a state of the image processing device so that the state transitions from a first state in which the area cut out by the first cutout means is enlarged by the enlargement means and output to an external device to a second state in which the enlargement means is used together with the second cutout means; when transitioning from the first state to the second state, controlling processing of the first cropping means so as to output an image including the area cropped by the first cropping means in the first state in a manner that makes the area identifiable; A control method comprising:

14. A program for causing a computer to execute each step of the control method according to claim 12 or 13.

15. A computer-readable storage medium storing a program for causing a computer to execute each step of the control method according to claim 12 or 13.

Images