Electronic equipment and control method therefor

Abstract

To enable a user to easily grasp states of a plurality of regions (a plurality of videos differing in angle of view) of an image at the same time.SOLUTION: Electronic equipment is characterized in having: selection means for selecting one of a plurality of regions of an image; control means for performing control to display the region selected by the selection means; and changing means for changing a parameter affecting a pixel value of the image as operated by a user, wherein the control means performs control to display information, related to the pixel value, corresponding to a second region different from a first region being displayed among the plurality of regions, over the first region.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an electronic device and a control method thereof, and more particularly to a technique for displaying a partial area of ​​an image. [Background technology]

[0002] There are imaging devices that set a portion of a captured image as a crop area and output a video of the entire captured image (hereinafter referred to as the "overall video") and a video of the crop area (hereinafter referred to as the "cropped video"). The angle of view of the cropped video can be adjusted by changing the position and size of the crop area. In addition, by displaying a frame indicating the crop area superimposed on the entire video, the user (e.g., the photographer) can check the entire video while understanding the crop area (cropped video).

[0003] By using the crop function to cut out (extract) a crop area from a captured image, it is possible to simultaneously output multiple images with different angles of view from a single image capture device. This allows the number of image capture devices used to be reduced in systems that distribute or output video.

[0004] In imaging devices, adjustments are made to the focus, exposure, color balance, etc. of the entire image. Furthermore, when distributing or outputting cropped images, there is a demand for checking the focus, exposure, color balance, etc. of the cropped images to determine whether the cropped images are desirable.

[0005] Patent Document 1 discloses a technology for displaying a full image and a cropped image side by side. The technology disclosed in Patent Document 1 allows a user to instruct exposure adjustment while checking both the full image and the cropped image. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2020-010111 Summary of the Invention [Problem to be solved by the invention]

[0007] However, with the technology disclosed in Patent Document 1, by displaying the entire image and the cropped image side by side, the display size of each image becomes small, making it difficult to check each image. Even when a frame indicating the cropped area is displayed superimposed on the entire image, the inside of the frame (cropped image) is small, making it difficult to check the inside of the frame. In particular, because the liquid crystal panel provided in the imaging device is small, these issues (difficulty in checking the image) become more pronounced when images are displayed on such a liquid crystal panel.

[0008] The present invention aims to enable a user to simultaneously and easily grasp the state of multiple regions in an image (multiple images with different angles of view). [Means for solving the problem]

[0009] The electronic device of the present invention comprises a selection means for selecting one of a plurality of regions in an image, a control means for controlling the display of the region selected by the selection means, and a change means for changing a parameter that affects pixel values ​​of the image in response to a user operation, and the control means changes a parameter that affects pixel values ​​of the image in response to a user operation, the parameter changing means changing a parameter that corresponds to a second region different from a first region being displayed among the plurality of regions. The method is characterized in that the information relating to the pixel values ​​is controlled so as to be displayed superimposed on the first area. [Effects of the Invention]

[0010] According to the present invention, the user can simultaneously and easily grasp the states of multiple regions in an image (multiple images with different angles of view). [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram of an imaging device. [Figure 2] FIG. 2 is a schematic diagram of a captured image. [Figure 3] FIG. 10 is a schematic diagram illustrating switching of a display image. [Figure 4] FIG. 1 is a schematic diagram of a cropped image. [Figure 5] 4 is a flowchart of a video display process according to the first embodiment. [Figure 6] FIG. 1 is a schematic diagram of an entire image. [Figure 7] 10 is a flowchart of a video display process according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] First Embodiment A first embodiment of the present invention will now be described. Fig. 1 is a block diagram showing the configuration of an image capture device 100 as an example of an electronic device to which the present invention can be applied.

[0013] The lens unit 101 has a fixed lens group for focusing light, a variable magnification lens group, an aperture, and a correction lens group, and by controlling these, it corrects the image formation position and adjusts the focus. The lens unit 101 forms an image of a subject on the imaging plane of the image sensor 102.

[0014] The image sensor 102 converts light into an electric charge and generates an imaging signal. The generated imaging signal is output to the image processing unit 104 (via the exposure control unit 103). The image sensor 102 is an imaging element such as a CCD image sensor or a CMOS image sensor. Note that a so-called dual pixel type imaging element may be used, in which all pixels on the imaging surface are each composed of a pair of light receiving elements, and a pair of optical images formed by a microlens at each pixel can be converted into an electrical signal by the pair of light receiving elements.

[0015] The exposure control unit 103 manages and adjusts various parameters (exposure setting information) related to exposure when the image sensor 102 acquires an imaging signal. The exposure setting information can be changed by a user operation. The exposure control unit 103 stores the exposure setting information set by the user in the RAM 113.

[0016] The image processing unit 104 converts the imaging signal input from the image sensor 102 into RAW data (RAW image). Thereafter, the image processing unit 104 performs RAW development processing, including interpolation processing and image quality adjustment processing, on the RAW data to generate image data in YUV format corresponding to the RAW data. The image processing unit 104 stores the generated image data in the RAM 113. The image processing unit 104 can also perform noise reduction processing using the image data stored in the RAM 113.

[0017] The display resizing circuit 105 generates display image data by performing resizing processing on the YUV format image data stored in the RAM 113, and stores the generated display image data in the RAM 113. The display resizing circuit 105 also generates image evaluation data for visualizing information on the image data (for example, display image data), and stores the image evaluation data in the RAM 113.

[0018] The recording resizing circuit 106 generates recording image data by performing resizing processing on the YUV format image data stored in the RAM 113 , and stores the generated recording image data in the RAM 113 .

[0019] The on-screen display (OSD) generation circuit 107 generates OSD data representing various setting menus and graphics such as titles, time, icons, and warning messages, and stores the generated OSD data in RAM 113. The setting menu is, for example, a parameter setting operation screen managed by the exposure control unit 103. The OSD generation circuit 107 can also read image evaluation data from RAM 113 and generate, as OSD data, image data for a waveform monitor image (WFM image) that displays the luminance distribution of an image (video) as a waveform. The OSD generation circuit 107 can also generate, as OSD data, image data for an image in which areas where luminance values ​​are outside the valid range are distinguishable (enhanced) based on the image evaluation data read from RAM 113 and image data corresponding to the image evaluation data. Areas where luminance values ​​are outside the valid range include, for example, overexposed areas where luminance values ​​are higher than a threshold, underexposed areas where luminance values ​​are lower than a threshold, blown-out areas, and crushed-up areas. The stored OSD data can be combined with display image data stored in RAM 113. The composite image data obtained by combining the OSD data with the display image data is displayed on the liquid crystal panel 109 or output from the external output unit 118 to an external display device. The external display device may have a recording function. The composite image data may be transmitted from the network communication unit 119 to a network device.

[0020] The image output circuit 108 reads display image data from the RAM 113 and outputs the read table image data to a liquid crystal panel 109 that is not detachable from the imaging device 100. The image output circuit 108 can also read OSD data from the RAM 113, generate composite image data, and output it to the liquid crystal panel 109.

[0021] The liquid crystal panel 109 displays an image (video) based on the image data output from the image output circuit 108. The liquid crystal panel 109 is, for example, a rear display or an electronic viewfinder (EVF) provided on the rear surface of the imaging device 100. Note that an organic EL panel or the like may be used instead of the liquid crystal panel 109.

[0022] The microcomputer 110 controls the entire imaging device 100 .

[0023] The operation switch group 111 includes a plurality of operation members that accept operations from the user. For example, the operation switch group 111 includes a menu button, a cancel button, four-way keys (up arrow key, down arrow key, left arrow key, and right arrow key), a SET key, and various function switching buttons. The switching buttons may include a button that switches the focus adjustment method between autofocus (AF) and manual focus (MF). The operation switch group 111 may include a switch that selects one of a plurality of operation modes. The plurality of operation modes include, for example, a video camera mode that can capture video, a still image camera mode that can capture still images, a playback mode that can play back images, and a power-off mode that turns off the power of the imaging device 100.

[0024] When the menu button is pressed, a menu screen that allows various settings to be made is displayed on the liquid crystal panel 109. The user can intuitively make various settings using the menu screen displayed on the liquid crystal panel 109, the four-way key, and the SET key. For example, the user can set a part of the captured image stored in the RAM 113 (an image corresponding to the entire image obtained by the image sensor 102) as a crop area. The user can also set multiple crop areas and change the position and size of the crop area. As will be described in detail later, image data of a cropped region can also be generated as display image data. The user can also switch the region of the display image data between the entire region of the captured image and a plurality of regions including one or more cropped regions. The OSD generation circuit 107 can also generate image data of an exposure setting UI as OSD data. In this case, the user can also operate the exposure setting UI.

[0025] If the operation switch group 111 includes a touch panel, the microcomputer 110 can detect the following operations and states on the touch panel. Touching the touch panel with a finger or pen (hereafter referred to as touchdown). The state in which the touch panel is touched with a finger or pen (hereafter referred to as "touch-on"). - Moving your finger or pen while touching the touch panel (hereafter referred to as "touch move"). -Removing your finger or pen from the touch panel (hereinafter referred to as "touch-up"). -Nothing is touching the touch panel.

[0026] These operations and the position information of the finger or pen on the touch panel are notified to the microcomputer 110, which determines what operations have been performed on the touch panel based on the notified information. Regarding touch moves, the direction of movement of the finger or pen moving on the touch panel can also be determined for each vertical and horizontal component of the touch panel based on changes in position coordinates. A stroke is considered to have been drawn when a touchdown is performed on the touch panel, followed by a certain number of touch moves and then a touchup. The operation of quickly drawing a stroke is called a flick. A flick is an operation in which a finger is kept on the touch panel, moved quickly a certain distance, and then released. In other words, it is an operation in which the finger is quickly traced across the touch panel as if flicking. A flick can be determined to have been performed when a touch move of at least a predetermined distance at a predetermined speed is detected, followed by a touchup. A drag can be determined to have been performed when a touch move of at least a predetermined distance at a speed slower than the predetermined speed is detected. The touch panel may be of any type among various types of touch panels such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, or an optical sensor type.

[0027] The ROM 112 is a flash ROM, and stores programs executed by the microcomputer 110. A portion of the area of ​​the ROM 112 is used to hold (back up) information on the system state.

[0028] The RAM 113 is a volatile memory used as a work memory. For example, the RAM 113 is used as a work memory by the microcomputer 110, the exposure control unit 103, the image processing unit 104, the display resizing circuit 105, the recording resizing circuit 106, the OSD generation circuit 107, and the image output circuit 108. The RAM 113 is also used as a work memory by the image compression / expansion circuit 116, the crop control unit 117, the external output unit 118, and the network communication unit 119, which will be described later.

[0029] Specifically, the RAM 113 is used as a memory for temporarily storing the recording image data generated by the recording resizing circuit 106 and the image data read from the SD card 115 in order to perform compression or decompression processing in the image compression / decompression circuit 116. The RAM 113 is also used as a memory for temporarily storing the image data in order to display it on the liquid crystal panel 109 or output it from the external output unit 118. The RAM 113 is also used as a memory for temporarily storing image data of the entire area or crop area of ​​the captured image in order to display it on the liquid crystal panel 109 or output it from the external output unit 118. The RAM 113 is also used as a memory for temporarily storing the system status and the user setting status. The RAM 113 is also used as a memory for temporarily storing the frame indicating the crop area set using the operation switch group 111 and the exposure setting It is also used as a memory for temporarily storing OSD data such as UI and WFM images to be displayed on the liquid crystal panel 109.

[0030] The SD card controller 114 records image data generated by the image compression / decompression circuit 116 and stored in the RAM 113 onto the SD card 115 in accordance with a computer-compatible format, such as a FAT file system. The SD card 115 is a recording medium that is detachable from the imaging device 100, and can also be attached to electronic devices other than the imaging device 100 (for example, a personal computer). The imaging device 100 may be able to record image data onto a non-detachable recording medium (a recording medium built into the imaging device 100).

[0031] The image compression / decompression circuit 116 compresses (encodes) image data stored in the RAM 113 and stores the compressed image data in the RAM 113, and decompresses (decodes) image data read from the SD card 115. For example, the image compression / decompression circuit 116 compresses the image data stored in the RAM 113 using MPEG to generate moving image data, and stores the moving image data in the RAM 113.

[0032] Crop control unit 117 stores crop information indicating the number, size, and position information of crop areas specified via operation switch group 111 in RAM 113. OSD generation circuit 107 can also generate image data of frames indicating crop areas as OSD data based on the crop information. Display resizing circuit 105 can also generate image data of crop areas as display image data based on the crop information.

[0033] The external output unit 118 has an external output terminal such as an SDI terminal or an HDMI (registered trademark) terminal, reads out image data stored in the RAM 113, converts it into a video signal, and outputs it.

[0034] The network communication unit 119 is an interface unit that communicates with the outside world. The network communication unit 119 also manages communication settings with the outside world and stores communication setting information set by user operation in the RAM 113. The network communication unit 119 may perform wired communication via a cable, or may perform wireless communication via an antenna.

[0035] FIG. 2 is a schematic diagram showing an example of an image (captured image) captured by the imaging device 100. The area surrounded by solid line 200 is the entire area of ​​the captured image, the area surrounded by dashed line 201 is the crop area (crop 1 area), and the area surrounded by dashed line 202 is the crop area (crop 2 area). The user can set (specify) a crop area of ​​any size and position by operating the operation switch group 111. A crop frame (OSD) surrounding the crop area may be superimposed on the entire image (image of the entire area) so that the user can grasp the size and position of the crop area. In this case, the position and size of the crop area may be changed by a user operation such as selecting, enlarging, or moving the crop frame. As shown in FIG. 2, multiple crop areas may be selectable.

[0036] FIG. 3 is a schematic diagram showing an example of switching of a display image (image to be displayed). Image 300 is an entire image, image 301 is an image of the crop 1 area (crop 1 image), and image 302 is an image of the crop 2 area (crop 2 image). For example, when the user performs an image switching operation using the operation switch group 111 while the entire image 300 is displayed, the display image transitions from the entire image 300 to the crop 1 image 301. When the user performs another image switching operation, the display image transitions from the crop 1 image 301 to the crop 2 image 302. When the user performs another image switching operation, the display image transitions from the crop 2 image 302 to the entire image 300. The order of switching (transitioning) the display image is not particularly limited, and the display image may be switched between crop images (images of the crop areas) without switching to the entire image. stomach.

[0037] In the first embodiment, while a cropped image is being displayed, information (color information, exposure information, brightness information) about pixel values ​​of another area of ​​the image (whole image or another cropped image) is superimposed on the currently displayed cropped image. This allows the user to simultaneously and easily grasp the status of multiple areas in the image (multiple images with different angles of view) even if parameters that affect pixel values ​​(exposure or white balance) are changed.

[0038] Fig. 4 is a schematic diagram showing an example of a crop 1 image. In Fig. 4, a GUI 401 and WFM images 402 and 403 are displayed superimposed on a crop 1 image 400. The GUI 401 is displayed during exposure adjustment and indicates the current exposure. The WFM images 402 and 403 are examples of exposure information. The WFM image 402 is a WFM image of the crop 2 image, and the WFM image 403 is a WFM image of the entire image.

[0039] Note that only one of the WFM image of the crop 2 video and the WFM image of the entire video (for example, only the WFM image of the crop 2 video) may be displayed. If there are three or more crop areas, WFM images of all crop areas other than the currently displayed crop 1 video may be displayed. A WFM image of the currently displayed crop 1 video may also be displayed.

[0040] Text indicating the maximum and minimum luminance values ​​of an area (whole area or cropped area) separate from the displayed image may be superimposed on the displayed image. The maximum and minimum luminance values ​​may be IRE values ​​or Y values ​​different from the IRE values. A reduced image (reduced image) of an area (whole area or cropped area) separate from the displayed image may be superimposed on the displayed image, with areas where the luminance values ​​are outside the valid range being identifiable.

[0041] If an area (whole area or cropped area) other than the displayed image includes an area where the brightness value is outside the valid range, a predetermined item (a predetermined icon or text indicating the brightness value that is outside the valid range) may be displayed superimposed on the displayed image. Areas where the brightness value is outside the valid range are, for example, areas with blown-out highlights or crushed shadows. If the area (whole area or cropped area) other than the displayed image does not include any blown-out highlights or crushed shadows, a first icon may be displayed. If the area (whole area or cropped area) other than the displayed image includes any blown-out highlights, a second icon may be displayed, and if the area includes any crushed shadows, a third icon may be displayed.

[0042] The above-mentioned text and icons may be displayed in association with the WFM image, or may be displayed in place of the WFM image.

[0043] Fig. 5 is a flowchart of the image display processing performed by the imaging device 100. The image display processing in Fig. 5 is realized by the microcomputer 110 expanding a program stored in the ROM 112 into the RAM 113 and executing it. For example, when the imaging device 100 is started up, the image display processing starts, and the image display processing is repeatedly performed while the imaging device 100 is running.

[0044] In S501, the microcomputer 110 reads out the entire video stored in the RAM 113 and displays it on the liquid crystal panel 109.

[0045] In S502, the microcomputer 110 sets crop areas in response to a user operation using the operation switch group 111. Here, it is assumed that a crop 1 area and a crop 2 area have been set. Under the control of the microcomputer 110, the crop control unit 117 acquires information on the set crop areas (crop information) and stores it in the RAM 113. Then, the OSD generating circuit 107 reads the crop information from the RAM 113, generates a crop frame based on the crop information, and displays the crop frame superimposed on the entire image.

[0046] In S503, the microcomputer 110 selects an area of ​​the image to be displayed after switching in response to a user operation using the operation switch group 111. Here, it is assumed that one of the crop 1 area, crop 2 area, and full image is selected. Information on the selected area is stored in the RAM 113. The user operation performed in S503 is, for example, the image switching operation described above. The user operation performed in S503 is not particularly limited, and may be a user operation of selecting an area of ​​the image to be displayed after switching from a menu screen, or a touch operation of touching the area of ​​the image to be displayed after switching. The user operation performed in S503 may be a user operation using a WebUI provided via a network.

[0047] In S504, the microcomputer 110 reads out the image of the area selected in S503 from the RAM 113 and displays it on the liquid crystal panel 109. As a result, the displayed image is updated (switched).

[0048] In S505, the microcomputer 110 reads information about the area of ​​the display image from the RAM 113 and determines whether the display image is a crop 1 image. If the display image is a crop 1 image, the process proceeds to S506, and if not, the process proceeds to S509.

[0049] In S506, the microcomputer 110 reads the exposure control information from the RAM 113 and determines whether or not exposure adjustment is in progress. If exposure adjustment is in progress, the process proceeds to S507; if not, the video display process ends.

[0050] In S507, the microcomputer 110 reads out the WFM image of the crop 2 video (crop 2 area) from the RAM 113, and displays it superimposed on the crop 1 video.

[0051] In S508, the microcomputer 110 reads out the WFM image of the entire video (entire area) from the RAM 113 and displays it superimposed on the crop 1 video. The WFM image of the crop 2 video and the WFM image of the entire video are displayed side by side.

[0052] In S509, the microcomputer 110 reads information about the area of ​​the display image from the RAM 113 and determines whether the display image is a crop 2 image. If the display image is a crop 2 image, the process proceeds to S510; if not, the image display process ends.

[0053] In S510, the microcomputer 110 reads the exposure control information from the RAM 113 and determines whether or not exposure adjustment is in progress. If exposure adjustment is in progress, the process proceeds to S511; if not, the video display process ends.

[0054] In S511, the microcomputer 110 reads out the WFM image of the crop 1 video (crop 1 area) from the RAM 113, and displays it superimposed on the crop 2 video.

[0055] In S512, the microcomputer 110 reads out the WFM image of the entire video (entire area) from the RAM 113 and displays it superimposed on the crop 2 video. The WFM image of the crop 1 video and the WFM image of the entire video are displayed side by side.

[0056] Although an example has been described in which a WFM image of an area (whole area or crop area) separate from the displayed image is not displayed when exposure adjustment is not being performed (parameters are not being changed), a WFM image may be displayed regardless of whether exposure adjustment is being performed. An example has been described in which a WFM image of an area (whole area or crop area) separate from the displayed image is not displayed when the displayed image is a whole image. However, a WFM image may be displayed regardless of whether the displayed image is the entire image or not.

[0057] Although an example has been described in which multiple WFM images corresponding to multiple regions are displayed side by side, a single WFM image in which multiple portions corresponding to the multiple regions are identifiable may be displayed superimposed on a display image. For example, a single WFM image may include multiple items each representing a multiple portion. In this case, any of the multiple regions may be a display image region. Among the multiple items, an item representing a portion corresponding to a display image region may be displayed in front of the other items. This allows the user to easily distinguish between the portion corresponding to the display image region and the other portions.

[0058] FIG. 6 is a schematic diagram showing an example of an overall image. In FIG. 6, a GUI 501, cropping frames 502 and 503, and a WFM image 504 are displayed superimposed on an overall image 500. The GUI 501 is displayed during exposure adjustment and indicates the current exposure. The cropping frame 502 is a frame that surrounds the crop 1 region, and the cropping frame 503 is a frame that surrounds the crop 2 region. The WFM image 504 is a WFM image of the overall image 500. The WFM image 504 includes an item 505 that indicates a portion corresponding to the crop 1 region and an item 506 that indicates a portion corresponding to the crop 2 region. The items 505 and 506 are, for example, masks that transmit the background with a predetermined transparency. The items 505 and 506 differ, for example, in color, brightness, transparency, etc.

[0059] Note that while a cropped image is being displayed, WFM image 504 may be displayed superimposed on the cropped image. In this case, in WFM image 504, an item indicating a portion corresponding to the currently displayed cropped image (crop area) may be displayed in front of an item indicating a portion corresponding to another crop area. For example, while crop 1 image is being displayed, item 505 may be displayed in front of item 506, and while crop 2 image is being displayed, item 506 may be displayed in front of item 505.

[0060] <Second embodiment> A second embodiment of the present invention will be described below. In the second embodiment, a specific controller can be used to control (operate) the imaging device 100. The specific controller is, for example, a controller that can display multiple areas (whole area and crop areas) of a captured image side by side with good visibility, and may be a WebUI.

[0061] Fig. 7 is a flowchart of the image display processing performed by the imaging device 100. The image display processing in Fig. 7 is realized by the microcomputer 110 expanding a program stored in the ROM 112 into the RAM 113 and executing it. For example, when the imaging device 100 is started up, the image display processing starts, and the image display processing is repeatedly performed while the imaging device 100 is running.

[0062] S701 to S704 are the same as S501 to S504 in the first embodiment (FIG. 5).

[0063] In S705, the microcomputer 110 reads information about the area of ​​the display image from the RAM 113 and determines whether the display image is a cropped image. If the display image is a cropped image, the process proceeds to S706, and if not (if the display image is a full image), the image display process ends.

[0064] In S706, the microcomputer 110 reads the communication setting information from the RAM 113 and determines whether or not control from a controller (a specific controller) is enabled. The enabled state of control from the controller may be interpreted as a state in which instructions from the controller to the imaging device 100 can be accepted. When the control from the controller is enabled In the case where the controller can display multiple areas (whole area and cropped areas) of the captured image side by side with good visibility, the video display process is terminated without displaying a WFM image as in the first embodiment. If the control from the controller is valid, the process proceeds to S707.

[0065] In S707, the microcomputer 110 acquires terminal output information from the external output unit 118 and determines whether or not the video displayed on the liquid crystal panel 109 is being externally output. If external output (distribution) is being performed, it is preferable to check the exposure of the area after switching when switching the area of ​​the displayed video. Therefore, if external output is being performed, the process proceeds to S708, and if not, the video display process ends.

[0066] In S708, the microcomputer 110 determines whether or not an enlarged image is being displayed on the liquid crystal panel 109 (whether or not the image is being enlarged). If an enlarged image is being displayed, the process proceeds to S709, and if not (if a normal-size image is being displayed), the process proceeds to S711.

[0067] In S709, the microcomputer 110 determines the type of enlargement. Enlarged display includes crop enlargement, which is used to enlarge and distribute cropped video, and focus enlargement, which is used to adjust focus. In the case of focus enlargement, the WFM image may interfere with focus confirmation. Therefore, in the case of crop enlargement, the process proceeds to S710, and in the case of focus enlargement, the video display process ends.

[0068] In S710, the microcomputer 110 reads out the WFM image of the crop 1 video, the WFM image of the crop 2 video, and the WFM image of the full video from the RAM 113, and displays them superimposed on the enlarged video.

[0069] S711 to S718 are the same as S505 to S512 in the first embodiment (FIG. 5).

[0070] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.

[0071] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0072] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0073] In the above-described embodiment, the present invention is applied to an imaging device. However, this is not limited to this example, and the present invention can be applied to any electronic device that can control the display of captured images. For example, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printers, digital photo frames, music players, game consoles, e-book readers, etc. The present invention can also be applied to video players, display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances, in-vehicle devices, etc.

[0074] The present invention is not limited to application to the imaging device itself, but can also be applied to a control device that communicates with an imaging device (including a network camera) via wired or wireless communication and remotely controls the imaging device. Examples of devices that remotely control an imaging device include smartphones, tablet PCs, and desktop PCs. The imaging device can be remotely controlled by issuing commands from the control device to the imaging device to perform various operations and settings based on operations or processes performed on the control device. Furthermore, a live view image captured by the imaging device may be received via wired or wireless communication and displayed on the control device.

[0075] <Other embodiments> The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program, or by a circuit that realizes one or more functions.

[0076] The disclosure of this embodiment includes the following configuration, method, program, and medium. (Configuration 1) a selection means for selecting one of a plurality of regions in an image; a control means for controlling the area selected by the selection means to be displayed; a changing means for changing parameters that affect pixel values ​​of the image in response to a user operation; and The control means controls the display of information about pixel values ​​corresponding to a second area, which is different from the first area being displayed, among the plurality of areas, so as to be superimposed on the first area. An electronic device characterized by: (Configuration 2) The parameters include exposure 2. The electronic device according to configuration 1. (Configuration 3) The control means does not control the display of the information corresponding to the second area when the parameter is not being changed. 3. The electronic device according to configuration 1 or 2. (Configuration 4) The control means controls the display so that at least one of color information, exposure information, and luminance information of the second area is superimposed on the first area. 4. The electronic device according to any one of configurations 1 to 3. (Configuration 5) The control means controls the display so that a reduced image of the second area, in which an area where the brightness value is outside the valid range can be identified, is superimposed on the first area. 5. The electronic device according to any one of configurations 1 to 4. (Configuration 6) The control means controls the display of a predetermined item so as to overlap the first area when the second area includes an area whose brightness value is outside a valid range. 6. The electronic device according to any one of configurations 1 to 5. (Configuration 7) The predetermined item includes at least one of a predetermined icon and text indicating a brightness value of the second region outside the valid range. 7. The electronic device according to configuration 6. (Configuration 8) The area where the brightness value is outside the valid range includes at least one of a whiteout area and a blackout area. 8. The electronic device according to any one of configurations 5 to 7. (Configuration 9) When the first area is the entire area of ​​the image, the control means does not control to display the information corresponding to the second area. 9. The electronic device according to any one of configurations 1 to 8. (Configuration 10) When the first area is being enlarged and the enlarged display is for a predetermined function, the control means does not control the second area to be displayed. 10. The electronic device according to any one of configurations 1 to 9. (Configuration 11) the image is a captured image, The predetermined function is focus adjustment. 11. The electronic device according to configuration 10. (Configuration 12) When the first area is not being output to an external device, the control means does not control the second area to display the information corresponding to the first area. 12. The electronic device according to any one of configurations 1 to 11. (Configuration 13) When the electronic device is in a state where it is possible to receive an instruction from a specific controller, the control means does not perform control to display the information corresponding to the second area. 13. The electronic device according to any one of configurations 1 to 12. (Configuration 14) The specific controller is a controller that can display the first area and the second area side by side. 14. The electronic device according to configuration 13. (Configuration 15) The specific controller is the WebUI 15. The electronic device according to configuration 13 or 14. (Configuration 16) The control means controls the display so that the waveform monitor image corresponding to the second area is superimposed on the first area. 16. The electronic device according to any one of configurations 1 to 15. (Configuration 17) The control means controls the display of two or more waveform monitor images corresponding to two or more areas including the second area among the plurality of areas so as to be superimposed on the first area. 17. The electronic device according to any one of configurations 1 to 16. (Configuration 18) The control means controls the display of one waveform monitor image, which corresponds to two or more areas including the second area among the plurality of areas and in which two or more portions corresponding to the two or more areas respectively can be identified, so as to be superimposed on the first area. 17. The electronic device according to any one of configurations 1 to 16. (Configuration 19) the two or more regions include the first region, the waveform monitor image includes two or more items respectively representing the two or more portions; Among the two or more items, an item showing a portion corresponding to the second area is displayed in front of an item showing a portion corresponding to the first area. 19. The electronic device according to configuration 18. (Configuration 20) The control means controls the display of text indicating the maximum and minimum luminance values ​​of the second region so as to be superimposed on the first region. 20. The electronic device according to any one of configurations 1 to 19. (method) a selection step of selecting one of a plurality of regions in the image; a control step of controlling to display the area selected in the selection step; a modifying step of modifying parameters that affect pixel values ​​of the image in response to a user operation; and A control method for an electronic device, characterized in that in the control step, information regarding pixel values ​​corresponding to a second area among the plurality of areas, which is different from the first area being displayed, is controlled so as to be displayed superimposed on the first area. (program) A program for causing a computer to function as each means of the electronic device according to any one of configurations 1 to 20. (medium) A computer-readable storage medium storing a program for causing a computer to function as each means of the electronic device according to any one of configurations 1 to 20. [Explanation of symbols]

[0077] 100: Imaging device 110: Microcomputer

Claims

1. a selection means for selecting one of a plurality of regions in an image; a control means for controlling the area selected by the selection means to be displayed; a changing means for changing parameters that affect pixel values ​​of the image in response to a user operation; and The control means controls the display of information about pixel values ​​corresponding to a second area, which is different from the first area being displayed, among the plurality of areas, so as to be superimposed on the first area. An electronic device characterized by:

2. The parameters include exposure 2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. The control means does not control the display of the information corresponding to the second area when the parameter is not being changed.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

4. The control means controls the display so that at least one of color information, exposure information, and luminance information of the second area is superimposed on the first area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

5. The control means controls the display so that a reduced image of the second area, in which an area where the brightness value is outside the valid range can be identified, is superimposed on the first area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

6. The control means controls the display of a predetermined item so as to overlap the first area when the second area includes an area whose brightness value is outside a valid range.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

7. The predetermined item includes at least one of a predetermined icon and text indicating a luminance value of the second region outside the valid range.

7. The electronic device according to claim 6, wherein the electronic device is a semiconductor device.

8. The area where the brightness value is outside the valid range includes at least one of a whiteout area and a blackout area.

6. The electronic device according to claim 5,

9. When the first area is the entire area of ​​the image, the control means does not control to display the information corresponding to the second area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

10. When the first area is being enlarged and the enlarged display is for a predetermined function, the control means does not control the display of the information corresponding to the second area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

11. the image is a captured image, The predetermined function is focus adjustment.

11. The electronic device according to claim 10.

12. When the first area is not being output to an external device, the control means does not control the second area to be displayed.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

13. When the electronic device is in a state where it can receive an instruction from a specific controller, the control means does not control the electronic device to display the information corresponding to the second area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

14. The specific controller is a controller that can display the first area and the second area side by side.

14. The electronic device according to claim 13.

15. The specific controller is a WebUI 14. The electronic device according to claim 13.

16. The control means controls the display so that the waveform monitor image corresponding to the second area is superimposed on the first area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

17. The control means controls the display of two or more waveform monitor images corresponding to two or more areas including the second area among the plurality of areas so as to be superimposed on the first area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

18. The control means controls the display of one waveform monitor image, which corresponds to two or more areas including the second area among the plurality of areas and in which two or more portions corresponding to the two or more areas respectively can be identified, so as to be superimposed on the first area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

19. the two or more regions include the first region, the waveform monitor image includes two or more items respectively representing the two or more portions; Among the two or more items, an item showing a portion corresponding to the second area is displayed in front of an item showing a portion corresponding to the first area.

20. The electronic device according to claim 18.

20. The control means controls the display of text indicating the maximum and minimum luminance values ​​of the second area so as to be superimposed on the first area.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

21. a selection step of selecting one of a plurality of regions in the image; a control step of controlling to display the area selected in the selection step; a modifying step of modifying parameters that affect pixel values ​​of the image in response to a user operation; and A control method for an electronic device, characterized in that in the control step, information regarding pixel values ​​corresponding to a second area among the plurality of areas, which is different from the first area being displayed, is controlled so as to be displayed superimposed on the first area.

22. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 20.

23. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 20.

Images