electronic machinery

Abstract

This invention provides a technology that can effectively suppress the overlapping of graphics with the video area of ​​an image. [Solution] The electronic device of the present invention is configured to generate an image without images at a predetermined end and to perform graphic superposition, and is characterized in that, when configured to generate an image without images at a predetermined end and to perform graphic superposition, it generates an image without images at a predetermined end based on a first image and generates a second image by superimposing graphics at the predetermined end, and when configured to generate an image without images at a predetermined end and not to perform graphic superposition, it generates a second image based on a first image without generating an image without images at the predetermined end or superimposing graphics.

Description

Technical Field

[0001] The present invention relates to an electronic device, and particularly to a technique for superimposing an OSD image (graphic such as a character string or an icon) on a captured image.

Background Art

[0002] Various techniques for superimposing an OSD image on a captured image have been proposed. For example, Patent Document 1 discloses a technique for superimposing a voice-input string on a captured image so as not to overlap the main subject.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique disclosed in Patent Document 1, although the OSD image does not overlap the main subject, it overlaps other subjects. Thus, in the conventional technique, the graphic overlaps the video area of the image.

[0005] An object of the present invention is to provide a technique capable of suitably suppressing the overlap of a graphic with the video area of an image.

Means for Solving the Problems

[0006] The electronic device of the present invention comprises: acquisition means for acquiring a first image; generation means for generating a second image to be displayed or output externally based on the first image; first setting means for setting whether or not to generate an image without images at a predetermined end; and second setting means for setting whether or not to superimpose graphics. When it is set to generate an image without images at a predetermined end and to superimpose graphics, the generation means generates the image without images at a predetermined end based on the first image and generates the second image by superimposing graphics at the predetermined end. When it is set to generate an image without images at a predetermined end and not to superimpose graphics, the generation means generates the second image based on the first image without generating the image without images at a predetermined end or superimposing graphics. [Effects of the Invention]

[0007] According to the present invention, it is possible to effectively suppress the overlapping of graphics with the video area of ​​an image. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing the configuration of an imaging device. [Figure 2] This is a flowchart of the shooting mode processing. [Figure 3] This is a flowchart of the display / external output processing. [Figure 4] This is a flowchart for the video recording process. [Figure 5] These are schematic diagrams of various images. [Figure 6] This is a schematic diagram of an image generated according to the non-video setting for the outer perimeter. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below. Figure 1 is a block diagram showing the configuration of an imaging device 100 as an example of an electronic device to which the present invention can be applied.

[0010] The lens unit 101 includes a fixed lens group for light collection, a variable magnification lens group, an aperture, and a corrective lens group. By controlling these, the image formation position is corrected and the focus is adjusted. The lens unit 101 forms an image of the subject on the imaging plane of the image sensor 102. The lens unit 101 is detachable from the imaging device 100.

[0011] The image sensor 102 converts light into electric charge to generate an imaging signal. The generated imaging signal is output to the image processing unit 103. The image sensor 102 is an imaging element such as a CCD image sensor or a CMOS image sensor. Alternatively, a so-called dual-pixel type imaging element may be used, in which all pixels on the imaging surface are each composed of a pair of light-receiving elements, and a pair of optical images formed by microlenses at each pixel can be converted into an electrical signal by the pair of light-receiving elements.

[0012] The image processing unit 103 converts the imaging signal input from the image sensor 102 into RAW data (RAW image). Subsequently, the image processing unit 103 generates YUV format image data corresponding to the RAW data by performing RAW development processing, including interpolation and image quality adjustment processing, on the RAW data, and stores the generated image data in RAM 111.

[0013] The display resize circuit 104 generates display image data by performing resizing and other operations on the YUV format image data stored in the RAM 111, and stores the generated display image data in the RAM 111.

[0014] The recording resizing circuit 105 generates recording image data by performing resizing and other operations on the YUV format image data stored in the RAM 111, and stores the generated recording image data in the RAM 111.

[0015] The on-screen display (OSD) generation circuit 106 generates OSD data representing graphics such as various setting menus, titles, times, icons, and warning messages, and stores the generated OSD data in the RAM 111. The stored OSD data can be combined with the display image data stored in the RAM 111. The combined image data obtained by combining the OSD data with the display image data is displayed on the liquid crystal panel 107 or output from the external output unit 118 to an external display device. Also, the stored OSD data may be combined with the recorded image data stored in the RAM 111 and recorded on the SD card 113.

[0016] The liquid crystal panel 107 displays an image (video) based on the image data output from the panel signal processing unit 115. The liquid crystal panel 107 is, for example, a rear display provided on the back of the imaging device 100 or an electronic viewfinder (EVF). Note that an organic EL panel or the like may be used instead of the liquid crystal panel 107.

[0017] The microcomputer 108 controls the entire imaging device 100.

[0018] The operation switch group 109 includes a plurality of operation members that receive operations from the user. The plurality of operation members may include physical buttons or a touch panel. For example, the operation switch group 109 includes a switch for switching the mode of the imaging device 100 among a plurality of modes including a shooting mode for shooting still images or moving images and a playback mode for playing back the captured still images or moving images.

[0019] The ROM 110 is a flash ROM, and various data including programs executed by the microcomputer 108 are stored in the ROM 110. Also, a part of the area of the ROM 110 is used to hold (backup) various information such as system state information.

[0020] RAM 111 is a volatile memory used as a work memory. For example, RAM 111 is used as a work memory by the microcomputer 108, the image processing unit 103, the compression / decompression circuit 114, etc.

[0021] The SD card controller 112 records the image data generated by the compression / decompression circuit 114 and stored in the RAM 111 onto the SD card 113 according to a format compatible with a computer, such as the FAT file system. The SD card 113 is a removable recording medium for the imaging device 100 and can also be attached to an electronic device other than the imaging device 100 (for example, a personal computer). The imaging device 100 may be able to record image data on a non-removable recording medium (a recording medium built into the imaging device 100).

[0022] The compression / decompression circuit 114 compresses (encodes) the image data stored in the RAM 111 and stores it in the RAM 111, or decompresses (decodes) the image data read from the SD card 113. For example, the compression / decompression circuit 114 MPEG-compresses the image data stored in the RAM 111 to generate video data and stores the video data in the RAM 111.

[0023] The panel signal processing unit 115 reads display image data from the RAM 111 and outputs the read display image data to the liquid crystal panel 107. The panel signal processing unit 115 can also read OSD data from the RAM 111, generate composite image data, and output it to the liquid crystal panel 107. When the panel signal processing unit 115 outputs image data to the liquid crystal panel 107, it converts the signal format of the image data into a signal format that the liquid crystal panel 107 can display.

[0024] The bus 116 connects a plurality of components of the imaging device 100 so that they can communicate with each other.

[0025] The external output signal processing unit 117 reads display image data from the RAM 111 and outputs the read display image data to the external output unit 118. The external output signal processing unit 117 can also read OSD data from the RAM 111, generate composite image data, and output it to the external output unit 118. When outputting image data to the external output unit 118, the external output signal processing unit 117 converts the signal format of the image data into a signal format that the external output unit 118 can output.

[0026] The external output unit 118 has external output terminals such as an SDI terminal and an HDMI (registered trademark) terminal, and outputs image data output from the external output signal processing unit 117 to the outside.

[0027] Figure 2 is a flowchart of the shooting mode processing performed by the imaging device 100. The shooting mode processing in Figure 2 is realized by the microcomputer 108 loading a program stored in the ROM 110 into the RAM 111 and executing it. For example, when the imaging device 100 is started in shooting mode or when it transitions from another mode to shooting mode, the shooting mode processing begins. In shooting mode, the shooting mode processing is performed repeatedly at the frame rate of imaging by the image sensor 102.

[0028] Note that Figure 2 omits the shooting preparation instructions and shooting instructions. For example, the microcomputer 108 starts the shooting preparation operation in response to a shooting preparation instruction (for example, half-pressing the shutter button included in the operation switch group 109). The shooting preparation operation includes AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and This includes EF (flash pre-flash) processing, etc. Then, the microcomputer 108 starts the shooting operation in response to a shooting instruction (for example, fully pressing the shutter button). The shooting operation is a series of operations that read signals from the image sensor 102 and write the captured image (an image of the subject) as an image file to the SD card 113.

[0029] In S201, the microcomputer 108 controls the acquisition of RAW data (RAW images). The microcomputer 108 controls the image sensor 102 to output an imaging signal (sensor data) from the image sensor 102 to the image processing unit 103. Then, the microcomputer 108 converts the imaging signal into RAW data through gamma processing, etc., and controls the image processing unit 103 to store the RAW data in the RAM 111.

[0030] In S202, the microcomputer 108 controls the image processing unit 103 to convert the RAW data acquired in S201 into developed data (developed image) through development processing and store the developed data in RAM 111.

[0031] In S203, the microcomputer 108 controls the image processing unit 103 to convert the developed data acquired in S202 into the main image data (main image) through a predetermined correction process (post-processing of the developed data), and to store the main image data in the RAM 111. Figure 5(A) is a schematic diagram showing an example of the main image data (main image). As shown in Figure 5(A), the main image data represents the main image 510, which has video (video of the subject) in its entirety. The format of the main image data is not particularly limited, but in this embodiment, the format of the main image data is assumed to be YUV format. The format of each image data based on the main image data is also the same.

[0032] In S204, the microcomputer 108 performs display / external output processing to display or output the captured image externally. Details of the display / external output processing will be described later with reference to Figure 3.

[0033] In S205, the microcomputer 108 determines whether the imaging device 100 is recording video. If it is recording video, the process proceeds to S206; otherwise, the shooting mode processing is terminated. The period of video recording is, for example, the period from when the start of video recording is instructed using an operating member included in the operation switch group 109 until the stop of video recording is instructed using an operating member included in the operation switch group 109. The operating member that instructs the start of video recording and the operating member that instructs the stop of video recording may be the same or different.

[0034] In S206, the microcomputer 108 performs video recording processing. Details of the video recording processing will be described later with reference to Figure 4.

[0035] Figure 3 is a flowchart of the display / external output processing for S204.

[0036] In S301, the microcomputer 108 determines whether the outer edge non-video setting is enabled or disabled. If the outer edge non-video setting is enabled, the process proceeds to S302; otherwise, it proceeds to S310. The enabled / disabled state of the outer edge non-video setting is switched, for example, using an operating component included in the operation switch group 109, and stored in the ROM 110.

[0037] The setting for non-image areas at the outer edges will be explained using Figure 6. The setting for non-image areas at the outer edges is a setting that generates an image without images at predetermined edges. Figure 6 is a schematic diagram showing an example of an image generated according to the setting for non-image areas at the outer edges. The image size is not particularly limited, but image 600 in Figure 6 has a size of 1920 pixels horizontally × 1080 pixels vertically. Image 600 has an image area 610 and a non-image area 620. The area sizes are not particularly limited, but the image area 610 has a size of 1280 × 720.

[0038] The image region 610 is a region containing an image (an image of a subject), and represents an image based on the main image, such as a scaled-down version of the main image or an image obtained by removing a predetermined edge (a predetermined range from a predetermined edge of the image) from the main image. The upper left corner of the image region 610 is positioned at coordinates (horizontal position, vertical position) = (320, 180) so that the center of the image 600 and the center of the image region 610 coincide, and a non-image region 620 surrounding the image region 610 is obtained.

[0039] The non-image area 620 is the outer region of the image 600 and is an area without image (image of the subject). For example, the non-image area is an area with a single color (pixel value), such as black. OSD data (graphics) can be superimposed on the non-image area 620 so as not to overlap with the image area 610.

[0040] Furthermore, the non-video area 620 (a predetermined edge of the image 600) does not have to enclose the entire video area 610, but may be an area adjacent only to a part of the video area 610. For example, like the black bars of a letterbox, two areas adjacent to the top and bottom edges (or left and right edges) of the video area 610 may be set as the non-video area 620.

[0041] Returning to the explanation of Figure 3, in S302, the microcomputer 108 determines whether the image quality of the present image is higher than a predetermined quality. If the image quality of the present image is higher than the predetermined quality, the process proceeds to S316; otherwise, it proceeds to S303. Image quality higher than a predetermined quality means, for example, an image quality that satisfies at least one of the following conditions: the resolution is higher than a predetermined resolution (such as 8K) and the frame rate is higher than a predetermined frame rate (such as 60P). The image quality of the present image (image quality of the captured image) is specified using the operating elements included in the operating switch group 109, and the information of the specified image quality is stored in the ROM 110.

[0042] In S303, the microcomputer 108 determines whether the OSD display / external output setting, which superimposes OSD data (graphics) during display or external output, is enabled. If the OSD display / external output setting is enabled, the process proceeds to S304; otherwise, it proceeds to S309. The OSD display / external output setting is enabled or disabled, for example, using an operating component included in the operation switch group 109, and stored in the ROM 110. The OSD data represents, for example, strings of characters or icons related to the imaging device 100.

[0043] In this embodiment, the microcomputer 108 selects at least one of a plurality of graphics to be superimposed as a graphic (OSD data) when displaying or outputting to an external device. The graphic to be superimposed when displaying or outputting to an external device is specified using an operating element included in the operating switch group 109, and information about the specified graphic (for example, information indicating the type of the specified graphic) is stored in the ROM 110.

[0044] In S304, the microcomputer 108 determines whether the OSD data to be superimposed during display or external output consists only of predetermined OSD data (predetermined graphics). If it consists only of predetermined OSD data, the process proceeds to S307; otherwise, it proceeds to S305. The predetermined OSD data is, for example, OSD data that can be superimposed on the image to be recorded, and may represent at least one of the time code of the video to be recorded, the current date, and the current time.

[0045] In S305, the microcomputer 108 controls the display resize circuit 104 to convert the size of the main image data (main image) acquired in S203 to the size of the video area 610 in Figure 6. Then, the microcomputer 108 controls the display resize circuit 104 to store the display image data (resized data), which is the image data after size conversion (resizing), in the RAM 111. Here, the display image data is image 60 in Figure 6. Similar to case 0, image data representing an image having both a video region and a non-video region is obtained.

[0046] In S306, the microcomputer 108 controls the OSD generation circuit 106 to generate OSD data in the RAM 111. The microcomputer 108 then controls the panel signal processing unit 115 or the external output signal processing unit 117 to superimpose (combine) the generated OSD data onto the display image data (non-video area of ​​the display image data) acquired in S305. If the panel signal processing unit 115 is controlled, the composite image data, which is the display image data combined with the OSD data, is output from the panel signal processing unit 115 to the liquid crystal panel 107 and displayed on the liquid crystal panel 107. If the external output signal processing unit 117 is controlled, the composite image data is output from the external output signal processing unit 117 to the external output unit 118 and output to the outside from the external output unit 118.

[0047] Figure 5(B) is a schematic diagram showing an example of composite image data (composite image) obtained in S306. As shown in Figure 5(B), the composite image data obtained in S306 represents a composite image 520 having a video area 521 and a non-video area 522. The non-video area 522 is superimposed with an icon 523 indicating that video recording is in progress, a video time code 524, and setting information 525 of the imaging device 100, according to the OSD data.

[0048] In S307, the microcomputer 108 controls the display resize circuit 104 to convert the size of the main image data (main image) acquired in S203 to the size of image 600 in Figure 6. Then, the microcomputer 108 controls the display resize circuit 104 to store the display image data (resized data), which is the image data after size conversion (resizing), in the RAM 111. Here, the display image data obtained is image data in which the entire area contains video (video of the subject).

[0049] In S308, the microcomputer 108 controls the OSD generation circuit 106 to generate OSD data in the RAM 111. The microcomputer 108 then controls the panel signal processing unit 115 or the external output signal processing unit 117 to superimpose (combine) the generated OSD data onto the display image data (video area of ​​the display image data) acquired in S305. If the panel signal processing unit 115 is controlled, the composite image data, which is the display image data combined with the OSD data, is output from the panel signal processing unit 115 to the liquid crystal panel 107 and displayed on the liquid crystal panel 107. If the external output signal processing unit 117 is controlled, the composite image data is output from the external output signal processing unit 117 to the external output unit 118 and then output to the outside from the external output unit 118.

[0050] Figure 5(C) is a schematic diagram showing an example of composite image data (composite image) obtained in S308. As shown in Figure 5(C), the composite image data obtained in S308 represents a composite image 530 in which the entire area is a video area 531. A graphic 532 containing the current date, current time, and video timecode is superimposed on the video area 531 according to the OSD data. In S308, OSD data that can be superimposed on the image to be recorded is used, and a composite image similar to a composite image recorded with superimposed OSD data is obtained.

[0051] In S309, the microcomputer 108 controls the display resize circuit 104 to convert the size of the main image data (main image) acquired in S203 to the size of image 600 in Figure 6. Then, the microcomputer 108 controls the display resize circuit 104 to store the display image data (resized data), which is the image data after size conversion (resizing), in the RAM 111. Here, the display image data obtained is image data in which the entire area contains video (video of the subject).

[0052] Furthermore, in S309, the microcomputer 108 displays the display image data or The panel signal processing unit 115 or the external output signal processing unit 117 is controlled to output to an external source. If the panel signal processing unit 115 is controlled, the display image data is output from the panel signal processing unit 115 to the liquid crystal panel 107 and displayed on the liquid crystal panel 107. If the external output signal processing unit 117 is controlled, the display image data is output from the external output signal processing unit 117 to the external output unit 118 and output to the outside from the external output unit 118.

[0053] Figure 5(D) is a schematic diagram showing an example of display image data (display image) obtained in S309. As shown in Figure 5(D), the display image data obtained in S309 represents a display image 540 in which the entire area is the video area 541. No OSD data is superimposed on the video area 541.

[0054] In S310, similar to S307, the microcomputer 108 controls the display resize circuit 104 to convert the size of the main image data (main image) acquired in S203 to the size of image 600 in Figure 6. Then, the microcomputer 108 controls the display resize circuit 104 to store the display image data (resized data), which is the image data after size conversion (resizing), in the RAM 111.

[0055] In S316, the microcomputer 108 determines that the actual image data (main image) acquired in S203 is to be used as the display image data. When processing in S316 is performed, processing by the display resize circuit 104 is not performed, which reduces the processing load on the imaging device 100 and reduces the amount of data and data rate of the RAM 111.

[0056] In S311, as in S303, the microcomputer 108 determines whether the OSD display / external output setting is enabled or not. If the OSD display / external output setting is enabled, the process proceeds to S314; otherwise, it proceeds to S312.

[0057] In S312, the microcomputer 108 determines whether the OSD recording setting, which superimposes OSD data (graphics) during recording, is enabled. If the OSD recording setting is enabled, the process proceeds to S313; otherwise, the display / external output process is terminated. When terminating the display / external output process, the microcomputer 108 controls the panel signal processing unit 115 or the external output signal processing unit 117 to display or output the display image data acquired in S310 or S316. If the panel signal processing unit 115 is controlled, the display image data is output from the panel signal processing unit 115 to the liquid crystal panel 107 and displayed on the liquid crystal panel 107. If the external output signal processing unit 117 is controlled, the display image data is output from the external output signal processing unit 117 to the external output unit 118 and output to the outside from the external output unit 118. The display image data obtained in S310 or S316 is the same as the display image data obtained in S309 (Figure 5(D)). The OSD recording setting can be enabled or disabled, for example, using an operating component included in the operation switch group 109, and stored in the ROM 110.

[0058] In steps S313 and S314, the microcomputer 108 controls the OSD generation circuit 106 to generate OSD data in the RAM 111. The microcomputer 108 then controls the panel signal processing unit 115 or the external output signal processing unit 117 to superimpose (combine) the generated OSD data onto the display image data (video area of ​​the display image data) acquired in S310 or S316. If the panel signal processing unit 115 is controlled, the composite image data, which is the display image data combined with the OSD data, is output from the panel signal processing unit 115 to the liquid crystal panel 107 and displayed on the liquid crystal panel 107. If the external output signal processing unit 117 is controlled, the composite image data is output from the external output signal processing unit 117 to the external output unit 118 and output to the outside from the external output unit 118.

[0059] The OSD data generated in S313 and S314 may differ. In S313, OSD data that can be superimposed on the image being recorded is generated, while in S314, OSD data specified (selected) by the user is generated. The composite image data obtained in S313 is the same as the composite image data obtained in S308 (Figure 5(C)). Figure 5(E) is a schematic diagram showing an example of the composite image data (composite image) obtained in S314. As shown in Figure 5(E), the composite image data obtained in S314 represents a composite image 550 in which the entire area is the video area 551. Depending on the OSD data, an icon 552 indicating that video recording is in progress, a video time code 553, setting information 554 for the imaging device 100, and dividing lines 555 that divide the area of ​​the composite image 550 into multiple areas are superimposed on the video area 551.

[0060] The display / external output processing may be modified as appropriate. For example, if the answer to S303 is YES, the process may proceed to 3S305; if the answer to S303 is NO, the process may proceed to S312; if the answer to S312 is YES, the process may proceed to S307; and if the answer to S312 is NO, the process may proceed to S309. Alternatively, if the answer to S311 is NO, the display / external output processing may be terminated; if the answer to S311 is YES, the process may proceed to S304; if the answer to S304 is YES, the process may proceed to S313; and if the answer to S304 is NO, the process may proceed to S314.

[0061] Figure 4 is a flowchart of the video recording process in S206. While this example describes video recording, still images can also be recorded. Still images can be recorded using the same process as video recording.

[0062] In S401, the microcomputer 108 controls the recording resize circuit 105 to convert the size of the main image data (main image) acquired in S203 to the set recording size. Then, the microcomputer 108 controls the recording resize circuit 105 to store the recorded image data (resized data), which is the image data after size conversion (resizing), in the RAM 111. Here, the recorded image data obtained is image data in which the entire area contains video (video of the subject). The recording size is specified, for example, using an operating element included in the operating switch group 109 and stored in the ROM 110.

[0063] In S402, the microcomputer 108 determines whether the OSD recording setting, which superimposes OSD data (graphics) during recording, is enabled or disabled. If the OSD recording setting is enabled, the process proceeds to S403; otherwise, it proceeds to S404. The OSD recording setting can be enabled or disabled, for example, using an operating component included in the operation switch group 109, and stored in the ROM 110. By switching the OSD recording setting on or off, it is determined whether or not to record an image with superimposed OSD data.

[0064] In S403, the microcomputer 108 controls the OSD generation circuit 106 to generate OSD data in the RAM 111. The OSD data generated here is predetermined OSD data that represents, for example, the time code of the video to be recorded, the current date, and the current time. The microcomputer 108 then controls the OSD generation circuit 106 to superimpose (combine) the generated OSD data onto the recorded image data (video area of ​​the recorded image data) acquired in S401. The composite image data obtained in S403 (image data obtained by combining the recorded image data with OSD data) is the same as the composite image data obtained in S308 (Figure 5(C)).

[0065] In S404, the microcomputer 108 encodes the image data to be recorded (image data to be recorded) and controls the compression / decompression circuit 114 to store the encoded image data in RAM 111 as data for one frame of a video. If the process in S403 is not performed, the image data to be recorded is the recorded image data obtained in S401. If the process in S403 is performed, the image data to be recorded is the composite image data obtained in S403. This is image data.

[0066] In S405, the microcomputer 108 controls the SD card controller 112 to write the image data acquired in S404 (encoded image data) to the SD card 113 as data for one frame of a video.

[0067] As described above, according to this embodiment, when the outer edge non-video setting is enabled and the OSD display / external output setting is enabled, an image having a video area and a non-video area is generated based on this image. Then, by superimposing graphics onto the non-video area, a composite image for display or external output is generated. In this way, it is possible to suppress the overlap of graphics on the video area of ​​the image.

[0068] However, in an image that has both a video area and a non-video area, the video area is smaller compared to an image with only a video area. According to this embodiment, when the outer edge non-video setting is enabled and the OSD display / external output setting is disabled, neither the generation of an image with both a video area and a non-video area nor the superposition of graphics occurs. An image with only a video area is generated based on this image as the image to be displayed or output externally. In this way, it is possible to suitably suppress the superposition of graphics on the video area of ​​the image (while suppressing the reduction of the video area).

[0069] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0070] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0071] Furthermore, the embodiments described above (including modified examples) are merely examples, and configurations obtained by appropriately modifying or changing the above-described configuration within the scope of the gist of the present invention are also included in the present invention. Configurations obtained by appropriately combining the above-described configurations are also included in the present invention. For example, although examples of displaying, outputting to an external source, and recording captured images have been described, the present invention is also applicable to cases where computer graphics (CG) images other than captured images are displayed, output to an external source, or recorded.

[0072] Furthermore, although the embodiments described above explained the application of the present invention to an imaging device as an example, the invention is not limited to this example and can be applied to any electronic device capable of image processing. For example, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printers, digital photo frames, music players, game consoles, e-book readers, and the like. The present invention can also be applied to video players, display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances, and in-vehicle devices.

[0073] Furthermore, the present invention is applicable not only to the imaging device itself, but also to a control device that communicates with the imaging device (including network cameras) via wired or wireless communication and remotely controls the imaging device. Examples of devices that remotely control the imaging device include smartphones, tablet PCs, and desktop PCs. The imaging device can be remotely controlled by notifying the imaging device of commands to perform various operations and settings based on operations and processing performed on the control device side. In addition, live view images captured by the imaging device may be received via wired or wireless communication and displayed on the control device side.

[0074] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0075] This embodiment includes the following configurations, methods, programs, and media. (Composition 1) A means for acquiring a first image, A generation means that generates a second image to be displayed or output externally based on the first image, A first setting means for setting whether or not to generate an image without video at a predetermined end, A second setting means for determining whether or not to superimpose graphics, It has, When it is set to generate an image without video at a predetermined end and to superimpose the graphic, the generation means generates the image without video at a predetermined end based on the first image, and generates the second image by superimposing the graphic at the predetermined end. If it is set to generate an image without video at a predetermined end and not to superimpose the graphic, the generation means generates the second image based on the first image without generating an image without video at a predetermined end or superimposing the graphic. An electronic device characterized by the following features. (Configuration 2) The image without images at the predetermined end is an image without images on its outer periphery. The electronic device according to configuration 1, characterized by the features described above. (Composition 3) If it is set to generate an image without video at a predetermined end, and the image quality of the first image is higher than the predetermined image quality, then, regardless of the setting by the second setting means, the generation means will generate the second image based on the first image without generating the image without video at the predetermined end. The electronic device according to configuration 1 or 2, characterized by the above. (Composition 4) The aforementioned image quality higher than the predetermined image quality is image quality that satisfies at least one of the following conditions: the resolution is higher than the predetermined resolution, and the frame rate is higher than the predetermined frame rate. The electronic device according to configuration 3, characterized by the features described above. (Composition 5) Selection means for selecting at least one of a plurality of graphics, including a predetermined graphic, as the superimposed graphic. It further possesses, If the system is configured to generate an image without video at a predetermined end, to superimpose the graphic, and the predetermined graphic is selected by the selection means, the generation means will generate the second image based on the first image by superimposing the predetermined graphic without generating the image without video at the predetermined end. An electronic device according to any one of configurations 1 to 4, characterized by the above. (Composition 6) A video based on the first image can be recorded, The predetermined graphic includes at least one of the timecode of the video, the current date, and the current time. The electronic device according to configuration 5, characterized by the features described herein. (Composition 7) A third image, which is a still image or video based on the first image, can be recorded. The aforementioned electronic device is A third setting means for setting whether or not to record an image with a predetermined graphic superimposed on it. It further possesses, If it is set not to superimpose the aforementioned graphics, and it is set to record the image with the predetermined graphics superimposed, then, regardless of the setting by the first setting means, the generation means will generate the second image based on the first image by superimposing the predetermined graphics, without generating the image without images at the predetermined edges. An electronic device according to any one of configurations 1 to 6, characterized by the features described above. (Composition 8) Regardless of whether or not it is set to record the image on which the predetermined graphic is superimposed, the third image, which has video in its entirety, is generated based on the first image. The electronic device according to configuration 7, characterized by the features described above. (method) The acquisition step involves obtaining the first image, A generation step of generating a second image to be displayed or output externally based on the first image, A first setting step to determine whether or not to generate an image without video at a predetermined end, A second setting step to determine whether or not to perform graphic overlay, It has, When it is set to generate an image without video at a predetermined end and to perform graphic superposition, the generation step generates the image without video at a predetermined end based on the first image, and generates the second image by superimposing the graphic at the predetermined end. If it is set to generate an image without video at a predetermined end and not to superimpose the graphics, the generation step generates the second image based on the first image without generating an image without video at a predetermined end or superimposing the graphics. A method for controlling electronic equipment characterized by the following features. (program) A program for causing a computer to function as one of the electronic devices described in any of configurations 1 to 8. (medium) A computer-readable storage medium that stores a program for causing the computer to function as one of the electronic devices described in any of configurations 1 to 8. [Explanation of symbols]

[0076] 100: Imaging device 102: Image sensor 103: Image processing unit 104: Display resizing circuit 106: OSD generation circuit 108: Microcomputer 115: Panel signal processing unit 117: External output signal processing unit

Claims

1. A means for acquiring a first image, A generation means for generating a second image to be displayed or output externally based on the first image, A first setting means for setting whether or not to generate an image without video at a predetermined end, A second setting means for determining whether or not to perform graphic overlay, It has, When it is set to generate an image without video at a predetermined end and to perform graphic superposition, the generation means generates the image without video at a predetermined end based on the first image, and generates the second image by superimposing the graphic at the predetermined end. If it is set to generate an image without video at a predetermined end and not to superimpose graphics, the generation means generates a second image based on the first image without generating an image without video at a predetermined end or superimposing graphics. An electronic device characterized by the following features.

2. The image without images at the predetermined end is an image without images on its outer periphery. The electronic device according to feature 1.

3. If it is set to generate an image without video at a predetermined end, and the image quality of the first image is higher than the predetermined image quality, then, regardless of the setting by the second setting means, the generation means will generate the second image based on the first image without generating the image without video at the predetermined end. The electronic device according to feature 1.

4. The aforementioned image quality higher than the predetermined image quality is image quality that satisfies at least one of the following conditions: the resolution is higher than the predetermined resolution, and the frame rate is higher than the predetermined frame rate. The electronic device according to feature 3.

5. Selection means for selecting at least one of a plurality of graphics, including a predetermined graphic, as the superimposed graphic. It further possesses, If the system is configured to generate an image without video at a predetermined end, to superimpose the graphic, and the predetermined graphic is selected by the selection means, the generation means will generate the second image based on the first image by superimposing the predetermined graphic without generating the image without video at the predetermined end. The electronic device according to feature 1.

6. A video based on the first image can be recorded, The predetermined graphic includes at least one of the timecode of the video, the current date, and the current time. The electronic device according to feature 5.

7. A third image, which is a still image or a video based on the first image, can be recorded. The aforementioned electronic device is A third setting means for setting whether or not to record an image with a predetermined graphic superimposed on it. It further possesses, If it is set not to superimpose the aforementioned graphics, and it is set to record the image with the predetermined graphics superimposed, then, regardless of the setting by the first setting means, the generation means will generate the second image based on the first image by superimposing the predetermined graphics, without generating the image without images at the predetermined edges. The electronic device according to feature 1.

8. Regardless of whether or not it is set to record the image on which the predetermined graphic is superimposed, the third image, which has video in its entirety, is generated based on the first image. The electronic device according to feature 7.

9. The acquisition step involves obtaining the first image, A generation step of generating a second image to be displayed or output externally based on the first image, A first setting step to determine whether or not to generate an image without video at a predetermined end, A second setting step to determine whether or not to perform graphic overlay, It has, When it is set to generate an image without video at a predetermined end and to perform graphic superposition, the generation step generates an image without video at a predetermined end based on the first image, and generates a second image by superimposing the graphic at the predetermined end. If it is set to generate an image without video at a predetermined end and not to superimpose the graphic, then in the generation step, the second image based on the first image is generated without generating an image without video at a predetermined end or superimposing the graphic. A method for controlling electronic equipment characterized by the following features.

10. A program for causing a computer to function as one of the means of an electronic device according to any one of claims 1 to 8.

11. A computer-readable storage medium storing a program for causing the computer to function as one of the means of the electronic device described in any one of claims 1 to 8.

Images