Display control device, display control method, program, and storage medium

Abstract

To provide a technique for displaying an image on the basis of a captured image including an image area and a non-image area in a suitable state.SOLUTION: A display control device has image acquisition means for acquiring a captured image that includes image and non-image areas, image processing means for applying a predetermined image processing to the captured image, and display control means for controlling to display the image after the predetermined image processing in a state in which the predetermined image processing is applied to the image area and the non-image area is not subjected to the predetermined image processing.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to a display control device, a display control method, a program, and a storage medium.

Background Art

[0002] Digital cameras having two optical systems are known. In such a digital camera, for example, an image in which two image regions with parallax are arranged side by side can be captured (Patent Document 1). In this image, non-image regions (invalid regions) exist around the two image regions (effective regions).

[0003] Also, a color conversion process (false color process) for converting the color of each pixel of an input image into a color according to the luminance level of the pixel is known (Patent Document 2). For example, by the false color process, black (luminance level 0%, including black crush) is converted into blue, making it easier to check the exposure state.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the prior art, an image based on a captured image including an image region and a non-image region (for example, an image after false color processing) may not be displayed in a suitable state.

[0006] An object of the present invention is to provide a technique capable of displaying an image based on a captured image including an image region and a non-image region in a suitable state.

Means for Solving the Problems

[0007] The display control device of the present invention is characterized by comprising: an image acquisition means for acquiring an image captured including an image region and a non-image region; an image processing means for applying predetermined image processing to the captured image; and a display control means for controlling the display of the image after the predetermined image processing so that the predetermined image processing is applied to the image region and the predetermined image processing is not applied to the non-image region. [Effects of the Invention]

[0008] According to the present invention, an image based on an captured image, including an image region and a non-image region, can be displayed in a suitable state. [Brief explanation of the drawing]

[0009] [Figure 1] This is an external view of the camera. [Figure 2] This is a block diagram showing the camera configuration. [Figure 3] This is a schematic diagram showing the configuration of the lens unit. [Figure 4] This diagram shows the meaning of each color (converted color) after false color processing. [Figure 5] This figure shows a display image according to Embodiment 1. [Figure 6] This flowchart shows the LV display process according to Embodiment 1. [Figure 7] This is a flowchart showing the LV display process according to Embodiment 2. [Figure 8] This figure shows a display image according to Embodiment 3. [Figure 9] This is a flowchart showing the LV display process according to Embodiment 3. [Modes for carrying out the invention]

[0010] Embodiments of the present invention will be described below with reference to the drawings. In this embodiment, the case in which the electronic device is a digital camera (imaging device) will be described as an example. The digital camera according to this embodiment can acquire a single image (two-lens image) including a left image region and a right image region having a predetermined parallax in the left-right direction, and display it on a display unit.

[0011] Figures 1(A) and 1(B) are external views showing an example of the external appearance of the digital camera (camera) 100 according to this embodiment. Figure 1(A) is a perspective view of the camera 100 as seen from the front, and Figure 1(B) is a perspective view of the camera 100 as seen from the rear.

[0012] Camera 100 has a shutter button 101, a power switch 102, a mode selector switch 103, a main electronic dial 104, a sub electronic dial 105, a video button 106, and an external viewfinder display 107 on its top surface. The shutter button 101 is an operating element for giving a shooting preparation instruction or a shooting instruction. The power switch 102 is an operating element for switching the power of camera 100 on and off. The mode selector switch 103 is an operating element for switching between various modes. The main electronic dial 104 is a rotary operating element for changing settings such as shutter speed and aperture. The sub electronic dial 105 is a rotary operating element for moving the selection frame (cursor) and advancing images. The video button 106 is an operating element for giving an instruction to start and stop video recording. The external viewfinder display 107 displays various settings such as shutter speed and aperture.

[0013] The camera 100 has a display unit 108, a touch panel 109, directional keys 110, a SET button 111, an AE lock button 112, a zoom button 113, a playback button 114, a menu button 115, an eyepiece 116, an eyepiece detection unit 118, a touch bar 119, a multi-controller 120, and a display mode switching button 121 on its back. The display unit 108 displays images and various information. The touch panel 109 is an operating member that detects touch operations on the display surface (touch operation surface) of the display unit 108. The directional keys 110 are an operating member consisting of keys that can be pressed up, down, left, and right (four directional keys). Processing can be performed according to the position where the directional keys 110 are pressed. The SET button 111 is an operating member that is mainly pressed when confirming a selection item. The AE lock button 112 is an operating member that is pressed when fixing the exposure state in the shooting standby state. The zoom button 113 is an operating element for switching the zoom mode on and off in the live view display (LV display) of the shooting mode. When the zoom mode is on, the live view image (LV image) can be enlarged or reduced by operating the main electronic dial 104. The zoom button 113 is also used in playback mode to enlarge the playback image or increase the magnification ratio. The playback button 114 is an operating element for switching between shooting mode and playback mode. By pressing the playback button 114 in shooting mode, the camera switches to playback mode, and the latest image recorded on the recording medium 227 (described later) can be displayed on the display unit 108.

[0014] The menu button 115 is an operating element that is pressed to display a menu screen on the display unit 108 that allows for various settings. The user can intuitively make various settings using the menu screen displayed on the display unit 108 and the directional keys 110 and SET button 111. The eyepiece section 116 is the part that the user looks through when they place their eye on the eyepiece viewfinder (peep-in type viewfinder) 117. The user can view the image displayed on the EVF 217 (Electronic View Finder), which will be described later, inside the camera 100, through the eyepiece section 116. The eyepiece detection section 118 is a sensor that detects whether or not the user is looking through the eyepiece section 116 (eyepiece viewfinder 117).

[0015] The touch bar 119 is a line-shaped touch operation component (line touch sensor) capable of accepting touch operations. The touch bar 119 is positioned so that it can be touched by the right thumb when the grip portion 122 is held with the right hand (with the little finger, ring finger, and middle finger) so that the shutter button 101 can be pressed with the right index finger. In other words, the touch bar 119 can be operated when the user is looking through the eyepiece viewfinder 117 and the camera is positioned to press the shutter button 101 at any time (shooting posture). The touch bar 119 can accept tap operations (touching and releasing the touch position within a predetermined period of time without moving the touch position), left and right sliding operations (touching and then moving the touch position while keeping the touch on the surface), etc. The touch bar 119 is a different operation component from the touch panel 109 and does not have a display function. The Touch Bar 119 functions, for example, as a multifunction bar (M-Fn bar) to which various functions can be assigned.

[0016] The multi-controller 120 is configured to be pushed down in a 360-degree direction. By pushing down the multi-controller 120, the user can indicate eight directions such as up, down, left, and right. Also, by pushing in the multi-controller 120, the user can indicate the activation of the functions assigned to the multi-controller 120. The display mode switching button 121 is an operation member for switching the display mode of images (including live images) and shooting information displayed on the display unit 108 and the EVF 217. Each time the display mode switching button 121 is pressed, the display mode is switched, and the user can view images and information in the desired display mode.

[0017] In addition, the camera 100 has a grip portion 122, a thumb rest portion 123, a terminal cover 124, a lid 125, a communication terminal 126, and the like. The grip portion 122 is a holding portion formed in a shape that is easy to hold with the right hand when the user holds the camera 100. With the grip portion 122 held by the little finger, ring finger, and middle finger of the right hand, the shutter button 101 and the main electronic dial 104 are arranged at positions operable by the index finger of the right hand. Also, in the same state, the sub electronic dial 105 and the touch bar 119 are arranged at positions operable by the thumb of the right hand. The thumb rest portion 123 (thumb standby position) is a grip portion provided on the back side of the camera 100 at a location where it is easy to place the thumb of the right hand that is holding the grip portion 122 without operating any operation members. The thumb rest portion 123 is composed of a rubber member or the like for enhancing the holding force (grip feeling). The terminal cover 124 protects connectors such as connection cables for connecting the camera 100 to external devices (external apparatuses). The lid 125 protects the recording medium 227 and the slot by closing the slot for storing the recording medium 227 described later. The communication terminal 126 is a terminal for communicating with the lens unit (lens units 200 and 300 described later) that is detachable from the camera 100.

[0018] FIG. 2 is a block diagram showing an example of the configuration of the camera 100. Components identical to those in FIGS. 1(A) and 1(B) are denoted by the same reference numerals as in FIGS. 1(A) and 1(B), and the description of those components will be omitted as appropriate. In FIG. 2, a lens unit 200 is attached to the camera 100.

[0019] First, the lens unit 200 will be described. The lens unit 200 is a type of interchangeable lens unit that can be attached to and detached from the camera 100. The lens unit 200 is a single-lens unit (monocular lens unit) and is an example of a normal lens unit. The lens unit 200 includes an aperture 201, a lens 202, an aperture drive circuit 203, an AF (auto focus) drive circuit 204, a lens system control circuit 205, a communication terminal 206, and the like.

[0020] The aperture 201 is configured such that its aperture diameter can be adjusted. The lens 202 is composed of a plurality of lenses. The aperture drive circuit 203 adjusts the amount of light by controlling the aperture diameter of the aperture 201. The AF drive circuit 204 drives the lens 202 to focus. The lens system control circuit 205 controls the aperture drive circuit 203, the AF drive circuit 204, etc. based on instructions from the system control unit 50 described later. The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203. Also, the lens system control circuit 205 focuses by changing the position of the lens 202 via the AF drive circuit 204. The lens system control circuit 205 can communicate with the camera 100. Specifically, communication is performed via the communication terminal 206 of the lens unit 200 and the communication terminal 126 of the camera 100. The communication terminal 206 is a terminal for the lens unit 200 to communicate with the camera 100 side.

[0021] Next, the camera 100 will be described. The camera 100 includes a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D / A converter 216, an EVF 217, a display unit 108, and a system control unit 50.

[0022] The shutter 210 is a focal-plane shutter that can freely control the exposure time of the imaging unit 211 based on instructions from the system control unit 50. The imaging unit 211 is an image sensor composed of a CCD or CMOS element that converts an optical image into an electrical signal. The imaging unit 211 may have an image plane phase-difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 212 converts the analog signal output from the imaging unit 211 into a digital signal. The image processing unit 214 performs predetermined image processing (such as resizing processing like pixel interpolation and reduction, and color conversion processing) on ​​the data from the A / D converter 212 or the data from the memory control unit 213. The image processing unit 214 also performs predetermined calculation processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained calculation results. This processing enables TTL (through-the-lens) AF processing, AE (automatic exposure) processing, EF (flash pre-flash) processing, etc. Furthermore, the image processing unit 214 performs predetermined calculations using the captured image data, and the system control unit 50 performs TTL-type AWB (auto white balance) processing based on the obtained calculation results.

[0023] Image data from the A / D converter 212 is written to the memory 215 via the image processing unit 214 and the memory control unit 213. Alternatively, image data from the A / D converter 212 is written to the memory 215 via the memory control unit 213 without going through the image processing unit 214. The memory 215 stores image data obtained by the imaging unit 211 and converted into digital data by the A / D converter 212, as well as image data for display on the display unit 108 and EVF 217. The memory 215 has sufficient storage capacity to store a predetermined number of still images, a predetermined amount of video footage, and audio. The memory 215 also serves as a memory for image display (video memory).

[0024] The D / A converter 216 converts the display image data stored in the memory 215 into an analog signal and supplies it to the display unit 108 and EVF 217. Therefore, the display image data written to the memory 215 is displayed on the display unit 108 and EVF 217 via the D / A converter 216. The display unit 108 and EVF 217 perform display according to the analog signal from the D / A converter 216. The display unit 108 and EVF 217 are displays such as LCDs and OLEDs. The digital signal, which has been A / D converted by the A / D converter 212 and stored in the memory 215, is converted into an analog signal by the D / A converter 216 and sequentially transferred to the display unit 108 and EVF 217 for display, thereby performing live view display.

[0025] The system control unit 50 includes at least one processor and / or at least one The control unit consists of the following circuits. That is, the system control unit 50 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 50 controls the entire camera 100. The system control unit 50 implements each process of the flowchart described later by executing a program recorded in the non-volatile memory 219. The system control unit 50 also performs display control by controlling the memory 215, D / A converter 216, display unit 108, EVF 217, etc. The system control unit 50 can identify the type of lens unit attached to the camera 100 by communicating via the communication terminal 126 and the communication terminal 206.

[0026] The camera 100 also includes a system memory 218, a non-volatile memory 219, a system timer 220, a communication unit 221, a posture detection unit 222, and an eyepiece detection unit 118.

[0027] For example, RAM is used as the system memory 218. The system memory 218 stores constants and variables for the operation of the system control unit 50, as well as programs read from the non-volatile memory 219. The non-volatile memory 219 is an electrically erasable and recordable memory, and for example, EEPROM is used as the non-volatile memory 219. The non-volatile memory 219 stores constants and programs for the operation of the system control unit 50. The program here refers to a program for executing the flowchart described later. The system timer 220 is a timing unit that measures the time used for various controls and the time of the built-in clock. The communication unit 221 transmits and receives video and audio signals to and from external devices connected by wireless or wired cables. The communication unit 221 can also connect to wireless LAN (Local Area Network) and the internet. Furthermore, the communication unit 221 can communicate with external devices using Bluetooth® and Bluetooth Low Energy. The communication unit 221 can transmit images (including live images) captured by the imaging unit 211 and images recorded on the recording medium 227, and can receive images and other various information from external devices. The attitude detection unit 222 detects the attitude (tilt) of the camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 222, it can detect the tilt angle of the camera 100 in the horizontal (left-right) or vertical (up-down; front-back) direction. Also, based on the attitude detected by the attitude detection unit 222, it can determine whether the image taken by the imaging unit 211 was taken with the camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 222 to the image file of the image taken by the imaging unit 211, or rotate the image according to the detected attitude. It is also possible to detect the movement of the camera 100 (pan, tilt, lift, whether it is stationary or not, etc.) using the attitude detection unit 222. The attitude detection unit 222 can use, for example, an accelerometer or a gyroscope.

[0028] The eyepiece detection unit 118 can detect the approach of any object to the eyepiece unit 116 (eyepiece finder 117). For example, an infrared proximity sensor can be used for the eyepiece detection unit 118. When an object approaches, infrared light emitted from the light emitter of the eyepiece detection unit 118 is reflected by the object and received by the light receiver of the infrared proximity sensor. The distance from the eyepiece unit 116 to the object can be determined by the amount of infrared light received. In this way, the eyepiece detection unit 118 performs eyepiece detection to detect the proximity distance of an object to the eyepiece unit 116. The eyepiece detection unit 118 is an eyepiece detection sensor that detects the approach (eye-sight) and departure (eye-away) of an eye (object) to the eyepiece unit 116. When an object is detected approaching the eyepiece unit 116 within a predetermined distance from a non-eyepiece state (non-approach state), it is detected that the eye has been focused on. On the other hand, if the object that was detected as approaching moves beyond a predetermined distance from the eye-contact state (close-up state), it is detected as having been moved away from the eye. The threshold for detecting eye contact and the threshold for detecting eye separation may be different, for example, by providing hysteresis. Also, after eye contact is detected, the eye-contact state is assumed until eye separation is detected. After eye separation is detected, the non-eye-contact state is assumed until eye contact is detected again. The system control unit 50 switches the display (display state) / hidden (hidden state) of the display unit 108 and EVF 217 according to the state detected by the eyepiece detection unit 118. Specifically, when the camera is in at least the shooting standby state and the display destination switching setting is set to automatic switching, the display unit 108 is set as the display destination and the EVF 217 is hidden when the user is not using an eyepiece. When the user is using an eyepiece, the EVF 217 is set as the display destination and the display unit 108 is hidden. Note that the eyepiece detection unit 118 is not limited to an infrared proximity sensor; other sensors that can detect a state that can be considered as using an eyepiece may be used in the eyepiece detection unit 118.

[0029] The camera 100 also includes an external viewfinder display unit 107, an external viewfinder display drive circuit 223, a power supply control unit 224, a power supply unit 225, a recording medium interface 226, an operation unit 228, and the like.

[0030] The external viewfinder display unit 107 is driven by the external viewfinder display drive circuit 223 and displays various settings of the camera 100, such as shutter speed and aperture. The power control unit 224 consists of a battery detection circuit, a DC-DC converter, a switch circuit for switching which blocks are powered, and detects whether a battery is installed, the type of battery, and the remaining battery level. The power control unit 224 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, supplying the necessary voltage to each part, including the recording medium 227, for the required period. The power supply unit 225 can be a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, or an AC adapter. The recording medium I / F 226 is an interface with the recording medium 227, such as a memory card or a hard disk. The recording medium 227 is a memory card or the like for recording captured images, and is composed of semiconductor memory or a magnetic disk. The recording medium 227 may be detachable from the camera 100 or may be built into the camera 100.

[0031] The operation unit 228 is an input unit that receives user input (user operation) and is used to input various instructions to the system control unit 50. The operation unit 228 includes the shutter button 101, power switch 102, mode switch 103, touch panel 109, and other operation units 229. Other operation units 229 include the main electronic dial 104, sub electronic dial 105, video button 106, directional keys 110, SET button 111, AE lock button 112, zoom button 113, playback button 114, menu button 115, and touch bar 119.

[0032] The shutter button 101 has a first shutter switch 230 and a second shutter switch 231. The first shutter switch 230 turns on during the operation of the shutter button 101, so-called half-press (shooting preparation instruction), and outputs a first shutter switch signal SW1. In response to the first shutter switch signal SW1, the system control unit 50 starts shooting preparation processing such as AF processing, AE processing, AWB processing, and EF processing. The second shutter switch 231 turns on when the operation of the shutter button 101 is completed, so-called full-press (shooting instruction), and outputs a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 50 starts a series of shooting processes, from reading the signal from the imaging unit 211 to generating an image file containing the captured image and writing it to the recording medium 227.

[0033] The mode switch 103 switches the operating mode of the system control unit 50 to one of the following: still image shooting mode, video shooting mode, or playback mode. The modes included in still image shooting mode are auto shooting mode, auto scene detection mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide shooting settings for different shooting scenes. The user can select the above shooting mode using the mode switch 103. The user can directly switch to any of these modes. Alternatively, the user can switch to the shooting mode list screen using the mode switch 103, and then selectively switch to any of the displayed modes using the control unit 228. Similarly, the video shooting mode may also include multiple modes.

[0034] The touch panel 109 is a touch sensor that detects various touch operations on the display surface of the display unit 108 (the operating surface of the touch panel 109). The touch panel 109 and the display unit 108 can be configured as an integrated unit. For example, the touch panel 109 has a light transmittance that does not interfere with the display of the display unit 108 and is mounted on the upper layer of the display surface of the display unit 108. Then, the input coordinates on the touch panel 109 are associated with the display coordinates on the display surface of the display unit 108. In this way, a GUI (Graphical User Interface) can be configured that makes it appear as if the user can directly operate the screen displayed on the display unit 108. The touch panel 109 can use any of the various methods, such as resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor methods. Depending on the method, there are methods that detect a touch when there is contact with the touch panel 109, and methods that detect a touch when a finger or pen approaches the touch panel 109, but either method is acceptable.

[0035] The system control unit 50 can detect the following operations or states on the touch panel 109. - A finger or pen that was not previously touching the touch panel 109 now touches the touch panel 109, i.e., the start of a touch (hereinafter referred to as Touch-Down). • The state in which the touch panel 109 is being touched with a finger or pen (hereinafter referred to as Touch-On). • The touch panel 109 is being moved while a finger or pen is touching it (hereinafter referred to as Touch-Move). The finger or pen that was touching the touch panel 109 is lifted (released), meaning the touch action ends (hereinafter referred to as "Touch-Up"). • The state in which nothing is being touched on the touch panel 109 (hereinafter referred to as Touch-Off).

[0036] When a touchdown is detected, a touch-on is also detected simultaneously. After a touchdown, touch-ons are usually detected continuously unless a touch-up is detected. Touch-ons are also detected if a touch-move is detected. A touch-move is not detected if the touch position has not moved, even if a touch-on has been detected. A touch-off occurs after all fingers or pens that were touching the screen have been detected as having touched up.

[0037] These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 109, are notified to the system control unit 50 via the internal bus. Based on the notified information, the system control unit 50 determines what kind of operation (touch operation) was performed on the touch panel 109. For touch moves, the direction of movement of the finger or pen moving on the touch panel 109 can also be determined for each vertical and horizontal component on the touch panel 109 based on the change in position coordinates. If a touch move of a predetermined distance or more is detected, it is determined that a slide operation was performed. An operation in which a finger is touched on the touch panel 109 and then quickly moved a certain distance and then released is called a flick. In other words, a flick is an operation in which the finger is quickly traced across the touch panel 109 as if flicking it. If a touch move of a predetermined distance or more at a predetermined speed or faster is detected, and a touch-up is then detected, it is determined that a flick was performed (it can be determined that a flick followed a slide operation). Furthermore, touching multiple points (for example, two points) together (multitouch) to bring them closer together is called pinch-in, and touching them further apart is called pinch-out. Pinch-out and pinch-in are collectively referred to as pinch operations (or simply pinch).

[0038] Figure 3 is a schematic diagram showing an example of the configuration of the lens unit 300. Figure 3 shows the lens unit 300 attached to the camera 100. By attaching the lens unit 300, the camera 100 can capture a single image (still image or video) containing two image regions with a predetermined parallax. Note that, among the components of the camera 100 shown in Figure 3, the same reference numerals as those described in Figure 2 are used, and the descriptions of those components are omitted as appropriate.

[0039] The lens unit 300 is a type of interchangeable lens unit that can be attached to and removed from the camera 100. The lens unit 300 is a twin-lens unit capable of capturing parallax right and left images. The lens unit 300 has two optical systems (photographic lenses), and each of the two optical systems can capture a wide field of view of approximately 180 degrees. Specifically, each of the two optical systems of the lens unit 300 can capture a subject with a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation / depression angle, pitch angle). In other words, each of the two optical systems can capture an area of ​​the front hemisphere.

[0040] The lens unit 300 includes a right-eye optical system 301R having multiple lenses and a reflective mirror, a left-eye optical system 301L having multiple lenses and a reflective mirror, and a lens system control circuit 303. The right-eye optical system 301R has a lens 302R positioned on the subject side, and the left-eye optical system 301L has a lens 302L positioned on the subject side. Lenses 302R and 302L face the same direction, and their optical axes are approximately parallel. Each of the right-eye optical system 301R and the left-eye optical system 301L has a fisheye lens and forms a circular optical image on the imaging unit 211. The optical image formed via the right-eye optical system 301R (right image) and the optical image formed via the left-eye optical system 301L (left image) are imaged onto the imaging plane of one imaging unit 211, and the imaging unit 211 acquires a single image that includes the image regions of each optical image.

[0041] The lens unit 300 is a two-lens lens unit (VR180 lens unit) for obtaining VR180 images, which are one of the VR (Virtual Reality) image formats that enable binocular stereoscopic viewing. The lens unit 300 has a fisheye lens capable of capturing a range of approximately 180 degrees in both the right eye optical system 301R and the left eye optical system 301L. However, the range that can be captured by the lenses in each of the right eye optical system 301R and the left eye optical system 301L may be narrower than 180 degrees, around 160 degrees. The lens unit 300 can image the right image formed via the right eye optical system 301R and the left image formed via the left eye optical system 301L onto one or two image sensors of the camera to which the lens unit 300 is attached. In camera 100, the right image and the left image are imaged on a single image sensor, generating a single image (binacular image) with the right image region corresponding to the right image and the left image region corresponding to the left image side by side. The binaural image includes the right image region, the left image region, and a region that does not correspond to the optical image (non-image region, e.g., black region).

[0042] The lens unit 300 is attached to the camera 100 via the lens mount portion 304 and the camera mount portion 305 of the camera 100. In this way, the system control unit 50 of the camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected via the communication terminal 126 of the camera 100 and the communication terminal 306 of the lens unit 300.

[0043] In Figure 3, the right image formed via the right-eye optical system 301R and the left image formed via the left-eye optical system 301L are imaged side by side on the imaging unit 211 of the camera 100. That is, the right-eye optical system 301R and the left-eye optical system 301L each image two optical images in two regions of a single image sensor. The imaging unit 211 converts the imaged subject (optical signal) into an analog electrical signal. By using the lens unit 300 (right-eye optical system 301R and left-eye optical system 301L) in this way, it is possible to acquire a single image (binocular image) that includes two image regions with parallax. By dividing the acquired image into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a three-dimensional VR image with a range of approximately 180 degrees. In other words, the user can view a VR180 image in 3D.

[0044] In the case of a typical single-lens unit, the image (optical image) incident on the lens unit is inverted point-symmetrically around the optical axis of the lens unit and input to the image sensor. Imaging devices such as camera 100 can generate an image that does not appear inverted by controlling the order in which signals are read from the image sensor or by performing an inversion process on the read signals (images). In the case of a twin-lens unit, the image is inverted vertically and input to the image sensor, but not horizontally. Therefore, the left image incident via the left-eye optical system is positioned on the left side, and the right image incident via the right-eye optical system remains positioned on the right side, with both the left and right images being input to the image sensor. Consequently, if the same inversion process as in the case of a single-lens unit is performed, the left and right orientations in camera 100 and the left and right orientations of the inverted image will be reversed. In other words, an image is generated in which the left image region corresponding to the left image is positioned on the right side, and the right image region corresponding to the right image is positioned on the left side.

[0045] Here, a VR image is an image that can be displayed in VR, as described later. VR images include omnidirectional images (spherical images) captured by an omnidirectional camera (spherical camera), and panoramic images with a wider field of view (effective field of view) than the display area that can be displayed at once on the display unit. Furthermore, VR images are not limited to still images, but also include videos and live images (images acquired from the camera in near real-time). A VR image has a field of view (effective field of view) of up to 360 degrees horizontally and vertically. In addition, VR images also include images with a wider field of view than that that can be captured by a normal camera, or an image range wider than the display area that can be displayed at once on the display unit, even if the field of view is less than 360 degrees horizontally or vertically. Images captured by the camera 100 using the lens unit 300 described above are a type of VR image. VR images can be displayed in VR, for example, by setting the display mode of a display device (a display device that can display VR images) to "VR View". By displaying a portion of a VR image with a 360-degree field of view, users can move the displayed area by changing the orientation of the display device left or right (horizontal rotation direction), allowing them to view seamless, omnidirectional images in the left and right directions.

[0046] VR display (VR view) is a display method (display mode) that allows the display range to be changed, displaying images within a field of view that corresponds to the orientation of the display device. One type of VR display is "single-eye VR display (single-eye VR view)," which displays a single image by performing a transformation (distortion correction) that maps the VR image to a virtual sphere. Another type of VR display is "two-eye VR display (two-eye VR view)," which displays a VR image for the left eye and a VR image for the right eye side by side by performing a transformation that maps each to a virtual sphere. By performing "two-eye VR display" using VR images for the left eye and the right eye that have parallax with each other, it is possible to view these VR images in 3D. In any type of VR display, for example, when a user wears a display device such as an HMD (head-mounted display), the image displayed will correspond to the field of view that corresponds to the orientation of the user's face. For example, suppose that in a VR image, at a certain point in time, the image displayed will correspond to a field of view that is centered around 0 degrees horizontally (a specific direction, e.g., north) and 90 degrees vertically (90 degrees from the zenith, i.e., horizontal). From this state, reverse the orientation of the display device (e.g.) For example, if the display surface is changed from facing south to facing north, the display range of the same VR image changes to an image with a field of view centered on 180 degrees horizontally (opposite direction, e.g., south) and 90 degrees vertically. In other words, when a user wearing the HMD turns their face from north to south (i.e., turns their back), the image displayed on the HMD also changes from a northern image to a southern image. Note that the VR image captured using the lens unit 300 is a VR180 image (180° image) that captures a range of approximately 180 degrees in front, and there is no image of a range of approximately 180 degrees behind. If such a VR180 image is displayed in VR and the orientation of the display device is changed to the side where there is no image, a blank area will be displayed.

[0047] By displaying VR images in VR in this way, users can visually experience the sensation (immersion) of being inside the VR image (in VR space). Note that the method of displaying VR images is not limited to changing the orientation of the display device. For example, the display range may be moved (scrolled) in response to user operations via a touch panel or directional buttons. Furthermore, during VR display (in "VR View" display mode), in addition to changing the display range due to changes in orientation, the display range may also be moved in response to touch movements on the touch panel, drag operations with a mouse, or pressing of directional buttons. Note that a smartphone mounted on VR goggles (head-mounted adapter) is a type of HMD (Head-Mounted Display).

[0048] The image processing unit 214 can perform false color processing as a color conversion process. False color processing converts the color of each pixel in the captured image (image captured by the imaging unit 211) to a color corresponding to the pixel's brightness level (pixel value). For false color processing, multiple colors corresponding to multiple parts of the pixel value range are predetermined. False color processing converts the color of each pixel in the captured image according to the correspondence between the multiple parts of the pixel value range and the multiple colors. Figure 4 shows an example of the meaning of each color (converted color) after false color processing. In the example in Figure 4, the gradation value is an 8-bit value, and the color of the white area (including the blown-out white area) with a gradation value of 255 is converted to red, the color of the gray area with a gradation value between 193 and 254 is converted to yellow, and the color of the gray area with a gradation value between 129 and 192 is converted to pink. Then, the gray areas with a gradation value of 65 or higher and 128 or lower are converted to green, the gray areas with a gradation value of 1 or higher and 64 or lower are converted to blue, and the black areas (including crushed black areas) with a gradation value of 0 are converted to purple. Although an example of achromatic colors being converted to chromatic colors has been explained, chromatic colors may also be converted to achromatic colors, or chromatic colors may be converted to other chromatic colors.

[0049] As described above, a binocular image includes an image region (right image region, left image region) and a non-image region. In an captured image that includes both an image region and a non-image region, the boundary between the image region and the non-image region may be ambiguous. For example, if the edges of the image region are dark and the non-image region is black, the boundary between the image region and the non-image region becomes ambiguous. Furthermore, if a predetermined image processing, such as false color processing, is applied to a captured image that includes both an image region and a non-image region, the predetermined image processing is applied not only to the image region but also to the non-image region. This embodiment solves these problems and displays an image based on a captured image that includes both an image region and a non-image region (such as the captured image or an image after predetermined image processing) in a suitable state.

[0050] <Embodiment 1> In Embodiment 1, an image after predetermined image processing is displayed in a state where the predetermined image processing is applied to the image area but not to the non-image area. For example, the image processing unit 214 applies the predetermined image processing to the image area but does not apply it to the non-image area. As the predetermined image processing, let's assume that false color processing is performed. Figure 5 shows an example of a display image (an image displayed on the display unit 108 or EVF 217) according to Embodiment 1. In Figure 5, the color of the black crushed area 504 in the right image area 502 and the color of the black crushed area 505 in the left image area 503 are converted to different colors by false color processing. On the other hand, the color of the non-image area 501 is not converted from black. In Figure 5, the image area (right image area 502, left image area 50 3) is the region within the image circle, while the non-image region 501 is the region outside the image circle.

[0051] Figure 6 is a flowchart showing an example of the LV display process according to Embodiment 1. This LV display process is realized when the system control unit 50 loads a program recorded in the non-volatile memory 219 into the system memory 218 and executes it. For example, when the camera 100 is started in shooting mode, or when the mode of the camera 100 is switched to shooting mode, the LV display process shown in Figure 6 starts.

[0052] In step S601, the system control unit 50 determines whether the lens unit attached to the camera 100 is a twin-lens unit (for example, lens unit 300). If it is a twin-lens unit, the system proceeds to step S602; otherwise, the system proceeds to step S603.

[0053] In step S602, the system control unit 50 acquires mask information (mask information indicating the presence of a mask) corresponding to the twin-lens unit attached to the camera 100. The mask information is, for example, information indicating at least one of the image region and the non-image region.

[0054] For example, multiple mask information corresponding to multiple twin-lens units is pre-recorded in the non-volatile memory 219. The system control unit 50 acquires lens information (e.g., identification information such as an ID) related to the twin-lens unit attached to the camera 100 (information acquisition), and reads the mask information corresponding to the acquired lens information from the non-volatile memory 219. The system control unit 50 may also communicate with an external device (e.g., a server on the internet) (e.g., wireless communication) and acquire (download) the mask information corresponding to the acquired lens information from the external device. The lens information may include information indicating the position and diameter of the image circle, and the system control unit 50 may generate mask information based on the lens information. These processes can also be considered as processes that determine at least one of the image region and non-image region based on the lens information (region determination). The system control unit 50 may determine at least one of the image region and non-image region by analyzing the captured image, and generate mask information according to the determination result.

[0055] In step S603, the system control unit 50 acquires mask information indicating that there is no mask.

[0056] In step S604, the system control unit 50 acquires an image (live image) from the imaging unit 211 (image acquisition).

[0057] In step S605, the system control unit 50 determines whether the false color function (a function that performs false color processing) is enabled. If it is enabled, the system proceeds to step S606; otherwise, it proceeds to step S607.

[0058] In step S606, the system control unit 50 uses the mask information acquired in step S602 or step S603 to determine the area to which false color processing will be applied. If mask information was acquired in step S602, the system control unit 50 determines the image area as the area to be processed with false color processing so that false color processing is not applied to non-image areas. If mask information was acquired in step S603, the system control unit 50 determines the entire captured image as the area to be processed with false color processing. The system control unit 50 then controls the image processing unit 214 to apply false color processing to the area of ​​the captured image acquired in step S604 that was determined using the mask information. As a result, the image after false color processing is obtained as the output image (display image).

[0059] In step S607, the system control unit 50 controls the image processing unit 214 so that false color processing is not performed. As a result, the captured image acquired in step S604 (an image without false color processing) is obtained as the output image (display image). Note that the output image may be subjected to image processing other than false color processing.

[0060] In step S608, the system control unit 50 displays the output image obtained in step S606 or step S607 on the display unit 108 or EVF 217. The output image may also be displayed on an external monitor.

[0061] In step S609, the system control unit 50 determines whether or not to terminate the LV display (LV display process). If the LV display is to be terminated, the LV display process shown in Figure 6 is terminated; otherwise, the process proceeds to step S610. For example, the system control unit 50 terminates the LV display process shown in Figure 6 if it receives an instruction to turn off the power of the camera 100 (pressing the power switch 102) or an instruction to switch the mode of the camera 100 from shooting mode to another mode (pressing the mode switch 103).

[0062] In step S610, the system control unit 50 determines whether the lens unit attached to the camera 100 has been changed. If the lens unit has not been changed, the system proceeds to step S604; if the lens unit has been changed, the system proceeds to step S601.

[0063] As described above, according to Embodiment 1, no predetermined image processing is applied to the non-image area, while predetermined image processing is applied to the image area. As a result, an image based on the captured image including the image area and non-image area (an image after predetermined image processing) can be displayed in a suitable state.

[0064] Furthermore, the specified image processing is not limited to false color processing; for example, it may also include patterning processing (processing that converts the pattern of a specific area into a predetermined pattern such as a zebra pattern), sharpening processing, and various filtering processes.

[0065] Furthermore, the captured image to which the predetermined image processing is applied only to the image area is not limited to an image captured using a two-lens unit, but may also be an image captured using, for example, another compound lens unit (three-lens unit). The captured image to which the predetermined image processing is applied only to the image area may also be an image captured using a monocular fisheye lens, etc. The image to which the predetermined image processing is applied only to the image area is not limited to an image captured using a fisheye lens, but may also be a letterbox panoramic image captured using a standard wide-angle lens, etc.

[0066] <Embodiment 2> In Embodiment 2, the image after predetermined image processing is displayed in a state where the predetermined image processing is applied to the image area but not to the non-image area. Embodiment 1 described an example in which the predetermined image processing is applied to the image area but not to the non-image area. In Embodiment 2, predetermined image processing is applied to the entire captured image, and the image after predetermined image processing is displayed with a predetermined mask (mask image, graphic) superimposed on the non-image area.

[0067] Figure 7 is a flowchart showing an example of the LV display process according to Embodiment 1. This LV display process is realized when the system control unit 50 loads a program recorded in the non-volatile memory 219 into the system memory 218 and executes it. For example, when the camera 100 is started in shooting mode, or when the mode of the camera 100 is switched to shooting mode, the LV display process shown in Figure 7 starts.

[0068] In step S701, the system control unit 50 receives the captured image (live image) from the imaging unit 211. Obtain the image.

[0069] In step S702, the system control unit 50 determines whether the false color function is enabled or not. If it is enabled, the system proceeds to step S704; otherwise, it proceeds to step S703.

[0070] In step S703, the system control unit 50 displays the image acquired in step S701 on the display unit 108 or the EVF 217.

[0071] In step S704, the system control unit 50 controls the image processing unit 214 to apply false color processing to the entire image acquired in step S701.

[0072] In step S705, the system control unit 50 determines whether the lens unit attached to the camera 100 is a twin-lens unit. If it is a twin-lens unit, the system proceeds to step S706; otherwise, it proceeds to step S707.

[0073] In step S706, the system control unit 50 controls the image processing unit 214 to superimpose a mask corresponding to the twin-lens unit mounted on the camera 100 onto the false-color image (the image after false-color processing in step S704). The mask is superimposed on the false-color image so as to cover the non-image areas. The system control unit 50 then displays the false-color image with the superimposed mask on the display unit 108 or the EVF 217.

[0074] In step S707, the system control unit 50 displays a false color image without a mask on the display unit 108 or EVF217.

[0075] In step S708, the system control unit 50 determines whether or not to terminate the LV display (LV display process). If the LV display is to be terminated, the LV display process shown in Figure 7 is terminated; otherwise, the process proceeds to step S701.

[0076] As described above, according to Embodiment 2, a predetermined image processing is applied to the entire captured image, and the image after the predetermined image processing is displayed with a predetermined mask superimposed on the non-image area. This also makes it possible to display an image based on the captured image (the image after the predetermined image processing) that includes the image area and the non-image area in a suitable state, similar to Embodiment 1.

[0077] <Embodiment 3> In Embodiment 3, an image based on an captured image (such as the captured image or an image after predetermined image processing) is displayed with the boundary between the image region and the non-image region emphasized. For example, the image processing unit 214 overlays the boundary line (boundary line image, graphic) between the image region and the non-image region onto the image based on the captured image. Figure 8 shows an example of a display image according to Embodiment 3. In Figure 8, the boundary line 804 between the right image region 802 and the non-image region 801, and the boundary line 805 between the left image region 803 and the non-image region 801 are depicted. In Figure 8, the image region (right image region 802, left image region 803) is the region within the image circle, and the non-image region 801 is the region outside the image circle. Although an example without predetermined image processing such as false color processing is described, predetermined image processing may be performed in the same manner as in Embodiment 1 and Embodiment 2.

[0078] Figure 9 is a flowchart showing an example of the LV display process according to Embodiment 3. This LV display process is realized when the system control unit 50 loads a program recorded in the non-volatile memory 219 into the system memory 218 and executes it. For example, when the camera 100 is started in shooting mode, or when the mode of the camera 100 is switched to shooting mode, the LV display process shown in Figure 9 starts.

[0079] In step S901, the system control unit 50 acquires an image (live image) from the imaging unit 211.

[0080] In step S902, the system control unit 50 determines whether the lens unit attached to the camera 100 is a twin-lens unit. If it is a twin-lens unit, the system proceeds to step S903; otherwise, it proceeds to step S904.

[0081] In step S903, the system control unit 50 controls the image processing unit 214 to superimpose the boundary line (the boundary line between the image area and the non-image area) corresponding to the twin-lens unit mounted on the camera 100 onto the captured image acquired in step S901. The system control unit 50 then displays the captured image with the superimposed boundary line on the display unit 108 or the EVF 217.

[0082] In step S904, the system control unit 50 displays the captured image (the captured image without overlapping boundaries) acquired in step S901 on the display unit 108 or the EVF 217.

[0083] In step S905, the system control unit 50 determines whether or not to terminate the LV display (LV display process). If the LV display is to be terminated, the LV display process shown in Figure 9 is terminated; otherwise, the process proceeds to step S901.

[0084] As described above, according to Embodiment 3, the boundary between the image region and the non-image region is emphasized. This makes it possible to display an image based on an captured image (such as the captured image or an image after predetermined image processing) that includes both the image region and the non-image region in a suitable state.

[0085] Furthermore, as long as the boundary between the image area and the non-image area can be made prominent, the color, brightness, and line type of the boundary are not particularly limited. For example, the color and brightness of the boundary may be changed according to the color and brightness of the image area.

[0086] Furthermore, methods for emphasizing (making stand out) the boundary between the image area and the non-image area are not limited to overlapping the boundary line. For example, the non-image area may be filled with a color not used in the image area, or the pattern of the non-image area may be converted into a predetermined pattern such as a zebra pattern.

[0087] Furthermore, the various controls described above, which are performed by the system control unit 50, may be performed by a single piece of hardware, or multiple pieces of hardware (for example, multiple processors or circuits) may share the processing to control the entire device.

[0088] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0089] Furthermore, the present invention is not limited to cameras (imaging devices), but can be applied to any electronic device (display control device) capable of controlling the display of an image. For example, the present invention can be applied to personal computers, PDAs, mobile phone terminals and portable image viewers, printers, digital photo frames, music players, game consoles, e-book readers, etc. The present invention can also be applied to video players, display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances, and in-vehicle devices. The present invention can also be applied to multi-lens smartphones that have multiple optical systems of different types, such as standard lenses, wide-angle lenses, and zoom lenses. Even in such cases, stereoscopic viewing is possible if the focal lengths (zoom magnification) of the two optical systems used are matched (made common) when shooting. You can obtain high-quality images.

[0090] Furthermore, the present invention is applicable not only to the imaging device itself, but also to a control device that communicates with the imaging device (including network cameras) via wired or wireless communication and remotely controls the imaging device. Examples of devices that remotely control the imaging device include smartphones, tablet PCs, and desktop PCs. The imaging device can be remotely controlled by notifying the imaging device of commands to perform various operations and settings based on operations and processes performed on the control device side. In addition, live view images captured by the imaging device may be received via wired or wireless communication and displayed on the control device side.

[0091] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0092] This embodiment includes the following configurations, methods, programs, and media. (Composition 1) Image acquisition means for acquiring an image that includes an image region and a non-image region, Image processing means for performing predetermined image processing on the captured image, Display control means for controlling the display of the image after the predetermined image processing in a state in which the predetermined image processing has been applied to the image area and the predetermined image processing has not been applied to the non-image area. A display control device characterized by having the following features. (Configuration 2) The aforementioned predetermined image processing is a color conversion process. A display control device according to configuration 1, characterized by the above. (Composition 3) Multiple colors are predetermined to correspond to multiple parts of the pixel value range. The color conversion process is a false color process that converts the color of each pixel in the captured image according to the correspondence between the plurality of parts and the plurality of colors. The display control device according to configuration 2, characterized in that... (Composition 4) The image processing means does not apply the predetermined image processing to the non-image area, but applies the predetermined image processing to the image area. A display control device according to any one of configurations 1 to 3. (Composition 5) The image processing means applies the predetermined image processing to the entire captured image. The display control means controls the display of the image after the predetermined image processing by superimposing a predetermined mask onto the non-image area. A display control device according to any one of configurations 1 to 3. (Composition 6) The aforementioned image region is the region within the image circle, and the aforementioned non-image region is the region outside the image circle. A display control device according to any one of configurations 1 to 5, characterized in that it is a display control device. (Composition 7) The aforementioned captured image is an image captured using a compound eye lens unit. A display control device according to any one of configurations 1 to 6, characterized by the above. (Composition 8) The aforementioned captured image is an image taken using a fisheye lens. A display control device according to any one of configurations 1 to 6, characterized by the above. (Composition 9) The system further comprises region determination means for determining at least one of the image region and the non-image region by analyzing the captured image. A display control device according to any one of configurations 1 to 8. (Composition 10) Information acquisition means for acquiring information about the lens unit used to capture the aforementioned image, Region determination means for determining at least one of the image region and the non-image region based on the aforementioned information. Furthermore, it has A display control device according to any one of configurations 1 to 8. (Composition 11) The display control means controls the display of the image after the predetermined image processing so that the predetermined image processing is applied to the image area, the predetermined image processing is not applied to the non-image area, and the boundary between the image area and the non-image area is emphasized. A display control device according to any one of configurations 1 to 10, characterized in that it is a display control device. (Composition 12) The display control means controls the image after the predetermined image processing to be displayed with the boundary line between the image area and the non-image area superimposed, in a state where the predetermined image processing has been applied to the image area but the predetermined image processing has not been applied to the non-image area. The display control device according to configuration 11, characterized by the above. (Composition 13) Image acquisition means for acquiring an image that includes an image region and a non-image region, Display control means for controlling the display of an image based on the captured image so that the boundary between the image region and the non-image region is emphasized. A display control device characterized by having the following features. (Method 1) Image acquisition step to acquire an image containing both image and non-image regions, An image processing step of applying predetermined image processing to the captured image, A display control step that controls the display of the image after the predetermined image processing so that the predetermined image processing is applied to the image area and not to the non-image area. A display control method characterized by having the following features. (Method 2) Image acquisition step to acquire an image containing both image regions and non-image regions, A display control step that controls the display of an image based on the captured image so that the boundary between the image region and the non-image region is emphasized. A display control method characterized by having the following features. (program) A program for causing a computer to function as one of the means of the display control device described in any one of configurations 1 to 13. (medium) A computer-readable storage medium containing a program for causing the computer to function as one of the means of the display control device described in any one of the configurations 1 to 13. [Explanation of Symbols]

[0093] 100: Digital Camera 50: System control unit 211: Imaging unit 214: Image processing unit

Claims

1. Image acquisition means for acquiring a captured image including an image area and a non-image area, Image processing means for performing color conversion processing on the captured image, Display control means for controlling to display the image after the color conversion processing in a state where the color conversion processing is performed on the image area and not performed on the non-image area A display control device characterized by comprising the same.

2. A plurality of colors respectively corresponding to a plurality of portions of the pixel value range are predetermined, The color conversion processing is false color processing for converting the color of each pixel of the captured image according to the correspondence between the plurality of portions and the plurality of colors The display control device according to claim 1, characterized in that.

3. The image processing means does not perform the color conversion processing on the non-image area and performs the color conversion processing on the image area The display control device according to claim 1, characterized in that.

4. The image processing means performs the color conversion processing on the entire captured image, The display control means controls to display the image after the color conversion processing with a predetermined mask superimposed on the non-image area The display control device according to claim 1, characterized in that.

5. The image area is an area within the image circle, and the non-image area is an area outside the image circle The display control device according to claim 1, characterized in that.

6. The captured image is an image captured using a compound eye lens unit The display control device according to claim 1, characterized in that.

7. The captured image is an image captured using a fish-eye lens The display control device according to claim 1, characterized in that.

8. Further comprising region determination means for determining at least one of the image region and the non-image region by analyzing the captured image The display control device according to claim 1, characterized in that.

9. Information acquisition means for acquiring information on the lens unit used for capturing the captured image, Region determination means for determining at least one of the image region and the non-image region based on the information Further comprising The display control device according to claim 1, characterized in that.

10. The display control means controls to display the image after the color conversion process in a state where the color conversion process is applied to the image region, the color conversion process is not applied to the non-image region, and the boundary between the image region and the non-image region is emphasized. The display control device according to claim 1, characterized in that.

11. The display control means controls to display the image after the color conversion process in a state where the color conversion process is applied to the image region and the color conversion process is not applied to the non-image region, with the boundary line between the image region and the non-image region superimposed. The display control device according to claim 10, characterized in that.

12. Image acquisition means for acquiring a captured image including an image region and a non-image region, Display control means for controlling to display the image based on the captured image in a state where the boundary between the image region and the non-image region is emphasized A display control device, characterized by comprising.

13. An image acquisition step of acquiring a captured image including an image region and a non-image region, An image processing step of performing a color conversion process on the captured image, A display control method, comprising: a display control step of controlling to display the image after the color conversion process in a state where the color conversion process is applied to the image area and not applied to the non-image area.

14. An image acquisition step of acquiring a captured image including an image area and a non-image area; A display control step of controlling to display an image based on the captured image in a state where the boundary between the image area and the non-image area is emphasized; The display control method is characterized by comprising the above steps.

15. A program for causing a computer to function as each means of the display control device according to any one of Claims 1 to 12.

16. A computer-readable storage medium storing a program for causing a computer to function as each means of the display control device according to any one of Claims 1 to 12.

Images