Information processing device, information processing method, program
Patent Information
- Application Number
- JP2022111787
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-07-12
- Publication Date
- 2026-10-13
- Estimated Expiration
- 2042-07-12
AI Technical Summary
【0008】 本発明によれば、ユーザーが所望する処理を実行しやすいように、互いに視差を有する2つの領域を含む画像を表示することができる。
Smart Images

Figure 0007933557000001 
Figure 0007933557000002 
Figure 0007933557000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.
Background Art
[0002] In recent years, digital cameras having two lens optical systems are known. If the two optical systems are arranged to image the same direction, two images having parallax with each other are acquired. Patent Document 1 describes a technique for creating an image (hemispherical image) obtained by imaging a 180-degree range in front of the digital camera and an image capable of stereoscopic viewing from these two images.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of Invention
Problems to be Solved by the Invention
[0004] When a digital camera having two optical systems as described above performs imaging, two image regions acquired via the two optical systems are displayed on one image (screen). At this time, if each image region is displayed in a small size, it may be difficult for the photographer to check the details of a specific part of the image when a certain adjustment process is applied to the image. On the other hand, when the photographer performs other processing on the image, there is a case where the photographer does not want to check a specific part in detail but wants to check the entire image including the two image regions.
[0005] Accordingly, an object of the present invention is to provide a technique for displaying an image including two regions having parallax with each other so that a user can easily execute a desired process.
Means for Solving the Problems
[0006] One aspect of the present invention is An acquisition means for acquiring captured images, The first and second items, each containing multiple setting items, are displayed together with the captured image. Display section A display control means for controlling, A determination means for determining whether the captured image is a binocular image that includes a first region acquired by imaging through a first imaging lens and a second region acquired by imaging through a second imaging lens, which has a parallax with respect to the first region. 1) If the captured image is determined to be the two-lens image and any of the first setting items is selected, the first and second regions of the captured image are displayed at the first display magnification. Display section Control, 2) If the captured image is determined to be the binocular image and any of the setting items in the second item is selected, the system will display only one of the first and second regions of the captured image at a second display magnification greater than the first display magnification. Display section Control means for controlling, to have death, The control means is If any of the first setting items is selected, the display unit is controlled to display the first setting change screen including the captured image. If any of the settings from the second item described above is selected, the display unit is controlled to display the second setting change screen, which includes the captured image. do 、 This is an information processing device characterized by the following features.
[0007] One aspect of the present invention is, The acquisition step involves obtaining the captured image, The first and second items, each containing multiple setting items, are displayed together with the captured image. Display section A display control step that controls the following: a determination step of determining whether the captured image is a binocular image that includes a first region acquired by imaging through a first photographing lens, and a second region that is a region acquired by imaging through a second photographing lens and has parallax with respect to the first region; 1) When it is determined that the captured image is the binocular image, and any setting item among the first items is selected, the Display section is controlled to display both the first region and the second region in the captured image at a first display magnification, 2) When it is determined that the captured image is the binocular image, and any one of the second items is selected, the Display section is controlled to display only either one of the first region and the second region in the captured image at a second display magnification larger than the first display magnification, a control step; comprising death, In the control step described above, If any of the first setting items is selected, the display unit is controlled to display the first setting change screen including the captured image. If any of the settings from the second item described above is selected, the display unit is controlled to display the second setting change screen, which includes the captured image. the steps above 、 This is an information processing method characterized by the above features. [[ID=25】Effects of the Invention]
[0008] According to the present invention, it is possible to display an image including two regions having parallax from each other, so that a user can easily execute a desired process. Brief Description of the Drawings
[0009] [Figure 1] This is an external view of a digital camera. [Figure 2] This is a block diagram of a digital camera. [Figure 3] This is a schematic diagram illustrating the configuration of a lens unit. [Figure 4] This is a diagram for describing a live view image displayed at equal magnification. [Figure 5]It is a diagram for explaining an enlarged and displayed LV image. [Figure 6] It is a diagram for explaining a menu displayed on the LV image. [Figure 7] It is a diagram for explaining a menu displayed on the LV image. [Figure 8] It is a diagram for explaining an example of a setting change screen. [Figure 9] It is a diagram for explaining an example of a setting change screen. [Figure 10] It is a flowchart showing processing in a shooting mode. [Figure 11] It is a flowchart showing setting change processing after a setting item is selected. [Figure 12] It is a flowchart showing setting change processing after a setting item is selected. [Mode for Carrying Out the Invention]
[0010] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. In the present embodiment, a case where the information processing apparatus (electronic device) is a digital camera 100 (imaging apparatus) will be described as an example. However, the present embodiment is applicable to any information processing apparatus as long as it is an information processing apparatus capable of executing at least part of the processing of the digital camera 100 (for example, a personal computer, a smartphone, or a server).
[0011] The digital camera 100 can acquire an image (a two-lens image) in which a left image and a right image having a predetermined parallax in the left-right direction are placed side by side, and display it on the display unit. Furthermore, the digital camera 100 can apply predetermined image processing to a target range (the range to be processed) of the image displayed on the display unit. The predetermined image processing is, for example, magnification processing. The digital camera 100 displays an image (magnified image) with the target range magnified in response to a magnification instruction on the display unit. In this embodiment, the magnification instruction is given by pressing the magnification button 78 (a pressable physical element), but the magnification instruction may also be given by pinching in on the touch panel 70a, and the magnified display may be canceled by pinching out. Note that the predetermined image processing is not limited to magnification processing. For example, the predetermined image processing may be a process that detects the luminance distribution and chromaticity distribution within the target range and generates a histogram or waveform monitor, or a process that applies a filter processing such as contrast enhancement processing to the target range.
[0012] The digital camera 100 displays items (display items) indicating the target area in the two-lens image. The item is, for example, a frame-shaped indicator (marker) that shows the target area, or a semi-transparent color image that is superimposed on the target area. The digital camera 100 can change the display position of the item (i.e., the target area indicated by the item) according to user operation. When the digital camera 100 is displaying a two-lens image, it displays the item in a position that does not straddle the left image and the right image. In other words, the target area is determined so as not to include both the left image and the right image. To put it another way, the target area (the area indicated by the item) is set to include only one of the left image or the right image.
[0013] Digital Camera 100 controls the display of items so that even if the user changes the display position (position of the target area) of an item, the target area indicated by the item does not span across the left and right images.
[0014] Figures 1A and 1B show an external view of a digital camera 100 as an example of a device to which the present invention can be applied. Figure 1A is a front perspective view of the digital camera 100, and Figure 1B is a rear perspective view of the digital camera 100. In Figures 1A and 1B, the display unit 28 is a display unit (a display unit provided on the back of the camera) that displays images and various information. The touch panel 70a is a touch detection unit that can detect touch operations on the display surface (operating surface) of the display unit 28. The viewfinder-external display unit 43 is a display unit provided on the top surface of the camera that displays various camera settings, including shutter speed and aperture.
[0015] The shutter button 61 is an operating part for issuing shooting instructions. The mode selector switch 60 is an operating part for switching between various modes. The terminal cover 40 is a cover that protects connectors (not shown) such as connection cables (cables that connect external devices to the digital camera 100). The main electronic dial 71 is a rotating operating element included in the operating section 70. By turning the main electronic dial 71, the user can change settings such as shutter speed and aperture. The power switch 72 is an operating element that switches the power of the digital camera 100 ON and OFF.
[0016] The sub-electronic dial 73 is included in the control unit 70 and is a rotary operating component included in the control unit 70. By operating the sub-electronic dial 73, the user can move the selection frame, advance images, etc. The directional pad 74 is included in the control unit 70 and is a directional pad (4-way key) with up, down, left, and right sections that can be pressed. Operations can be performed according to the part of the directional pad 74 that is pressed. The SET button 75 is a push button included in the control unit 70 and is mainly used for confirming selection items. The video button 76 is used to instruct the start and stop of video recording.
[0017] The magnification button 78 is included in the control unit 70 and is used to turn the magnification mode ON and OFF in the live view display in shooting mode. By turning the magnification mode ON and then operating the main electronic dial 71, the LV image can be enlarged or reduced. In playback mode, it functions as a magnification button to enlarge the playback image and increase the display magnification. The playback button 79 is also included in the control unit 70 and is used to switch between shooting mode and playback mode. By pressing the playback button 79 while in shooting mode, the camera switches to playback mode, and the latest image recorded on the recording medium 200 can be displayed on the display unit 28.
[0018] The menu button 81 is included in the operation unit 70, and when the menu button 81 is pressed, various configurable menus (menu screens) are displayed on the display unit 28. The user can intuitively make various settings using the directional keys 74 or the SET button 75 while referring to the menu displayed on the display unit 28.
[0019] The multi-controller 82 can be tilted in any direction within 360 degrees to control the 8 directions (up, down, left, right, etc.). It can be used for directional key instructions. The multi-controller 82 can also be used to activate assigned functions by pressing it. The display mode switching button 83 is an operating element for switching between multiple different display modes for information such as the live view image and shooting information displayed on the display unit 28 or EVF 29. Each time the display mode switching button 83 is pressed, the display mode is switched. This allows the user to view information about the image being shot or played back in the desired display mode. The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens side (detachable).
[0020] The eyepiece section 16 is the eyepiece of the eyepiece viewfinder (a type of viewfinder that you look through). The user can view the image displayed on the internal EVF 29 through the eyepiece section 16. The eyepiece detection section 57 is an eyepiece detection sensor that detects whether or not the photographer is looking through the eyepiece section 16. The cover 202 is the cover of the slot that houses the recording medium 200. The grip section 90 is a holding section shaped to be easily gripped by the user with their right hand when holding the digital camera 100. With the digital camera held by gripping the grip section 90 with the little finger, ring finger, and middle finger of the right hand, the shutter button 61 and the main electronic dial 71 are positioned to be operated by the index finger of the right hand. Also, in the same position, the sub electronic dial 73 is positioned to be operated by the thumb of the right hand.
[0021] Figure 2 is a block diagram showing an example configuration of the digital camera 100 according to this embodiment. In Figure 2, the lens unit 150 is a lens unit equipped with an interchangeable photographic lens. The lens 103 is usually composed of multiple lenses, but here it is shown simply as a single lens. Communication terminal 6 is a communication terminal for the lens unit 150 to communicate with the digital camera 100. Communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens unit 150. The lens unit 150 communicates with the system control unit 50 via these communication terminals 6 and 10. The lens unit 150 controls the aperture 1 via the aperture drive circuit 2 using an internal lens system control circuit 4, and focuses by displacing the position of the lens 103 via the AF drive circuit 3. The digital camera 100 also identifies the type of lens unit 150 attached to the digital camera 100 via communication terminals 6 and 10.
[0022] The shutter 101 is a focal-plane shutter that allows the exposure time of the imaging unit 22 to be freely controlled by the system control unit 50.
[0023] The imaging unit 22 is an image sensor composed of a CCD or CMOS element, etc., which converts an optical image into an electrical signal. The imaging unit 22 may have an image plane phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 23 converts an analog signal into a digital signal. The A / D converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.
[0024] The image processing unit 24 performs predetermined pixel interpolation, resizing (such as reduction), and color conversion processing on the data (data from the A / D converter 23 or data from the memory control unit 15). The image processing unit 24 also performs predetermined calculation processing using the captured image data. Based on the calculation results obtained by the image processing unit 24, the system control unit 50 performs exposure control and distance measurement control. This enables TTL (through-the-lens) AF (autofocus), AE (automatic exposure), and EF (flash pre-flash) processing. The image processing unit 24 further performs predetermined calculation processing using the captured image data and performs TTL AWB (auto white balance) processing based on the obtained calculation results.
[0025] The output data from the A / D converter 23 is processed via the image processing unit 24 and the memory control unit 15. Alternatively, the data is written directly to the memory 32 via the memory control unit 15. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as image data for display on the display unit 28 and EVF 29. The memory 32 has sufficient storage capacity to store a predetermined number of still images, a predetermined amount of video footage, and audio. The memory 32 also serves as a memory for image display (video memory).
[0026] The D / A converter 19 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28 or EVF 29. In this way, the display image data written to the memory 32 is displayed by the display unit 28 or EVF 29 via the D / A converter 19. The display unit 28 or EVF 29 displays the image on a display device such as an LCD or organic EL according to the analog signal from the D / A converter 19. By converting the digital signal (the signal that has been A / D converted once by the A / D converter 23 and stored in the memory 32) into an analog signal in the D / A converter 19 and sequentially transferring it to the display unit 28 or EVF 29 for display, live view display (LV display) can be performed. Hereinafter, the image displayed in live view will be referred to as the live view image (LV image).
[0027] The external viewfinder display unit 43 displays various camera settings, including shutter speed and aperture, via the external viewfinder display unit drive circuit 44.
[0028] The non-volatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. The non-volatile memory 56 stores constants for the operation of the system control unit 50, programs, etc. The program referred to here is a program for executing various flowcharts described later in this embodiment.
[0029] The system control unit 50 is a control unit consisting of at least one processor or circuit, and controls the entire digital camera 100. It realizes each of the processes of this embodiment, which will be described later, by executing the program recorded in the non-volatile memory 56 mentioned above. For example, RAM is used in the system memory 52, and constants, variables for the operation of the system control unit 50, the program read from the non-volatile memory 56, etc. are stored there. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 19, the display unit 28, etc.
[0030] The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of the built-in clock.
[0031] The operation unit 70 is an operation unit for inputting various operation instructions to the system control unit 50. The mode switching switch 60 is an operating component included in the operation unit 70 and switches the operating mode of the system control unit 50 to one of the following: still image shooting mode, video shooting mode, playback mode, etc. Modes included in the still image shooting mode include auto shooting mode, auto scene detection mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide shooting settings for different shooting scenes. The user can switch directly to any of these modes using the mode switching switch 60. Alternatively, the user can switch to a list screen of shooting modes using the mode switching switch 60, select one of the displayed modes, and then switch using another operating component. Similarly, the video shooting mode may also include multiple modes.
[0032] The first shutter switch 62 turns ON during the operation of the shutter button 61 on the digital camera 100, specifically when it is half-pressed (instruction to prepare for shooting), and generates the first shutter switch signal SW1. The generation of the first shutter switch signal SW1 triggers shooting preparation operations (AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance)). Start processing (e.g., flash pre-flash processing).
[0033] The second shutter switch 64 turns ON when the shutter button 61 is fully pressed (shooting instruction), generating the second shutter switch signal SW2. Upon generation of the second shutter switch signal SW2, the system control unit 50 starts a series of shooting processes (from reading the signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file).
[0034] The control unit 70 consists of various operating components (reception units) that act as input units for receiving operations from the user. The control unit 70 includes at least the following operating units: shutter button 61, main electronic dial 71, power switch 72, sub electronic dial 73, cross key 74, SET button 75, video button 76, AF lock button 77, zoom button 78, playback button 79, menu button 81, and multi-controller 82.
[0035] The power control unit 80 consists of a battery detection circuit, a DC-DC converter, a switch circuit (a circuit that switches which block is energized), and the like. The power control unit 80 detects whether a battery is installed, the type of battery, and the remaining battery level. The power control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, supplying the necessary voltage to each part, including the recording medium 200, for the required period of time. The power supply unit 30 consists of a primary battery (alkaline battery or lithium battery, etc.), a secondary battery (NiCd battery, NiMH battery, or Li battery, etc.), an AC adapter, and the like.
[0036] The recording medium I / F18 is an interface to the recording medium 200, such as a memory card or hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images. The recording medium 200 is composed of semiconductor memory, magnetic disks, etc.
[0037] The communication unit 54 connects to external devices wirelessly or via wired cable to transmit and receive video and audio signals. The communication unit 54 can also connect to wireless LAN (Local Area Network) and the internet. Furthermore, the communication unit 54 can communicate with external devices using Bluetooth® and Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the imaging unit 22 and images recorded on the recording medium 200. In addition, the communication unit 54 can receive images and other various information from external devices.
[0038] The attitude detection unit 55 detects the orientation of the digital camera 100 relative to the direction of gravity. Based on the orientation detected by the attitude detection unit 55, it is possible to determine whether the image captured by the imaging unit 22 was taken with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the attitude detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate the image before recording. An acceleration sensor or gyro sensor can be used as the attitude detection unit 55. It is also possible to detect the movement of the digital camera 100 (pan, tilt, lift, whether it is stationary or not, etc.) using the acceleration sensor or gyro sensor in the attitude detection unit 55.
[0039] The eyepiece detection unit 57 is an eyepiece detection sensor that detects the approach (eye-to-eye contact) and retraction (eye-away) of the eye (object) to the eyepiece 16 of the viewfinder (proximity detection). The system control unit 50 switches the display (display state) / hidden (hidden state) of the display unit 28 and EVF 29 according to the state detected by the eyepiece detection unit 57. More specifically, at least in the shooting standby state and when the display destination switching is automatic, when not using an eyepiece, the display destination is set to the display unit 28 and the display is turned on, and the EVF 29 is hidden. Also, when using an eyepiece, the display destination is set to the EVF 29 The display is turned on, and the display unit 29 is hidden.
[0040] The eyepiece detection unit 57 includes, for example, an infrared proximity sensor. The eyepiece detection unit 57 can detect the approach of any object to the eyepiece 16 of the viewfinder, which houses the EVF 29. When an object approaches, infrared light emitted from the light emitter (not shown) of the eyepiece detection unit 57 is reflected and received by the light receiver (not shown) of the infrared proximity sensor. The amount of infrared light received can also be used to determine how close the object is to the eyepiece 16 (eyepiece distance). In this way, the eyepiece detection unit 57 performs eyepiece detection to detect the proximity distance of an object to the eyepiece 16.
[0041] The system detects that the eyepiece has been used when an object approaches the eyepiece 16 within a predetermined distance from the non-eyepiece state (non-proximity state). The system detects that the eye has been removed when the object that was detected approaching moves beyond a predetermined distance from the eyepiece state (proximity state). The threshold for detecting eyepiece use and the threshold for detecting eye removal may be different, for example, by providing hysteresis. After detecting eyepiece use, the system remains in the eyepiece state until eye removal is detected. After detecting eye removal, the system remains in the non-eyepiece state until eyepiece use is detected again. Note that the infrared proximity sensor is just one example, and the eyepiece detection unit 57 may use any other sensor that can detect the approach of an eye or object that can be considered as eyepiece use.
[0042] The touch panel 70a and the display unit 28 can be configured as an integrated unit. For example, the touch panel 70a is configured such that its light transmittance does not interfere with the display of the display unit 28, and is mounted on the upper layer of the display surface of the display unit 28. Then, the input coordinates on the touch panel 70a are associated with the display coordinates on the display surface of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that makes it appear as if the user can directly operate the screen displayed on the display unit 28.
[0043] The system control unit 50 can detect the following operations or states on the touch panel 70a. - A finger or pen that was not previously touching the touch panel 70a now touches the touch panel 70a. In other words, the start of a touch (hereinafter referred to as Touch-Down). The touch panel 70a is being touched with a finger or pen (hereinafter referred to as Touch-On). - The user is moving while touching the touch panel 70a with their finger or pen (hereinafter referred to as Touch-Move). • The finger or pen that was touching the touch panel 70a is lifted. In other words, the touch action ends (hereinafter referred to as Touch-Up). • The touch panel 70a is not being touched (hereinafter referred to as Touch-Off).
[0044] When a touchdown is detected, a touch-on state is also detected simultaneously. After a touchdown, a touch-on state is usually detected unless a touch-up is detected. Touch move is also detected when a touch-on state is detected. Even if a touch-on state is detected, a touch move will not be detected if the touch position has not moved. After all fingers or pens that were touching have been detected as having touched up, the touch-off state is activated.
[0045] These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 70a, are notified to the system control unit 50 via the internal bus, and the system control unit 50 determines what kind of operation (touch operation) was performed on the touch panel 70a based on the notified information. For touch moves, the direction of movement of the finger or pen moving on the touch panel 70a is also notified. Based on the change in position coordinates, a determination can be made for each vertical and horizontal component on the touch panel 70a.
[0046] If a touch movement exceeding a predetermined distance is detected, it will be determined that a slide operation has been performed. A flick is an operation in which a finger is quickly moved a certain distance while touching the touch panel and then released. In other words, a flick is an operation in which the finger is quickly swiped across the touch panel 70a. If a touch movement exceeding a predetermined distance and at a predetermined speed is detected, and a touch-up is then detected, it can be determined that a flick has been performed (it can be determined that a flick followed a slide operation).
[0047] Furthermore, touching multiple points (for example, two points) simultaneously (multitouch) to bring them closer together is called a pinch-in, and touching them further apart is called a pinch-out. Pinch-out and pinch-in are collectively referred to as a pinch operation (or simply a pinch). The touch panel 70a may use any of the various types of touch panels, such as resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor types. Depending on the type, a touch may be detected when there is contact with the touch panel, or when a finger or pen approaches the touch panel; either type is acceptable.
[0048] Figure 3 is a schematic diagram showing an example of the configuration of the lens unit 300. Figure 3 shows the lens unit 300 attached to the digital camera 100. Note that components of the digital camera 100 shown in Figure 3 that are the same as those described in Figure 2 are denoted by the same reference numerals, and their descriptions are omitted as appropriate.
[0049] The lens unit 300 is a type of interchangeable lens that can be attached to and removed from the digital camera 100. The lens unit 300 is a twin-lens system capable of acquiring optical images with parallax between the left and right images. The lens unit 300 has two optical systems (photographic lenses), each with a wide field of view of 180 degrees, and can capture an area of the front hemisphere. Specifically, the two optical systems of the lens unit 300 can each input optical images of subjects contained within a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation / depression angle, pitch angle).
[0050] The lens unit 300 includes a right-eye optical system 301R (an optical system having multiple lenses and a reflective mirror, etc.), a left-eye optical system 301L (an optical system having multiple lenses and a reflective mirror, etc.), and a lens system control circuit 303. The right-eye optical system 301R corresponds to an example of a first optical system, and the left-eye optical system 301L corresponds to an example of a second optical system. In the right-eye optical system 301R and the left-eye optical system 301L, the lenses 302R and 302L located on the subject side are oriented in the same direction, and their optical axes are parallel. In addition, each optical system is a so-called fisheye lens, and a circular optical image is formed on the imaging unit 22 (sensor). The optical image input via the left-eye optical system 301L (left image) and the optical image input via the right-eye optical system 301R (right image) are imaged onto the imaging plane of one imaging unit 22, and the imaging unit 22 acquires an image including each optical image.
[0051] The lens unit 300 of this embodiment is a VR180 lens (two-lens lens) for capturing images in the so-called VR180 format (a VR image format that enables two-eye stereoscopic viewing). The VR180 lens has a fisheye lens in which the right eye optical system 301R and the left eye optical system 301L are each capable of capturing a range of 180 degrees. In addition, for the VR180 lens, it is sufficient that the right eye optical system 301R and the left eye optical system 301L each acquire an image that can be displayed as two-eye VR in VR180 format. For this reason, the VR180 lens may be a lens capable of capturing a wide field of view of about 160 degrees, which is narrower than the 180-degree range. The VR180 lens can form a right image (first image) formed via the right eye optical system 301R and a left image (second image) formed via the left eye optical system 301L, which has parallax with respect to the right image, on one or two image sensors of the camera to which it is mounted. In the digital camera 100 according to this embodiment, the right image and the left image are imaged on a single image sensor, and a single image (dual-lens image) is generated in which the image corresponding to the right image (image area of the right image) and the image corresponding to the left image (image area of the left image) are arranged side by side. The dual-lens image at this time includes the image area of the right image, the image area of the left image, and an area where no optical image is formed (blacked-out area).
[0052] Furthermore, the lens unit 300 is attached to the digital camera 100 via the lens mount portion 304 and the camera mount portion 305 of the digital camera 100. As a result, the system control unit 50 of the digital camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected via the communication terminal 10 of the digital camera 100 and the communication terminal 306 of the lens unit 300.
[0053] In this embodiment, the right image formed via the right-eye optical system 301R and the left image formed via the left-eye optical system 301L, which has parallax with respect to the right image, are imaged side by side on the imaging unit 22 of the digital camera 100. That is, two optical images formed by the right-eye optical system 301R and the left-eye optical system 301L are formed on a single image sensor. The imaging unit 22 converts the imaged subject image (optical signal) into an analog electrical signal to acquire image data of the binocular image. In this way, by using the lens unit 300, two images with parallax can be acquired simultaneously (as a set) from two locations (optical systems), the right-eye optical system 301R and the left-eye optical system 301L. Furthermore, by separating the acquired images into a left-eye image and a right-eye image and displaying them in VR, the user can view a three-dimensional VR image (so-called VR180) with a 180-degree range.
[0054] Conventionally, with a standard single-lens reflex camera, the image incident on the lens is inverted point-symmetrically around the optical axis and input to the sensor. Imaging devices like the digital camera 100 generate an image that does not appear distorted (uninverted) by reading the sensor and performing inversion processing on the read image. On the other hand, with a twin-lens reflex camera, the image is inverted point-symmetrically vertically and input to the sensor, but the image is not inverted horizontally. Images acquired through the left-eye optical system are input to the sensor on the left side, and images acquired through the right-eye optical system are input to the sensor on the right side. Therefore, if inversion processing is performed as before, the left and right sides of the digital camera 100 and the image after inversion processing will be reversed; that is, images acquired through the left-eye optical system will be displayed on the right side, and images acquired through the right-eye optical system will be displayed on the left side.
[0055] Here, a VR image is an image that can be displayed in VR, as described later. VR images include omnidirectional images (spherical images) taken with an omnidirectional camera (spherical camera), and panoramic images with a wider field of view (effective field of view) than the display area that can be displayed on the display unit at once. Furthermore, VR images are not limited to still images, but also include videos and live images (images acquired from the camera in near real-time). A VR image has a field of view (effective field of view) of up to 360 degrees horizontally and vertically. In addition, VR images also include images with a wider field of view than that that can be captured by a normal camera, or images with a wider field of view than the display area that can be displayed on the display unit at once, even if the field of view is less than 360 degrees horizontally or vertically. Images taken by the digital camera 100 using the aforementioned lens unit 300 are a type of VR image. VR images can be displayed in VR, for example, by setting the display mode of a display device (a display device that can display VR images) to "VR View". By displaying VR images with a 360-degree field of view in VR, users can change the orientation of the display device left or right (horizontal rotation direction) to view seamless, omnidirectional images in the left and right directions.
[0056] Here, VR display (VR view) refers to a display method (display mode) in which the display range can be changed, such as displaying an image within the field of view range corresponding to the orientation of the display device. One type of VR display is "single-eye VR display (single-eye VR view)," which displays a single image by performing a transformation (a transformation that applies distortion correction) that maps the VR image to a virtual sphere. Another type of VR display is "two-eye VR display (two-eye VR view)," which displays a VR image for the left eye and a VR image for the right eye side by side by performing a transformation that maps each to a virtual sphere. Stereoscopic viewing is possible by performing "two-eye VR display" using a VR image for the left eye and a VR image for the right eye that have parallax with each other.
[0057] Regardless of the VR display method, when a user wears a display device such as an HMD (Head-Mounted Display), the displayed image will have a field of view corresponding to the orientation of the user's face. For example, suppose a VR image is currently displaying an image with a field of view centered at 0 degrees horizontally (a specific direction, e.g., north) and 90 degrees vertically (90 degrees from the zenith, i.e., horizontal). If the orientation of the display device is then reversed (for example, changing the display surface from facing south to facing north), the display range of the same VR image will change to an image with a field of view centered at 180 degrees horizontally (the opposite direction, e.g., south) and 90 degrees vertically. In other words, if a user wearing an HMD turns their face from north to south (i.e., turns their back), the image displayed on the HMD will also change from a north image to a south image.
[0058] The VR image captured using the lens unit 300 of this embodiment is a VR180 image capturing a 180-degree range in front. Therefore, this VR image does not contain any images in the 180-degree range behind. When such a VR180 image is displayed, if the orientation of the display device is changed to the side where there is no image, a blank area will be displayed.
[0059] By displaying VR images in VR in this way, users can visually experience the sensation of being inside the VR image (in a VR space). Note that the method of displaying VR images is not limited to changing the orientation of the display device. For example, the display range may move (scroll) in response to user operations via a touch panel or directional buttons. Furthermore, during VR display (in the "VR View" display mode), in addition to changes in the display range due to changes in orientation, the display range may also be changed in response to specific operations (such as touch-movement on a touch panel, dragging with a mouse, or pressing directional buttons). Note that a smartphone mounted on VR goggles (head-mounted adapter) is a type of HMD (Head-Mounted Display).
[0060] In the digital camera 100, the binocular image captured via the lens unit 300 includes the image area of the right image input to the imaging unit 22 via the right-eye optical system, and the image area of the left image input to the imaging unit 22 via the left-eye optical system. Furthermore, a user of the digital camera 100 may enlarge a portion of the image (live view image or recorded image) to examine its details. In general digital cameras, when enlarging, the center of the enlargement is sometimes uniquely set to the center of the entire image.
[0061] On the other hand, to examine the details of a binocular image, it is desirable to display only a portion of the right image's area or only a portion of the left image's area. However, if the center of the magnification is uniquely set to the center of the entire image, then both the right and left image areas will be included in the magnified image. In this case, it is difficult for the user to intuitively understand which part of the original image the magnified image represents. Specifically, the left edge of the right image's area is placed on the right side of the magnified image, and the right edge of the left image's area is placed on the left side. As a result, the displayed magnified image will have a different left-right positional relationship than the actual positional relationship of the subject.
[0062] Therefore, in the following, when imaging is performed via a twin-lens system such as lens unit 300... This section describes the processing performed by the digital camera 100, which performs live view magnification suitable for this purpose.
[0063] (Regarding live view images) Figures 4 to 9 illustrate the display of the live view image (LV image) acquired by the digital camera 100 equipped with a twin-lens reflex camera on the display unit 28.
[0064] Figure 4 shows an example of displaying an LV image (imaging image) at a display magnification of 1:1 (i.e., standard field of view; no magnification). The display unit 28 displays an LV image that includes an image area 401 captured via the right eye optical system 301R and an image area 402 captured via the left eye optical system 301L.
[0065] Figure 5 shows an example of the LV image display after the display mode switching button 83 is pressed when the twin-lens reflex camera 100 is attached. The display unit 28 shows an enlarged image of a portion of the image area 402 (the image area on the right in Figure 4) of the LV image. In other words, in Figure 5, an enlarged image of the LV image is displayed at a higher display magnification than the 1:1 magnification shown in Figure 4. Here, in Figure 5, only one of the two image areas is displayed, so it is displayed at a display magnification greater than twice that of 1:1 magnification. In other words, the subject is displayed so that its vertical and horizontal lengths are more than twice as large as when displayed at 1:1 magnification.
[0066] Figure 6 shows an example of the menu displayed on the display unit 28 after the menu button 81 is pressed, when the digital camera 100 is equipped with a twin-lens reflex camera and an LV image with a standard field of view (reference field of view) as shown in Figure 4 is displayed on the display unit 28. The menu includes a first item group 431, a second item group 432, and a third item group 433. Each of the first item group 431, the second item group 432, and the third item group 433 includes multiple setting items.
[0067] The first group of items 431 includes, for example, setting items for an assist function (field of view assist function) to indicate a specific position in the captured image (field of view). The setting items for the assist function include setting items for determining the size of a user-specified marker (display item; frame) (user marker size), and setting items for determining the position of a user-specified marker (user marker position). The first group of items 431 may also include, for example, setting items for changing the brightness of the display surface of the display unit 28. This is because it is possible to set the brightness of the display surface of the display unit 28 more appropriately while viewing the entire LV image. The first group of items 431 also includes, for example, setting items for horizontally inverting the display of the screen. In this way, the first group of items 431 includes setting items for arbitrary settings that make it easier for the user to make appropriate settings by viewing the entire LV image.
[0068] The second group of items 432 includes settings related to image processing settings during image acquisition. Specifically, the second group of items 432 includes settings that determine the image processing method (color, sharpness, and knee adjustment method) for the recorded captured image. The second group of items 432 also includes, for example, settings for arbitrary settings that make it easier for the user to appropriately adjust settings by viewing an enlarged LV image.
[0069] The third group of items 433 includes setting items related to the settings (display method) of the display unit 28 (for example, setting items for contrast or color settings on the display surface of the display unit 28). The third group of items 433 also includes setting items for settings where it may be easier to set up if the LV image is enlarged, or easier to set up if it is not enlarged, depending on the situation.
[0070] Figure 7 shows the digital camera 100 with a twin-lens reflex camera attached, as shown in Figure 5. This is an example of the menu displayed on the display unit 28 when the menu button 81 is pressed while the enlarged LV image is displayed on the display unit 28. The menu shown in Figure 7, like the menu shown in Figure 6, includes a first item group 431, a second item group 432, and a third item group 433.
[0071] Figure 8 shows an example of a settings change screen displayed on the display unit 28 when a setting item from the second group of items 432 is selected. In the settings change screen shown in Figure 8, the size (vertical and horizontal dimensions) of the user marker (rectangular frame) placed on the LV image (display surface of the display unit 28) can be set.
[0072] Figure 9 shows an example of the setting change screen displayed on the display unit 28 when a setting item from the first item group 431 is selected. In the setting change screen shown in Figure 9, the degree of emphasis (sharpness level) in image processing that enhances the contours of the LV image can be set.
[0073] (Regarding processing in shooting mode) An example of the processing in the shooting mode of the digital camera 100 will be explained using the flowchart in Figure 10. The processing in the flowchart in Figure 10 starts when the digital camera 100 is powered on and in shooting standby mode.
[0074] In step S1001, the system control unit 50 displays the live view image (LV image) at 1:1 magnification on the display unit 28 (so that the entire LV image is displayed across the entire display surface of the display unit 28) (see Figure 4).
[0075] In step S1002, the system control unit 50 determines whether the display mode switching button 83 has been pressed (i.e., an enlargement operation has been performed) while the LV image is being displayed on the display unit 28. If it is determined that the display mode switching button 83 has been pressed, the process proceeds to step S1003. If it is determined that the display mode switching button 83 has not been pressed, the process proceeds to step S1004.
[0076] In step S1003, as shown in Figure 5, the system control unit 50 moves the LV image, which has been magnified at a predetermined display magnification (higher than 1x magnification), so that a predetermined position of the LV image is centered on the display surface of the display unit 28, and displays it on the display unit 28. Here, the predetermined display magnification and predetermined position are set in advance so that only the image region of the right image or the image region of the left image of the LV image is displayed on the display unit 28. Therefore, the predetermined display magnification is greater than twice 1x magnification.
[0077] In step S1004, the system control unit 50 overlays the menu (first item group, second item group, and third item group) onto the LV image and displays it on the display unit 28.
[0078] In step S1005, the system control unit 50 communicates with the lens via communication terminals 6 and 10 to determine whether the lens attached to the digital camera 100 (attached lens) is a twin-lens reflex lens. If it is determined that the attached lens is a twin-lens reflex lens, the process proceeds to step S1006. If it is determined that the attached lens is not a twin-lens reflex lens, the process proceeds to step S1009.
[0079] In step S1005, it may also be determined whether the LV image is a binocular image (a binocular image) that includes the image regions of both the right and left images. If it is determined that the LV image is a binocular image, proceed to step S1006. If it is determined that the LV image is not a binocular image, proceed to step S1009.
[0080] In step S1006, the system control unit 50 determines whether or not one setting item has been selected from the second group of items (second items). If it is determined that one setting item has been selected from the second group of items, the process proceeds to step S1101 (see Figure 11A). If it is determined that no setting item has been selected from the second group of items, the process proceeds to step S1007.
[0081] In step S1007, the system control unit 50 determines whether or not one setting item has been selected from the first group of items (first items). If it is determined that one setting item has been selected from the first group of items, the process proceeds to step S1121 (see Figure 11B). If it is determined that no setting item has been selected from the first group of items, the process proceeds to step S1008.
[0082] In step S1008, the system control unit 50 determines whether or not one setting item has been selected from the third group of items (third item). If it is determined that one setting item has been selected from the third group of items, the process proceeds to step S1201 (see Figure 12). If it is determined that no setting item has been selected from the third group of items, the process proceeds to step S1015.
[0083] In step S1009, the system control unit 50 determines whether one setting item from the menu has been selected. If it is determined that one setting item has been selected, the process proceeds to step S1010. If it is determined that no setting item has been selected, the process proceeds to step S1015. Note that the setting item referred to here may be any of the setting items from the first item group, the second item group, or the third item group.
[0084] In step S1010, the system control unit 50 displays a setting change screen (setting change screen) corresponding to the selected setting item on the display unit 28. At this time, the LV image remains displayed in the state it was in immediately before the setting item was selected (the display magnification is not changed).
[0085] In step S1011, the system control unit 50 determines whether or not a setting change operation has been performed. If it is determined that a setting change operation has been performed, the process proceeds to step S1012. If it is determined that a setting change operation has not been performed, the process proceeds to step S1013.
[0086] In step S1012, the system control unit 50 changes the setting (setting value) in response to the setting change operation.
[0087] In step S1013, the system control unit 50 determines whether or not the setting (setting value) change is continuing. If it is determined that the setting change is continuing, the process proceeds to step S1011. If it is determined that the setting change is not continuing (for example, if a specific button such as the menu button 81 is pressed), the process proceeds to step S1014.
[0088] In step S1014, the system control unit 50 returns to the field of view before selecting a setting item (the field of view at the end of processing in step S1005) and displays the LV image of the returned field of view on the display unit 28. In other words, in step S1014, the range of the LV image that was displayed before selecting a setting item is displayed at the display magnification before selecting a setting item. The system control unit 50 also switches from displaying the setting change screen to displaying the LV image and menu.
[0089] In step S1015, the system control unit 50 determines whether to continue displaying the menu. If it is determined to continue displaying the menu, the process proceeds to step S1004. If it is determined not to continue displaying the menu (for example, if a specific button is pressed), the process proceeds to step S1016.
[0090] In step S1016, the system control unit 50 hides the menu displayed on the display unit 28.
[0091] In step S1017, the system control unit 50 determines whether to continue processing this flowchart. If it is determined to continue processing this flowchart, the process proceeds to step S1002. If it is determined not to continue processing this flowchart (for example, if a specific button is pressed), the process of this flowchart ends.
[0092] (Processing to change settings for the second set of items) Referring to Figure 11A, the processes in steps S1101 to S1110 (setting change processing for the second group of items) will be explained.
[0093] In step S1101, the system control unit 50 displays the LV image on the display unit 28 at a predetermined magnification (higher than 1:1 magnification) so that a predetermined position of the LV image is located at the center of the display surface of the display unit 28, as shown in Figure 5 (similar to step S1003).
[0094] In step S1102, the system control unit 50 displays a screen for changing the selected setting item (setting change screen), which includes an enlarged LV image, on the display unit 28, as shown in Figure 9.
[0095] In step S1103, the system control unit 50 determines whether or not a setting change operation has been performed. If it is determined that a setting change operation has been performed, the process proceeds to step S1104. If it is determined that a setting change operation has not been performed, the process proceeds to step S1105.
[0096] In step S1104, the system control unit 50 changes the settings in response to the setting change operation.
[0097] In step S1105, the system control unit 50 determines whether or not a display magnification change operation has been performed. If it is determined that a display magnification change operation has been performed, the process proceeds to step S1106. If it is determined that a display magnification change operation has not been performed, the process proceeds to step S1107.
[0098] In step S1106, the system control unit 50 displays the LV image on the display unit 28 at the display magnification according to the display magnification change operation.
[0099] In step S1107, the system control unit 50 determines whether the LV image is being enlarged (whether the magnification of the LV image is greater than 1x). If it is determined that the LV image is being enlarged, the process proceeds to step S1108. If it is determined that the LV image is not being enlarged, the process proceeds to step S1110.
[0100] In step S1108, the system control unit 50 determines whether or not an operation to change the magnification position (the center position when magnifying the LV image; the center position of the displayed range within the LV image) has been performed. If it is determined that an operation to change the magnification position has been performed, the process proceeds to step S1109. If it is determined that an operation to change the magnification position has not been performed, the process proceeds to step S1110.
[0101] In step S1109, the system control unit 50 moves the LV image so that the magnified position in the LV image is located at the center of the display surface of the display unit 28.
[0102] In step S1110, the system control unit 50 determines whether or not the setting (setting value) change is continuing. If it is determined that the setting change is continuing, the process proceeds to step S1103. If it is determined that the setting change is not continuing, the process proceeds to step S1014.
[0103] (Processing to change settings for the first group of items) Referring to Figure 11B, the processes in steps S1121 to S1125 (setting change processing for the first group of items) will be explained.
[0104] In step S1121, the system control unit 50 displays the standard field-of-view LV image on the display unit 28, as shown in Figure 4. That is, the display unit 28 displays the LV image at 1:1 magnification so that both the image area of the right image and the image area of the left image are displayed. Note that it is not limited to displaying the standard field-of-view LV image (standard image at 1:1 magnification); for example, the LV image may be enlarged (or reduced) from 1:1 magnification so that the entire image area of the right image and the entire image area of the left image are displayed.
[0105] In step S1122, the system control unit 50 displays a setting change screen for the selected setting item on the display unit 28, which includes a standard field-of-view LV image, as shown in Figure 8.
[0106] In step S1123, the system control unit 50 determines whether or not a setting change operation has been performed. If it is determined that a setting change operation has been performed, the process proceeds to step S1124. If it is determined that a setting change operation has not been performed, the process proceeds to step S1125.
[0107] In step S1124, the system control unit 50 changes the settings in response to the setting change operation.
[0108] In step S1125, the system control unit 50 determines whether the setting change is continuing. If it is determined that the setting change is continuing, the process proceeds to step S1123. If it is determined that the setting change is not continuing, the process proceeds to step S1014.
[0109] (Processing to change settings for the third group of items) Referring to Figure 12, the processes in steps S1201 to S1209 (setting change processing for the third group of items) will be explained.
[0110] In step S1201, the system control unit 50 displays the setting change screen for the selected setting item on the display unit 28. If a setting item from the third group of items is selected, the LV image continues to be displayed in the state (angle of view; display magnification) immediately before the selection of that setting item (the display magnification is not changed).
[0111] In step S1202, the system control unit 50 determines whether or not a setting change operation has been performed. If it is determined that a setting change operation has been performed, the process proceeds to step S1203. If it is determined that a setting change operation has not been performed, the process proceeds to step S1204.
[0112] In step S1203, the system control unit 50 changes the settings in response to the setting change operation.
[0113] In step S1204, the system control unit 50 determines whether or not a display magnification change operation has been performed. If it is determined that a display magnification change operation has been performed, the process proceeds to step S1205. If it is determined that a display magnification change operation has not been performed, the process proceeds to step S12 Proceed to 06.
[0114] In step S1205, the system control unit 50 displays the LV image on the display unit 28 at the display magnification according to the display magnification change operation.
[0115] In step S1206, the system control unit 50 determines whether the LV image is being enlarged (the magnification of the LV image is greater than 1x). If it is determined that the LV image is being enlarged, the process proceeds to step S1207. If it is determined that the LV image is not being enlarged, the process proceeds to step S1209.
[0116] In step S1207, the system control unit 50 determines whether or not an operation to change the magnification position (the center position when displaying the magnified LV image) has been performed. If it is determined that an operation to change the magnification position has been performed, the process proceeds to step S1208; if it is determined that an operation to change the magnification position has not been performed, the process proceeds to step S1209.
[0117] In step S1208, the system control unit 50 moves the LV image so that the magnified position in the LV image is located at the center of the display surface of the display unit 28.
[0118] In step S1209, the system control unit 50 determines whether or not the setting value change is continuing. If it is determined that the setting value change is continuing, the process proceeds to step S1202. If it is determined that the setting value change is not continuing, the process proceeds to step S1014.
[0119] As described above, when a dual-lens system is attached (when displaying a dual-lens image), the display magnification and display range of the LV image are changed according to the setting item (menu item) selected by the user (the LV image is enlarged or the entire field of view is displayed). This ensures that the LV image is displayed with a display magnification and display range that is easy for the user to set (operate) according to the setting item. Therefore, user operability is improved.
[0120] Furthermore, this embodiment is particularly effective when the size of the display surface of the display unit 28 is not sufficient. For example, when outputting an image to a display device with a larger display surface via HDMI® or the like, there is little need to enlarge the LV image. In other words, if the size of the display surface of the display unit 28 is larger than a specific size, even if one of the selection items from the second group of items is selected in step S1006, the process may proceed to step S1121 or S1201 instead of step S1101. The case where the size of the display surface of the display unit 28 is larger than a specific size is, for example, when the length of all four sides of the display surface of the display unit 28 is longer than a predetermined length.
[0121] Furthermore, in the above, the statement "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2" can be rephrased as "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2." Conversely, the statement "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2" can be rephrased as "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2." Therefore, as long as no contradiction arises, the expression "greater than or equal to A" can be replaced with "A or greater than (higher; longer; more)" or rephrased as "greater than (higher; longer; more)." On the other hand, the expression "less than or equal to A" can be replaced with "A or less than (lower; shorter; fewer)" or rephrased as "less than (lower; shorter; fewer)." Furthermore, "larger than A (higher; longer; more)" can be reinterpreted as "greater than or equal to A," and "smaller than A (lower; shorter; fewer)" can be reinterpreted as "less than or equal to A." It can also be interpreted as "...".
[0122] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Some of the above embodiments may be combined as appropriate.
[0123] Furthermore, each functional unit in each of the above embodiments (each modified example) may or may not be individual hardware. The functions of two or more functional units may be implemented by common hardware. Each of the multiple functions of a single functional unit may be implemented by individual hardware. Two or more functions of a single functional unit may be implemented by common hardware. In addition, each functional unit may or may not be implemented by hardware such as an ASIC, FPGA, or DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. The functions of at least some of the functional units of the device may be implemented by the processor reading and executing the control program from the memory.
[0124] (Other embodiments) The present invention can also be realized by supplying a program that implements one or more of the functions of the above embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.
[0125] The above-disclosed embodiments include the following configurations, methods, and programs. [Configuration 1] An acquisition means for acquiring captured images, A display control means controls the display means to display a first item and a second item, each containing multiple setting items, together with the captured image. A determination means for determining whether the captured image is a binocular image that includes a first region acquired by imaging through a first imaging lens and a second region acquired by imaging through a second imaging lens, which has a parallax with respect to the first region. 1) If the captured image is determined to be the binocular image and any of the setting items from the first item is selected, the display means is controlled to display both the first and second regions of the captured image at the first display magnification. 2) When it is determined that the captured image is the two-lens image, and any of the setting items from the second item is selected, a control means controls the display means to display only one of the first and second regions of the captured image at a second display magnification greater than the first display magnification, An information processing device characterized by having the following features. [Configuration 2] The display control means controls the display means to display a third item which includes a plurality of setting items and is different from both the first item and the second item. The control means controls the display means to display the captured image in the state immediately before the selection of any of the third setting items. The information processing device according to configuration 1, characterized by the above. [Configuration 3] The third item includes setting items relating to the setting of the display means, The information processing apparatus according to configuration 2, characterized in that... [Structure 4] The acquisition means acquires the captured image by capturing it. An information processing device according to any one of configurations 1 to 3. [Composition 5] The second item described above includes settings related to image processing settings during imaging, The information processing apparatus according to configuration 4, characterized by the features described above. [Composition 6] The first item mentioned above includes setting items related to the display items, An information processing device according to any one of configurations 1 to 5, characterized by the above. [Composition 7] If the size of the display surface of the display means is larger than a specific size, the control means will not control the display means to display only one of the first or second regions, even if any of the setting items from the second region is selected. An information processing device according to any one of configurations 1 to 6. [Structure 8] If the control means determines that the captured image is not the binocular image, it controls the display means to display the captured image in the state it was in immediately before the setting item was selected, regardless of which of the first and second setting items is selected. An information processing device according to any one of configurations 1 to 7, characterized by the above. [Composition 9] The control means is If any of the first setting items is selected, the display means is controlled to display the first setting change screen including the captured image. If any of the setting items in the second item is selected, the display means is controlled to display a second setting change screen including the captured image. An information processing device according to any one of configurations 1 to 8. [Configuration 10] When the first setting change screen is displayed on the display means, the user cannot change the display magnification of the captured image. When the second setting change screen is displayed on the display means, the user can change the display magnification of the captured image. The information processing apparatus according to configuration 9, characterized by the features described therein. [method] The acquisition step involves obtaining the captured image, A display control step that controls the display means to display a first item and a second item, each containing multiple setting items, together with the captured image, A determination step of determining whether the captured image is a binocular image that includes a first region acquired by imaging through a first imaging lens and a second region acquired by imaging through a second imaging lens, which has a parallax with respect to the first region, 1) If the captured image is determined to be the two-lens image and any of the first setting items is selected, the display means is controlled to display both the first and second regions of the captured image at the first display magnification. 2) If the captured image is determined to be the two-lens image and any of the setting items from the second item is selected, a control step is made to control the display means to display only one of the first and second regions of the captured image at a second display magnification greater than the first display magnification, An information processing method characterized by having the following features. [program] A program for causing a computer to function as one of the means of an information processing device described in any one of the configurations 1 to 10. [Explanation of Symbols]
[0126] 100: Digital camera, 50: System control unit, 22: Image capture unit, 28: Display unit
Claims
1. An acquisition means for acquiring captured images, A display control means controls the display unit to display a first item and a second item, each containing multiple setting items, together with the captured image. A determination means for determining whether the captured image is a binocular image that includes a first region acquired by imaging through a first imaging lens and a second region acquired by imaging through a second imaging lens, which has a parallax with respect to the first region. 1) If the captured image is determined to be the two-lens image and any of the first setting items is selected, the display unit is controlled to display both the first and second regions of the captured image at the first display magnification. 2) When it is determined that the captured image is the two-lens image, and any of the setting items from the second item is selected, the control means controls the display unit to display only one of the first and second regions of the captured image at a second display magnification greater than the first display magnification, It has, The control means is If any of the first setting items is selected, the display unit is controlled to display the first setting change screen including the captured image. If any of the setting items from the second item is selected, the display unit is controlled to display the second setting change screen, which includes the captured image. An information processing device characterized by the following.
2. The display control means controls the display unit to display a third item which includes a plurality of setting items and is different from both the first item and the second item. The control means controls the display unit to display the captured image in the state immediately before the selection of any of the third setting items when that setting item is selected. The information processing apparatus according to feature 1.
3. The third item includes setting items related to the settings of the display unit, The information processing apparatus according to feature 2.
4. The acquisition means acquires the captured image by capturing it. The information processing apparatus according to any one of claims 1 to 3.
5. The second item described above includes setting items related to image processing settings during imaging, The information processing apparatus according to feature 4.
6. The first item mentioned above includes setting items related to the display items, The information processing apparatus according to any one of claims 1 to 3.
7. The display unit is provided in an external display device connected to the information processing device, If the size of the display surface of the display unit is larger than a specific size, the control means will not control the display unit to display only one of the first or second regions, even if any of the setting items from the second region is selected. The information processing apparatus according to any one of claims 1 to 3.
8. If the control means determines that the captured image is not the two-lens image, it controls the display unit to display the captured image in the state it was in immediately before the setting item was selected, regardless of which of the first and second setting items is selected. The information processing apparatus according to any one of claims 1 to 3.
9. When the first setting change screen is displayed on the display unit, the user cannot change the display magnification of the captured image. When the second setting change screen is displayed on the display unit, the user can change the display magnification of the captured image. The information processing apparatus according to any one of claims 1 to 3.
10. The acquisition step involves obtaining the captured image, A display control step that controls the display unit to display a first item and a second item, each containing multiple setting items, together with the captured image, A determination step of determining whether the captured image is a binocular image that includes a first region acquired by imaging through a first imaging lens and a second region acquired by imaging through a second imaging lens, which has a parallax with respect to the first region, 1) If the captured image is determined to be the two-lens image and any of the first setting items is selected, the display unit is controlled to display both the first and second regions of the captured image at the first display magnification. 2) If it is determined that the captured image is the two-lens image and any of the setting items from the second item is selected, a control step is made to control the display unit to display only one of the first and second regions of the captured image at a second display magnification greater than the first display magnification, It has, In the control step described above, If any of the first setting items is selected, the display unit is controlled to display the first setting change screen including the captured image. If any of the setting items from the second item is selected, the display unit is controlled to display the second setting change screen, which includes the captured image. An information processing method characterized by this feature.
11. A program for causing a computer to function as one of the means of an information processing apparatus according to any one of claims 1 to 3.
Citation Information
Patent Citations
Information processing device and information processing method
JP2018165985A
Electronic device, control method of the same, and program
JP2021158559A
Image processing device, image processing method and program
JP2022046260A