Electronic device, electronic device control method, program, and storage medium

Abstract

To provide a technique that can easily capture a VR image in which the line of sight of a viewer and the line of sight of a person being photographed are aligned.SOLUTION: An electronic device according to the present invention includes acquisition means for acquiring a tally signal indicating one of a plurality of tally lamps corresponding to a plurality of optical systems in a lens unit of an imaging device, and control means for controlling the tally lamp indicated by the tally signal to be lit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, a program, and a storage medium. [Background technology]

[0002] In recent years, imaging devices for taking stereoscopic photographs or videos and display devices for viewing highly immersive and realistic VR (Virtual Reality) images have been attracting attention. There are two ways to view VR images: 3D viewing on a head-mounted display (HMD) and 2D viewing on a computer monitor or the like.

[0003] VR180 is one of the VR image formats that allows for two-eye stereoscopic viewing. An imaging device equipped with two lenses for obtaining VR180 images generates an image area for the left eye and an image area for the right eye, but when viewing VR180 images in 2D, the image area for the left eye is displayed. Therefore, during shooting, it is desirable for the line of sight of the person being photographed (subject) to be aligned with the lens corresponding to the image area for the left eye. This is to align the line of sight of the viewer viewing the VR180 images in 2D with the line of sight of the person being photographed. Therefore, to clearly indicate which lens the person being photographed should look at, marks are sometimes attached to the lenses during shooting.

[0004] Furthermore, when filming performers or the like in a studio, there are cases where filming is performed by switching between multiple imaging devices. In this case, tally lamps are used to inform the person being filmed which of the multiple imaging devices is currently being used for filming and which imaging device the person should aim their gaze at. For example, Patent Document 1 discloses a filming method in which multiple tally lamps are provided on one imaging device. Patent Document 2 discloses a filming method using multiple imaging devices with tally lamps. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-7447 [Patent Document 2] Japanese Patent Application Laid-Open No. 2016-33563 Summary of the Invention [Problem to be solved by the invention]

[0006] In the method of attaching marks to lenses for shooting, attaching marks to lenses is time-consuming when using multiple imaging devices. Furthermore, when shooting in a dark location where the imaging devices are installed, it is difficult for the subject to see the marks. The technologies disclosed in Patent Documents 1 and 2 can use a tally lamp to inform the subject which imaging device they should focus their gaze on, but cannot inform the subject which of the two lenses they should focus their gaze on. In the case of VR images shot under such conditions, the gaze of the viewer viewing the VR image in 2D may not match the gaze of the subject.

[0007] Therefore, an object of the present invention is to provide a technology that can easily capture a VR image in which the viewer's line of sight and the person being photographed's line of sight are aligned. [Means for solving the problem]

[0008] The electronic device of the present invention includes an acquisition unit that acquires a tally signal indicating one of a plurality of tally lamps corresponding to a plurality of optical systems in a lens unit of an imaging device, and a control unit that controls the tally lamp indicated by the tally signal to be lit. It is characterized by: [Effects of the Invention]

[0009] According to the present invention, it is possible to easily capture a VR image in which the viewer's line of sight and the person being photographed's line of sight are aligned. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing the configuration of a camera according to a first embodiment. [Figure 2] 1 is a schematic diagram showing the overall configuration of a system according to a first embodiment. [Figure 3] 4 is a flowchart showing the operation of the camera according to the first embodiment. [Figure 4] FIG. 10 is a schematic diagram showing the overall configuration of a system according to a second embodiment. [Figure 5] 10 is a flowchart showing the operation of the camera according to the second embodiment. [Figure 6] FIG. 10 is a block diagram showing the configuration of a camera according to a third embodiment. [Figure 7] 10 is a flowchart showing the operation of a camera according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0012] First Embodiment 1 is a block diagram showing the configuration of a camera (imaging system, imaging device) 100 according to the first embodiment. The camera 100 has a lens device (lens unit) 10 and a camera body (camera housing) 20. The camera 100, the lens device 10, and the camera body 20 are an example of an electronic device according to the first embodiment.

[0013] The lens device 10 has a left lens group (left optical system) 110, a right lens group (right optical system) 120, a left tally lamp 114, a right tally lamp 124, a communication unit 130, and a lighting control unit 140. The lens device 10 is a type of interchangeable lens unit that is detachable from a camera body 20.

[0014] The left lens group 110 and the right lens group 120 each form an optical image from incident light and receive the light at the image sensor 221. As a result, the camera body 20 forms an image for the left eye and an image for the right eye, and records the images as images that can be viewed stereoscopically (3D). The left lens group 110 has a zoom lens 111, a focus lens 112, and a focus motor 113. The focus motor 113 drives the focus lens 112 to adjust the focus. Like the left lens group 110, the right lens group 120 has a zoom lens 121, a focus lens 122, and a focus motor 123. The focus motor 123 drives the focus lens 122 to adjust the focus.

[0015] The left tally lamp 114 is a tally lamp corresponding to the left lens group 110. The right tally lamp 124 is a tally lamp corresponding to the right lens group 120. The illumination of the left tally lamp 114 and the illumination of the right tally lamp 124 are controlled individually. By providing multiple tally lamps corresponding to the multiple optical systems in the lens device 10 of the camera 100, it is possible to show the subject during shooting which lens they should focus their gaze on.

[0016] The communication unit 130 transmits and receives control signals and data to and from the camera body 20. For example, the communication unit 130 receives a tally signal transmitted from the camera body 20. Communication between the lens device 10 and the camera body 20 is performed via mount communication via electrical contacts between the lens device 10 and the camera body 20. Note that, because the shooting sequence is controlled by the camera body 20, it is desirable that communication between the lens device 10 and the camera body 20 be performed in accordance with the communication protocol of the camera body 20.

[0017] The lighting control unit 140 controls the lighting (emission) of the left tally lamp 114 and the right tally lamp 124 in accordance with the tally signal received via the communication unit 130. The tally signal includes information about the tally lamp to be lit (information indicating one of multiple tally lamps, selection information). The lighting control unit 140 controls the tally lamp indicated by the selection information to be lit and the other tally lamps to be turned off.

[0018] The camera body 20 has a CPU 210, a volatile memory 211, a non-volatile memory 212, an imaging processing unit 220, an image processing unit 230, an attitude detection unit 240, a communication unit 250, a storage unit 260, an external communication unit 270, and an operation unit 280.

[0019] The CPU 210 is the central processing unit of the microcomputer and controls the entire camera body 20. The CPU 210 is composed of at least one processor and / or at least one circuit. That is, the CPU 210 may be a processor, a circuit, or a combination of a processor and a circuit. The CPU 210 executes programs recorded in the nonvolatile memory 212 to realize each process in the flowcharts described below.

[0020] The volatile memory 211 is, for example, a RAM (Random Access Memory) and is used to temporarily store data. Constants and variables for the operation of the CPU 210, programs read from the nonvolatile memory 212, and the like are expanded in the volatile memory 211.

[0021] The nonvolatile memory 212 is, for example, a ROM (Read Only Memory), and stores constants, programs, etc. for the operation of the CPU 210. The programs here are programs for executing the flowcharts described below.

[0022] The imaging element (image sensor) 221 is composed of a CCD, CMOS element, or the like, receives an optical image formed by passing through the lens device 10, and converts the optical image into an electrical signal. The imaging processing unit 220 performs A / D conversion on the electrical signal (charge information) output from the imaging element 221, and generates an image signal that is digital data.

[0023] The image processing unit 230 performs predetermined processing (lens correction, brightness correction, conversion of image data format according to the distribution destination, etc.) on the image signal generated by the imaging processing unit 220, and outputs the image data after the predetermined processing. Lens correction includes, for example, aberration correction and peripheral illumination correction. Image data formats include VR180 and VR360 for online distribution.

[0024] The orientation detection unit 240 detects the orientation of the camera body 20 relative to the direction of gravity. It is possible to determine whether the camera body 20 is installed in the normal orientation or upside down based on the orientation detected by the orientation detection unit 240. The orientation detection unit 240 can be, for example, an acceleration sensor or a gyro sensor.

[0025] The communication unit 250 transmits and receives control signals and data to and from the lens device 10. For example, the communication unit 250 transmits a tally signal to the lens device 10 and acquires lens information held by the lens device 10. The lens information includes information specific to the lens, such as the type of lens, an identifier (ID) for identifying an individual lens, and aberration information, as well as shooting information, such as the zoom magnification at the time of shooting.

[0026] The storage unit 260 stores (stores) the image data output from the image processing unit 230. The storage unit 260 may be built into the camera body 20, or may be detachable from the camera body 20. It may be possible.

[0027] The external communication unit 270 transmits and receives control signals and data to and from external devices. For example, the external communication unit 270 receives a tally signal from the video signal selection device 30 and transmits captured image data to the video signal selection device 30. The video signal selection device 30 will be described later.

[0028] The operation unit 280 is an input unit that accepts operations from the user (photographer) and is used to input various operational instructions to the CPU 210. For example, the user can use the operation unit 280 to instruct the start of photography.

[0029] Here, lens device 10 is a twin lens unit (VR180 lens unit) for obtaining VR180 images, which is one of the VR (Virtual Reality) image formats that enable twin-eye stereoscopic viewing. Lens device 10 has fisheye lenses in right lens group 120 and left lens group 110, each of which can capture a range of approximately 180 degrees. Note that the range that can be captured by the lenses in right lens group 120 and left lens group 110 may be approximately 160 degrees, which is narrower than the 180-degree range. Lens device 10 can form a right image formed through right lens group 120 and a left image formed through left lens group 110 on one or two image sensors of camera body 20 to which lens device 10 is attached. In camera body 20, the right and left images are formed on one image sensor (image sensor), and a single image (twin-eye image) is generated in which a right image area corresponding to the right image and a left image area corresponding to the left image are arranged side by side. The twin-eye image includes a right image region, a left image region, and a region that does not correspond to the optical image (a non-image region, for example, a black region).

[0030] A right image formed via the right lens group 120 and a left image formed via the left lens group 110 are formed side by side on the imaging section of the camera body 20. That is, two optical images are formed in two areas of a single imaging element (imaging sensor) by the right lens group 120 and the left lens group 110. The imaging section converts the formed subject image (optical signal) into an analog electrical signal. By using the lens device 10 (the right lens group 120 and the left lens group 110) in this manner, it is possible to acquire a single image (two-eye image) including two image areas with parallax. By dividing the acquired image into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image with a range of approximately 180 degrees. That is, the user can view a VR180 image in stereo.

[0031] Here, a VR image refers to an image that can be displayed in VR, as described below. VR images include omnidirectional images (spherical images) captured by an omnidirectional camera (spherical camera) and panoramic images with a wider image range (effective image range) than the display range that can be displayed at one time on a display unit. VR images are not limited to still images, but also include videos and live images (images acquired from a camera in almost real time). VR images have an image range (effective image range) of up to 360 degrees horizontally and 360 degrees vertically. VR images also include images with a wider angle of view than that which can be captured by a normal camera, or an image range wider than the display range that can be displayed at one time on a display unit, even if the field of view is less than 360 degrees horizontally or vertically. An image captured by the camera body 20 using the lens device 10 described above is a type of VR image. VR images can be displayed in VR, for example, by setting the display mode of a display device (a display device capable of displaying VR images) to "VR view." A portion of a VR image with a 360-degree angle of view is displayed, and the user can move the displayed area by changing the orientation of the display device left and right (horizontal rotation direction), allowing them to view seamless omnidirectional images left and right.

[0032] VR display (VR view) is a display method (display mode) that displays the image of the field of view range according to the posture of the display device, and allows the display range to be changed. One type of VR display is a "single-eye VR view," which displays a single image by mapping a VR image onto a virtual sphere (distortion correction). Another type of VR display is a "two-eye VR view," which displays a left-eye VR image and a right-eye VR image side-by-side in left and right regions after mapping each image onto a virtual sphere. By performing "two-eye VR display" using a left-eye VR image and a right-eye VR image with parallax, it is possible to view these VR images in stereoscopic form. Regardless of the VR display, when a user wears a display device such as an HMD (head-mounted display), the image displayed corresponds to the user's facial orientation. For example, suppose a VR image is displayed with a field of view centered at 0 degrees left and right (a specific direction, e.g., north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) at a certain point in time. If the orientation of the display device is flipped from this state (for example, by changing the display surface from facing south to facing north), the display range of the same VR image is changed to an image with a field of view centered at 180 degrees left and right (the opposite direction, for example, south) and 90 degrees up and down. In other words, when the user is wearing the HMD and turns their face from north to south (i.e., turns around), the image displayed on the HMD also changes from a north image to a south image. Note that the VR image captured using the lens device 10 is an image (180-degree image) capturing a range of approximately 180 degrees in front, and no image exists in a range of approximately 180 degrees behind. If such an image is VR-displayed and the orientation of the display device is changed to the side where no image exists, a blank area is displayed.

[0033] By displaying VR images in this way, the user can visually experience a sense of immersion as if they were inside the VR image (in the VR space). Note that the method of displaying VR images is not limited to changing the posture of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons. Furthermore, during VR display (in the "VR view" display mode), in addition to changing the display range due to posture changes, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing directional buttons, etc. Note that a smartphone attached to VR goggles (head-mounted adapter) is a type of HMD.

[0034] Fig. 2 is a schematic diagram showing an example of the overall configuration of the system according to the first embodiment. Fig. 2 shows an example in which cameras 1, 2, and 3 fixed to a tripod are connected to a video signal selection device 30. The cameras 1, 2, and 3 are examples of the camera 100.

[0035] 2 also shows a schematic diagram of the lens apparatus 1010 of camera 1 as seen from the subject side. The lens apparatus 1010 is an example of the lens apparatus 10. When the lens apparatus 1010 is seen from the subject side, a left lens group 1110 and a left tally lamp 1114 corresponding to the left lens group 1110 are arranged on the right side of the lens apparatus 1010. A right lens group 1120 and a right tally lamp 1124 corresponding to the right lens group 1120 are arranged on the left side of the lens apparatus 1010. Although not shown in FIG. 2, the lens apparatuses of cameras 2 and 3 also have lens groups and tally lamps arranged in the same manner as camera 1.

[0036] Cameras 1, 2, and 3 convert the captured video into VR180 video, which is an image data format for distribution, and transmit it to video signal selection device 30. Video signal selection device 30 selects a camera from cameras 1, 2, and 3 to capture the video to be distributed. Video signal selection device 30 transmits a tally-on signal to the camera capturing the video to be distributed and a tally-off signal to the other cameras, thereby switching the video to be distributed. Note that video signal selection device 30 may also convert the format of the video captured by cameras 1, 2, and 3 into an image data format for distribution.

[0037] FIG. 3 is a flowchart showing an example of the operation of camera 1 (an example of camera 100). This operation is realized by CPU 210 loading a program recorded in nonvolatile memory 212 into volatile memory 211 and executing it. For example, when camera 1 is turned on, When the video signal selection device 30 is connected, the operation of FIG. 3 starts.

[0038] In step S301, the CPU 210 transmits an initialization signal for initializing the lighting state of the tally lamps to the lens device 10 (lighting control unit 140). The lighting control unit 140 turns off all the tally lamps of the camera 1 (left tally lamp 1114, right tally lamp 1124).

[0039] In step S302, after starting shooting, the CPU 210 determines whether or not a tally signal has been received from the video signal selection device 30. If a tally signal has been received, the process proceeds to step S303; otherwise, the process waits until a tally signal is received. Note that even while waiting for reception of a tally signal, the image data output from the image processing unit 230 is transmitted to the video signal selection device 30 via the external communication unit 270.

[0040] In step S303, the CPU 210 determines whether the received tally signal is tally on or tally off. If the received tally signal is tally on, the process proceeds to step S304, and if not, the process proceeds to step S307.

[0041] In step S304, the CPU 210 selects a tally lamp to be turned on from among the tally lamps arranged in the lens device 1010.

[0042] Here, the camera 1 equipped with the lens device 1010 (a lens unit for obtaining a VR180 image) generates an image in which a right image area captured via the right lens group 1120 and a left image area captured via the left lens group 1110 are arranged side by side. This image can be viewed in 2D viewing, in which one of multiple image areas (the right image area and the left image area) is displayed. In 2D viewing of the VR180 image, an image area for the left eye in 3D viewing is displayed. When the camera 1 is in the upright position as shown in FIG. 2, the image area corresponding to the image area for the left eye is the left image area captured via the left lens group 1110. Therefore, in step S304, the CPU 210 selects the left tally lamp 1114 corresponding to the left lens group 1110 as the tally lamp to be turned on. This makes it possible to inform the subject at the time of shooting (capturing) to align (turn their gaze) toward the left lens group 1110. As a result, it is possible to easily capture a VR image in which the gaze of the viewer viewing in 2D and the gaze of the subject are aligned.

[0043] The left tally lamp 1114 and the right tally lamp 1124 may be arranged so that the subject can see that they correspond to the left lens group 1110 and the right lens group 1120, respectively. For example, in the example of FIG. 2, the left tally lamp 1114 is arranged above the left lens group 1110, and the right tally lamp 1124 is arranged above the right lens group 1120. Note that each tally lamp may also be arranged below the corresponding lens group. As shown in FIG. 2, the left tally lamp 1114 and the right tally lamp 1124 are preferably arranged near the center of the lens device 1010. For example, if the left tally lamp 1114 is arranged near the outer edge of the lens device 1010, the subject's line of sight is more likely to be directed toward that position while the left tally lamp 1114 is lit. In such a situation, even if the viewer's line of sight and the subject's line of sight match in 2D viewing, which displays the left image area, the viewer's line of sight and the subject's line of sight may not match in 3D viewing, which displays the right and left image areas. Therefore, by placing each tally lamp in a position closer to the center of the lens device 1010, the person being photographed can be notified to align their gaze with that position, making it easier to shoot a VR image in which the viewer's gaze and the person being photographed's gaze are aligned, whether viewing in 2D or 3D.

[0044] Returning to the description of FIG. 3, in step S305, the CPU 210 (communication unit 250) transmits a tally-on signal including information on the tally lamp selected in step S304 (selection information) to the lens device 1010 (communication unit 130). Receive the Lion signal.

[0045] In step S306, the lighting control unit 140 controls the tally lamp indicated by the tally-on signal received in step S305 to light up.

[0046] According to the processing of steps S304 to S306, a tally signal indicating a tally lamp corresponding to the optical system of a predetermined image area among a plurality of image areas captured via a plurality of optical systems is transmitted and received between the camera body 20 and the lens device 1010. The predetermined image area is, for example, an image area for the left eye. The lighting control unit 140 turns on the left tally lamp 1114 corresponding to the optical system of the image area for the left eye, and turns off the right tally lamp 1124 corresponding to the optical system of the image area for the right eye.

[0047] In step S307, the CPU 210 (communication unit 250) transmits a tally-off signal to the lens apparatus 1010 (communication unit 130). The lens apparatus 1010 receives the tally-off signal.

[0048] In step S308, the lighting control unit 140 performs control so that all tally lamps of camera 1 (left tally lamp 1114 and right tally lamp 1124) are turned off in accordance with the tally off signal received in step S307.

[0049] Although the above describes an example in which the CPU 210 acquires a tally signal transmitted from the video signal selection device 30, the CPU 210 may perform control by regarding a tally-on signal as having been acquired when a shooting instruction is received from the photographer (user). For example, the CPU 210 may transmit a tally-on signal to the lens device 1010 when a shooting instruction is received by half-pressing the shooting button on the operation unit 280.

[0050] Furthermore, although an imaging system in which the lens device 1010 is detachable from the camera body 20 has been described, the present invention is not limited to this and can also be applied to an imaging device in which the camera body and lens device are integrally configured.

[0051] In this way, in the first embodiment, a plurality of tally lamps are provided corresponding to the plurality of lens groups in the camera lens device, and the tally lamp corresponding to the lens group capturing the image area displayed during 2D viewing is turned on. This allows the subject to be informed of the lens to which the subject should align their gaze while capturing a VR image, making it easier to capture a VR image in which the gazes of the viewer viewing in 2D and the subject are aligned.

[0052] <Second embodiment> Fig. 4 is a schematic diagram showing an example of the overall configuration of a system according to the second embodiment. In both the first and second embodiments, a plurality of cameras 1, 2, and 3 are connected to a video signal selection device 30. In the first embodiment, cameras 1, 2, and 3 are all installed in the normal position, but in the second embodiment, camera 2 is installed on the ceiling in the inverted position (upside down relative to the normal position). Fig. 4 also shows a schematic diagram of cameras 1 and 2 as viewed from the subject side.

[0053] When the lens device 1010 of the camera 1 installed in the normal position is viewed from the subject side, a left lens group 1110 and a left tally lamp 1114 corresponding to the left lens group 1110 are arranged on the right side of the lens device 1010. A right lens group 1120 and a right tally lamp 1124 corresponding to the right lens group 1120 are arranged on the left side of the lens device 1010.

[0054] When the lens device 2010 of the camera 2 installed in the reverse position is viewed from the subject side, a right lens group 2120 and a right tally lamp 2124 corresponding to the right lens group 2120 are arranged on the right side of the lens device 2010. A left lens group 2110 and a left tally lamp 2114 corresponding to the left lens group 2110 are arranged on the left side of the lens device 2010.

[0055] In this way, the positions of the lens group and tally lamp of camera 1 and the lens group and tally lamp of camera 2 are reversed left and right when viewed from the subject side of camera 1 and camera 2. When viewing an image of VR180, zenith correction (a process of correcting the orientation of the image so that the nadir direction is downward and the zenith direction is upward) is performed. Therefore, the lens group that captures the image area for the left eye, which is the image area displayed when viewing an image of VR180 in 2D, differs depending on the attitude of the camera. For example, in camera 1, it is the left lens group 1110, but in camera 2, it is the right lens group 2120. Therefore, in the second embodiment, the tally lamp that is turned on is changed depending on the attitude of the camera.

[0056] Figure 5 is a flowchart showing an example of the operation of camera 2 (an example of camera 100). The processes in steps S501 to S503 and S506 to S509 are the same as those in steps S301 to S303 and S305 to S308 in Figure 3. In the following description of the flowchart in Figure 5, the CPU 210 of camera 2 will be used as an example.

[0057] In step S504, the CPU 210 acquires attitude information indicating the attitude of the camera 2 from the detection result of the attitude detection unit 240. For example, the CPU 210 determines whether the attitude of the camera 2 is normal or inverted using a gyro sensor or an acceleration sensor built into the body of the camera 2. As shown in Fig. 4, if the camera 2 is installed in the inverted attitude, the CPU 210 acquires attitude information indicating the inverted attitude.

[0058] In step S505, the CPU 210 selects a tally lamp to be turned on from among the tally lamps arranged on the lens device 2010 based on the attitude information acquired in step S504.

[0059] Here, even with a VR image captured in the inverted position orientation, an image area for the left eye is displayed during 2D viewing, just like a VR image captured in the normal position orientation. When the camera 2 is in the inverted position orientation as shown in FIG. 4, the image area corresponding to the image area for the left eye is captured via the right lens group 2120. Therefore, it is desirable that the line of sight of the person being photographed during shooting (capturing) is directed toward the right lens group 2120. Therefore, if orientation information indicating the inverted position orientation is acquired in step S504, the CPU 210 selects the right tally lamp 2124 corresponding to the right lens group 2120 as the tally lamp to be turned on in step S505. Note that if orientation information indicating the normal position orientation is acquired in step S504, the CPU 210 selects the left tally lamp 2114 corresponding to the left lens group 2110 as the tally lamp to be turned on in step S505.

[0060] According to the processing of steps S504 to S507, a tally signal indicating a different tally lamp depending on the attitude of the camera (electronic device) is transmitted and received between the camera body 20 and the lens device 1010. In a conventional method in which a mark is attached to the lens that the subject is to aim their gaze at, if the camera is turned upside down, it is necessary to reattach the mark to the other lens, but this method allows VR images to be captured without such hassle.

[0061] In this way, in the second embodiment, the tally lamp to be turned on is changed depending on the camera position. This makes it possible to easily tell the subject which lens to align their gaze with during VR image capture, even if the lens to align their gaze with differs depending on the camera position. This makes it easy to shoot a VR image in which the viewer's and subject's gazes meet.

[0062] <Third embodiment> 6 is a block diagram showing the configuration of a camera 300 according to the third embodiment. The camera 300 has a lens device 11 and a camera body 21. Below, differences from the configuration of the camera 100 according to the first embodiment (FIG. 1) will be mainly described.

[0063] Camera body 21 has the same configuration as camera body 20 of camera 100, and further includes a focus control unit 290. Focus control unit 290 generates a lens drive signal for adjusting focus. Lens device 11 has the same configuration as lens device 10 of camera 100, and further includes a lens control unit 150. Lens control unit 150 controls focus motor 113 and focus motor 123 based on the lens drive signal received via communication unit 130, and drives focus lens 112 and focus lens 122.

[0064] Recent camera functions include the ability to automatically detect the eyes of a person or animal and focus (maintain focus) on the position of the eye on the image, which is called pupil autofocus. When pupil autofocus is used while capturing a VR image, the focus can be more reliably adjusted to the position of the eye on the image by using the image area to which the gaze of the subject is directed. Therefore, in the third embodiment, when a tally-on signal is received, the focus is adjusted using the image area corresponding to the lit tally lamp.

[0065] 7 is a flowchart showing an example of the operation of the camera 300. The processing in steps S701 to S709 is the same as the processing in steps S501 to S509 in FIG.

[0066] In step S710, the CPU 210 (focus control unit 290) generates a lens drive signal for adjusting the focus of the left lens group 110 and the right lens group 120. First, the CPU 210 determines whether to use an image area captured via the left lens group 110 (left image area) or an image area captured via the right lens group 120 (right image area) to calculate a defocus amount that indicates a shift in focus.

[0067] If a tally-on signal has been received (YES in S703), CPU 210 calculates the defocus amount using the image area captured through the lens group corresponding to the tally lamp (illuminated tally lamp) selected in step S705. If a tally-on signal has not been received (NO in S702 or NO in S703), CPU 210 calculates the defocus amount using the left image area. Note that the image area to be used when a tally-on signal has not been received may be a predetermined area, and may be the right image area. CPU 210 calculates the drive amount of focus lens 112 and the drive amount of focus lens 122 based on the calculated defocus amount. Then, CPU 210 generates a lens drive signal including the calculated drive amount (lens drive amount).

[0068] In step S711, the CPU 210 (communication unit 250) transmits a lens driving signal to the lens device 10 (communication unit 130). The lens device 10 receives the lens driving signal.

[0069] In step S712, lens control unit 150 adjusts the focus by driving focus lens 112 and focus lens 122 based on the lens driving amount included in the lens driving signal received in step S711.

[0070] In this way, in the third embodiment, the lens group corresponding to the lit tally lamp is used to The captured image area is used to adjust the focus of multiple lens groups, making it easier to capture VR images that are focused on the subject's eyes.

[0071] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0072] For example, although we have described acquiring one image in which two image areas with parallax are arranged side by side, the number of image areas, i.e., the number of optical systems, may be more than two, and the arrangement of multiple image areas is not particularly limited.

[0073] Furthermore, the present invention is not limited to cameras and PCs, but can be applied to any electronic device that can handle images having multiple image regions corresponding to multiple optical systems. For example, the present invention can be applied to PDAs, mobile phone terminals, portable image viewers, printers, digital photo frames, music players, game consoles, e-book readers, cloud servers, etc. The present invention can also be applied to video players, display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances, in-vehicle devices, etc. The present invention can also be applied to multi-lens smartphones that have multiple optical systems of different types, such as a standard lens, a wide-angle lens, and a zoom lens.

[0074] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0075] The disclosure of this embodiment includes the following configuration, method, program, and medium. (Configuration 1) an acquisition means for acquiring a tally signal indicating one of a plurality of tally lamps respectively corresponding to a plurality of optical systems in a lens unit of the imaging device; a control means for controlling the tally lamp indicated by the tally signal to be turned on; have An electronic device characterized by: (Configuration 2) the electronic device is the lens unit that is detachable from the imaging device, The acquisition means receives the tally signal from the imaging device. 2. The electronic device according to configuration 1. (Configuration 3) the electronic device is the imaging device, The control means controls the lens unit attached to the imaging device to transmit the tally signal. 2. The electronic device according to configuration 1. (Configuration 4) The tally signal indicates the tally lamp corresponding to the optical system of a predetermined image area among a plurality of image areas captured via the plurality of optical systems. 4. The electronic device according to any one of configurations 1 to 3. (Configuration 5) To view the plurality of image areas, one of the plurality of image areas is displayed. There is 2D viewing available, The predetermined image area is the image area displayed in the 2D viewing mode. 5. The electronic device according to configuration 4. (Configuration 6) the plurality of image regions include an image region for a right eye and an image region for a left eye, The predetermined image area is the image area for the left eye. 5. The electronic device according to configuration 4. (Configuration 7) The acquisition means acquires the tally signal when a shooting instruction is received from a user. 7. The electronic device according to any one of configurations 1 to 6. (Configuration 8) The tally signal indicates different tally lamps depending on the position of the electronic device. 8. The electronic device according to any one of configurations 1 to 7. (Configuration 9) The control means further controls the plurality of optical systems to perform focus adjustment using an image area captured through an optical system corresponding to a lit tally lamp. 9. The electronic device according to any one of configurations 1 to 8. (Configuration 10) a plurality of optical systems for capturing images of a plurality of image regions, respectively; a plurality of tally lamps respectively corresponding to the plurality of optical systems; have An electronic device characterized by: (method) an acquisition step of acquiring a tally signal indicating any one of a plurality of tally lamps respectively corresponding to a plurality of optical systems in a lens unit of the imaging device; a control step of controlling the tally lamp indicated by the tally signal to be turned on; have A method for controlling an electronic device. (program) A program for causing a computer to function as each means of the electronic device according to any one of configurations 1 to 10. (medium) 11. A computer-readable storage medium storing a program for causing a computer to function as each means of the electronic device according to any one of configurations 1 to 10. [Explanation of symbols]

[0076] 100: Camera 140: Lighting control unit 210: CPU

Claims

1. an acquisition means for acquiring a tally signal indicating one of a plurality of tally lamps respectively corresponding to a plurality of optical systems in a lens unit of the imaging device; a control means for controlling the tally lamp indicated by the tally signal to be turned on; have An electronic device characterized by:

2. the electronic device is the lens unit that is detachable from the imaging device, The acquisition means receives the tally signal from the imaging device.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. the electronic device is the imaging device, The control means controls the lens unit attached to the imaging device to transmit the tally signal.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

4. The tally signal indicates the tally lamp corresponding to the optical system of a predetermined image area among a plurality of image areas captured via the plurality of optical systems.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

5. The viewing of the plurality of image regions includes 2D viewing in which one image region among the plurality of image regions is displayed, The predetermined image area is an image area displayed in the 2D viewing mode.

5. The electronic device according to claim 4.

6. the plurality of image regions include an image region for a right eye and an image region for a left eye, The predetermined image area is the image area for the left eye.

5. The electronic device according to claim 4.

7. The acquisition means acquires the tally signal when a shooting instruction is received from a user.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

8. The tally signal indicates different tally lamps depending on the position of the electronic device.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

9. The control means further controls the plurality of optical systems to perform focus adjustment using an image area captured through an optical system corresponding to a lit tally lamp.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

10. a plurality of optical systems for capturing images of a plurality of image regions, respectively; a plurality of tally lamps respectively corresponding to the plurality of optical systems; have An electronic device characterized by:

11. an acquisition step of acquiring a tally signal indicating any one of a plurality of tally lamps respectively corresponding to a plurality of optical systems in a lens unit of the imaging device; a control step of controlling the tally lamp indicated by the tally signal to be turned on; have A method for controlling an electronic device.

12. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 10.

13. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 10.

Images