Display control device, display control method, and program

Abstract

To provide a technique for displaying VR video suitable for each user who views VR video.SOLUTION: A display control device includes: acquisition means for acquiring VR video captured by an imaging device; detection means for detecting movement of the imaging device; processing means for performing a reduction process on a live view image to reduce the possibility that a specific symptom occurs to a user who views the live view image of the VR video; control means for controlling the degree of the reduction process on the live view image on the basis of whether or not the user is an operator of the imaging device, when the movement of the imaging device is detected by the detection means; and display control means for controlling the display means to display an image after the reduction process has been performed on the live view image when the reduction process has been performed on the live view image.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a display control device, a display control method, and a program for controlling the display of VR video images. [Background technology]

[0002] In recent years, VR content, such as VR images (VR still images or VR videos) captured by a VR camera, has been viewed through live streaming. A head-mounted display (HMD) is used to view this VR content.

[0003] When viewing VR content using an HMD, the viewer may experience unintended viewpoint movement (for example, viewpoint movement accompanying the movement of the VR camera). In this case, the viewer may experience a feeling of nausea, commonly known as "VR sickness (Virtual Reality Sickness)."

[0004] In Patent Document 1, when controlling a robot equipped with a VR camera in a remote location, the VR image is temporarily frozen or temporarily replaced with single-color image data while the robot is moving. In this way, Patent Document 1 discloses an example of a technology that reduces VR sickness by performing image processing that reduces the sense of immersion. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-180425 Summary of the Invention [Problem to be solved by the invention]

[0006] When creating VR content, the camera operator may operate the VR camera while checking the VR image displayed on the HMD. At this time, for example, the shooting position and direction are adjusted. At that time, multiple viewers other than the operator (other users creating VR content or viewers of live streaming, etc.) may also view the VR image from the same VR camera on their own HMDs, etc.

[0007] In such a case, if immersion reduction processing is performed on the VR video in order to reduce VR sickness in the viewer, the viewer's VR sickness can be reduced, but the operator cannot quickly check the video due to changes in the camera's angle of view or composition. This means that the operator may miss a shooting opportunity. In addition, if VR video that has not been subjected to immersion reduction processing (or has weakened immersion reduction processing) is displayed for the operator who wants to quickly check the video, viewers of the VR video other than the operator will experience VR sickness due to unintended viewpoint movement.

[0008] Therefore, an object of the present invention is to provide a technology for displaying VR video suitable for each user who views the VR video. [Means for solving the problem]

[0009] One aspect of the present invention is a method for producing a composition comprising the steps of: An acquisition means for acquiring a VR image captured by an imaging device; A detection means for detecting a movement of the imaging device; The possibility of a specific symptom occurring in a user viewing a live view image of the VR image is reduced. A processing means for performing a reduction process on the live view image to reduce the blurring caused by the blurring. a control means for controlling a degree of the reduction processing on the live view image when the detection means detects movement of the image capture device, based on whether or not the user is an operator of the image capture device; and a display control means for controlling a display means to display an image after the reduction process has been performed on the live view image when the reduction process has been performed on the live view image; The display control device is characterized by having the following features.

[0010] One aspect of the present invention is a method for producing a composition comprising the steps of: An acquisition step of acquiring a VR image by capturing an image with an imaging device; a detection step of detecting a movement of the imaging device; A processing step of performing a reduction process on the live view image to reduce the possibility that a specific symptom will occur in a user viewing the live view image of the VR video; a control step of controlling a degree of the reduction processing on the live view image based on whether or not the user is an operator of the imaging device when the movement of the imaging device is detected in the detection step; a display control step of controlling a display means to display an image after the reduction process has been performed on the live view image when the reduction process has been performed on the live view image; The display control method is characterized by comprising the steps of: Effect of the Invention

[0011] According to the present invention, it is possible to display VR video suitable for each user who views the VR video. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating a digital camera. [Diagram 2] FIG. 2 is a diagram illustrating a display control device. [Diagram 3] FIG. 2 is a diagram illustrating a controller. [Figure 4] 11 is a flowchart illustrating an example of a control process for displaying VR video. [Figure 5A] 11 is a flowchart illustrating an example of a control process for displaying VR video. [Figure 5B]11 is a flowchart illustrating an example of a control process for displaying VR video. [Figure 6] FIG. 11 is a diagram illustrating a VR sickness reduction process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0014] Fig. 1A shows a front perspective view (external view) of a digital camera 100 (imaging device) which is an electronic device. Fig. 1B shows a rear perspective view (external view) of the digital camera 100. The digital camera 100 is an omnidirectional camera (panoramic camera).

[0015] Barrier 102a is a protective window of taking lens 103a for "camera unit a" whose shooting range is the front of digital camera 100. Barrier 102a may be the outer surface of taking lens 103a itself. "Camera unit a" is a wide-angle camera whose shooting range is a wide range of 180 degrees or more up, down, left, and right on the front side of digital camera 100. Barrier 102b is a protective window of taking lens 103b for "camera unit b" whose shooting range is the rear of the digital camera. Barrier 102b may be the outer surface of taking lens 103b itself. "Camera unit b" is a wide-angle camera whose shooting range is a wide range of 180 degrees or more up, down, left, and right on the rear side of digital camera 100.

[0016] The display unit 28 is a display unit that displays various information. The shutter button 61 is an operation unit for issuing a shooting instruction. The mode change switch 60 is an operation unit for switching between various modes. The connection I / F 25 is a connector between a connection cable (a cable for connecting to an external device such as a smartphone, a personal computer, or a television) and the digital camera 100. The operation unit 70 has operation members (various switches, buttons, dials, touch sensors, etc.) that accept various operations from the user. The power switch 72 is a push button for switching the power on and off.

[0017] The light-emitting unit 21 is a light-emitting member such as a light-emitting diode (LED). The light-emitting unit 21 notifies the user of various states of the digital camera 100 by light emission patterns and colors. The fixing unit 40 is, for example, a tripod screw hole. The fixing unit 40 is a member for fixing and installing on a fixing fixture such as a tripod.

[0018] FIG. 1C is a block diagram showing an example of the configuration of the digital camera 100. The barrier 102a covers the imaging system of the "camera section a" including the photographing lens 103a to prevent the imaging system (including the photographing lens 103a, the shutter 101a, and the imaging section 22a) from becoming dirty or being damaged. The photographing lens 103a is a lens group including a zoom lens and a focus lens. The photographing lens 103a is a wide-angle lens. The shutter 101a has an aperture function for adjusting the amount of subject light incident on the imaging section 22a. The imaging section 22a is an imaging element formed of a CCD, CMOS element, or the like, which converts an optical image into an electrical signal. The A / D converter 23a converts an analog signal output from the imaging section 22a into a digital signal.

[0019] The barrier 102b covers the imaging system of the "camera section b" including the photographing lens 103b to prevent the imaging system (including the photographing lens 103b, the shutter 101b, and the imaging section 22b) from getting dirty or damaged. The photographing lens 103b is a lens group including a zoom lens and a focus lens. The photographing lens 103b is a wide-angle lens. The shutter 101b has an aperture function that adjusts the amount of subject light incident on the imaging section 22b. The imaging section 22b is an imaging element composed of a CCD, CMOS element, etc. that converts an optical image into an electrical signal. The A / D converter 23b converts the analog signal output from the imaging section 22b into a digital signal.

[0020] The imaging unit 22a or the imaging unit 22b captures a VR image. The VR image is an image that can be displayed in VR. The VR image includes an omnidirectional image (spherical image) captured by an omnidirectional camera (spherical camera) and a panoramic image having a wider image range (effective image range) than the display range that can be displayed at one time on a display means. The VR image includes not only still images but also videos (images) and live view images (images acquired from a camera almost in real time). The VR image has an image range (effective image range) of a maximum of 360 degrees in the vertical direction (vertical angle, angle from the zenith, elevation angle, depression angle, altitude angle) and 360 degrees in the horizontal direction (horizontal angle, azimuth angle). The VR image also includes an image having a wide angle of view (viewing range) wider than the angle of view that can be captured by a normal camera, or an image range (effective image range) wider than the display range that can be displayed at one time on a display means, even if it is less than 360 degrees up and down or less than 360 degrees left and right. For example, an image taken by a spherical camera capable of photographing a subject with a field of view (angle of view) of 360 degrees in the left-right direction (horizontal angle, azimuth angle) and a vertical angle of 210 degrees centered on the zenith is a type of VR image. Also, for example, an image taken by a camera capable of photographing a subject with a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle) and a vertical angle of 180 degrees centered on the horizontal direction is a type of VR image. In other words, an image that has a field of view of 160 degrees (±80 degrees) or more in the up-down and left-right directions and has a wider field of view than a human can see at one time is a type of VR image. When this VR image is displayed in VR (display mode: "VR view"), by changing the attitude of the display device in the left-right rotation direction, seamless omnidirectional images can be viewed in the left-right direction (horizontal rotation direction). In the up-down direction (vertical rotation direction), from directly above (zenith) You can watch seamless omnidirectional images within a range of ±105 degrees, but anything beyond 105 degrees from directly above is a blank area with no images. A VR image can also be described as "an image whose image range is at least a part of a virtual space (VR space)."

[0021] VR display (VR view) is a display method (display mode) that displays an image of a VR image with a viewing range according to the orientation of the display device, and is a display method (display mode) that allows the display range to be changed. When viewing by wearing a head-mounted display (HMD) that is a display device, an image with a viewing range according to the orientation of the user's face is displayed. For example, it is assumed that an image with a viewing angle (field of view) centered on 0 degrees left and right (a specific direction, for example, north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) is displayed at a certain point in time among VR images. From this state, when the orientation of the display means is reversed (for example, when the display surface is changed from facing south to facing north), the display range is changed to an image with a viewing angle centered on 180 degrees left and right (the opposite direction, for example, south) and 90 degrees up and down (horizontal) among the same VR image. In the case where a user is viewing an HMD, if the user turns his or her face from north to south (i.e., turns back), the image displayed on the HMD also changes from a north image to a south image. Such VR display can provide the user with the visual sensation of being in the VR image (VR space). A smartphone attached to VR goggles (head-mounted adapter) can be considered a type of HMD. Note that the method of displaying VR images is not limited to the above, and the display range may be moved (scrolled) in response to user operations on a touch panel or directional buttons, rather than changes in posture. Even when displayed in VR display (VR view mode), the display range may be changed in response to touch-move operations on a touch panel or drag operations on an operating member such as a mouse, in addition to changes in the display range due to changes in posture.

[0022] The image processing unit 24 performs predetermined pixel interpolation, resizing (reducing, etc.), or color conversion on the data (data from the A / D converter 23a, data from the A / D converter 23b, or data from the memory control unit 15). The image processing unit 24 also performs predetermined arithmetic processing using the captured image data. The system control unit 50 performs exposure control or distance measurement control based on the arithmetic result obtained by the image processing unit 24. This allows TTL (through-the-lens) AF (autofocus) processing, AE (autoexposure) processing, or EF (flash pre-flash) processing to be performed. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL AWB (auto white balance) processing based on the arithmetic result obtained. The image processing unit 24 also performs basic image processing on the two images (fisheye images) obtained from the A / D converter 23a and the A / D converter 23b, and then synthesizes them (splices them together) to generate a single VR image. In the stitching process of two images, the image processing unit 24 calculates the amount of deviation between the reference image and the comparative image for each area by pattern matching process for each of the two images, and detects the stitching position. Then, taking into consideration the detected stitching position and the lens characteristics of each optical system, the image processing unit 24 performs distortion correction on each of the two images by geometric transformation, and converts them into a celestial sphere image format. By blending these two images in the celestial sphere image format, the image processing unit 24 finally generates one celestial sphere image (VR image). The generated celestial sphere image (VR image) is an image using, for example, equirectangular projection, and the position of each pixel can be associated with the coordinates of the surface of a sphere. In addition, during VR display in live view or during playback, image cropping, enlargement, distortion correction, etc. for VR display of the VR image are performed, and rendering is also performed to draw the VR image in the VRAM of the memory 32.

[0023] The output data from the A / D converter 23 is written into the memory 32 via the image processing unit 24 and the memory control unit 15 (or via the memory control unit 15). The memory 32 stores image data obtained by the imaging unit 22 and then converted into digital data by the A / D converter 23, and images to be output from the connection I / F 25 to an external display. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio.

[0024] The memory 32 also serves as a memory (video memory) for image display. The image display data stored in the memory 32 may be output from the connection I / F 25 to an external display. The VR images captured by the imaging units 22a and 22b and generated by the image processing unit 24 and stored in the memory 32 are sequentially transferred to the external display. The external display functions as an electronic viewfinder by displaying the VR images, and can perform live view display (LV display) for displaying live view images. The VR images stored in the memory 32 can also be transferred to an external device (such as a smartphone) wirelessly connected via the communication unit 54 and displayed on the external device side, thereby performing live view display (remote LV display).

[0025] The non-volatile memory 56 is a memory serving as an electrically erasable and recordable recording medium. For example, an EEPROM or the like is used for the non-volatile memory 56. Constants, programs, and the like for the operation of the system control unit 50 are stored in the non-volatile memory 56. Here, the programs refer to computer programs for executing various flowcharts described later in this embodiment.

[0026] The system control unit 50 is a control unit having at least one processor or circuit. The system control unit 50 controls the entire digital camera 100. The system control unit 50 executes the programs recorded in the non-volatile memory 56 described above to realize each process of this embodiment described later. For example, a RAM is used for the system memory 52. ​​Constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 56, etc. are deployed in the system memory 52. ​​The system control unit 50 also performs display control by controlling the memory 32, the image processing unit 24, and the memory control unit 15.

[0027] The system timer 53 is a timing unit that measures the time used for various controls and the time of a built-in clock.

[0028] The mode changeover switch 60, the shutter button 61, and the operation unit 70 are operation means for inputting various operation instructions to the system control unit 50. The mode changeover switch 60 switches the operation mode of the system control unit 50 to one of a still image recording mode, a video shooting mode, a playback mode, and a communication connection mode. Modes included in the still image recording mode include an auto shooting mode, an auto scene discrimination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode. Modes included in the still image recording mode include various scene modes and a custom mode, which are shooting settings for each shooting scene. The user can directly switch to one of these modes using the mode changeover switch 60. Alternatively, after switching to a list screen of shooting modes using the mode changeover switch 60, one of the multiple modes displayed on the display unit 28 may be selected and switched using other operation members. Similarly, the video shooting mode may also include multiple modes.

[0029] The first shutter switch 62 is turned on by half-pressing (instruction of preparation for shooting) during operation of the shutter button 61 provided on the digital camera 100, and generates a first shutter switch signal SW1. The generation of the first shutter switch signal SW1 starts preparation operations for shooting, such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, or EF (pre-flash) processing.

[0030] The second shutter switch 64 is pressed when the shutter button 61 is fully pressed ( The second shutter switch signal SW2 is turned on when a shooting instruction is received, and generates a second shutter switch signal SW2. When the second shutter switch signal SW2 is generated, the system control unit 50 starts a series of shooting processing operations (processing from reading out the signal from the imaging unit 22 to writing image data to the recording medium 90). The shutter button 61 is not limited to being capable of two-stage operation, full press and half press, but may be an operating member that can be pressed only in one stage. In that case, pressing it in one stage performs shooting preparation operations and shooting processing consecutively. This is the same operation as when a shutter button that can be pressed halfway or full press is pressed all the way (operation when SW1 and SW2 occur almost simultaneously).

[0031] Each operating member of the operating unit 70 is assigned a function appropriate for each situation by selecting and operating various function icons and options displayed on the display unit 28, and acts as various function buttons. Examples of the function buttons include an end button, a back button, an image forward button, a jump button, a filter button, and an attribute change button. For example, when the menu button is pressed, a menu screen in which various settings can be made is displayed on the display unit 28. The user can intuitively make various settings by operating the operating unit 70 while looking at the menu screen displayed on the display unit 28.

[0032] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, and a switch circuit (a circuit that switches the block to which electricity is applied), etc. The power supply control unit 80 detects whether a battery is attached, the type of battery, and the remaining battery power. Based on the detection result and instructions from the system control unit 50, the power supply control unit 80 controls the DC-DC converter to supply the required voltage to each unit (including the recording medium 90) for the required period of time. The power supply unit 30 is a primary battery (an alkaline battery or a lithium battery, etc.), a secondary battery (a NiCd battery, a NiMH battery, a Li battery, etc.), an AC adapter, etc.

[0033] The recording medium I / F 18 is an interface for connecting to a recording medium 90. The recording medium 90 is a recording medium such as a memory card for recording captured images. The recording medium 90 is composed of a semiconductor memory, an optical disk, a magnetic disk, etc. The recording medium 90 may be a recording medium that is detachable from the digital camera 100, or may be a built-in recording medium.

[0034] The communication unit 54 is connected wirelessly or via a wired cable, and transmits and receives video signals, audio signals, and the like. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can transmit images (including live view images) captured by the imaging unit 22a or the imaging unit 22b, and images recorded on the recording medium 90. The communication unit 54 can also receive images and various other information from external devices.

[0035] The attitude detection unit 55 detects the attitude of the digital camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 55, it is possible to determine whether the image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. It is also possible to determine the degree to which the image was captured with the digital camera 100 tilted in the three axial directions of yaw, pitch, and low. The system control unit 50 can add orientation information according to the attitude detected by the attitude detection unit 55 to the image file of the VR image captured by the imaging units 22a and 22b. The system control unit 50 can rotate the image (adjust the orientation of the image to correct the tilt) and record it according to the attitude detected by the attitude detection unit 55. The attitude detection unit 55 can use one or more combinations of an acceleration sensor, a gyro sensor, a geomagnetic sensor, a direction sensor, an altitude sensor, and the like. The attitude detection unit 55 can also detect the movement of the digital camera 100 (pan, tilt, lift, whether it is stationary, etc.) using an acceleration sensor, a gyro sensor, or an azimuth sensor.

[0036] The microphone 20 is a microphone that collects sounds around the digital camera 100. The collected sounds are recorded, for example, as the sound of a moving image of a VR image.

[0037] The connection I / F 25 is a connection plug for connecting to an external device such as an HDMI (registered trademark) cable or a USB cable.

[0038] FIG. 2A shows an example of an external view of a display control device 200, which is a type of electronic device. The display 205 is a display unit that displays images and various information. The display 205 is integrally configured with a touch panel 206a as described later, and can detect a touch operation on the display surface of the display 205. The display control device 200 can VR display a VR image (VR content) on the display 205. The operation unit 206 includes a touch panel 206a and operation units 206b, 206c, 206d, and 206e as shown in the figure. The operation unit 206b is a power button that accepts an operation to switch the power of the display control device 200 on and off. The operation units 206c and 206d are volume buttons that increase and decrease the volume of the sound output from the sound output unit 222. The operation unit 206e is a home button for displaying a home screen on the display 205. The sound output terminal 212a is an earphone jack, and is a detection for outputting sound to an earphone, an external speaker, or the like. The speaker 212b is a built-in speaker for producing sounds.

[0039] 2B shows an example of an external view of another surface of the display control device 200. The imaging unit 215 is a camera capable of capturing images.

[0040] 2C shows an example of the configuration of the display control device 200. The display control device 200 can be configured using a display device such as a smartphone. A CPU 201, a memory 202, a non-volatile memory 203, an image processing unit 204, a display 205, an operation unit 206, a storage medium I / F 207, an external I / F 209, and a communication I / F 210 are connected to an internal bus 220. In addition, an audio output unit 212 and a posture detection unit 213 are also connected to the internal bus 220. Each unit connected to the internal bus 220 can exchange data with each other via the internal bus 220.

[0041] The CPU 201 is a control unit that controls the entire display control device 200. The CPU 201 is composed of at least one processor or circuit. The memory 202 is composed of, for example, a RAM (such as a volatile memory using a semiconductor element). The CPU 201 controls each unit of the display control device 200 using the memory 202 as a work memory according to a program stored in, for example, the nonvolatile memory 203. The nonvolatile memory 203 stores image data, audio data, other data, various programs for the operation of the CPU 201, and the like. The nonvolatile memory 203 is composed of, for example, a flash memory, a ROM, and the like.

[0042] The image processing unit 204 performs various image processing on images stored in the non-volatile memory 203 or the storage medium 208, video signals acquired via the external I / F 209, images acquired via the communication I / F 210, etc., based on the control of the CPU 201. The image processing performed by the image processing unit 204 includes A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, color conversion processing, etc. The image processing unit 204 also performs various image processing (panoramic expansion, mapping processing, conversion, etc.) on VR images, which are wide-range images (omnidirectional images or images having wide-range data even if not omnidirectional). The image processing unit 204 may be configured with a dedicated circuit block for performing specific image processing. Depending on the type of image processing, it is also possible for the CPU 201 to perform image processing according to a program without using the image processing unit 204.

[0043] The display 205 displays images, GUI screens constituting a GUI (Graphical User Interface), and the like under the control of the CPU 201. The CPU 201 generates a display control signal according to a program. The CPU 201 controls each unit of the display control device 200 by the display control signal so as to "generate a video signal for display on the display 205 and output it to the display 205." The display 205 displays an image based on the output video signal. Note that the configuration of the display control device 200 itself may only include an interface for outputting a video signal for display on the display 205. The display 205 may be configured as an external monitor (such as a television).

[0044] The operation unit 206 is an input device for receiving user operations. The operation unit 206 includes a character information input device (such as a keyboard), a pointing device (a mouse or a touch panel), a button, a dial, a joystick, a touch sensor, a touch pad, etc. The touch panel is an input device that is configured to be planar and superimposed on the display 205, and outputs coordinate information according to the touched position.

[0045] A storage medium 208 (memory card, CD, or DVD) can be attached to the storage medium I / F 207. The storage medium I / F 207 reads data from the attached storage medium 208 and writes data to the storage medium 208 under the control of the CPU 201. The external I / F 209 is an interface for connecting to an external device via a wired cable or wirelessly and inputting and outputting video signals and audio signals. The communication I / F 210 is an interface for communicating with an external device, the Internet 211, etc., and sending and receiving various data such as files and commands.

[0046] The audio output unit 212 outputs audio (audio of video or music data), operation sounds, ringtones, various notification sounds, etc. The audio output unit 212 includes an audio output terminal 212a for connecting earphones or the like, and a speaker 212b. The audio output unit 212 may output audio via wireless communication or the like.

[0047] The attitude detection unit 213 detects the attitude of the display control device 200 with respect to the direction of gravity and the inclination of the attitude with respect to each axis of yaw, roll, and pitch. Based on the attitude detected by the attitude detection unit 213, it is possible to determine whether the display control device 200 is held horizontally, held vertically, facing up, facing down, or at an angle. The attitude detection unit 213 can use at least one of an acceleration sensor, a gyro sensor, a geomagnetic sensor, a direction sensor, an altitude sensor, and the like.

[0048] The estimation unit 214 estimates the self-position and the surrounding environment in the space of the display control device 200 or the VR goggles 230 described later.

[0049] "Self-position" refers to the position of the display control device 200 or the VR goggles 230 in real space. "Self-position" is expressed, for example, by three parameters (parameters representing a position in a coordinate system in which three mutually orthogonal axes are defined as the X-axis, Y-axis, and Z-axis) with a predetermined position in a predetermined range of space as the origin. "Self-position" may be further expressed by three parameters representing the attitude (orientation).

[0050] The "obstacle area" is an area where an obstacle exists within the range where a user holding the display control device 200 or a user wearing the VR goggles 230 exists. The "obstacle area" is a parameter that represents a position in a coordinate system in which three mutually orthogonal axes are defined as the X-axis, Y-axis, and Z-axis, with a predetermined position in a predetermined range of space as the origin. It is represented by multiple sets of

[0051] The imaging unit 215 is a camera capable of acquiring an image. The acquired image can be used for various detection processes by the gesture detection unit 206f and the estimation unit 214. The imaging unit 215 can also output an image of the outside world to the display 205.

[0052] The operation unit 206 includes a touch panel 206a. The CPU 201 can detect the following operations or states on the touch panel 206a. A finger or pen that has not been touching the touch panel 206a touches the touch panel 206a again, that is, the start of touching (hereinafter referred to as touch-down). The touch panel 206a is in a state where a finger or a pen is touching the touch panel 206a (hereinafter referred to as Touch-On). A finger or a pen is moved while touching the touch panel 206a (hereinafter referred to as Touch-Move). The finger or pen that was touching the touch panel 206a is removed from the touch panel 206a, that is, the touch ends (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 206a (hereinafter referred to as Touch-Off)

[0053] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. If touch-move is detected, touch-on is also detected at the same time. Even if touch-on is detected, touch-move will not be detected if the touch position does not move. When it is detected that all fingers or pens that were touching have touched up, touch-off is detected.

[0054] These operation states and the position coordinates of the touch panel 206a touched by a finger or pen are notified to the CPU 201 via the internal bus, and the CPU 201 determines what kind of operation (touch operation) has been performed on the touch panel 206a based on the notified information. For touch-move, the moving direction of the finger or pen moving on the touch panel 206a can also be determined for each vertical component and horizontal component on the touch panel 106a based on the change in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 206a, quickly moved for a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced on the touch panel 206a as if flicking it. If a touch-move of a predetermined distance or more at a predetermined speed or more is detected and a touch-up is detected immediately, it can be determined that a flick has been performed (it can be determined that a flick has occurred following a slide operation). Furthermore, a touch operation in which multiple points (for example, two points) are touched simultaneously and the touch positions are brought closer to each other is called pinch in, and a touch operation in which the touch positions are moved away from each other is called pinch out. Pinch out and pinch in are collectively called pinch operation (or simply pinch). The touch panel 206a may be of any of various touch panel types, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. There are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or a pen to the touch panel, and either type may be used.

[0055] The operation unit 206 also includes a gesture detection unit 206f. The gesture detection unit 206f acquires an image showing the user's hand or the like from the imaging unit 215, and detects a gesture from the image.

[0056] FIG. 2D shows an external view of VR goggles (head mount adapter) 230 to which the display control device 200 can be attached. The display control device 200 can also be used as a head mount display by attaching it to the VR goggles 230. The insertion port 231 is an insertion port for inserting the display control device 200. The entire display control device 200 can be inserted into the VR goggles 230 with the display surface of the display 205 facing the headband 232 side (i.e., the user side) for fixing the VR goggles 230 to the user's head. In this way, when the user wears the VR goggles 230 to which the display control device 200 is attached, the user can view the display 205 of the display control device 200 without holding the display control device 200 with the user's hands. In this case, when the user moves his / her head or entire body, the posture of the display control device 200 also changes. The posture detection unit 213 detects the change in posture of the display control device 200, and the CPU 201 performs VR display processing based on this change in posture. In this case, detecting the orientation of the display control device 200 by the orientation detection unit 213 is equivalent to detecting the orientation of the user's head (the direction in which the user's line of sight is facing).

[0057] 3A and 3B show external views of controllers (controller 240 and controller 250) capable of communicating with display control device 200. In grip-type controller 240 as shown in Fig. 3A, a user holds holding section 241 with his / her hand and operates members of operation surface 242. In this way, an operation event is notified from controller 240 to display control device 200.

[0058] 3B, ring-type controller 250 includes ring unit 251 for being worn on user's finger 253, and ring operation unit 252. Ring operation unit 252 may be a member such as a push button, or may be a member capable of detecting touch by a finger (such as a rotary dial or an optical track pad).

[0059] 4, a process of controlling live view display of VR video displayed in the display control device 200 depending on whether or not a user wearing the display control device 200 is the operator of the digital camera 100 will be described. The process of the flowchart in FIG. 4 is realized by the CPU 201 expanding a program recorded in the non-volatile memory 203 into the memory 202 and executing it.

[0060] In step S401, CPU 201 acquires the camera state of digital camera 100 via communication I / F 210. The camera state includes movement information (information on pan, tilt, dolly, or zoom of digital camera 100) acquired by attitude detection unit 55 or operation unit 70. The camera state may also include information on the vibration isolation settings of digital camera 100, subject detection settings, or various other setting states (control states). CPU 201 also acquires VR video of a subject captured by digital camera 100 from digital camera 100.

[0061] In step S402, CPU 201 determines whether digital camera 100 is moving. If it is determined that digital camera 100 is moving (movement of digital camera 100 is detected), the process proceeds to step S404. If it is determined that digital camera 100 is not moving, the process proceeds to step S403. CPU 201 determines that digital camera 100 is moving, for example, when movement information (movement amount or movement speed) of digital camera 100 exceeds a threshold value.

[0062] In step S403, the CPU 201 performs normal live view display (displaying on the display control device 200 a live view image of the VR video that has not been subjected to processing for reducing the possibility of VR sickness occurring). Here, the live view image is an image within a part of one frame of the VR video. VR sickness is a symptom that occurs to a user when the user watches a VR video. In the following, the process of reducing the possibility of a user experiencing VR sickness while watching a VR video image will be referred to as the "VR sickness reduction process."

[0063] In step S403, the CPU 201 may display a live view image that has been subjected to VR sickness reduction processing, instead of a normal live view display. In this case, the CPU 201 sets the degree (strength) of the VR sickness reduction processing in step S403 to be smaller than the degree of the VR sickness reduction processing in step S405. The greater the degree of the VR sickness reduction processing, the more processing is performed on the live view image that reduces the possibility that the wearing user will experience VR sickness. When the degree of the VR sickness reduction processing is minimum, the VR sickness reduction processing is not performed on the live view image.

[0064] In step S404, the CPU 201 determines whether or not the user wearing the display control device 200 (hereinafter referred to as the "wearing user") is the operator of the digital camera 100. If it is determined that the wearing user is the operator, the process proceeds to step S403. If it is determined that the wearing user is not the operator, the process proceeds to step S405.

[0065] In step S404, the CPU 201 may obtain information on whether the user wearing the digital camera 100 is the operator of the digital camera 100 from the digital camera 100 through the external I / F 209 or the communication I / F 210. The user wearing the digital camera 100 may be able to set in advance that the digital camera 100 is the display device of the user wearing the digital camera 100 using the operation unit 206, the controller 240, or the controller 250 of the display control device 200. The CPU 201 may determine whether the user wearing the digital camera 100 is the operator based on the set information. For this reason, it is sufficient that the CPU 201 obtains information that can determine whether the operator of the digital camera 100 is using the display control device 200. The operation on the digital camera 100 may be an operation on the operation unit 70, or may be a remote operation via the connection I / F 25 or the like.

[0066] In step S405, the CPU 201 performs processed live view display (displays a live view image of the VR video that has been subjected to the VR sickness reduction process on the display control device 200).

[0067] 6A to 6D show an example of a live view image displayed on the display control device 200 according to the embodiment.

[0068] 6A is a diagram illustrating a normal live view display. A live view image 601 is an image displayed on the display control device 200, and is a live view image to which no VR sickness reduction processing has been applied.

[0069] 6B is a diagram illustrating a processed live view display. An image 602 is an image displayed on the display control device 200. The image 602 includes a live view image 603 and an image 604. The live view image 603 is an image obtained after a process for reducing the display range (narrowing the viewing angle) of the live view image 601 has been performed as an example of a VR sickness reduction process. The image 604 is a monochrome white image that replaces a part (peripheral area) of the live view image 601 in order to reduce the display range of the live view image 601.

[0070] Note that, when the VR sickness reduction process is applied to the live view image 601, the display ratio between the live view image 603 and the monochrome white image 604 may be changeable. This may allow the degree of the VR sickness reduction process to be set to be changeable.

[0071] Note that the VR sickness reduction process is not limited to this method. As a VR sickness reduction process, a still image of the live view immediately before the digital camera 100 is moved may be continuously displayed (VR The processing may include a process of displaying a live view image by reducing the frame rate, or a process of displaying a live view image by stopping playback of the video. Note that instead of the time immediately before the movement, the time when the movement of the digital camera 100 is detected or the current time may be used. As the VR sickness reduction processing, a process of displaying a single color image (black other than white, etc.) instead of the live view image, or a process of displaying a predetermined standby image (an image stored in the storage medium 208) instead of the live view image may be performed. In addition, with regard to the processing of narrowing the viewing angle, the range in which the live view image is left is not limited to the center of the viewing angle of view, and may be any range. In other words, any type of processing may be performed as the VR sickness reduction processing as long as it is image processing that can reduce the possibility of VR sickness occurring.

[0072] 6C shows an example of a live view image superimposed with the camera setting state of the digital camera 100, displayed on the display control device 200. An image 605 is an image displayed on the display control device 200. A camera setting state 606 is a camera setting state acquired from the digital camera 100.

[0073] Fig. 6D shows an image after VR sickness reduction processing has been performed on the live view image shown in Fig. 6C. An image 607 is an image displayed on the display control device 200. A camera setting state 608 in the image 607 is a camera setting state acquired by the digital camera 100. Even if the live view image has been subjected to VR sickness reduction processing, the camera setting state 608 does not need to be subjected to VR sickness reduction processing. In other words, the camera setting state 608 may be displayed in the same manner as the camera setting state 606 in the normal live view display shown in Fig. 6C.

[0074] Note that various setting states of the display control device 200 may be displayed instead of the camera setting state 608. Also, the camera setting state 608 and the various setting states of the display control device 200 may be displayed simultaneously. Also, the camera setting state 608 and the various setting states of the display control device 200 may be displayed at any position, not limited to the bottom of the screen.

[0075] (Example 1: VR video display control processing) An example of a process (another example of the process of the flowchart in FIG. 4) for controlling the display of a VR video image displayed on the display control device 200 will be described with reference to the flowchart in FIG. 5A. This process is realized by the CPU 201 expanding a program recorded in the non-volatile memory 203 into the memory 202 and executing it.

[0076] In step S501, the CPU 201 acquires the camera state of the digital camera 100 via the communication I / F 210. The CPU 201 also acquires from the digital camera 100 a VR image in which the digital camera 100 captures a subject.

[0077] In step S502, CPU 201 determines whether digital camera 100 is moving (digital camera 100 is in motion). If it is determined that digital camera 100 is moving (movement of digital camera 100 is detected), the process proceeds to step S504. If it is determined that digital camera 100 is not moving, the process proceeds to step S503. CPU 201 determines that digital camera 100 is moving, for example, when movement information (movement amount or movement speed) of digital camera 100 exceeds threshold value Th1.

[0078] In step S503, the CPU 201 performs normal live view display. In step S503, the CPU 201 may display a live view image that has been subjected to VR sickness reduction processing, instead of the normal live view display. In this case, the CPU 201 sets the degree (strength) of the VR sickness reduction processing in step S503 to be smaller than the degree of the VR sickness reduction processing in step S510.

[0079] In step S504, CPU 201 determines whether or not the user wearing the digital camera 100 is the operator of the digital camera 100. If it is determined that the user wearing the digital camera 100 is the operator, the process proceeds to step S505. If it is determined that the user wearing the digital camera 100 is not the operator, the process proceeds to step S510.

[0080] In step S505, the CPU 201 determines whether or not the display control device 200 is set to a mode (reduction processing mode) for performing VR sickness reduction processing (processing for reducing the possibility of occurrence of VR sickness). If it is determined that the display control device 200 is set to the reduction processing mode, the process proceeds to step S506. If it is determined that the display control device 200 is not set to the reduction processing mode, the process proceeds to step S503. The user wearing the device can control whether or not to set the display control device 200 to the reduction processing mode via the operation unit 206.

[0081] In step S506, the CPU 201 determines whether or not the display control device 200 is set to a mode in which the viewing angle of view is maintained (view angle maintenance mode). If it is determined that the display control device 200 is set to the view angle maintenance mode, the process proceeds to step S512. If it is determined that the display control device 200 is not set to the view angle maintenance mode, the process proceeds to step S507. The user wearing the device can control whether or not to set the display control device 200 to the view angle maintenance mode via the operation unit 206.

[0082] In step S507, CPU 201 determines whether digital camera 100 is recording (recording video). If it is determined that digital camera 100 is recording, the process proceeds to step S508. If it is determined that digital camera 100 is not recording, the process proceeds to step S503. Instead of determining whether digital camera 100 is recording, it may be determined whether digital camera 100 is in pre-recording (a state in which recording is being performed going back a specified time from immediately before recording is started). Alternatively, instead of determining whether digital camera 100 is recording, it may be determined whether digital camera 100 is live streaming (a state in which video is being transmitted in real time via the Internet).

[0083] In step S508, CPU 201 determines whether digital camera 100 has acquired a live view image of VR video with camera shake correction (whether digital camera 100's vibration prevention setting is ON or shooting is being performed with a gimbal camera or the like). A gimbal camera is a camera that has a gimbal, which is an item for preventing camera shake. If it is determined that a live view image of VR video with camera shake correction has been acquired, the process proceeds to step S503. If it is determined that a live view image of VR video with camera shake correction has not been acquired, the process proceeds to step S509.

[0084] In step S509, CPU 201 determines whether or not AF is being performed on the subject detected by digital camera 100. If it is determined that AF is being performed on the detected subject, the process proceeds to step S511. If it is determined that AF is not being performed on the detected subject, the process proceeds to step S510. Note that in the determination of step S509, it may be determined whether or not a subject has been detected by digital camera 100, rather than whether or not AF is being performed on the detected subject.

[0085] In step S510, the CPU 201 performs processed live view display.

[0086] In step S511, the CPU 201 generates a live view image centered on the position of the subject detected by the display control device 200, and displays the generated live view image having been subjected to VR sickness reduction processing.

[0087] In step S512, CPU 201 determines whether or not "the amount of movement of digital camera 100 is an amount that allows the current viewing angle of view corresponding to the live view image being displayed on display 205 of display control device 200 to be maintained." If it is determined that the amount of movement of digital camera 100 is an amount that allows the current viewing angle of view to be maintained, processing proceeds to step S513. If it is determined that the amount of movement of digital camera 100 is not an amount that allows the current viewing angle of view to be maintained, processing proceeds to step S507.

[0088] "The amount of movement of digital camera 100 is an amount that allows the current viewing angle of view to be maintained" means, for example, that the current live view image and the next live view image to be displayed can be controlled to have the same angle of view (can be displayed with the same angle of view). If the angle of view of the VR video of the next frame includes the angle of view of the current live view image, it can be said that "the amount of movement of digital camera 100 is an amount that allows the current viewing angle of view to be maintained."

[0089] In step S513, CPU 201 determines whether or not the movement information (movement amount or movement speed) of digital camera 100 exceeds threshold value Th2. If it is determined that the movement information (movement amount or movement speed) of digital camera 100 exceeds threshold value Th2, the process proceeds to step S507. If it is determined that the movement information of digital camera 100 does not exceed threshold value Th2, the process proceeds to step S514. Here, for example, threshold value Th2 has a value larger than threshold value Th1 used in step S502.

[0090] In step S514, CPU 201 displays a live view image having the same viewing angle of view as the previous live view image on display control device 200 (performs live view display maintaining the viewing angle of view). In step S514, since the viewing angle of view is maintained, the live view image is not affected by movement of digital camera 100. Therefore, since the wearing user who views the live view image is unlikely to experience VR sickness, CPU 201 does not apply VR reduction processing to the live view image.

[0091] 5A, when the digital camera 100 is moving, if the user who wears the digital camera 100 is the operator of the digital camera 100, the display of the VR video can be controlled according to the settings of the display control device 200. On the other hand, when the digital camera 100 is moving, if the user who wears the digital camera 100 is not the operator, the processed live view display is always performed.

[0092] (Example 2: VR video display control processing) Another example of the process for controlling the display of VR video images displayed on the display control device 200 (another example of the process in the flowchart in FIG. 4) will be described with reference to the flowchart in FIG. 5B. This process is realized by loading a program recorded in the non-volatile memory 203 into the memory 202 and executing it by the CPU 201.

[0093] Only step S524 in the process of the flowchart in Fig. 5B differs from step S504 in the process of the flowchart in Fig. 5A. The other steps are the same in Fig. 5A and Fig. 5B, so their explanations are omitted. When it is determined in step S502 that the digital camera 100 is moving, the process of step S524 starts.

[0094] In step S524, CPU 201 determines whether or not the user wearing the digital camera 100 is the operator of the digital camera 100. If it is determined that the user wearing the digital camera 100 is the operator, the process proceeds to step S503. If it is determined that the user wearing the digital camera 100 is not the operator, the process proceeds to step S505.

[0095] According to the process of the flowchart in FIG. 5B, when the digital camera 100 is moving, if the user who wears the digital camera 100 is not the operator of the digital camera 100, the setting of the display control device 200 On the other hand, when the digital camera 100 is moving, if the user who is wearing the digital camera 100 is the operator, normal live view display is always performed.

[0096] In addition, if the degree of processing for reducing the possibility of the wearing user experiencing VR sickness is controlled depending on whether the wearing user is the operator or not, processing of a flowchart that arbitrarily combines the flowchart of FIG. 5A and the flowchart of FIG. 5B may be performed.

[0097] The number of operators of digital camera 100 may be multiple or zero. The number of non-operators of digital camera 100 may be multiple or zero. The detected subject may be a person, an animal, a car, an airplane, or the like. The subject may be detected in response to an instruction (selection) by the operator of digital camera 100. Digital camera 100 may detect the subject automatically.

[0098] The display control device 200 and the VR goggles 230 may be an integrated housing. The image processing unit of the digital camera 100 may perform the processing (image processing of the VR image to be displayed) performed by the image processing unit 204 of the display control device 200. In this case, the processed image may be transmitted via the external I / F 209 and the communication I / F 210 and displayed on the display 205 of the display control device 200.

[0099] Although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0100] Also, in the above, "If A is equal to or greater than B, proceed to step S1, and if A is smaller (lower) than B, proceed to step S2" may be read as "If A is greater (higher) than B, proceed to step S1, and if A is equal to or less than B, proceed to step S2." Conversely, "If A is greater (higher) than B, proceed to step S1, and if A is equal to or less than B, proceed to step S2" may be read as "If A is greater (higher) than B, proceed to step S1, and if A is smaller (lower) than B, proceed to step S2." Therefore, unless a contradiction occurs, "equal to or greater than A" may be read as "equal to or greater than A (high; long; many)," and "equal to or less than A" may be read as "equal to or less than A (low; short; few)." And, "equal to or greater than A" may be read as "equal to or greater than A," and "equal to or less than A" may be read as "equal to or less than A."

[0101] Each functional unit in each of the above embodiments (variations) may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of a plurality of functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Furthermore, each functional unit may or may not be realized by hardware such as an ASIC, FPGA, or DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. Then, the functions of at least some of the functional units of the device may be realized by the processor reading and executing the control program from the memory.

[0102] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for implementing one or more of the functions.

[0103] The disclosure of the above embodiments includes the following configurations, methods, and programs. (Configuration 1) An acquisition means for acquiring a VR image captured by an imaging device; A detection means for detecting a movement of the imaging device; A processing means for performing a reduction process on the live view image of the VR video to reduce the possibility that a specific symptom will occur in a user viewing the live view image of the VR video; a control means for controlling a degree of the reduction processing on the live view image when the detection means detects movement of the image capture device, based on whether the user is an operator of the image capture device; and a display control means for controlling a display means to display an image after the reduction process has been performed on the live view image when the reduction process has been performed on the live view image; A display control device comprising: (Configuration 2) and when the detection means detects a movement of the imaging device, the control means increases a degree of the reduction process on the live view image when the user is not an operator of the imaging device compared to when the user is an operator of the imaging device. 2. The display control device according to configuration 1. (Configuration 3) and when the detection means detects a movement of the imaging device, if the user is an operator of the imaging device, the control means controls a degree of the reduction process of the live view image in accordance with a setting of the display control device. 3. The display control device according to configuration 1 or 2. (Configuration 4) and when the detection means detects movement of the imaging device, if the user is not an operator of the imaging device, the control means controls a degree of the reduction process of the live view image in accordance with a setting of the display control device. 3. The display control device according to configuration 1 or 2. (Configuration 5) the processing means performs a process of replacing at least a part of the live view image with a specific image as the reduction process on the live view image, 5. The display control device according to any one of configurations 1 to 4. (Configuration 6) the processing means performs, as the reduction processing on the live view image, a processing of continuing to display a still image of the live view image at a specific time point, or a processing of reducing the frame rate of the live view image. 5. The display control device according to any one of configurations 1 to 4. (Configuration 7) the processing means does not perform the reduction process on the live view image when the detection means does not detect movement of the imaging device. 7. The display control device according to any one of configurations 1 to 6. (Configuration 8) the processing means does not perform the reduction process on the live view image when the moving speed or the moving amount of the imaging device does not exceed a threshold value. 8. The display control device according to configuration 7. (Configuration 9) The live view image is an image of a part of the VR video, the display control means controls the display means to display the second image while maintaining an angle of view corresponding to the first image, if a second image, which is a next live view image, can be displayed while maintaining an angle of view corresponding to the first image; The processing means is capable of displaying the second image while maintaining an angle of view corresponding to the first image. if so, do not perform the reduction process on the second image. 9. The display control device according to any one of configurations 1 to 8. (Configuration 10) the display control means controls the display means to display information on a specific setting together with the live view image; Even when the processing means performs the reduction process on the live view image, the processing means does not perform the reduction process on the information of the specific setting. 10. The display control device according to any one of configurations 1 to 9. (Configuration 11) the processing means does not perform the reduction process on the live view image if the imaging device is recording an image, performing pre-recording, or performing live streaming. 11. The display control device according to any one of configurations 1 to 10. (Configuration 12) The processing means does not perform the reduction process on the live view image when the VR image is an image that has been corrected for camera shake. 12. The display control device according to any one of configurations 1 to 11. (Configuration 13) When the detection means detects the movement of the imaging device and the imaging device is in a state of detecting a subject, the processing means generates the live view image having a center position corresponding to the position of the detected subject, and performs the reduction processing on the generated live view image. 13. The display control device according to any one of configurations 1 to 12. (method) An acquisition step of acquiring a VR image by capturing an image with an imaging device; a detection step of detecting a movement of the imaging device; A processing step of performing a reduction process on the live view image to reduce the possibility that a specific symptom will occur in a user viewing the live view image of the VR video; a control step of controlling a degree of the reduction processing on the live view image based on whether or not the user is an operator of the imaging device when the movement of the imaging device is detected in the detection step; a display control step of controlling a display means to display an image after the reduction process has been performed on the live view image when the reduction process has been performed on the live view image; A display control method comprising: (program) A program for causing a computer to function as each of the means of the display control device according to any one of configurations 1 to 13. [Explanation of symbols]

[0104] 100: digital camera, 200: display control device, 201: CPU, 205: Display

Claims

1. Acquisition means for acquiring VR images by imaging with an imaging device, A detection means for detecting the movement of the imaging device, Processing means for performing reduction processing on the live view image of the VR video displayed on the display to reduce the possibility of a user experiencing specific symptoms when viewing the live view image of the VR video, A determination means for determining whether the user is the operator of the imaging device that captures the VR image, or a viewer of the VR image other than the operator, When the movement of the imaging device is detected by the detection means, a control means controls the degree of reduction processing applied to the live view image based on whether the user is the operator or the viewer. If the reduction process is performed on the live view image, the display control means controls the display to display the image after the reduction process has been performed on the live view image, A display control device characterized by having the following features.

2. When the movement of the imaging device is detected by the detection means, the control means increases the degree of reduction processing applied to the live view image when the user is not the operator compared to when the user is the operator. The display control device according to feature 1.

3. When the movement of the imaging device is detected by the detection means, the control means controls the degree of reduction processing of the live view image according to the settings of the display control device, if the user is the operator. The display control device according to claim 1 or 2, characterized in that it is a display control device.

4. When the movement of the imaging device is detected by the detection means, the control means controls the degree of reduction processing of the live view image according to the settings of the display control device, if the user is not the operator. The display control device according to claim 1 or 2, characterized in that it is a display control device.

5. The processing means performs a reduction process on the live view image, which involves replacing at least a portion of the live view image with a specific image. The display control device according to claim 1 or 2, characterized in that it is a display control device.

6. The processing means performs the following reduction processes on the live view image: a process that continues to display a still image of the live view image at a specific point in time, or a process that reduces the frame rate of the live view image. The display control device according to claim 1 or 2, characterized in that it is a display control device.

7. If the detection means does not detect movement of the imaging device, the processing means does not perform the reduction processing on the live view image. The display control device according to claim 1 or 2, characterized in that it is a display control device.

8. The processing means does not perform the reduction processing on the live view image if the movement speed or amount of movement of the imaging device does not exceed a threshold. The display control device according to feature 7.

9. The aforementioned live view image is a part of the VR video, If the display control means can display the second image, which is the next live view image, while maintaining the field of view corresponding to the first image, which is the current live view image, then the display control means controls the display to display the second image while maintaining the field of view corresponding to the first image. If the processing means can display the second image while maintaining the field of view corresponding to the first image, it will not perform the reduction processing on the second image. The display control device according to claim 1 or 2, characterized in that it is a display control device.

10. The display control means controls the display to display information about specific settings along with the live view image. Even when the processing means performs the reduction processing on the live view image, it does not perform the reduction processing on the information of the specific settings. The display control device according to claim 1 or 2, characterized in that it is a display control device.

11. The processing means does not perform the reduction processing on the live view image if the imaging device is recording, pre-recording, or live streaming an image. The display control device according to claim 1 or 2, characterized in that it is a display control device.

12. The processing means, if the VR image is an image that has been corrected for camera shake, does not perform the reduction processing on the live view image. The display control device according to claim 1 or 2, characterized in that it is a display control device.

13. If the detection means detects the movement of the imaging device and the imaging device has detected a subject, the processing means generates a live view image with the detected subject's position as the center, and performs the reduction process on the generated live view image. The display control device according to claim 1 or 2, characterized in that it is a display control device.

14. Whether the user is the operator or the viewer is determined based on information obtained from the imaging device. The image processing apparatus according to claim 1 or 2.

15. The image processing apparatus according to claim 1 or 2, characterized in that whether the user is the operator or the viewer is set by the user.

16. The control means controls the live view image to perform the reduction process at a lower degree than when movement of the imaging device is detected, if the movement of the imaging device is not detected by the detection means. The image processing apparatus according to claim 1 or 2.

17. The reduction process includes narrowing the field of view of the live view image by replacing the peripheral area of ​​the live view image with a monochrome image, The degree of the reduction process is determined based on the display ratio between the remaining area of ​​the live view image and the monochrome image. The image processing apparatus according to claim 1 or 2.

18. The remaining region includes the central region of the live view image. The image processing apparatus according to feature 17.

19. The acquisition step involves acquiring VR images through imaging by an imaging device, A detection step for detecting the movement of the imaging device, A processing step of performing a reduction process on the live view image to reduce the possibility of a user experiencing specific symptoms when viewing the live view image of the VR video displayed on the display, A determination step to determine whether the user is the operator of the imaging device that captures the VR image, or a viewer of the VR image other than the operator, If movement of the imaging device is detected in the detection step, a control step is performed to control the degree of reduction processing applied to the live view image based on whether the user is the operator or the viewer. If the reduction process is performed on the live view image, a display control step is included in which the display controls the display to show the image after the reduction process has been performed on the live view image. A display control method characterized by having the following features.

20. A program for causing a computer to function as each of the means of the display control device described in claim 1 or 2.

Images