Electronic device

Abstract

To visually recognize a moving video with high resolution feeling while suppressing deterioration in image quality of a non-moving video and deterioration in a device.SOLUTION: According to an aspect of the present invention, there is provided an electronic apparatus including a display unit, an apparatus motion detection unit configured to detect a motion of the electronic apparatus, and a control unit configured to display a display image on the display unit, wherein a position of a portion displayed as the display image in a three dimensional space changes according to the motion of the electronic apparatus, and the control unit switches a state of the display image between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the motion detected by the apparatus motion detection unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to electronic devices, and more particularly to controlling a display device that is held by a user or worn on the head and displays images linked to the user's movements. [Background technology]

[0002] Known display devices that magnify an image on a small display using an eyepiece optical system or the like and present it to a user (observer) include camera electronic viewfinders (EVFs) and head-mounted displays (HMDs) (Patent Documents 1 and 2). These display devices are held by the user or worn on the head, and display images that are synchronized with the user's movements. Virtual reality (VR) HMDs display virtual computer graphics (CG) on a small display. EVFs and mixed reality (MR) HMDs display real images captured by a camera on a small display. MR HMDs can display CG superimposed on real images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-133725 [Patent Document 2] Patent Publication No. 2021-13057 Summary of the Invention [Problem to be solved by the invention]

[0004] EVFs and HMDs display not only still images but also moving images. When a user stands still and observes a still object, a still image is displayed. When a user stands still and observes a moving object, or when the user observes a still object while moving, a still image is displayed. It is desirable to be able to view both still and moving images with high resolution (clearness). However, the resolution of moving images is in a trade-off relationship with the image quality of still images, the lifespan of the device, etc.

[0005] The present invention aims to make it possible to view moving images with high resolution while suppressing deterioration of the image quality of still images and deterioration of devices. [Means for solving the problem]

[0006] A first aspect of the present invention is an electronic device comprising a display means, an apparatus motion detection means for detecting the movement of the electronic device, and a control means for displaying a display image on the display means, wherein the position of the portion to be displayed as the display image in three-dimensional space changes in accordance with the movement of the electronic device, and the control means switches the state of the display image between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the movement detected by the apparatus motion detection means.

[0007] A second aspect of the present invention provides an image capturing apparatus comprising: an imaging means; a display means; an image motion detection means for detecting motion in a display image based on an image of real space obtained by the imaging means; and a control means for controlling the display means to display the display image, wherein the control means switches a state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the motion detected by the image motion detection means, and switches a state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state. This is an electronic device characterized by switching between

[0008] A third aspect of the present invention is an electronic device comprising a display means, a gaze detection means for detecting a user's gaze, an image motion detection means for detecting movement in a display image displayed on the display means, and a control means for controlling the display means to display the display image, wherein the control means switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state based on the movement detected by the image motion detection means at the location where the user's gaze is directed.

[0009] A fourth aspect of the present invention is a control method for an electronic device having a display means, comprising an equipment motion detection step of detecting movement of the electronic device and a control step of displaying a display image on the display means, wherein the position of the portion to be displayed as the display image in three-dimensional space changes depending on the movement of the electronic device, and the control step switches the state of the display image between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the movement detected in the equipment motion detection step.

[0010] A fifth aspect of the present invention is a control method for an electronic device having an imaging means and a display means, comprising: an image motion detection step of detecting motion in a display image based on an image of real space obtained by the imaging means; and a control step of controlling the display means to display the display image, wherein the control step switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state based on the motion detected in the image motion detection step, and switches the state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state.

[0011] A sixth aspect of the present invention is a control method for an electronic device having a display means, comprising a gaze detection step of detecting a user's gaze, an image motion detection step of detecting movement in a display image displayed on the display means, and a control step of controlling the display means to display the display image, wherein the control step switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state based on the movement detected in the image motion detection step at the location where the user's gaze is directed.

[0012] A seventh aspect of the present invention is a program for causing a computer to execute each step of the above control method. [Effects of the Invention]

[0013] According to the present invention, it is possible to suppress deterioration of the image quality of still images and deterioration of the device, while making it possible to view moving images with high resolution. [Brief explanation of the drawings]

[0014] [Figure 1] Schematic diagram of an HMD, etc. [Figure 2] Schematic diagram of an HMD, etc. [Figure 3] 3A and 3B are schematic diagrams showing the light emission time and light emission intensity of a display panel. [Figure 4] 3A and 3B are schematic diagrams showing the light emission time and light emission intensity of a display panel. [Figure 5] FIG. 2 is a schematic diagram of a display image. [Figure 6] FIG. 2 is a schematic diagram of a display image. [Figure 7] FIG. 2 is a schematic diagram of a display image. [Figure 8] FIG. 2 is a schematic diagram showing the shutter speed (exposure time) of an imaging element. [Figure 9] FIG. 2 is a schematic diagram showing the shutter speed (exposure time) of an imaging element. [Figure 10] Schematic diagram of an HMD, etc. [Figure 11] Schematic diagram of an HMD, etc. [Figure 12] Schematic diagram of an HMD, etc. DETAILED DESCRIPTION OF THE INVENTION

[0015] (First embodiment) A first embodiment of the present invention will be described below, in which the present invention is applied to a head-mounted display (HMD), which is a head-mounted display device.

[0016] 1 is a schematic diagram showing a user 102 viewing (observing, experiencing) an image using an HMD 100 according to the first embodiment. Fig. 1 shows a cross section parallel to the vertical direction. The Z axis, whose positive direction is the direction facing forward from the user 102 (visual axis direction), the X axis parallel to the left-right direction of the user 102, and the Y axis parallel to the up-down direction of the user 102 (vertical direction), are defined in a right-handed system.

[0017] The imaging unit includes an imaging optical system 103 and an imaging element 104. The imaging optical system 103 focuses light from real space onto the imaging element 104. The imaging element 104 generates an image (video signal, video data) of real space including an object 105 by converting the incident light into an electrical signal. The display unit includes a display panel 106 and an observation optical system 107. The display panel 106 is, for example, an organic EL panel or a liquid crystal panel, and displays an image. The observation optical system 107 presents an enlarged virtual image of the image on the display panel 106 to the user 102. The observation optical system 107 may be a refractive optical system, a reflective optical system using polarized light, or another optical system. While FIG. 1 shows an imaging unit and a display unit for one eye of the user, an imaging unit and a display unit are provided for each of the user's right and left eyes.

[0018] In the first embodiment, the optical axis of the observation optical system 107 and the optical axis of the imaging optical system 103 substantially coincide (including completely coincide). The optical axis of the observation optical system 107 and the optical axis of the imaging optical system substantially coincide not only in the YZ cross section shown in FIG. 1 but also in the XZ cross section. The distance from the imaging unit to the eyes of the user 102 is L1. The position of the imaging unit may be the position of the imaging optical system 103. The position of the eyes of the user 102 may be the position of the eyepiece where the eyes of the user 102 are placed. The distance L1 may be a distance taking into account all of the X-axis, Y-axis, and Z-axis directions, or may be a distance in the Z-axis direction (optical axis direction). The distance L1 is, for example, 35 mm. When an image of real space obtained by the imaging element 104 is displayed on the display panel 106, if the distance L1 is long, the appearance of real space via the HMD 100 will significantly differ from the appearance of real space with the naked eye without the HMD 100. Therefore, it is preferable that the distance L1 be 60 mm or less. By doing so, the difference between how the real space looks through the HMD 100 and how the real space looks with the naked eye without the HMD 100 can be reduced.

[0019] Furthermore, in the first embodiment, the angle of view θ2 of the imaging optical system 103 and the angle of view θ1 of the observation optical system 107 are approximately the same. This also reduces the difference between how the real space looks through the HMD 100 and how the real space looks with the naked eye without the HMD 100. The angles of view θ1 and θ2 are, for example, a horizontal angle of view of 80 degrees and a vertical angle of view of 70 degrees. Note that the angle of view θ2 of the imaging optical system 103 may be larger than the angle of view θ1 of the observation optical system 107. In that case, the image with the angle of view θ1 can be displayed by, for example, extracting the image with the angle of view θ1 from the image with the angle of view θ2.

[0020] In the case of an HMD that can be used as an HMD for mixed reality (MR), such as the HMD 100, it is preferable to adjust the optical axis, angle of view, etc. so that the image of real space can be viewed at approximately life-size. On the other hand, in the case of an EVF, it is not necessary to adjust the optical axis, angle of view, etc., as long as the image of the real space that you want to capture can be viewed even if it is not approximately life-size.

[0021] In the first embodiment, a display image based on an image of real space obtained by the image sensor 104 is displayed on the display panel 106. Then, the position of the portion displayed as the display image in three-dimensional space (such as real space, mixed reality space, or virtual space) changes according to the movement of the HMD 100. In the case of an EVF or MR HMD, an image of real space is displayed on the display panel 106. In the case of an MR HMD, computer graphics (CG) may be superimposed on the image of real space. In the case of a virtual reality (VR) HMD, an image of virtual space (CG image) is displayed on the display panel 106 without using an image of real space. However, even in the case of a VR HMD, an imaging unit may be provided for estimating the self-position and orientation. Furthermore, in the case of an MR HMD, an imaging unit for estimating the self-position and orientation may be provided separately from the imaging unit for obtaining the image of real space to be displayed. The imaging unit for obtaining the image of real space to be displayed may also be used for estimating the self-position and orientation.

[0022] The control unit 110 controls the entire HMD 100. The inertial measurement unit (IMU) 111 has inertial sensors such as an acceleration sensor and a gyro sensor. The device motion detection unit 121 detects the movement (such as the direction and speed of movement) of the HMD 100 based on at least one of information obtained by the IMU 111 and an image of real space obtained by the image sensor 104. The device motion detection unit 121 may detect the movement of the HMD 100 based on the result of self-position and orientation estimation. The image processing circuit 122 performs self-position and orientation estimation based on at least one of information obtained by the IMU 111 and an image of real space obtained by the image sensor 104. In the self-position and orientation estimation, the position and orientation of the HMD 100 are estimated in real time. Then, the image processing circuit 122 generates a display image corresponding to the estimated position and orientation. The control unit 110 displays the display image generated by the image processing circuit 122 on the display panel 106.

[0023] The device motion detection unit 121 and the image processing circuit 122 may be built into the HMD 100, or may be provided in an external device (such as a personal computer) of the HMD 100. When the device motion detection unit 121 and the image processing circuit 122 are provided in the external device, the HMD 100 (for example, the control unit 110) acquires the processing results of the device motion detection unit 121 and the image processing circuit 122 from the external device. Then, the HMD 100 (for example, the control unit 110) detects the motion of the HMD 100 based on the processing result of the device motion detection unit 121, and displays the display image on the display panel 106 based on the processing result of the image processing circuit 122.

[0024] 2 is a schematic diagram showing a state in which the HMD 100 is worn on the user's head using a head-mounted device 200. The HMD 100 is worn on the head-mounted device 200, and the head-mounted device 200 is worn on the head. By wearing the HMD 100 on the user's head, the displayed image can be changed in conjunction with the movement of the head. The HMD 100 has a wearing detection unit (such as an infrared sensor) (not shown) that detects whether the HMD 100 is worn by the user, and can determine whether the HMD 100 is worn by the user.

[0025] 3 and 4 are schematic diagrams showing the light emission time and light emission intensity of the display panel 106 during one frame period of a displayed image. Here, it is assumed that the displayed image is displayed at a frame rate of 60 fps. Therefore, the maximum light emission time of the display panel 106 during one frame period is 16.67 ms. In FIG. 3, the light emission time of the display panel 106 is the maximum light emission time (16.67 ms), and the data, which is the ratio of the light emission time of the display panel 106 to the period of one frame, 3 and 4, the light emission intensity in FIG. 4 is four times that of FIG. 4 so that the user can perceive the same brightness in the cases of FIG. 3 and FIG. 4. In FIG. 4, the light emission time of the display panel 106 is 1 / 4 of the period of one frame (4.17 ms), and the duty ratio is 25%.

[0026] By reducing the duty ratio (light-emitting time), it is possible to reduce motion blur in the displayed image (increase the resolution (sharpness) of the displayed image). However, in order to maintain the brightness perceived by the user, it is necessary to increase the light-emitting intensity. Increasing the light-emitting intensity increases the load on the display panel 106, accelerating the deterioration rate of the display panel 106. For this reason, it is difficult to continuously drive the display panel 106 at a small duty ratio (short light-emitting time) as shown in FIG. 4.

[0027] Therefore, in the first embodiment, the control unit 110 switches the state of the displayed image between a plurality of states including a normal state and a motion blur reduced state, based on the motion detected by the device motion detection unit 121. The normal state is a state in which the duty ratio is relatively large (a state in which the light emission time is relatively long) as shown in Fig. 3, and the motion blur reduced state is a state in which the duty ratio is relatively small (a state in which the light emission time is relatively short) as shown in Fig. 4.

[0028] For example, when the speed of motion detected by device motion detection unit 121 is slower than a threshold, control unit 110 controls the state of the displayed image to a normal state. When the speed of motion detected by device motion detection unit 121 is faster than the threshold, control unit 110 controls the state of the displayed image to a motion blur reduced state. When the speed of motion detected by device motion detection unit 121 is equal to the threshold, control unit 110 may control the state of the displayed image to either the normal state or the motion blur reduced state.

[0029] Assume that a user is viewing the image shown in FIG. 5 and has the house on the left side captured in the center of the field of view. The image state is normal. From this state, the user continues to capture the object (the house) on the fovea through a compensatory movement (vestibular-ocular reflex) of rotating their eyes to the right while rotating their head to the left. If the normal state with a relatively high duty ratio is maintained at this time, motion blur as shown in FIG. 6 is observed. In the first embodiment, when the angular velocity of the HMD 100 detected by the device motion detection unit 121 becomes equal to or greater than a threshold value (e.g., 15 deg / s), the image state is switched to a motion blur reduction state with a relatively low duty ratio. This allows the user to continue viewing a clear image as shown in FIG. 7. When the head swing ends and the angular velocity of the HMD 100 becomes less than the threshold value, the image state is returned to the normal state with a relatively high duty ratio, thereby suppressing deterioration of the display panel 106.

[0030] In this way, by controlling the state of the displayed image to a motion blur reduced state only in specific cases, it becomes possible to suppress deterioration of the display panel 106 and to view moving images with high resolution.

[0031] Note that if the brightness or color of the display image changes significantly when the state of the display image is switched, it will cause a sense of discomfort to the user. Therefore, it is preferable that the brightness or color of the display image does not change significantly when the state of the display image is switched. For example, the ratio of the difference between the brightness of the display image in the normal state and the brightness of the display image in the motion blur reduced state to the brightness of the display image in the normal state or the brightness of the display image in the motion blur reduced state is preferably 10% or less, and more preferably 5% or less. Furthermore, the value of ΔE*ab, which corresponds to the difference in chromaticity between the display image in the normal state and the motion blur reduced state, is preferably 5 or less, and more preferably less than 2.3, which is the minimum noticeable difference. The pixel values ​​of the display image may be adjusted to satisfy these conditions.

[0032] The control for switching the state of the display image may be delayed. In such a case, if control for switching the state of the display image is initiated at the timing when the speed of the HMD 100 switches between a state where the speed is slower than a threshold and a state where the speed is faster than the threshold, the switching of the state of the display image will be delayed relative to that timing. Such a delay may cause an uncomfortable feeling to the user. Therefore, it is preferable that the control unit 110 predicts the timing when the speed of the HMD 100 detected by the device motion detection unit 121 switches between a state where the speed is slower than a threshold and a state where the speed is faster than the threshold. The prediction method is not particularly limited, and for example, the timing can be predicted based on the motion detected by the device motion detection unit 121. Then, it is preferable that the control unit 110 initiates control for switching the state of the display image before the predicted timing so that the state of the display image switches at the predicted timing.

[0033] If the above-mentioned thresholds (threshold for switching the state of the displayed image, threshold for the speed of the HMD 100) are too slow, the state of the displayed image will be switched frequently, reducing the effect of suppressing deterioration of the display panel 106. Therefore, it is preferable to set the thresholds by considering the balance between the effect of reducing motion blur and the effect of suppressing deterioration of the display panel 106. For example, assuming a human head movement, it is preferable to use 15 deg / sec as the threshold. If there is sufficient margin in the life of the display panel 106, 10 deg / sec may be used as the threshold to increase the priority of reducing motion blur. If there is even more margin in the life of the display panel 106, 5 deg / sec may be used as the threshold to obtain the effect of reducing motion blur even for slight movements of the HMD 100.

[0034] Note that if the wearing detection unit determines that the user is not wearing the HMD 100, the state of the display image may be controlled to the normal state regardless of the detection result by the device motion detection unit 121. The state of the display image does not have to be switched between two states, but may be switched between three or more states. For example, the display image may be displayed with a larger duty ratio (the faster the speed of the HMD 100, the longer the light emission time). The duty ratio may be changed continuously or in steps.

[0035] (Second embodiment) A second embodiment of the present invention will now be described. The configuration of the HMD according to the second embodiment is the same as that of the first embodiment (FIG. 1). In the first embodiment, the state of the displayed image is changed by changing the duty ratio (light-emitting time) of the display panel 106. In the second embodiment, the state of the displayed image is changed by changing the shutter speed of the image sensor 104.

[0036] 8 and 9 are schematic diagrams showing the shutter speed (exposure time) of the image sensor 104. Here, it is assumed that the image sensor 104 captures images at a frame rate of 60 fps. In FIG. 8, the shutter speed of the image sensor 104 is 1 / 90 s, and the exposure time of the image sensor 104 is 11.11 ms. In FIG. 9, the shutter speed of the image sensor 104 is 1 / 350 s, and the exposure time of the image sensor 104 is 2.86 ms.

[0037] When the shutter speed is slow (when the exposure time is long), a display image with less noise can be obtained, but motion blur is likely to occur in the display image. By increasing the shutter speed (reducing the exposure time), motion blur in the display image can be reduced (the resolution (clarity) of the display image can be increased). However, to maintain the brightness perceived by the user, it is necessary to increase the amplification factor (gain) of the signal obtained by the image sensor 104. Furthermore, increasing the gain increases the noise in the display image. For this reason, it is not desirable to always continue capturing images at a fast shutter speed (short exposure time) as shown in FIG. 9.

[0038] Therefore, in the second embodiment, a state in which the shutter speed is relatively slow (a state in which the exposure time is relatively long) as shown in Figure 8 is defined as the normal state, and a state in which the shutter speed is relatively fast (a state in which the exposure time is relatively short) as shown in Figure 9 is defined as the motion blur reduction state.

[0039] Then, similar to the first embodiment, the control unit 110 switches the state of the display image between a plurality of states including a normal state and a motion blur reduced state based on the motion detected by the device motion detection unit 121. For example, when the speed of motion detected by the device motion detection unit 121 is slower than a threshold, the control unit 110 controls the state of the display image to the normal state. When the speed of motion detected by the device motion detection unit 121 is faster than the threshold, the control unit 110 controls the state of the display image to the motion blur reduced state. When the speed of motion detected by the device motion detection unit 121 is equal to the threshold, the control unit 110 may control the state of the display image to either the normal state or the motion blur reduced state.

[0040] In the normal state where the shutter speed is relatively slow, a display image with little noise is obtained. In the normal state, when the angular velocity of the HMD 100 detected by the device motion detection unit 121 becomes equal to or greater than a threshold value (e.g., 10 deg / s), the shutter speed and gain are increased, and the state of the display image is switched to a motion blur reduction state. For example, the state of FIG. 8 is switched to the state of FIG. 9. By increasing the shutter speed and gain, the brightness of the display image is maintained while motion blur of the display image is reduced (the resolution (clarity) of the display image is increased). When the angular velocity of the HMD 100 becomes less than the threshold value, the state of the display image is returned to the normal state where the shutter speed is relatively slow, and the noise of the display image is reduced.

[0041] In this way, by controlling the state of the displayed image to a motion blur reduced state only in specific cases, it is possible to suppress deterioration in the image quality of still images while making it possible to view moving images with high resolution.

[0042] It is also possible to combine the first and second embodiments, and define a state in which the duty ratio of the display panel 106 is relatively large and the shutter speed of the image sensor 104 is relatively slow as the normal state. And, define a state in which the duty ratio of the display panel 106 is relatively small and the shutter speed of the image sensor 104 is relatively fast as the motion blur reduction state. This makes it possible to suppress both degradation of the image quality of still images and degradation of the display panel 106, while still allowing moving images to be viewed with high resolution.

[0043] (Third embodiment) A third embodiment of the present invention will now be described. The configuration of the HMD according to the third embodiment is the same as that of the first embodiment (FIG. 1). In the third embodiment, the state of the displayed image is changed by changing the frame rate of the displayed image.

[0044] By increasing the frame rate of the display image, it is possible to reduce motion blur in the display image (to increase the resolution (clarity) of the display image). However, this increases the power consumption, load, heat generation, etc. of the image processing circuit 122, etc., and increases the rate of deterioration of the image processing circuit 122, etc. Therefore, it is not desirable to continuously display the display image at a high frame rate.

[0045] Therefore, in the third embodiment, a state where the frame rate is relatively low (for example, a frame rate of 60 fps) is defined as a normal state, and a state where the frame rate is relatively high (for example, a frame rate of 120 fps) is defined as a motion blur reduction state.

[0046] As in the first embodiment, the control unit 110 switches the state of the displayed image between a plurality of states including a normal state and a motion blur reduced state based on the motion detected by the device motion detection unit 121. For example, when the speed of the motion detected by the device motion detection unit 121 is If the speed of motion detected by device motion detection unit 121 is slower than the threshold, control unit 110 controls the state of the displayed image to the normal state. If the speed of motion detected by device motion detection unit 121 is faster than the threshold, control unit 110 controls the state of the displayed image to the motion blur reduced state. If the speed of motion detected by device motion detection unit 121 is equal to the threshold, control unit 110 may control the state of the displayed image to the normal state or the motion blur reduced state.

[0047] In a normal state with a relatively low frame rate, when the angular velocity of the HMD 100 detected by the device motion detection unit 121 becomes equal to or greater than a threshold value (e.g., 15 deg / s), the state of the displayed image is switched to a motion blur reduction state with a relatively high frame rate. For example, the frame rate is increased from 60 fps to 120 fps. When the angular velocity of the HMD 100 becomes less than the threshold value, the state of the displayed image is returned to the normal state with a relatively low frame rate.

[0048] In this way, by controlling the state of the displayed image to a motion blur reduced state only in specific cases, it is possible to suppress deterioration of the image processing circuit 122 and the like, while making it possible to view moving images with high resolution.

[0049] Note that the first, second, and third embodiments may be combined, and a state in which the duty ratio of the display panel 106 is relatively large, the shutter speed of the image sensor 104 is relatively slow, and the frame rate of the displayed image is relatively low may be defined as the normal state. A state in which the duty ratio of the display panel 106 is relatively small, the shutter speed of the image sensor 104 is relatively fast, and the frame rate of the displayed image is relatively high may be defined as the motion blur reduction state. This makes it possible to suppress degradation of the image quality of still images and degradation of more devices, while allowing moving images to be viewed with high resolution. The first and third embodiments may be combined, or the first and third embodiments may be combined.

[0050] (Fourth embodiment) A fourth embodiment of the present invention will now be described. Fig. 10 is a schematic diagram showing a state in which a user 102 is viewing an image using an HMD 1000 according to the fourth embodiment. The HMD 1000 in Fig. 10 has an image motion detection unit 1001 and an image motion determination unit 1002 instead of the inertial measurement unit (IMU) 111 and device motion detection unit 121 of the first embodiment (Fig. 1).

[0051] The image motion detection unit 1001 detects motion in a display image based on an image of real space obtained by the image sensor 104. For example, the image motion detection unit 1001 is a processor that analyzes the display image (display image data) for each frame to detect changes (motion) in the display image, or that detects motion in the display image using optical flow.

[0052] The video motion determination unit 1002 determines whether the motion detected by the video motion detection unit 1001 is the target of the user's observation. For example, the video motion determination unit 1002 is a processor that determines whether the detected motion is the target of observation by determining whether a predetermined condition is satisfied based on the position of the location where the motion is detected by the video motion detection unit 1001, the video, etc. The predetermined condition for determining whether the detected motion is the target of observation may be a condition that the detected motion is the target of observation, or a condition that the detected motion is not the target of observation.

[0053] Two or three of the image processing circuit 122, the image motion detection unit 1001, and the image motion determination unit 1002 may be integrated into a single processor. This eliminates the need for data transfer between processors, and allows for efficient arithmetic processing. It can be done.

[0054] Furthermore, image motion detection unit 1001 and image motion determination unit 1002 may be built into HMD 1000, or may be provided in an external device (such as a personal computer) of HMD 1000. When image motion detection unit 1001 and image motion determination unit 1002 are provided in the external device, HMD 1000 (for example, control unit 110) acquires the processing results of image motion detection unit 1001 and image motion determination unit 1002 from the external device. Then, HMD 1000 (for example, control unit 110) detects motion in the displayed image based on the processing result of image motion detection unit 1001, and determines whether the motion in the displayed image is the object of observation based on the processing result of image motion determination unit 1002.

[0055] The predetermined conditions for determining whether the motion detected by video motion detection unit 1001 is an observation target include, for example, at least one of the following conditions (A) to (E). (A) The location where the movement is detected is not at the edge of the displayed image. (B) The size of the area where the movement is detected (the size in the displayed image) is equal to or larger than a threshold value. (C) The distance in the depth direction from the user to the point where the movement is detected, as perceived by the user, is equal to or less than a threshold. (D) The brightness of the area where movement is detected is above a threshold. (E) The object present at the location where the movement is detected is a virtual object placed in real space.

[0056] Condition (A) will now be described. When a user observes a subject in a display image displayed on an HMD, if the subject is located in the peripheral area, i.e., the edge of the display image (the edge of the display area), the user will capture the subject in their peripheral vision and will not be able to perceive the subject with high resolution. For this reason, users often turn their heads to face the subject so that the subject is in their central field of vision. Furthermore, HMDs are becoming increasingly wider in angle of view to enhance the sense of realism. When the HMD's angle of view (the angle of view of the display image) is wide, it is difficult to keep looking at the edge of the display image (the edge of the display area). Therefore, if a moving subject is displayed at the edge of the display image, it can be determined that the user is not observing the subject (the subject (the subject's movement) is not a target of observation). Furthermore, if a moving subject is displayed in the center of the display image (if the moving subject is not displayed at the edge of the display image), it can be determined that the user is observing the subject (the subject (the subject's movement) is a target of observation). The boundary between the edge and the center is not particularly limited and may be set, for example, based on the angle of view of the display image. A position inside the edge of the display area by a distance of 10% of the length of the edge may be set as the boundary position.

[0057] Condition (B) will now be described. If the location (area) where motion is detected is too small, it is difficult to observe or identify the location. Although a high resolution of the displayed image can clearly display even small objects, for comfortable observation, it is preferable for the user to approach the object to be observed so that the object is displayed at an appropriate size. Therefore, if the size of the location (area) where motion is detected is less than a threshold, it can be determined that the user is not observing the location (the location (movement of the location) is not an object of observation). If the size of the location (area) where motion is detected is equal to or greater than a threshold, it can be determined that the user is observing the location (the location (movement of the location) is an object of observation). The size of the location is not particularly limited, and may be, for example, the length of the location in a predetermined direction or the area of ​​the location. The threshold is also not particularly limited. If the size of the location is the length of the location in a predetermined direction, a length that is 10% of the length of the display area in the predetermined direction may be set as the threshold.

[0058] Condition (C) is explained below. Areas far from the user are unlikely to be observed. If the depth distance of the location where movement is detected (the depth distance from the user to the location where movement is detected, as perceived by the user) is longer than a threshold, it can be determined that the user is not observing that location. If the depth distance of the location where movement is detected is equal to or less than the threshold, it can be determined that the user is observing that location. The method for acquiring the depth distance is not particularly limited. The depth distance may be acquired by distance measurement using stereo camera images, or by distance measurement using LiDAR (Light Detection and Ranging). The threshold is also not particularly limited. The depth distance corresponding to the center position of the range in which the depth distance can be acquired may be set as the threshold.

[0059] Condition (D) will now be described. Due to the characteristics of the human eye, sensitivity to movement in dark areas is lower than sensitivity to movement in bright areas, and so dark areas are less likely to become objects of observation. Therefore, if the luminance of an area where movement is detected is below a threshold, it can be determined that the user is not observing that area (that area (movement in that area) is not an object of observation). If the luminance of an area where movement is detected is equal to or greater than a threshold, it can be determined that the user is observing that area (that area (movement in that area) is an object of observation). The threshold is not particularly limited. A luminance of 2.5% of the upper limit luminance of the displayed image may be set as the threshold. A luminance of 2.5% of the maximum luminance in a frame where movement is detected (the maximum value of multiple luminances present in the image of the frame where movement is detected) may be set as the threshold.

[0060] If the subject is dark, the surrounding environment is also dark, and it is highly likely that the gain of the image sensor 104 is adjusted to a high level. Increasing the shutter speed of the image sensor 104 in this state to reduce motion blur may result in a significant deterioration in the image quality of the displayed image. In order to suppress such deterioration in image quality, it is preferable to use condition (D).

[0061] Condition (E) will now be explained. Mixed reality (MR) HMDs and augmented reality (AR) HMDs can display images of virtual objects (CG) superimposed on images of real space. In this case, the virtual objects are intentionally displayed so as to be observed by the user, and therefore have a high probability of becoming the object of observation. Therefore, if the object present at the location where movement is detected is not a virtual object placed in real space, it can be determined that the user is not observing that location (the location (movement of the location) is not the object of observation). On the other hand, if the object present at the location where movement is detected is a virtual object placed in real space, it can be determined that the user is observing that location (the location (movement of the location) is the object of observation). Note that in the case of MR HMDs, it is also possible to display images of real objects superimposed on CG background images. In this case, other conditions can be used, or the condition that the object present at the location where movement is detected is a real object can be used.

[0062] A user may observe a moving object without moving the HMD 1000 (head). For example, the user may observe a moving object in the center of a displayed image while facing forward. In this case, it is preferable to control the state of the displayed image to a motion blur reduction state even if the HMD 1000 is not moving.

[0063] Therefore, in the fourth embodiment, when the image motion determination unit 1002 determines that the motion detected by the image motion detection unit 1001 is the object of observation, the control unit 110 switches the state of the display image based on the motion. In the fourth embodiment, the state of the display image is switched by switching the state of the display panel 106 and the state of the image sensor 104.

[0064] For example, when the object of observation is a movement in the displayed image, the control unit 110 controls the state of the displayed image to a normal state if the amount of movement in the displayed image is smaller than a threshold value, and is greater than the threshold, the control unit 110 controls the state of the displayed image to a motion blur reduced state. If the amount of motion is equal to the threshold, the control unit 110 may control the state of the displayed image to a normal state or a motion blur reduced state. The method of controlling the state of the displayed image is not limited to this, and for example, the motion speed may be used instead of the amount of motion. The normal state is, for example, a state in which the duty ratio of the display panel 106 is relatively large and the shutter speed of the image sensor 104 is relatively slow. The motion blur reduced state is, for example, a state in which the duty ratio of the display panel 106 is relatively small and the shutter speed of the image sensor 104 is relatively fast.

[0065] Assume that image motion determination unit 1002 determines that the motion detected by image motion detection unit 1001 is the object of observation. In the normal state, when image motion detection unit 1001 detects motion greater than a threshold, the duty ratio of display panel 106 is reduced, the shutter speed and gain of image sensor 104 are increased, and the state of the displayed image is switched to a motion blur reduction state. When image motion detection unit 1001 no longer detects motion greater than the threshold, the state of the displayed image is returned to the normal state.

[0066] In this way, by controlling the state of the displayed image to a motion blur reduction state only in specific cases, it is possible to suppress deterioration of the image quality of still images and deterioration of the display panel 106, while making it possible to view moving images with high resolution.

[0067] Note that control unit 110 may switch the state of the display image based on the motion detected by image motion detection unit 1001, regardless of whether the motion is the object of observation. Control unit 110 may then control the state of the display image to the normal state when no motion is detected by image motion detection unit 1001, and may control the state of the display image to the motion blur reduced state when motion is detected by image motion detection unit 1001.

[0068] (Fifth embodiment) A fifth embodiment of the present invention will now be described. Fig. 11 is a schematic diagram showing a state in which a user 102 is viewing an image using an HMD 1100 according to the fifth embodiment. The HMD 1100 in Fig. 11 is configured using the components shown in Fig. 10, a light source 1110, an eye imaging element 1111, and an eye imaging optical system 1112.

[0069] The light source 1110 is a light source for illuminating the user's eye (eyeball) and is arranged around the observation optical system 107. For example, an infrared light emitting diode is used as the light source 1110. Light emitted from the light source 1110 and reflected by the eye passes through the eye imaging optical system 1112 and is imaged on the eye imaging element 1111. An eye image (an image of the user's eye) is then obtained by the eye imaging element 1111. The control unit 110 performs gaze detection processing to detect the user's gaze based on the eye image obtained by the eye imaging element 1111. The gaze detection processing can obtain, for example, angle information indicating the gaze direction and coordinate information indicating the position or area in the displayed image where the gaze is directed. Hereinafter, the area (location) where the gaze is directed will be referred to as the gaze area.

[0070] The method for determining the gaze area is not particularly limited. An area of ​​a predetermined size (for example, 5% of the size of the entire displayed image) centered on the position where the gaze is directed may be determined as the gaze area. The area of ​​the displayed image may be divided into a plurality of partial areas (for example, 16 partial areas of 4 rows x 4 columns, or 25 partial areas of 5 rows x 5 columns), and the partial area including the position where the gaze is directed may be determined as the gaze area.

[0071] The image motion detection unit 1001 detects motion in the displayed image from the gaze area determined (detected) by the gaze detection process. The image motion determination unit 1002 determines whether the motion detected by the image motion detection unit 1001 is the target of the user's observation. When the image motion determination unit 1002 determines that the motion detected by the image motion detection unit 1001 is the object of observation, the image motion determination unit 1002 switches the state of the display image based on the motion. In the fifth embodiment, the state of the display image may be switched by switching the state of the display panel 106 and the state of the image sensor 104, or the state of the display image may be switched by switching the state of the display panel 106 without switching the state of the image sensor 104. Note that motion may be detected from the entire display image, and the state of the display image may be switched based on the motion in the gaze area. The state of the display image may be switched based on the motion in the gaze area, regardless of whether the motion in the gaze area is the object of observation.

[0072] In this way, by limiting the movement considered when switching the state of the displayed image to movement in the line of sight area, the time in the motion blur reduction state can be suitably shortened, and deterioration of the image quality of still images and deterioration of the device can be further suppressed.

[0073] (Sixth embodiment) A sixth embodiment of the present invention will be described. Fig. 12 is a schematic diagram showing a state in which a user 102 views an image using an HMD 1200 according to the sixth embodiment. The HMD 1200 in Fig. 12 has the components shown in Fig. 11 as well as an inertial measurement unit (IMU) 111 and an equipment motion detection unit 121 shown in Fig. 1. Note that the HMD 1200 does not necessarily have to have an image motion determination unit 1002, a light source 1110, an eye imaging element 1111, and an eye imaging optical system 1112.

[0074] In the sixth embodiment, the control unit 110 switches the state of the display image based on the motion detected by the device motion detection unit 121 and the motion detected by the video motion detection unit 1001. For example, when motion is detected by at least one of the device motion detection unit 121 and the video motion detection unit 1001, the control unit 110 controls the state of the display image to a motion blur reduced state. When motion is not detected by either the device motion detection unit 121 or the video motion detection unit 1001, the control unit 110 controls the state of the display image to a normal state.

[0075] In the normal state, when device motion detection unit 121 detects motion, control unit 110 switches the state of the displayed image to the motion blur reduction state, regardless of the detection result by image motion detection unit 1001. At this time, control unit 110 causes image motion detection unit 1001 to suspend motion detection. When device motion detection unit 121 no longer detects motion, control unit 110 returns the state of the displayed image to the normal state and causes image motion detection unit 1001 to resume motion detection.

[0076] In the normal state, even if no motion is detected by device motion detection unit 121 but motion is detected by video motion detection unit 1001, control unit 110 switches the state of the displayed video to the motion blur reduction state. In this case, control unit 110 causes device motion detection unit 121 to continue motion detection without interruption. When motion is no longer detected by video motion detection unit 1001, control unit 110 returns the state of the displayed video to the normal state.

[0077] Generally, the processing amount (processing load) of device motion detection unit 121 is smaller than the processing amount (processing load) of video motion detection unit 1001, and therefore device motion detection unit 121 has a faster response than video motion detection unit 1001. When both motion of HMD 1200 and motion of the displayed video occur, device motion detection unit 121 detects motion of HMD 1200 earlier than the timing at which video motion detection unit 1001 detects motion of the displayed video.

[0078] In the sixth embodiment, when the device motion detector 121 detects the motion of the HMD 1200, the state of the displayed image is switched to the motion blur reduction state without waiting for the image motion detector 1001 to detect the motion of the displayed image. Furthermore, by temporarily stopping motion detection by video motion detection unit 1001, it is possible to reduce the processing load and power consumption.

[0079] Seventh embodiment A seventh embodiment of the present invention will be described. The configuration of the HMD according to the seventh embodiment is the same as that of the sixth embodiment (FIG. 12). The differences between the seventh embodiment and the sixth embodiment will be described.

[0080] In the seventh embodiment, even if the device motion detector 121 or the video motion detector 1001 detects motion, both the motion detection by the device motion detector 121 and the motion detection by the video motion detector 1001 continue without interruption.

[0081] As in the sixth embodiment, when motion is detected by both device motion detection unit 121 and video motion detection unit 1001, control unit 110 controls the state of the displayed video to the motion blur reduced state. When motion is not detected by device motion detection unit 121 but motion is detected by video motion detection unit 1001, control unit 110 also controls the state of the displayed video to the motion blur reduced state. When motion is not detected by either device motion detection unit 121 or video motion detection unit 1001, control unit 110 controls the state of the displayed video to the normal state.

[0082] Unlike the sixth embodiment, if the device motion detection unit 121 detects motion but the image motion detection unit 1001 does not, the control unit 110 controls the state of the displayed image to the normal state. For example, if a user continues to observe a subject that is moving significantly while turning their head to track the subject, the HMD 1200 moves, but the subject remains in the center of the displayed image, so there is no need to control the state of the displayed image to the motion blur reduced state. In such a case, the state of the displayed image is not controlled to the motion blur reduced state but is controlled to the normal state. This can suitably shorten the time in the motion blur reduced state, and can further suppress deterioration of the image quality of static images and deterioration of the device.

[0083] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.

[0084] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0085] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined. For example, although an example in which the present invention is applied to an HMD has been described, the present invention can also be applied to an HMD. The present invention is applicable to various electronic devices with a display unit, such as digital cameras with EVFs, smartphones, and tablet terminals.

[0086] (Other embodiments) The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program, or by a circuit that realizes one or more functions.

[0087] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An electronic device, A display means; device motion detection means for detecting motion of the electronic device; a control means for displaying a display image on the display means; and The position of the part displayed as the display image in three-dimensional space changes in accordance with the movement of the electronic device; The control means switches the state of the displayed image between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the motion detected by the device motion detection means. An electronic device characterized by: (Configuration 2) The second state is a state in which the light emission time of the display means in one frame period of the displayed image is shorter than that of the first state. 2. The electronic device according to configuration 1. (Configuration 3) the display image is an image based on an image of real space obtained by an imaging means of the electronic device, The second state is a state in which the shutter speed of the imaging means is faster than that of the first state. 3. The electronic device according to configuration 1 or 2. (Configuration 4) The second state is a state in which the frame rate of the displayed image is higher than that of the first state. 4. The electronic device according to any one of configurations 1 to 3. (Configuration 5) further comprising an inertial sensor; The device motion detection means detects the motion of the electronic device based on the information obtained by the inertial sensor. 5. The electronic device according to any one of configurations 1 to 4. (Configuration 6) The device movement detection means detects the movement of the electronic device based on an image of real space obtained by an imaging means of the electronic device. 6. The electronic device according to any one of configurations 1 to 5. (Configuration 7) The control means When the speed of the motion detected by the device motion detection means is slower than a threshold, the state of the displayed image is controlled to the first state; When the speed of the movement detected by the device movement detection means is faster than the threshold value, The state of the displayed image is controlled to the second state. 7. The electronic device according to any one of configurations 1 to 6. (Configuration 8) The device further includes a prediction unit that predicts a timing of a transition between a state in which the speed of the motion detected by the device motion detection unit is slower than the threshold value and a state in which the speed is faster than the threshold value, The switching of the state of the display image is delayed in response to the control for switching the state of the display image, The control means starts control to switch the state of the display image before the timing predicted by the prediction means so that the state of the display image is switched at the timing. 8. The electronic device according to configuration 7. (Configuration 9) The threshold is 15 deg / s 9. The electronic device according to configuration 7 or 8. (Configuration 10) A ratio of a difference between the luminance of the display image in the first state and the luminance of the display image in the second state to the luminance of the display image in the first state or the luminance of the display image in the second state is 10% or less. 10. The electronic device according to any one of configurations 1 to 9. (Configuration 11) The value of ΔE*ab corresponding to the difference between the chromaticity of the display image in the first state and the chromaticity of the display image in the second state is 5 or less. 11. The electronic device according to any one of configurations 1 to 10. (Configuration 12) the display image is an image based on an image of real space obtained by an imaging means of the electronic device, the optical axis of the optical system of the display means and the optical axis of the optical system of the imaging means are substantially aligned, The distance from the imaging means to the eyepiece where the user's eye is placed is 60 mm or less. 12. The electronic device according to any one of configurations 1 to 11. (Configuration 13) further comprising an image motion detection means for detecting a motion in the displayed image from the displayed image; The control means switches the state of the displayed image based on the motion detected by the device motion detection means and the motion detected by the image motion detection means. 13. The electronic device according to any one of configurations 1 to 12. (Configuration 14) When the device motion detection means detects motion, the control means controls the state of the displayed image to the second state regardless of the result of detection by the image motion detection means. 14. The electronic device according to configuration 13. (Configuration 15) The control means When the device motion detection means detects a motion, the video motion detection means is controlled to stop detection; When the device motion detection means no longer detects motion, the video motion detection means is controlled to resume detection. 15. The electronic device according to configuration 14. (Configuration 16) The control means controls the state of the displayed image to the first state when the device motion detection means detects motion but the image motion detection means does not detect motion. 14. The electronic device according to configuration 13. (Configuration 17) An imaging means; A display means; an image motion detection means for detecting a motion in a display image based on an image of real space obtained by the imaging means; a control means for controlling the display means to display the display image; and The control means switches the state of the display means between a plurality of states including a first state and a second state in which motion blur of the displayed image is reduced more than in the first state, based on the motion detected by the image motion detection means, and switches the state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur of the displayed image is reduced more than in the third state. An electronic device characterized by: (Configuration 18) The image processing device further includes a determination unit that determines whether the motion detected by the image motion detection unit is a target of the user's observation, When the determination means determines that the motion detected by the image motion detection means is an object of observation by the user, the control means switches the states of the imaging means and the display means based on the motion detected by the image motion detection means. 18. The electronic device according to configuration 17. (Configuration 19) The condition that the motion detected by the image motion detection means is the object of the user's observation is: a condition that the location where the motion is detected by the image motion detection means is not an edge of the displayed image; a condition that the size of the portion where motion is detected by the video motion detection means is equal to or larger than a threshold value; a condition that the distance in the depth direction from the user to the point where the motion is detected by the video motion detection means, as perceived by the user, is equal to or less than a threshold value; A condition that the luminance of the portion where the motion is detected by the video motion detection means is equal to or greater than a threshold value; and A condition that an object present at a location where the motion is detected by the image motion detection means is a virtual object located in real space. Includes at least one of the following: 19. The electronic device according to configuration 18. (Configuration 20) A display means; A gaze detection means for detecting a user's gaze; an image motion detection means for detecting a motion in the displayed image from the displayed image displayed on the display means; a control means for controlling the display means to display the display image; and The control means switches the state of the display means between a plurality of states including a first state and a second state in which motion blur of the displayed image is reduced more than in the first state, based on the movement detected by the image movement detection means at the location where the user's gaze is directed. An electronic device characterized by: (Configuration 21) further comprising an imaging means; the display image is an image based on an image of real space obtained by an imaging means, The control means switches the state of the display means between the plurality of states including the first state and the second state based on the movement detected by the image movement detection means at the location where the user's gaze is directed, and switches the state of the imaging means between the plurality of states including a third state and a fourth state in which motion blur in the displayed image is reduced more than in the third state. 21. The electronic device according to configuration 20. (Method 1) A method for controlling an electronic device having a display means, comprising: an equipment movement detection step of detecting movement of the electronic device; a control step of displaying a display image on the display means; and The position of the part displayed as the display image in three-dimensional space changes in accordance with the movement of the electronic device; In the control step, the state of the display image is switched between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the motion detected in the device motion detection step. A control method comprising: (Method 2) A method for controlling an electronic device having an imaging means and a display means, an image motion detection step of detecting a motion in a display image based on an image of real space obtained by the imaging means; a control step of controlling the display means to display the display image; and In the control step, based on the motion detected in the image motion detection step, the state of the display means is switched between a plurality of states including a first state and a second state in which motion blur of the displayed image is reduced more than in the first state, and the state of the imaging means is switched between a plurality of states including a third state and a fourth state in which motion blur of the displayed image is reduced more than in the third state. A control method comprising: (Method 3) A method for controlling an electronic device having a display means, comprising: a gaze detection step of detecting a user's gaze; an image motion detection step of detecting a motion in the displayed image from the displayed image displayed on the display means; a control step of controlling the display means to display the display image; and In the control step, the state of the display means is switched between a plurality of states including a first state and a second state in which motion blur of the displayed image is reduced more than in the first state, based on the movement detected in the image movement detection step at the location where the user's gaze is directed. A control method comprising: (program) A program for causing a computer to execute each step of the control method according to any one of Methods 1 to 3. [Explanation of symbols]

[0088] 100,1000,1100,1200:HMD 104: Image sensor 106: Display panel 110: Control unit 121: Device motion detection unit 1001: Video motion detection unit

Claims

1. An electronic device, A display means; device motion detection means for detecting motion of the electronic device; a control means for displaying a display image on the display means; and The position of the part to be displayed as the display image in the three-dimensional space changes in accordance with the movement of the electronic device; The control means switches the state of the displayed image between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the motion detected by the device motion detection means. An electronic device characterized by:

2. The second state is a state in which the light emission time of the display means in one frame period of the displayed image is shorter than that of the first state.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. the display image is an image based on an image of real space obtained by an imaging means of the electronic device, The second state is a state in which the shutter speed of the imaging means is faster than that of the first state.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

4. The second state is a state in which the frame rate of the displayed image is higher than that of the first state.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

5. further comprising an inertial sensor; The device motion detection means detects the motion of the electronic device based on the information obtained by the inertial sensor.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

6. The device movement detection means detects the movement of the electronic device based on an image of real space obtained by an imaging means of the electronic device.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

7. The control means When the speed of the motion detected by the device motion detection means is slower than a threshold, the state of the displayed image is controlled to the first state; When the speed of the motion detected by the device motion detection means is faster than the threshold value, the state of the displayed image is controlled to the second state.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

8. The device further includes a prediction unit that predicts a timing of a transition between a state in which the speed of the motion detected by the device motion detection unit is slower than the threshold value and a state in which the speed is faster than the threshold value, The switching of the state of the display image is delayed in response to the control for switching the state of the display image, The control means determines whether the state of the display image changes at the timing predicted by the prediction means. Control for switching the state of the display image is started before the timing so that the state is switched.

8. The electronic device according to claim 7,

9. The threshold is 15 deg / s.

8. The electronic device according to claim 7,

10. A ratio of a difference between the luminance of the display image in the first state and the luminance of the display image in the second state to the luminance of the display image in the first state or the luminance of the display image in the second state is 10% or less.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

11. The value of ΔE*ab corresponding to the difference between the chromaticity of the display image in the first state and the chromaticity of the display image in the second state is 5 or less.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

12. the display image is an image based on an image of real space obtained by an imaging means of the electronic device, the optical axis of the optical system of the display means and the optical axis of the optical system of the imaging means are substantially aligned, The distance from the imaging means to the eyepiece where the user's eye is placed is 60 mm or less.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

13. further comprising an image motion detection means for detecting a motion in the displayed image from the displayed image; The control means switches the state of the displayed image based on the motion detected by the device motion detection means and the motion detected by the image motion detection means.

3. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.

14. When the device motion detection means detects motion, the control means controls the state of the displayed image to the second state regardless of the result of detection by the image motion detection means.

14. The electronic device according to claim 13.

15. The control means When the device motion detection means detects a motion, the video motion detection means is controlled to stop detection; When the device motion detection means no longer detects motion, the video motion detection means is controlled to resume detection.

15. The electronic device according to claim 14.

16. The control means controls the state of the displayed image to the first state when the device motion detection means detects motion but the image motion detection means does not detect motion.

14. The electronic device according to claim 13.

17. An imaging means; A display means; an image motion detection means for detecting a motion in a display image based on an image of real space obtained by the imaging means; a control means for controlling the display means to display the display image; and The control means switches the state of the display means between a plurality of states including a first state and a second state in which motion blur of the displayed image is reduced more than in the first state, based on the motion detected by the image motion detection means, and switches the state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur of the displayed image is reduced more than in the third state. An electronic device characterized by:

18. The image processing device further includes a determination unit that determines whether the motion detected by the image motion detection unit is a target of the user's observation, When the determination means determines that the motion detected by the image motion detection means is an object of observation by the user, the control means switches the states of the imaging means and the display means based on the motion detected by the image motion detection means.

18. The electronic device according to claim 17.

19. The condition that the motion detected by the image motion detection means is the object of the user's observation is: a condition that the location where the motion is detected by the image motion detection means is not an edge of the displayed image; a condition that the size of the portion where motion is detected by the video motion detection means is equal to or larger than a threshold value; a condition that the distance in the depth direction from the user to the point where the motion is detected by the video motion detection means, as perceived by the user, is equal to or less than a threshold value; A condition that the luminance of the portion where the motion is detected by the video motion detection means is equal to or greater than a threshold value; and A condition that an object present at a location where the motion is detected by the image motion detection means is a virtual object located in real space. Includes at least one of the following:

20. The electronic device according to claim 18.

20. A display means; A gaze detection means for detecting a user's gaze; an image motion detection means for detecting a motion in the displayed image from the displayed image displayed on the display means; a control means for controlling the display means to display the display image; and The control means switches the state of the display means between a plurality of states including a first state and a second state in which motion blur of the displayed image is reduced more than in the first state, based on the movement detected by the image movement detection means at the location where the user's gaze is directed. An electronic device characterized by:

21. further comprising an imaging means; the display image is an image based on an image of real space obtained by an imaging means, The control means switches the state of the display means between the plurality of states including the first state and the second state based on the movement detected by the image movement detection means at the location where the user's gaze is directed, and switches the state of the imaging means between the plurality of states including a third state and a fourth state in which motion blur in the displayed image is reduced more than in the third state.

21. The electronic device according to claim 20.

22. A method for controlling an electronic device having a display means, comprising: an equipment movement detection step of detecting movement of the electronic device; a control step of displaying a display image on the display means; and The position of the part to be displayed as the display image in the three-dimensional space changes in accordance with the movement of the electronic device; In the control step, the state of the display image is switched between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the motion detected in the device motion detection step. A control method comprising:

23. A method for controlling an electronic device having an imaging means and a display means, an image motion detection step of detecting a motion in a display image based on an image of real space obtained by the imaging means; a control step of controlling the display means to display the display image; and In the control step, based on the motion detected in the image motion detection step, the state of the display means is switched between a plurality of states including a first state and a second state in which motion blur of the displayed image is reduced more than in the first state, and the state of the imaging means is switched between a plurality of states including a third state and a fourth state in which motion blur of the displayed image is reduced more than in the third state. A control method comprising:

24. A method for controlling an electronic device having a display means, comprising: a gaze detection step of detecting a gaze of a user; an image motion detection step of detecting a motion in the displayed image from the displayed image displayed on the display means; a control step of controlling the display means to display the display image; and In the control step, a state of the display means is switched between a plurality of states including a first state and a second state in which motion blur of the displayed image is reduced more than in the first state, based on the movement detected in the image movement detection step at a location where the user's gaze is directed. A control method comprising:

25. A program for causing a computer to execute each step of the control method according to any one of claims 22 to 24.

Images