Electronic device

Abstract

An electronic device according to the present invention is characterized by comprising a display means, a device movement detection means for detecting a movement of the electronic device, and a control means for displaying a display image on the display means and in that the position of a portion displayed as the display image in a three-dimensional space changes according to the movement of the electronic device, and that the control means switches the state of the display image among a plurality of states including a first state and a second state having less motion blurs than in the first state, on the basis of the movement detected by the device movement detection means.

Description

electronic equipment

[0001] The present invention relates to electronic devices, and more particularly to controlling a display device that is held by a user or worn on the head and displays images linked to the user's movements.

[0002] Known display devices that magnify an image on a small display using an eyepiece optical system or the like and present it to a user (observer) include camera electronic viewfinders (EVFs) and head-mounted displays (HMDs) (see Patent Documents 1 and 2). These display devices are held by the user or worn on the head, and display images linked to the user's movements. Virtual reality (VR) HMDs display virtual computer graphics (CG) on a small display. EVFs and mixed reality (MR) HMDs display real images captured by a camera on a small display. MR HMDs can display CG images superimposed on real images.

[0003] JP 2001-133725 A JP 2021-13057 A

[0004] EVFs and HMDs display not only still images but also moving images. When a user stands still and observes a still object, a still image is displayed. When a user stands still and observes a moving object, or when the user observes a still object while moving, a moving image is displayed. It is preferable that both still images and moving images can be viewed with high resolution (clearness). However, the resolution of moving images is in a trade-off relationship with the image quality of the still image, the lifespan of the device, etc.

[0005] The present invention aims to make it possible to view moving images with high resolution while suppressing deterioration of the image quality of still images and deterioration of devices.

[0006] A first aspect of the present invention is an electronic device comprising a display means, an apparatus motion detection means for detecting the movement of the electronic device, and a control means for displaying a display image on the display means, wherein the position of the portion to be displayed as the display image in three-dimensional space changes in accordance with the movement of the electronic device, and the control means switches the state of the display image between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the movement detected by the apparatus motion detection means.

[0007] A second aspect of the present invention is an electronic device comprising an imaging means, a display means, an image motion detection means for detecting motion in a display image based on an image of real space obtained by the imaging means, and a control means for controlling the display means to display the display image, wherein the control means switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state based on the motion detected by the image motion detection means, and switches the state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state.

[0008] A third aspect of the present invention is an electronic device comprising a display means, a gaze detection means for detecting a user's gaze, an image motion detection means for detecting movement in a display image displayed on the display means, and a control means for controlling the display means to display the display image, wherein the control means switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the movement detected by the image motion detection means at the location where the user's gaze is directed.

[0009] A fourth aspect of the present invention is a control method for an electronic device having a display means, comprising an equipment motion detection step of detecting movement of the electronic device and a control step of displaying a display image on the display means, wherein the position of the portion to be displayed as the display image in three-dimensional space changes in accordance with the movement of the electronic device, and the control step switches the state of the display image between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the movement detected in the equipment motion detection step.

[0010] A fifth aspect of the present invention is a control method for an electronic device having an imaging means and a display means, comprising: an image motion detection step of detecting motion in a display image based on an image of real space obtained by the imaging means; and a control step of controlling the display means to display the display image, wherein the control step switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the motion detected in the image motion detection step, and switches the state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state.

[0011] A sixth aspect of the present invention is a control method for an electronic device having a display means, comprising: a gaze detection step for detecting a user's gaze; an image motion detection step for detecting movement in a display image displayed on the display means; and a control step for controlling the display means to display the display image, wherein the control step switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the movement detected in the image motion detection step at a location where the user's gaze is directed.

[0012] A seventh aspect of the present invention is a program for causing a computer to execute each step of the above control method.

[0013] According to the present invention, it is possible to suppress deterioration of the image quality of still images and deterioration of the device, while making it possible to view moving images with high resolution.

[0014] FIG. 1 is a schematic diagram of an HMD, etc. FIG. 2 is a schematic diagram of an HMD, etc. FIG. 3 is a schematic diagram showing the light emission time and light emission intensity of a display panel. FIG. 4 is a schematic diagram showing the light emission time and light emission intensity of a display panel. FIG. 5 is a schematic diagram of a displayed image. FIG. 6 is a schematic diagram of a displayed image. FIG. 7 is a schematic diagram of a displayed image. FIG. 8 is a schematic diagram showing the shutter speed (exposure time) of an image sensor. FIG. 9 is a schematic diagram showing the shutter speed (exposure time) of an image sensor. FIG. 10 is a schematic diagram of an HMD, etc. FIG. 11 is a schematic diagram of an HMD, etc. FIG. 12 is a schematic diagram of an HMD, etc.

[0015] First Embodiment A first embodiment of the present invention will be described below, which will be described as an example in which the present invention is applied to a head-mounted display (HMD), which is a head-mounted display device.

[0016] 1 is a schematic diagram showing a user 102 viewing (observing, experiencing) an image using an HMD 100 according to the first embodiment. Fig. 1 shows a cross section parallel to the vertical direction. The Z axis, whose positive direction is the direction facing forward from the user 102 (visual axis direction), the X axis parallel to the left-right direction of the user 102, and the Y axis parallel to the up-down direction of the user 102 (vertical direction), are defined in a right-handed system.

[0017] The imaging unit is composed of an imaging optical system 103, an imaging element 104, and the like. The imaging optical system 103 forms an image of light from real space on the imaging element 104. The imaging element 104 generates an image (video signal, video data) of real space including an object 105 by, for example, converting the incident light into an electrical signal. The display unit is composed of a display panel 106, an observation optical system 107, and the like. The display panel 106 is, for example, an organic EL panel or a liquid crystal panel, and displays an image. The observation optical system 107 presents an enlarged virtual image of the image on the display panel 106 to the user 102. The observation optical system 107 may be a refractive optical system, a reflective optical system using polarized light, or another optical system. While FIG. 1 shows an imaging unit and a display unit for one eye of the user, an imaging unit and a display unit are provided for each of the user's right and left eyes.

[0018] In the first embodiment, the optical axis of the observation optical system 107 and the optical axis of the imaging optical system 103 substantially coincide (including completely coincident). The optical axis of the observation optical system 107 substantially coincides with the optical axis of the imaging optical system 103 not only in the YZ cross section shown in FIG. 1 but also in the XZ cross section. The distance from the imaging unit to the eye of the user 102 is L1. The position of the imaging unit may be the position of the imaging optical system 103. The position of the eye of the user 102 may be the position of the eyepiece where the eye of the user 102 is placed. The distance L1 may be a distance taking into account all of the X-axis, Y-axis, and Z-axis directions, or may be a distance in the Z-axis direction (optical axis direction). The distance L1 is, for example, 35 mm. When an image of real space obtained by the imaging element 104 is displayed on the display panel 106, if the distance L1 is long, the real space seen through the HMD 100 will significantly deviate from the real space seen with the naked eye without the HMD 100. Therefore, it is preferable that the distance L1 be 60 mm or less. By doing so, the difference between how the real space looks through the HMD 100 and how the real space looks with the naked eye without the HMD 100 can be reduced.

[0019] Furthermore, in the first embodiment, the angle of view θ2 of the imaging optical system 103 and the angle of view θ1 of the observation optical system 107 are approximately the same. This also reduces the difference between how the real space looks through the HMD 100 and how the real space looks with the naked eye without the HMD 100. The angles of view θ1 and θ2 are, for example, a horizontal angle of view of 80 degrees and a vertical angle of view of 70 degrees. Note that the angle of view θ2 of the imaging optical system 103 may be larger than the angle of view θ1 of the observation optical system 107. In that case, the image with the angle of view θ1 may be displayed by, for example, extracting the image with the angle of view θ1 from the image with the angle of view θ2.

[0020] In the case of an HMD that can be used as an HMD for mixed reality (MR), such as the HMD 100, it is preferable to adjust the optical axis, angle of view, etc. so that the image of real space can be viewed at approximately life-size. On the other hand, in the case of an EVF, it is not necessary to adjust the optical axis, angle of view, etc., as long as the image of the real space that you want to capture can be viewed even if it is not approximately life-size.

[0021] In the first embodiment, a display image based on an image of real space obtained by the image sensor 104 is displayed on the display panel 106. The position of the portion of the display image in three-dimensional space (such as real space, mixed reality space, or virtual space) changes according to the movement of the HMD 100. In the case of an EVF or MR HMD, an image of real space is displayed on the display panel 106. In the case of an MR HMD, computer graphics (CG) may be superimposed on the image of real space. In the case of a virtual reality (VR) HMD, an image of virtual space (CG image) is displayed on the display panel 106 without using an image of real space. However, even in the case of a VR HMD, an imaging unit may be provided for estimating the user's position and orientation. Furthermore, in the case of an MR HMD, an imaging unit for estimating the user's position and orientation may be provided separately from the imaging unit for obtaining the image of real space to be displayed. The imaging unit for obtaining the image of the real space to be displayed may also be used for estimating the self-position and orientation.

[0022] The control unit 110 controls the entire HMD 100. The inertial measurement unit (IMU) 111 has inertial sensors such as an acceleration sensor and a gyro sensor. The device motion detection unit 121 detects the movement (such as the direction and speed of movement) of the HMD 100 based on at least one of information obtained by the IMU 111 and an image of real space obtained by the image sensor 104. The device motion detection unit 121 may detect the movement of the HMD 100 based on the results of self-position and orientation estimation. The image processing circuit 122 performs self-position and orientation estimation based on at least one of information obtained by the IMU 111 and an image of real space obtained by the image sensor 104. In the self-position and orientation estimation, the position and orientation of the HMD 100 are estimated in real time. The image processing circuit 122 then generates a display image corresponding to the estimated position and orientation. The control unit 110 displays the display image generated by the image processing circuit 122 on the display panel 106.

[0023] The device motion detection unit 121 and the image processing circuit 122 may be built into the HMD 100, or may be provided in an external device (such as a personal computer) of the HMD 100. When the device motion detection unit 121 and the image processing circuit 122 are provided in the external device, the HMD 100 (e.g., the control unit 110) acquires the processing results of the device motion detection unit 121 and the image processing circuit 122 from the external device. Then, the HMD 100 (e.g., the control unit 110) detects the movement of the HMD 100 based on the processing result of the device motion detection unit 121, and displays the display image on the display panel 106 based on the processing result of the image processing circuit 122.

[0024] 2 is a schematic diagram showing the state in which the HMD 100 is worn on the user's head using a head-mounted device 200. The HMD 100 is worn on the head-mounted device 200, and the head-mounted device 200 is worn on the head. By wearing the HMD 100 on the user's head, the displayed image can be changed in conjunction with head movement. The HMD 100 has a wearing detection unit (such as an infrared sensor) (not shown) that detects whether the HMD 100 is worn by the user, and can determine whether the HMD 100 is worn by the user.

[0025] 3 and 4 are schematic diagrams showing the light-emitting time and light-emitting intensity of the display panel 106 during one frame period of a displayed image. Assume that the displayed image is displayed at a frame rate of 60 fps. Therefore, the maximum light-emitting time of the display panel 106 during one frame period is 16.67 ms. In FIG. 3 , the light-emitting time of the display panel 106 is the maximum light-emitting time (16.67 ms), and the duty ratio, which is the ratio of the light-emitting time of the display panel 106 to one frame period, is 100%. In FIG. 4 , the light-emitting time of the display panel 106 is 1 / 4 of the one frame period (4.17 ms), and the duty ratio is 25%. To ensure that the user perceives the same brightness in the cases of FIGS. 3 and 4 , the light-emitting intensity in FIG. 4 is four times that of FIG. 4 .

[0026] By reducing the duty ratio (light-emitting time), it is possible to reduce motion blur in the displayed image (to increase the perceived resolution (sharpness) of the displayed image). However, in order to maintain the brightness perceived by the user, it is necessary to increase the light-emitting intensity. Increasing the light-emitting intensity increases the load on the display panel 106, accelerating the deterioration rate of the display panel 106. For this reason, it is difficult to continuously drive the display panel 106 at a small duty ratio (short light-emitting time) as shown in FIG. 4.

[0027] Therefore, in the first embodiment, the control unit 110 switches the state of the displayed image between a plurality of states including a normal state and a motion blur reduced state, based on the motion detected by the device motion detection unit 121. The normal state is a state in which the duty ratio is relatively large (a state in which the light emission time is relatively long) as shown in Fig. 3, and the motion blur reduced state is a state in which the duty ratio is relatively small (a state in which the light emission time is relatively short) as shown in Fig. 4.

[0028] For example, if the speed of motion detected by the device motion detection unit 121 is slower than a threshold, the control unit 110 controls the state of the displayed image to a normal state. If the speed of motion detected by the device motion detection unit 121 is faster than the threshold, the control unit 110 controls the state of the displayed image to a motion blur reduced state. If the speed of motion detected by the device motion detection unit 121 is equal to the threshold, the control unit 110 may control the state of the displayed image to either the normal state or the motion blur reduced state.

[0029] Assume that a user is observing the image shown in FIG. 5 and has the house on the left side captured in the center of their field of view. The image state is normal. From this state, the user continues to capture the object (the house) on the fovea through a compensatory movement (vestibular-ocular reflex) of rotating their eyes to the right while rotating their head to the left. If the normal state with a relatively high duty ratio is maintained at this time, motion blur as shown in FIG. 6 is observed. In the first embodiment, when the angular velocity of the HMD 100 detected by the device motion detection unit 121 exceeds a threshold value (e.g., 15 deg / s), the image state is switched to a motion blur reduction state with a relatively low duty ratio. This allows the user to continue observing a clear image as shown in FIG. 7. When the head swing ends and the angular velocity of the HMD 100 falls below the threshold value, the image state is returned to the normal state with a relatively high duty ratio, thereby suppressing deterioration of the display panel 106.

[0030] In this way, by controlling the state of the displayed image to a motion blur reduced state only in specific cases, it becomes possible to suppress deterioration of the display panel 106 while making it possible to view moving images with high resolution.

[0031] Note that if the brightness or color of the display image changes significantly when the state of the display image is switched, it will cause a sense of discomfort to the user. Therefore, it is preferable that the brightness or color of the display image does not change significantly when the state of the display image is switched. For example, the ratio of the difference between the brightness of the display image in the normal state and the brightness of the display image in the motion blur reduced state to the brightness of the display image in the normal state or the brightness of the display image in the motion blur reduced state is preferably 10% or less, and more preferably 5% or less. Furthermore, the value of ΔE*ab, which corresponds to the difference in chromaticity between the display image in the normal state and the motion blur reduced state, is preferably 5 or less, and more preferably less than 2.3, which is the minimum noticeable difference. The pixel values ​​of the display image may be adjusted to satisfy these conditions.

[0032] The control for switching the state of the display image may be delayed. In such a case, if control for switching the state of the display image is initiated at the timing when the HMD 100 switches between a state where the speed is slower than a threshold and a state where the speed is faster than the threshold, the switching of the state of the display image will be delayed relative to that timing. Such a delay causes an uncomfortable feeling to the user. Therefore, it is preferable that the control unit 110 predicts the timing when the speed of the HMD 100 detected by the device motion detection unit 121 switches between a state where the speed is slower than a threshold and a state where the speed is faster than the threshold. The prediction method is not particularly limited, and for example, the timing can be predicted based on the movement detected by the device motion detection unit 121. Then, it is preferable that the control unit 110 initiates control for switching the state of the display image before the predicted timing so that the state of the display image switches at the predicted timing.

[0033] If the above-mentioned thresholds (thresholds for switching the state of the displayed image, thresholds for the speed of the HMD 100) are too slow, the state of the displayed image will be switched frequently, reducing the effect of suppressing deterioration of the display panel 106. Therefore, it is preferable to set the thresholds by considering the balance between the effect of reducing motion blur and the effect of suppressing deterioration of the display panel 106. For example, assuming a human head movement, it is preferable to use 15 deg / sec as the threshold. If there is sufficient margin in the lifespan of the display panel 106, 10 deg / sec may be used as the threshold to increase the priority of reducing motion blur. If there is even more margin in the lifespan of the display panel 106, 5 deg / sec may be used as the threshold to obtain the effect of reducing motion blur even for slight movements of the HMD 100.

[0034] Note that, when the wearing detection unit determines that the user is not wearing the HMD 100, the state of the display image may be controlled to the normal state regardless of the detection result by the device motion detection unit 121. The state of the display image does not have to be switched between two states, but may be switched between three or more states. For example, the display image may be displayed with a smaller duty ratio (the faster the speed of the HMD 100, the shorter the light emission time). The duty ratio may be changed continuously or in steps.

[0035] Second Embodiment A second embodiment of the present invention will be described. The configuration of the HMD according to the second embodiment is the same as that of the first embodiment (FIG. 1). In the first embodiment, the state of the displayed image is changed by changing the duty ratio (light-emitting time) of the display panel 106. In the second embodiment, the state of the displayed image is changed by changing the shutter speed of the image sensor 104.

[0036] 8 and 9 are schematic diagrams showing the shutter speed (exposure time) of the image sensor 104. Assume that the image sensor 104 captures images at a frame rate of 60 fps. In Fig. 8, the shutter speed of the image sensor 104 is 1 / 90 s, and the exposure time of the image sensor 104 is 11.11 ms. In Fig. 9, the shutter speed of the image sensor 104 is 1 / 350 s, and the exposure time of the image sensor 104 is 2.86 ms.

[0037] A slow shutter speed (long exposure time) can produce a display image with less noise, but motion blur is likely to occur in the display image. Increasing the shutter speed (reducing the exposure time) can reduce motion blur in the display image (increase the resolution (sharpness) of the display image). However, to maintain the brightness perceived by the user, it is necessary to increase the amplification factor (gain) of the signal obtained by the image sensor 104. Furthermore, increasing the gain increases the noise in the display image. For this reason, it is not desirable to constantly capture images at a fast shutter speed (short exposure time) as shown in FIG. 9 .

[0038] Therefore, in the second embodiment, a state in which the shutter speed is relatively slow (a state in which the exposure time is relatively long) as shown in Figure 8 is defined as the normal state, and a state in which the shutter speed is relatively fast (a state in which the exposure time is relatively short) as shown in Figure 9 is defined as the motion blur reduction state.

[0039] Then, similar to the first embodiment, the control unit 110 switches the state of the display image between a plurality of states, including a normal state and a motion blur reduced state, based on the motion detected by the device motion detection unit 121. For example, when the speed of motion detected by the device motion detection unit 121 is slower than a threshold, the control unit 110 controls the state of the display image to the normal state. When the speed of motion detected by the device motion detection unit 121 is faster than the threshold, the control unit 110 controls the state of the display image to the motion blur reduced state. When the speed of motion detected by the device motion detection unit 121 is equal to the threshold, the control unit 110 may control the state of the display image to either the normal state or the motion blur reduced state.

[0040] In the normal state where the shutter speed is relatively slow, a display image with less noise is obtained. In the normal state, when the angular velocity of the HMD 100 detected by the device motion detection unit 121 becomes equal to or greater than a threshold value (e.g., 10 deg / s), the shutter speed and gain are increased, and the state of the display image is switched to a motion blur reduction state. For example, the state of FIG. 8 is switched to the state of FIG. 9. By increasing the shutter speed and gain, the brightness of the display image is maintained while motion blur of the display image is reduced (the resolution (clarity) of the display image is increased). When the angular velocity of the HMD 100 becomes less than the threshold value, the state of the display image is returned to the normal state where the shutter speed is relatively slow, and the noise of the display image is reduced.

[0041] In this way, by controlling the state of the displayed image to a motion blur reduced state only in specific cases, it is possible to suppress deterioration in the image quality of still images while making it possible to view moving images with high resolution.

[0042] Note that the first and second embodiments may be combined, and a state in which the duty ratio of the display panel 106 is relatively large and the shutter speed of the image sensor 104 is relatively slow may be defined as the normal state. A state in which the duty ratio of the display panel 106 is relatively small and the shutter speed of the image sensor 104 is relatively fast may be defined as the motion blur reduction state. This makes it possible to view moving images with high resolution while suppressing both degradation of the image quality of still images and degradation of the display panel 106.

[0043] Third Embodiment A third embodiment of the present invention will be described. The configuration of the HMD according to the third embodiment is the same as that of the first embodiment (FIG. 1). In the third embodiment, the state of the displayed image is changed by changing the frame rate of the displayed image.

[0044] By increasing the frame rate of the displayed image, it is possible to reduce motion blur in the displayed image (to increase the resolution (clarity) of the displayed image). However, this increases the power consumption, load, heat generation, etc. of the image processing circuit 122, etc., and increases the rate of deterioration of the image processing circuit 122, etc. Therefore, it is not desirable to continuously display the displayed image at a high frame rate.

[0045] Therefore, in the third embodiment, a state in which the frame rate is relatively low (for example, a state in which the frame rate is 60 fps) is defined as the normal state, and a state in which the frame rate is relatively high (for example, a state in which the frame rate is 120 fps) is defined as the motion blur reduction state.

[0046] Then, similar to the first embodiment, the control unit 110 switches the state of the display image between a plurality of states, including a normal state and a motion blur reduced state, based on the motion detected by the device motion detection unit 121. For example, when the speed of motion detected by the device motion detection unit 121 is slower than a threshold, the control unit 110 controls the state of the display image to the normal state. When the speed of motion detected by the device motion detection unit 121 is faster than the threshold, the control unit 110 controls the state of the display image to the motion blur reduced state. When the speed of motion detected by the device motion detection unit 121 is equal to the threshold, the control unit 110 may control the state of the display image to either the normal state or the motion blur reduced state.

[0047] In a normal state with a relatively low frame rate, when the angular velocity of the HMD 100 detected by the device motion detection unit 121 becomes equal to or greater than a threshold value (e.g., 15 deg / s), the state of the displayed image is switched to a motion blur reduction state with a relatively high frame rate. For example, the frame rate is increased from 60 fps to 120 fps. When the angular velocity of the HMD 100 becomes less than the threshold value, the state of the displayed image is returned to the normal state with a relatively low frame rate.

[0048] In this way, by controlling the state of the displayed image to a motion blur reduction state only in specific cases, it is possible to suppress deterioration of the image processing circuit 122 and the like, while making it possible to view moving images with high resolution.

[0049] Note that the first, second, and third embodiments may be combined, and a state in which the duty ratio of the display panel 106 is relatively large, the shutter speed of the image sensor 104 is relatively slow, and the frame rate of the displayed image is relatively low may be defined as the normal state. A state in which the duty ratio of the display panel 106 is relatively small, the shutter speed of the image sensor 104 is relatively fast, and the frame rate of the displayed image is relatively high may be defined as the motion blur reduction state. This makes it possible to view moving images with high resolution while suppressing degradation of the image quality of still images and degradation of more devices. The first and second embodiments may be combined, or the first and third embodiments may be combined.

[0050] (Fourth embodiment) A fourth embodiment of the present invention will be described. Fig. 10 is a schematic diagram showing a state in which a user 102 is viewing an image using an HMD 1000 according to the fourth embodiment. The HMD 1000 in Fig. 10 has an image motion detection unit 1001 and an image motion determination unit 1002 instead of the inertial measurement unit (IMU) 111 and the device motion detection unit 121 of the first embodiment (Fig. 1).

[0051] The image motion detection unit 1001 detects motion in a display image based on an image of real space obtained by the image sensor 104. For example, the image motion detection unit 1001 is a processor that analyzes the display image (display image data) for each frame to detect changes (motion) in the display image, or that detects motion in the display image using optical flow.

[0052] The video motion determination unit 1002 determines whether the motion detected by the video motion detection unit 1001 is the target of the user's observation. For example, the video motion determination unit 1002 is a processor that determines whether the detected motion is the target of observation by determining whether a predetermined condition is satisfied based on the position of the location where the motion is detected by the video motion detection unit 1001, the video, etc. The predetermined condition for determining whether the detected motion is the target of observation may be a condition that the detected motion is the target of observation, or a condition that the detected motion is not the target of observation.

[0053] Two or three of the image processing circuit 122, the video motion detection unit 1001, and the video motion determination unit 1002 may be integrated into a single processor. This eliminates the need to pass data between processors, allowing for efficient arithmetic processing.

[0054] Furthermore, the image motion detection unit 1001 and the image motion determination unit 1002 may be built into the HMD 1000, or may be provided in an external device (such as a personal computer) of the HMD 1000. When the image motion detection unit 1001 and the image motion determination unit 1002 are provided in the external device, the HMD 1000 (e.g., the control unit 110) acquires the processing results of the image motion detection unit 1001 and the image motion determination unit 1002 from the external device. The HMD 1000 (e.g., the control unit 110) then detects motion in the displayed image based on the processing result of the image motion detection unit 1001, and determines whether the motion in the displayed image is the object of observation based on the processing result of the image motion determination unit 1002.

[0055] The predetermined conditions for determining whether the motion detected by the video motion detection unit 1001 is an observation target include, for example, at least one of the following conditions (A) to (E): (A) The location where the motion is detected is not an edge of the displayed video. (B) The size of the location where the motion is detected (size in the displayed video) is equal to or greater than a threshold. (C) The distance in the depth direction from the user to the location where the motion is detected, as perceived by the user, is equal to or less than a threshold. (D) The brightness of the location where the motion is detected is equal to or greater than a threshold. (E) The object present in the location where the motion is detected is a virtual object placed in real space.

[0056] Condition (A) will now be described. When a user observes a subject in a display image displayed on an HMD, if the subject is located in the peripheral region, i.e., the edge of the display image (the edge of the display area), the user will capture the subject in their peripheral vision, preventing them from perceiving the subject with high resolution. Therefore, users often turn their heads to face the subject so as to keep the subject in their central field of vision. Furthermore, HMDs are becoming increasingly wider in angle of view to enhance the sense of realism. When the HMD's angle of view (the angle of view of the display image) is wide, it is difficult to keep looking at the edge of the display image (the edge of the display area). Therefore, when a moving subject is displayed at the edge of the display image, it can be determined that the user is not observing the subject (the subject (the subject's movement) is not a target for observation). Furthermore, when a moving subject is displayed in the center of the display image (when the moving subject is not displayed at the edge of the display image), it can be determined that the user is observing the subject (the subject (the subject's movement) is a target for observation). The boundary between the end and center portions is not particularly limited and may be set based on, for example, the angle of view of the displayed image. The boundary may be set to a position inside a side of the display area by a distance of 10% of the length of the side.

[0057] Condition (B) will now be described. If the location (area) where motion is detected is too small, it is difficult to observe or identify the location. Although a high resolution display image can clearly display even small objects, for comfortable viewing, it is preferable for the user to approach the object to be observed so that the object is displayed at an appropriate size. Therefore, if the size of the location (area) where motion is detected is less than a threshold, it can be determined that the user is not observing the location (the location (movement in the location) is not an object of observation). If the size of the location (area) where motion is detected is equal to or greater than a threshold, it can be determined that the user is observing the location (the location (movement in the location) is an object of observation). The size of the location is not particularly limited, and can be, for example, the length of the location in a predetermined direction or the area of ​​the location. The threshold is also not particularly limited. If the size of the location is the length of the location in a predetermined direction, a length that is 10% of the length of the display area in the predetermined direction may be set as the threshold.

[0058] Condition (C) will now be described. A location far from the user is unlikely to be an observation target. Therefore, if the depth distance of a location where movement is detected (the depth distance from the user to the location where movement is detected, as perceived by the user) is longer than a threshold, it can be determined that the user is not observing that location. If the depth distance of a location where movement is detected is equal to or less than the threshold, it can be determined that the user is observing that location. The method for acquiring the depth distance is not particularly limited. The depth distance may be acquired by distance measurement using stereo camera images, or by distance measurement using LiDAR (Light Detection and Ranging). The threshold is also not particularly limited. A depth distance corresponding to the center position of a range in which the depth distance can be acquired may be set as the threshold.

[0059] Condition (D) will be explained. Due to the characteristics of the human eye, sensitivity to movement in dark areas is lower than sensitivity to movement in bright areas, making dark areas less likely to be observed. Therefore, if the luminance of the area where movement is detected is below a threshold, it can be determined that the user is not observing that area (the area (movement in that area) is not an observation target). If the luminance of the area where movement is detected is equal to or greater than a threshold, it can be determined that the user is observing that area (the area (movement in that area) is an observation target). The threshold is not particularly limited. A luminance of 2.5% of the upper limit luminance of the displayed image may be set as the threshold. A luminance of 2.5% of the maximum luminance in the frame where movement is detected (the maximum value of multiple luminances present in the image of the frame where movement is detected) may be set as the threshold.

[0060] Note that if the subject is dark, the surrounding environment is also dark, and it is highly likely that the gain of the image sensor 104 is adjusted to a high level. Increasing the shutter speed of the image sensor 104 in this state to reduce motion blur may result in a significant deterioration in the image quality of the displayed image. In order to suppress such deterioration in image quality, it is preferable to use condition (D).

[0061] Condition (E) will be described. Mixed reality (MR) HMDs and augmented reality (AR) HMDs can display images of virtual objects (CG) superimposed on images of real space. In this case, the virtual objects are intentionally displayed so as to be observed by the user, and therefore have a high probability of becoming the object of observation. Therefore, if the object present at the location where movement is detected is not a virtual object located in real space, it can be determined that the user is not observing that location (the location (movement of the location) is not the object of observation). Furthermore, if the object present at the location where movement is detected is a virtual object located in real space, it can be determined that the user is observing that location (the location (movement of the location) is the object of observation). Note that, in the case of an MR HMD, it is also possible to display an image of a real object superimposed on a CG background image. In this case, other conditions may be used, or the condition that the object present at the location where movement is detected is a real object may be used.

[0062] A user may observe a moving object without moving the HMD 1000 (head). For example, the user may observe a moving object in the center of a displayed image while facing forward. In this case, it is preferable to control the state of the displayed image to a motion blur reduction state even if the HMD 1000 is not moving.

[0063] Therefore, in the fourth embodiment, when the image motion determination unit 1002 determines that the motion detected by the image motion detection unit 1001 is the object of observation, the control unit 110 switches the state of the displayed image based on the motion. In the fourth embodiment, the state of the displayed image is switched by switching the state of the display panel 106 and the state of the image sensor 104.

[0064] For example, when the object of observation is movement in the display image, the control unit 110 controls the state of the display image to a normal state if the amount of movement in the display image is smaller than a threshold, and controls the state of the display image to a motion blur reduced state if the amount of movement is greater than the threshold. If the amount of movement is equal to the threshold, the control unit 110 may control the state of the display image to a normal state or a motion blur reduced state. The method of controlling the state of the display image is not limited to this, and, for example, motion speed may be used instead of the amount of movement. The normal state is, for example, a state in which the duty ratio of the display panel 106 is relatively large and the shutter speed of the image sensor 104 is relatively slow. The motion blur reduced state is, for example, a state in which the duty ratio of the display panel 106 is relatively small and the shutter speed of the image sensor 104 is relatively fast.

[0065] Assume that image motion determination unit 1002 determines that the motion detected by image motion detection unit 1001 is the object of observation. In a normal state, when image motion detection unit 1001 detects motion greater than a threshold, the duty ratio of display panel 106 is reduced, the shutter speed and gain of image sensor 104 are increased, and the state of the displayed image is switched to a motion blur reduction state. When image motion detection unit 1001 no longer detects motion greater than the threshold, the state of the displayed image is returned to the normal state.

[0066] In this way, by controlling the state of the displayed image to a motion blur reduction state only in specific cases, it is possible to suppress deterioration of the image quality of still images and deterioration of the display panel 106, while making it possible to view moving images with high resolution.

[0067] Note that control unit 110 may switch the state of the display image based on the motion detected by image motion detection unit 1001, regardless of whether the motion is the object of observation. Control unit 110 may then control the state of the display image to the normal state when image motion detection unit 1001 does not detect motion, and may control the state of the display image to the motion blur reduced state when image motion detection unit 1001 detects motion.

[0068] Fifth Embodiment A fifth embodiment of the present invention will be described. Fig. 11 is a schematic diagram showing a state in which a user 102 is viewing an image using an HMD 1100 according to the fifth embodiment. The HMD 1100 in Fig. 11 is configured using the components shown in Fig. 10 , a light source 1110, an eye imaging element 1111, and an eye imaging optical system 1112.

[0069] The light source 1110 is a light source for illuminating the user's eye (eyeball) and is arranged around the observation optical system 107. For example, an infrared light-emitting diode is used as the light source 1110. Light emitted from the light source 1110 and reflected by the eye passes through the eye imaging optical system 1112 and is imaged on the eye imaging element 1111. An eye image (image of the user's eye) is then obtained by the eye imaging element 1111. The control unit 110 performs gaze detection processing to detect the user's gaze based on the eye image obtained by the eye imaging element 1111. The gaze detection processing can obtain, for example, angle information indicating the gaze direction and coordinate information indicating the position or area in the displayed image where the gaze is directed. Hereinafter, the area (location) where the gaze is directed will be referred to as the gaze area.

[0070] The method for determining the gaze area is not particularly limited. An area of ​​a predetermined size (for example, 5% of the size of the entire displayed image) centered on the position where the gaze is directed may be determined as the gaze area. The area of ​​the displayed image may be divided into a plurality of partial areas (for example, 16 partial areas of 4 rows x 4 columns, or 25 partial areas of 5 rows x 5 columns), and the partial area including the position where the gaze is directed may be determined as the gaze area.

[0071] The image motion detection unit 1001 detects motion in the display image from the gaze area determined (detected) by the gaze detection process. The image motion determination unit 1002 determines whether the motion detected by the image motion detection unit 1001 is the object of the user's observation. Then, when the image motion determination unit 1002 determines that the motion detected by the image motion detection unit 1001 is the object of the observation, the control unit 110 switches the state of the display image based on the motion. In the fifth embodiment, the state of the display image may be switched by switching the state of the display panel 106 and the state of the image sensor 104, or the state of the display image may be switched by switching the state of the display panel 106 without switching the state of the image sensor 104. Note that motion may be detected from the entire display image, and the state of the display image may be switched based on the motion in the gaze area. The state of the display image may be switched based on the motion in the gaze area, regardless of whether the motion in the gaze area is the object of the observation.

[0072] In this way, by limiting the movement considered when switching the state of the displayed image to movement in the line of sight area, the time in the motion blur reduction state can be suitably shortened, and deterioration of the image quality of still images and deterioration of the device can be further suppressed.

[0073] Sixth Embodiment A sixth embodiment of the present invention will be described. Fig. 12 is a schematic diagram showing a state in which a user 102 is viewing an image using an HMD 1200 according to the sixth embodiment. The HMD 1200 in Fig. 12 has the components shown in Fig. 11 as well as the inertial measurement unit (IMU) 111 and device motion detection unit 121 shown in Fig. 1. Note that the HMD 1200 does not necessarily have to have the image motion determination unit 1002, the light source 1110, the eye imaging element 1111, and the eye imaging optical system 1112.

[0074] In the sixth embodiment, the control unit 110 switches the state of the display image based on the motion detected by the device motion detection unit 121 and the motion detected by the video motion detection unit 1001. For example, when motion is detected by at least one of the device motion detection unit 121 and the video motion detection unit 1001, the control unit 110 controls the state of the display image to a motion blur reduced state. When motion is not detected by either the device motion detection unit 121 or the video motion detection unit 1001, the control unit 110 controls the state of the display image to a normal state.

[0075] In the normal state, when device motion detection unit 121 detects motion, control unit 110 switches the state of the displayed image to the motion blur reduction state, regardless of the result of detection by image motion detection unit 1001. At this time, control unit 110 causes image motion detection unit 1001 to suspend motion detection. When device motion detection unit 121 no longer detects motion, control unit 110 returns the state of the displayed image to the normal state and causes image motion detection unit 1001 to resume motion detection.

[0076] In the normal state, even if no motion is detected by device motion detection unit 121 but motion is detected by video motion detection unit 1001, control unit 110 switches the state of the displayed video to the motion blur reduction state. In this case, control unit 110 causes device motion detection unit 121 to continue motion detection without interruption. When motion is no longer detected by video motion detection unit 1001, control unit 110 returns the state of the displayed video to the normal state.

[0077] Generally, the processing amount (processing load) of the device motion detection unit 121 is smaller than the processing amount (processing load) of the image motion detection unit 1001, and therefore the device motion detection unit 121 has a faster response than the image motion detection unit 1001. When both the HMD 1200 and the displayed image move, the device motion detection unit 121 detects the HMD 1200 movement earlier than the image motion detection unit 1001 detects the displayed image movement.

[0078] In the sixth embodiment, when the device motion detection unit 121 detects motion of the HMD 1200, the state of the displayed image is switched to the motion blur reduction state without waiting for the image motion detection unit 1001 to detect motion of the displayed image. This allows for quick switching to the motion blur reduction state. Furthermore, by temporarily stopping motion detection by the image motion detection unit 1001, it is possible to reduce the processing load, power consumption, and the like.

[0079] Seventh Embodiment A seventh embodiment of the present invention will be described. The configuration of the HMD according to the seventh embodiment is the same as that of the sixth embodiment (FIG. 12). The differences between the seventh embodiment and the sixth embodiment will be described.

[0080] In the seventh embodiment, even if the device motion detection unit 121 or the video motion detection unit 1001 detects motion, both the motion detection by the device motion detection unit 121 and the motion detection by the video motion detection unit 1001 continue without interruption.

[0081] As in the sixth embodiment, when motion is detected by both the device motion detection unit 121 and the video motion detection unit 1001, the control unit 110 controls the state of the displayed video to the motion blur reduced state. When motion is not detected by the device motion detection unit 121 but motion is detected by the video motion detection unit 1001, the control unit 110 also controls the state of the displayed video to the motion blur reduced state. When motion is not detected by either the device motion detection unit 121 or the video motion detection unit 1001, the control unit 110 controls the state of the displayed video to the normal state.

[0082] Unlike the sixth embodiment, if the device motion detection unit 121 detects motion but the image motion detection unit 1001 does not, the control unit 110 controls the state of the displayed image to the normal state. For example, if a user continues to observe a subject that is moving significantly while turning their head to track the subject, the HMD 1200 moves, but the subject remains in the center of the displayed image, so there is no need to control the state of the displayed image to the motion blur reduced state. In such a case, the state of the displayed image is not controlled to the motion blur reduced state but is controlled to the normal state. This can suitably shorten the time in the motion blur reduced state, and can further suppress deterioration of the image quality of static images and deterioration of the device.

[0083] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.

[0084] The processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, a central processing unit (CPU), a micro processing unit (MPU), and a digital signal processor (DSP). Dedicated processors include, for example, a graphics processing unit (GPU), an application specific integrated circuit (ASIC), and a programmable logic device (PLD). Examples of programmable logic devices include a field programmable gate array (FPGA) and a complex programmable logic device (CPLD).

[0085] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various modifications within the scope of the gist of the present invention are also included in the present invention. Furthermore, the above-described embodiments merely illustrate one embodiment of the present invention, and the embodiments can be appropriately combined. For example, although an example in which the present invention is applied to an HMD has been described, the present invention can also be applied to various electronic devices having a display unit, such as digital cameras with EVFs, smartphones, and tablet terminals.

[0086] The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit that realizes one or more functions.

[0087] The disclosure of the present embodiments includes the following configurations, methods, and programs. (Configuration 1) An electronic device comprising: a display means; a device motion detection means for detecting movement of the electronic device; and a control means for displaying a display image on the display means, wherein a position of a portion to be displayed as the display image in three-dimensional space changes in response to movement of the electronic device, and the control means switches the state of the display image between a plurality of states including a first state and a second state in which motion blur is reduced compared to the first state, based on the movement detected by the device motion detection means. (Configuration 2) The electronic device according to Configuration 1, wherein the second state is a state in which the light emission time of the display means during one frame period of the display image is shorter than in the first state. (Configuration 3) The electronic device according to Configuration 1 or 2, wherein the display image is based on an image of real space obtained by an imaging means of the electronic device, and wherein the second state is a state in which the shutter speed of the imaging means is faster than in the first state. (Configuration 4) The electronic device of any one of Configurations 1 to 3, wherein the second state is a state in which the frame rate of the display image is higher than that of the first state. (Configuration 5) The electronic device of any one of Configurations 1 to 4, further comprising an inertial sensor, wherein the device motion detection means detects motion of the electronic device based on information obtained by the inertial sensor. (Configuration 6) The electronic device of any one of Configurations 1 to 5, wherein the device motion detection means detects motion of the electronic device based on an image of real space obtained by an imaging means of the electronic device. (Configuration 7) The electronic device of any one of Configurations 1 to 6, wherein the control means controls the state of the display image to the first state when the speed of the motion detected by the device motion detection means is slower than a threshold, and controls the state of the display image to the second state when the speed of the motion detected by the device motion detection means is faster than the threshold.(Configuration 8) The electronic device of Configuration 7, further comprising: a prediction means for predicting timing of switching between a state in which the speed of motion detected by the device motion detection means is slower than the threshold and a state in which the speed is faster than the threshold, wherein switching of the state of the display image is delayed with respect to control for switching the state of the display image, and the control means starts control for switching the state of the display image before the timing predicted by the prediction means so that the state of the display image switches at the timing predicted by the prediction means. (Configuration 9) The electronic device of Configuration 7 or 8, wherein the threshold is 15 deg / s. (Configuration 10) The electronic device of any of Configurations 1 to 9, wherein a ratio of a difference between the luminance of the display image in the first state and the luminance of the display image in the second state to the luminance of the display image in the first state or the luminance of the display image in the second state is 10% or less. (Configuration 11) The electronic device according to any one of configurations 1 to 10, wherein a value of ΔE*ab corresponding to a difference between the chromaticity of the display image in the first state and the chromaticity of the display image in the second state is not more than 5. (Configuration 12) The electronic device according to any one of configurations 1 to 11, wherein the display image is an image based on an image of real space obtained by an imaging means of the electronic device, wherein an optical axis of an optical system of the display means and an optical axis of an optical system of the imaging means are approximately aligned, and wherein a distance from the imaging means to an eyepiece unit on which the user's eyes are positioned is not more than 60 mm. (Configuration 13) The electronic device according to any one of configurations 1 to 12, further comprising image motion detection means for detecting motion in the display image from the display image, and wherein the control means switches the state of the display image based on the motion detected by the device motion detection means and the motion detected by the image motion detection means. (Configuration 14) The electronic device described in Configuration 13, wherein the control means controls the state of the displayed image to the second state when motion is detected by the device motion detection means, regardless of the result of detection by the image motion detection means.(Configuration 15) The electronic device according to Configuration 14, wherein the control means controls the video motion detection means to suspend detection when motion is detected by the device motion detection means, and controls the video motion detection means to resume detection when motion is no longer detected by the device motion detection means. (Configuration 16) The electronic device according to Configuration 13, wherein the control means controls the state of the displayed video to the first state when motion is detected by the device motion detection means but no motion is detected by the video motion detection means. (Configuration 17) An electronic device comprising: an imaging means; a display means; an image motion detection means for detecting motion in a display image based on an image of real space obtained by the imaging means; and a control means for controlling the display means to display the display image, wherein the control means switches a state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state based on the motion detected by the image motion detection means, and switches a state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state. (Configuration 18) The electronic device of Configuration 17 further comprises a determination means for determining whether the motion detected by the image motion detection means is an object of a user's observation, wherein when the determination means determines that the motion detected by the image motion detection means is an object of a user's observation, the control means switches the states of the imaging means and the display means based on the motion detected by the image motion detection means.(Configuration 19) The electronic device described in Configuration 18, characterized in that the conditions for the motion detected by the image motion detection means to be the object of observation for the user include at least one of the following: the location where the motion is detected by the image motion detection means is not an edge of the displayed image; the size of the location where the motion is detected by the image motion detection means is equal to or greater than a threshold; the depth direction distance from the user to the location where the motion is detected by the image motion detection means, as perceived by the user, is equal to or less than a threshold; the brightness of the location where the motion is detected by the image motion detection means is equal to or greater than a threshold; and the object present at the location where the motion is detected by the image motion detection means is a virtual object located in real space. (Configuration 20) An electronic device comprising: a display means, a gaze detection means for detecting a user's gaze, an image motion detection means for detecting movement in a display image displayed on the display means, and a control means for controlling the display means to display the display image, wherein the control means switches a state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the movement detected by the image motion detection means at a location where the user's gaze is directed. (Configuration 21) The electronic device of Configuration 20 further comprises an imaging means, wherein the display image is an image based on an image of real space obtained by the imaging means, and the control means switches a state of the display means between the plurality of states including the first state and the second state, and switches a state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state, based on the movement detected by the image motion detection means at a location where the user's gaze is directed.(Method 1) A control method for an electronic device having a display means, comprising: an equipment motion detection step of detecting motion of the electronic device; and a control step of displaying a display image on the display means, wherein the position of the portion to be displayed as the display image in three-dimensional space changes according to the motion of the electronic device, and in the control step, the state of the display image is switched between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the motion detected in the equipment motion detection step. (Method 2) A control method for an electronic device having an imaging means and a display means, comprising: an image motion detection step of detecting motion in a display image based on an image of real space obtained by the imaging means; and a control step of controlling the display means to display the display image, wherein the control step switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the motion detected in the image motion detection step, and switches the state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state. (Method 3) A control method for an electronic device having a display means, comprising: a gaze detection step of detecting a user's gaze, an image motion detection step of detecting movement in a display image displayed on the display means, and a control step of controlling the display means to display the display image, wherein the control step switches a state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the movement detected in the image motion detection step at a location where the user's gaze is directed. (Program) A program for causing a computer to execute each step of the control method described in any of Methods 1 to 3.

[0088] The present invention is not limited to the above-described embodiments, and various modifications and variations can be made without departing from the spirit and scope of the present invention. Therefore, the following claims are appended to apprise the public of the scope of the present invention.

[0089] This application claims priority based on Japanese Patent Application No. 2024-115585, filed on July 19, 2024, the entire contents of which are incorporated herein by reference.

[0090] 100, 1000, 1100, 1200: HMD 104: Image sensor 106: Display panel 110: Control unit 121: Device motion detection unit 1001: Image motion detection unit

Claims

1. An electronic device comprising: a display means; a device motion detection means for detecting the movement of said electronic device; and a control means for displaying a display image on said display means, wherein the position of the portion to be displayed as the display image in three-dimensional space changes in accordance with the movement of said electronic device, and said control means switches the state of the display image between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the movement detected by said device motion detection means.

2. The electronic device according to claim 1, wherein the second state is a state in which the light emission time of the display means during one frame period of the displayed image is shorter than that of the first state.

3. The electronic device according to claim 1 or 2, characterized in that the displayed image is an image based on an image of real space obtained by an imaging means of the electronic device, and the second state is a state in which the shutter speed of the imaging means is faster than that of the first state.

4. The electronic device according to claim 1 or 2, characterized in that the second state is a state in which the frame rate of the displayed image is higher than that of the first state.

5. An electronic device according to claim 1 or 2, further comprising an inertial sensor, wherein the device movement detection means detects the movement of the electronic device based on information obtained by the inertial sensor.

6. The electronic device according to claim 1 or 2, characterized in that the device movement detection means detects the movement of the electronic device based on an image of real space obtained by an imaging means of the electronic device.

7. The electronic device described in claim 1 or 2, characterized in that the control means controls the state of the displayed image to the first state when the speed of movement detected by the device motion detection means is slower than a threshold value, and controls the state of the displayed image to the second state when the speed of movement detected by the device motion detection means is faster than the threshold value.

8. The electronic device according to claim 7, further comprising a prediction means for predicting the timing of switching between a state in which the speed of movement detected by the device motion detection means is slower than the threshold value and a state in which the speed is faster than the threshold value, wherein the switching of the state of the display image is delayed relative to the control for switching the state of the display image, and the control means initiates control for switching the state of the display image prior to the timing predicted by the prediction means so that the state of the display image switches at the timing predicted by the prediction means.

9. The electronic device according to claim 7, wherein the threshold value is 15 deg / s.

10. The electronic device described in claim 1 or 2, characterized in that the ratio of the difference between the luminance of the display image in the first state and the luminance of the display image in the second state to the luminance of the display image in the first state or the luminance of the display image in the second state is 10% or less.

11. The electronic device according to claim 1 or 2, characterized in that the value of ΔE*ab corresponding to the difference between the chromaticity of the displayed image in the first state and the chromaticity of the displayed image in the second state is 5 or less.

12. The electronic device described in claim 1 or 2, characterized in that the displayed image is an image based on an image of real space obtained by an imaging means of the electronic device, the optical axis of the optical system of the display means and the optical axis of the optical system of the imaging means are approximately aligned, and the distance from the imaging means to the eyepiece where the user's eyes are positioned is 60 mm or less.

13. An electronic device as described in claim 1 or 2, further comprising an image motion detection means for detecting motion in the displayed image from the displayed image, and the control means switches the state of the displayed image based on the motion detected by the device motion detection means and the motion detected by the image motion detection means.

14. The electronic device according to claim 13, wherein the control means controls the state of the displayed image to the second state when motion is detected by the device motion detection means, regardless of the result of detection by the image motion detection means.

15. The electronic device described in claim 14, characterized in that the control means controls the video motion detection means to suspend detection when motion is detected by the device motion detection means, and controls the video motion detection means to resume detection when motion is no longer detected by the device motion detection means.

16. The electronic device according to claim 13, wherein the control means controls the state of the displayed image to the first state when motion is detected by the device motion detection means but no motion is detected by the image motion detection means.

17. An electronic device comprising: an imaging means; a display means; an image motion detection means for detecting motion in a display image based on an image of real space obtained by said imaging means; and a control means for controlling said display means to display said display image, wherein said control means switches the state of said display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the motion detected by said image motion detection means, and switches the state of said imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state.

18. The electronic device described in claim 17 further comprises a determination means for determining whether or not the motion detected by the image motion detection means is an object of the user's observation, and when the determination means determines that the motion detected by the image motion detection means is an object of the user's observation, the control means switches the state of the imaging means and the display means based on the motion detected by the image motion detection means.

19. The electronic device of claim 18, characterized in that the conditions for the motion detected by the image motion detection means to be the object of observation by the user include at least one of the following: the location where the motion is detected by the image motion detection means is not an edge of the displayed image; the size of the location where the motion is detected by the image motion detection means is equal to or greater than a threshold; the depth direction distance from the user to the location where the motion is detected by the image motion detection means, as perceived by the user, is equal to or less than a threshold; the brightness of the location where the motion is detected by the image motion detection means is equal to or greater than a threshold; and the object present at the location where the motion is detected by the image motion detection means is a virtual object located in real space.

20. An electronic device comprising: a display means; a gaze detection means for detecting a user's gaze; an image motion detection means for detecting movement in an image displayed on said display means; and a control means for controlling said display means to display said image, wherein said control means switches the state of said display means between a plurality of states including a first state and a second state in which motion blur in the displayed image is reduced more than in the first state, based on the movement detected by the image motion detection means at the location where the user's gaze is directed.

21. The electronic device described in claim 20, further comprising an imaging means, wherein the displayed image is an image based on an image of real space obtained by the imaging means, and wherein the control means switches the state of the display means between the plurality of states including the first state and the second state based on the movement detected by the image motion detection means at the location where the user's gaze is directed, and switches the state of the imaging means between the plurality of states including a third state and a fourth state in which motion blur in the displayed image is reduced more than in the third state.

22. A control method for an electronic device having a display means, comprising: an equipment motion detection step for detecting the movement of the electronic device; and a control step for displaying a display image on the display means, wherein the position of the portion to be displayed as the display image in three-dimensional space changes in accordance with the movement of the electronic device, and in the control step, the state of the display image is switched between a plurality of states including a first state and a second state in which motion blur is reduced more than in the first state, based on the movement detected in the equipment motion detection step.

23. A control method for an electronic device having an imaging means and a display means, comprising: an image motion detection step of detecting motion in a display image based on an image of real space obtained by the imaging means; and a control step of controlling the display means to display the display image, wherein the control step switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the motion detected in the image motion detection step, and switches the state of the imaging means between a plurality of states including a third state and a fourth state in which motion blur in the display image is reduced more than in the third state.

24. A control method for an electronic device having a display means, comprising: a gaze detection step of detecting a user's gaze; an image motion detection step of detecting movement in a display image displayed on the display means; and a control step of controlling the display means to display the display image, wherein the control step switches the state of the display means between a plurality of states including a first state and a second state in which motion blur in the display image is reduced more than in the first state, based on the movement detected in the image motion detection step at a location where the user's gaze is directed.

25. A program for causing a computer to execute each step of the control method according to any one of claims 22 to 24.

Images