Method of mitigating dizziness, electronic device, and computer-readable storage medium

Abstract

Embodiments of the present application provide a method for reducing dizziness, an electronic device and a computer readable storage medium. The method comprises: providing a first visual content of a first reality mode in a field of view; adding a specific shield to the first visual content, wherein the specific shield displays a specific part of a second visual content of a second reality mode, and the position of the specific shield in the first visual content is fixed. In this way, the user can feel less dizziness when watching, thereby improving the user experience.

Description

Technical Field

[0001] This invention relates to a 3D display technology, and more particularly to a method for alleviating dizziness, an electronic device, and a computer-readable storage medium. Background Technology

[0002] Motion sickness is a very common symptom, especially when traveling by boat, car, or airplane. When the motion perceived by the eyes does not match the motion sensed by the vestibular system in the brain, symptoms such as fainting, nausea, and dizziness may occur.

[0003] In certain situations, people wearing head-mounted displays (HMDs) may also suffer from motion sickness when experiencing virtual reality (VR), augmented reality (AR), mixed reality (MR), extended reality (XR), and other similar scenarios. Summary of the Invention

[0004] In view of this, the present invention provides a method for alleviating dizziness, an electronic device, and a computer-readable storage medium, which can be used to solve the above-mentioned technical problems.

[0005] Embodiments of the present invention provide a method for alleviating dizziness, applicable to electronic devices. The method includes: providing a first visual content of a first reality mode within a field of vision; and, in response to determining that a shielding function is activated, adding a specific shield to the first visual content, wherein the specific shield displays a specific portion of a second visual content of a second reality mode, and the position of the specific shield within the first visual content is fixed.

[0006] Embodiments of the present invention provide an electronic device including a storage circuit and a processor. The storage circuit stores program code. The processor is coupled to the storage circuit to access and execute: providing first visual content of a first reality mode within a field of view; and, in response to determining that a masking function has been activated, adding a specific mask to the first visual content, wherein the specific mask displays a specific portion of a second visual content of a second reality mode, and the position of the specific mask within the first visual content is fixed.

[0007] Embodiments of the present invention provide a computer-readable storage medium that records an executable computer program, and the executable computer program is loaded by an electronic device to perform the following steps: providing first visual content of a first reality mode within a field of view; in response to determining that a masking function has been activated, adding a specific mask to the first visual content, wherein the specific mask displays a specific portion of a second visual content of a second reality mode, and the position of the specific mask in the first visual content is fixed. Attached Figure Description

[0008] The accompanying drawings are included to further illustrate the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0009] Figure 1 This is a schematic diagram of an electronic device according to an embodiment of the present invention.

[0010] Figure 2 This is a flowchart illustrating a method for alleviating dizziness according to an embodiment of the present invention.

[0011] Figure 3 This is the first visual content of a first reality mode illustrated according to an embodiment of the present invention.

[0012] Figure 4 It is a second visual content of a second reality mode illustrated according to an embodiment of the present invention. Detailed Implementation

[0013] Reference will now be made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same component symbols are used in the drawings and description to denote the same or similar parts.

[0014] Figure 1 This is a schematic diagram of an electronic device according to an embodiment of the present invention. In various embodiments, the electronic device 100 can be any device capable of providing visual content (such as VR / AR / MR / XR and other reality service content) to a user. In this embodiment of the invention, the electronic device 100 can be the host of a reality service system (such as a VR / AR / MR / XR system), which may include other components, such as a head-mounted display (HMD), a controller, and a position tracking component, but is not limited thereto. In other embodiments, the electronic device 100 can also be an integrated HMD capable of operating independently and displaying reality service content to a user, but the invention is not limited thereto.

[0015] To make the contents of this invention easier to understand, the electronic device 100 is assumed to be a host that can provide visual content for and display to the corresponding HMD, but this invention is not limited thereto.

[0016] exist Figure 1 In this embodiment, the electronic device 100 includes a storage circuit 102 and a processor 104. The storage circuit 102 can be any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk drive (HDD), solid-state drive (SSD), or other similar components, and can be used to record program code or multiple modules executed by the processor 104.

[0017] Processor 104 may be coupled to storage circuit 102. Processor 104 may be a graphics processing unit (GPU), a general purpose processor, a special purpose processor, a conventional processor, a digital signal processor (DSP), multiple microprocessors, one or more microprocessors connected to a DSP core, a controller, a microcontroller, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or any other type of integrated circuit (IC), state machine, etc.

[0018] In embodiments of the present invention, the processor 104 can access modules and / or program code stored in the storage circuit 102 to implement the dizziness relief method provided by the present invention. The method will be further discussed below.

[0019] Figure 2 This is a flowchart illustrating a method for alleviating dizziness according to an embodiment of the present invention. The method for alleviating dizziness in this embodiment can be derived from... Figure 1 The electronic device 100 in the middle performs the operation, and will be supplemented below. Figure 1 Component description shown Figure 2 Details of each step.

[0020] First, in step S210, the processor 104 can provide first visual content of the first reality mode within the field of view. For ease of understanding, the following will use... Figure 3 This is just one example, but it is not the only one.

[0021] Figure 3This is a first visual content of a first reality mode illustrated according to an embodiment of the present invention. In an embodiment of the present invention, the processor 104 can perform the same operation on visual content in the user's binocular vision; therefore, the following description will only focus on the operation performed on visual content for a single eye (e.g., the right eye), but is not limited thereto.

[0022] exist Figure 3 In this embodiment, processor 104 can provide first visual content VC1 of a first reality mode within the field of view (FoV) F1 of the HMD controlled by electronic device 100. In this case, the first reality mode may be an AR mode. The front-facing camera of the HMD can capture an image of the scene in front of the HMD, which the processor 104 can then use to generate the first visual content VC1. The processor 104 can then provide the first visual content VC1 to the HMD for display to the user, but is not limited to this.

[0023] When a user moves their head, the first visual content VC1 should be adjusted accordingly. However, as mentioned above, some users may experience dizziness during this process. Therefore, in embodiments of the present invention, the processor 104 may add a specific shielding SM to the first visual content VC1 to alleviate the user's dizziness.

[0024] Specifically, in embodiments of the present invention, the electronic device 100 can detect whether the shielding function is automatically or manually activated. In step S220, in response to determining that the shielding function has been activated, the processor 104 can add a specific shield SM to the first visual content VC1.

[0025] In one embodiment, the HMD may have a button specifically for activating the shielding function. In response to determining that this button has been triggered, the processor 104 can determine that the user of the electronic device 100 has manually activated the shielding function. Therefore, the processor 104 can add a specific shielding SM to the first visual content VC1.

[0026] In another embodiment, the FOV F1 may be configured with a specific area 310, and a user may activate the shielding function by placing their gaze on the specific area 310 for more than a time threshold. In one embodiment, the specific area 310 may be designed to correspond to a specific shielding SM. In other embodiments, the specific area 310 may be adjusted to any form / shape / size / position according to the designer's requirements. Therefore, in response to determining that the user's gaze has lingered in the specific area 310 of the FOV F1 for more than the aforementioned time threshold, the processor 104 may determine that the shielding function has been activated and add the specific shielding SM to the first visual content VC1.

[0027] In another embodiment, the processor 104 can detect the movement speed of the HMD and determine whether this movement speed is higher than a speed threshold. In response to determining that the movement speed of the HMD is higher than the speed threshold, which means that the user may be more prone to dizziness, the processor 104 can determine to activate the shielding function and add a specific shielding SM to the first visual content VC1.

[0028] In one embodiment, in response to determining that the movement speed of the HMD changes to below a speed threshold for a time threshold, which means that the user may be less likely to feel dizzy, the processor 104 may determine to disable the shielding function and remove a specific shield SM from the first visual content VC1, but the invention is not limited thereto.

[0029] In an embodiment of the present invention, the position of the specific shielding SM within the first visual content VC1 is fixed, so that the user is less likely to experience dizziness when viewing the first visual content VC1. Figure 3 In this embodiment, the specific shielding SM can be a semi-transparent annular region surrounding at least a portion of the FOV F1. In one embodiment, the specific shielding SM may include an outer ring side SM1 and an inner ring side SM2, and the transparency of the specific shielding SM may gradually increase from the outer ring side SM1 to the inner ring side SM2 to avoid excessively obstructing the user's view.

[0030] Furthermore, in some embodiments, the processor 104 may allow the user to switch the electronic device 104 from providing content in a first reality mode to providing content in a second reality mode, wherein the second reality mode may be a different reality mode from the first reality mode. In this case, the processor 104 may run the service of the second reality mode (e.g., VR mode) in the background for the user to use when needed.

[0031] In this case, a specific shielded SM can display a specific portion of the second visual content of the second reality mode. Figure 3 In this context, a specific masking SM may include multiple geometric windows GW separated by multiple separating paths SP, wherein the geometric windows GW can display specific portions of the second visual content of the second reality mode, and the separating paths SP can display corresponding portions of the first visual content VC1. In other words, Figure 3 In this embodiment, only a geometric window GW is used to display a specific portion of the second visual content, but the invention is not limited thereto. In other embodiments, the shape / size of the geometric window GW and the separating path SP can be adjusted according to the designer's needs, but the invention is not limited thereto.

[0032] In one embodiment, since a specific shielding SM can display a specific portion of the second visual content of the second reality mode, the processor 104 can adjust the specific portion displayed by the specific shielding SM in response to detecting movement of the HMD. That is, when the user moves their head, the specific portion of the second visual content displayed in the specific shielding SM in the first visual content VC1 will be adjusted accordingly.

[0033] In one embodiment, the processor 104 can determine whether the electronic device 100 has switched from a first reality mode (such as AR mode) to a second reality mode (such as VR mode). In response to determining that the electronic device 100 has switched from the first reality mode to the second reality mode, the processor 104 can render the second visual content of the second reality mode from the outer region of the field of view (FOV) F1 to the central region of the FOV F1. That is, the processor 104 can (gradually) along... Figure 1 The FOV F1 is rendered using the second visual content in the direction of the middle arrow, but this invention is not limited thereto.

[0034] In one embodiment, in response to determining that the electronic device 100 is switching from a first reality mode to a second reality mode, the processor 104 can render the second visual content of the second reality mode outward from the geometric window GW to the field of view F1. Therefore, the visual transition from the first reality mode to the second reality mode is smoother, thereby further improving the user experience.

[0035] In one embodiment, the processor 104 can determine whether the user triggers a specific button on the HMD, or whether the user's gaze remains within a reference area of ​​FOV F1 for more than a time threshold. In one embodiment, the specific button on the HMD may be specifically designed for the user to use to switch reality modes, but the invention is not limited thereto. In another embodiment, the reference area of ​​FOV F1 may be designed to allow the user to switch reality modes by placing their gaze within the reference area of ​​FOV F1 for more than a time threshold, but the invention is not limited thereto.

[0036] In one embodiment, in response to determining that a user triggers a specific button on the HMD, or that the user's gaze lingers on the reference area of ​​FOVF1 for more than a time threshold, the processor 104 can determine that the electronic device 100 has been controlled to switch from a first reality mode to a second reality mode. Therefore, the processor 104 can render the second visual content from the outer region of FOVF1 to the central region.

[0037] In existing technologies, when a user controls an HMD to switch from one reality mode to another, the HMD abruptly switches to display the visual content of the other reality mode, making the transition between the two reality modes feel less smooth. In contrast, because the processor 104 can gradually render the second visual content from the outer area of ​​the FOV F1 to the center area, users will find the present invention to be smoother than traditional reality mode switching methods compared to existing approaches.

[0038] In embodiments of the present invention, the FOV F1, which is fully rendered with second visual content of a second reality mode, can be as follows: Figure 4 exemplified.

[0039] Figure 4 This is a second visual content depicting a second reality mode according to an embodiment of the present invention. Figure 4 In this context, the HMD can display a second visual content VC2 within the FOV F1. (By...) Figure 4 It can be seen that the processor 104 can maintain a specific shielding SM in the second visual content VC2.

[0040] In one embodiment, Figure 3 The first visual range of a specific shielded SM in the first visual content VC1 can correspond to the second visual range of a specific part in the second visual content VC2. Specifically, through Figure 3 and Figure 4 Through cross-referencing, it can be seen that Figure 3 The content displayed by a specific shielded SM can correspond to Figure 4 The content displayed in a specific shielding SM in the first visual content VC1. From another perspective, the processor 104 can be understood as extracting a specific portion of the second visual content VC2 (which occupies the same visual range as the specific shielding SM in the first visual content VC1) and filling it into the specific shielding SM added to the first visual content VC1, but the present invention is not limited thereto.

[0041] In some embodiments, the processor 104 can determine whether the shielding function is activated. In one embodiment, when a specific shielding SM is displayed in FOV F1, a button originally used to activate the shielding function can be used to deactivate it. In this case, in response to determining that the button has been triggered, the processor 104 can determine that the user of the electronic device 100 has manually deactivated the shielding function. Therefore, the processor 104 can remove the specific shielding SM from the second visual content VC2.

[0042] In other embodiments, in response to determining that the user's gaze has lingered in a specific area of ​​FOV F1 for more than a time threshold, or that the HMD's movement speed has been below a speed threshold for a period of time, the processor 104 may remove a specific shield SM, but the present invention is not limited thereto.

[0043] In some embodiments, the processor 104 may also allow the user to switch the HMD from a second reality mode back to a first reality mode by, for example, triggering a specific button on the HMD. When the processor 104 determines that the user wants to switch the HMD from the second reality mode back to the first reality mode, the processor 104 may (gradually) render the first visual content VC1 from the central area of ​​the FOV F1 to the outer area. That is, the processor 104 may (gradually) render along... Figure 4 The direction of the middle arrow is rendered using the first-view content (VC1) to create a field of view (FOVF1), allowing the user to see the corresponding content. Figure 3 The first visual content VC1 shown on the left is not limited to this invention.

[0044] In the above teachings, although AR mode and VR mode are examples of the first and second reality modes, respectively, the present invention is not limited thereto. In other embodiments, the first and second reality modes can be any two of VR, AR, MR, XR, and see-through mode.

[0045] In other embodiments, based on the foregoing teachings, those skilled in the art should be able to understand and use a standalone reality service HMD to implement the content disclosed in this invention. Specifically, the electronic device 100 can be implemented as a standalone reality service HMD, which includes a display for displaying first visual content VC1 or second visual content VC2 in a field of view (FOV) F1. In this case, the operation of the processor 104 in the standalone reality service HMD to adjust the content displayed in the FOV F1 can be referred to the foregoing teachings and will not be described again here.

[0046] The present invention also provides a computer-readable storage medium for performing a method to alleviate dizziness. This computer-readable storage medium comprises a plurality of program instructions (such as setup and deployment program instructions). These program instructions can be loaded into electronic device 100 and executed to perform the aforementioned method to alleviate dizziness and the functions of electronic device 100.

[0047] In summary, when an electronic device provides a user with first visual content in a first reality mode (such as AR mode), the present invention can also add a specific shield (which may be a semi-transparent ring) to the first visual content in response to the determination that the shielding function is activated. Since the position of the specific shield in the first visual content is fixed, the user can experience less dizziness when viewing the first visual content VC1 or the second visual content VC2, thereby improving the user experience.

[0048] In addition, because specific shielding can be used to display certain portions of the second visual content in a second reality mode (such as VR mode), the transition from the first reality mode to the second reality mode can be smoother, thereby improving the user experience.

[0049] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for alleviating dizziness, applicable to electronic devices, characterized in that, The methods for alleviating dizziness include: Provides first-person visual content in a first-realistic mode within the field of view; and A specific mask is added to the first visual content, wherein the specific mask displays a specific portion of the second visual content in a second reality mode, and the position of the specific mask in the first visual content is fixed, wherein the specific mask comprises a plurality of geometric windows separated by a plurality of dividing paths, wherein the plurality of geometric windows display the specific portion of the second visual content, and the plurality of dividing paths display the corresponding portion of the first visual content.

2. The method for alleviating dizziness according to claim 1, wherein the specific shield is a semi-transparent annular region surrounding at least a portion of the field of vision.

3. The method for alleviating dizziness according to claim 2, wherein the first visual range of the specific shield in the first visual content corresponds to the second visual range of the specific portion in the second visual content.

4. The method for alleviating dizziness according to claim 2, wherein the specific shield comprises an outer ring side and an inner ring side, and the transparency of the specific shield gradually increases from the outer ring side to the inner ring side.

5. The method for alleviating dizziness according to claim 1, wherein after the step of adding the specific content blocked to the first visual content, the method further comprises: In response to detecting movement of the head-mounted display used to display the first visual content, the specific portion displayed in the specific shield is adjusted according to the movement of the head-mounted display.

6. The method for alleviating dizziness according to claim 1, wherein the visual field includes a central region and an outer region, and after the step of adding the specific shielding to the first visual content, the method further includes: In response to determining that the electronic device has switched from the first reality mode to the second reality mode, the second visual content of the second reality mode is rendered from the outer region of the field of view to the central region of the field of view.

7. The method for alleviating dizziness according to claim 6, further comprising: In response to the determination that a specific button on the head-mounted display used to display the first visual content has been triggered, or that the user's gaze has remained on the reference area of ​​the field of vision for more than a first time threshold, it is determined that the electronic device has been controlled to switch from the first reality mode to the second reality mode.

8. The method for alleviating dizziness according to claim 6, further comprising: In response to determining that the electronic device has switched from the second reality mode to the first reality mode, the first visual content of the first reality mode is rendered from the central region of the field of view to the outer region of the field of view.

9. The method for alleviating dizziness according to claim 6, wherein the specific shielding is maintained in the second visual content after the electronic device switches to the second reality mode.

10. The method for alleviating dizziness according to claim 1, further comprising: In response to the determination that the user of the electronic device has manually activated the blocking function, the specific blocking is added to the first visual content; In response to determining that the user's gaze has lingered in a specific area of ​​the field of vision for more than a second time threshold, the system determines to activate the detection and masking function and adds the specific masking to the first visual content; In response to determining that the moving speed of the head-mounted display used to display the first visual content is higher than a speed threshold, the detection and masking function is activated, and the specific masking is added to the first visual content. or In response to determining that the movement speed of the head-mounted display changes to below the speed threshold to a third time threshold, the detection masking function is turned off, and the specific masking is removed from the first visual content.

11. An electronic device, characterized in that, include: Storage circuitry stores program code; as well as The processor, coupled to the storage circuitry, accesses the program code to execute: Provides first-person visual content in the first-realistic mode within the field of view; as well as A specific mask is added to the first visual content, wherein the specific mask displays a specific portion of the second visual content in a second reality mode, and the position of the specific mask in the first visual content is fixed, wherein the specific mask includes a plurality of geometric windows separated by a plurality of dividing paths, wherein the plurality of geometric windows display the specific portion of the second visual content, and the plurality of dividing paths display the corresponding portion of the first visual content.

12. The electronic device of claim 11, wherein the electronic device is the host of a head-mounted display, and the processor performs: The first visual content is provided to the head-mounted display so that the head-mounted display can display the first visual content.

13. The electronic device of claim 11, wherein the electronic device is a head-mounted display and further includes a display coupled to the processor, the processor further controlling the display to display the first visual content.

14. The electronic device of claim 11, wherein the particular shield is a semi-transparent annular region surrounding at least a portion of the field of view; Wherein the first visual range of the specific shielding in the first visual content corresponds to the second visual range of the specific part of the second visual content; The specific shielding includes an outer ring side and an inner ring side, and the transparency of the specific shielding gradually increases from the outer ring side to the inner ring side.

15. The electronic device of claim 11, wherein after adding the specific masking to the first visual content, the processor further performs: In response to detecting movement of the head-mounted display used to display the first visual content, the specific portion displayed in the specific shield is adjusted according to the movement of the head-mounted display.

16. The electronic device of claim 11, wherein the field of view comprises a central region and an outer region, and after adding the specific masking to the first visual content, the processor further performs: In response to determining that the electronic device has switched from the first reality mode to the second reality mode, the second visual content of the second reality mode is rendered from the outer region of the field of view to the central region of the field of view.

17. The electronic device of claim 16, wherein the processor further performs: In response to the determination that a specific button on the head-mounted display used to display the first visual content has been triggered, or that the user's gaze has remained on the reference area of ​​the field of vision for more than a first time threshold, it is determined that the electronic device has been controlled to switch from the first reality mode to the second reality mode. In response to determining that the electronic device has switched from the second reality mode to the first reality mode, the first visual content of the first reality mode is rendered from the central region of the field of view to the outer region of the field of view; as well as After the electronic device switches to the second reality mode, the specific shielding is maintained in the second visual content.

18. The electronic device of claim 11, wherein the processor further performs: In response to the determination that the user of the electronic device has manually activated the blocking function, the specific blocking is added to the first visual content; In response to determining that the user's gaze has lingered in a specific area of ​​the field of vision for more than a second time threshold, the system determines to activate the detection and masking function and adds the specific masking to the first visual content; In response to determining that the moving speed of the head-mounted display used to display the first visual content is higher than a speed threshold, the detection and masking function is activated, and the specific masking is added to the first visual content. or In response to determining that the movement speed of the head-mounted display changes to below the speed threshold to a third time threshold, the detection masking function is turned off, and the specific masking is removed from the first visual content.

19. A computer-readable storage medium that records an executable computer program, the executable computer program being loaded by an electronic device to perform the following steps: Displaying the first visual content of the first reality mode within the field of view of the electronic device; and A specific mask is added to the first visual content, wherein the specific mask displays a specific portion of the second visual content in a second reality mode, and the position of the specific mask in the first visual content is fixed, wherein the specific mask comprises a plurality of geometric windows separated by a plurality of dividing paths, wherein the plurality of geometric windows display the specific portion of the second visual content, and the plurality of dividing paths display the corresponding portion of the first visual content.

Images