Electronic system, computer-readable storage medium, and method of operating an electronic device

By introducing portal effects and visual effects layers in 3D environments, the comfort problem in viewing of three-dimensional projects is solved, providing a more comfortable and immersive viewing experience.

CN117768630BActive Publication Date: 2025-08-01APPLE INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311230236.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2023-09-21
Filing Date
2023-09-22
Publication Date
2025-08-01
Estimated Expiration
2043-09-22

AI Technical Summary

Technical Problem

The prior art may not provide a comfortable or desired viewing experience when viewing stereoscopic photos and stereoscopic videos, such as window violations, field of view shifts, and visual conflicts.

Method used

By introducing portal effects in a 3D environment, use the visual effect layer to change the appearance of a 3D project, including the first layer, the background visual effect layer, the internal visual effect layer and the edge visual effect layer, enhancing the 3D appearance of the 3D project and reducing visual conflicts with the surrounding environment.

Benefits of technology

Improves viewing comfort for stereo projects, reduces window violations and field of view offsets, and provides a more immersive viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117768630B_ABST
    Figure CN117768630B_ABST
Patent Text Reader

Abstract

The present disclosure relates to vision technologies for 3D content. Various embodiments provide a view of a 3D environment of the portal for viewing a stereoscopic item (e.g., a photograph or video) positioned at a distance behind the portal. One or more visual effects are provided based on the texture of one or more portions of the stereoscopic item, such as the texture at a truncated or visible edge of the stereoscopic item. The effect changes the appearance of the stereoscopic item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various embodiments provide a view of the 3D environment, including an immersive view of the stereoscopic item, without using a portal. Such visual effects may be provided to partially occlude the surrounding 3D environment.
Need to check novelty before this filing date? Find Prior Art

Claims

1. A method for operating an electronic device, comprising: At a processor of the electronic device: Position a portal within a three-dimensional (3D) coordinate system corresponding to an extended reality (XR) environment; Position a stereoscopic item within the 3D coordinate system at a distance behind the portal; Position a visual effect layer within the 3D coordinate system, the visual effect layer being different from the stereoscopic item and the portal; And Provide a view of the XR environment based on a viewpoint in front of the portal within the 3D coordinate system, wherein the stereoscopic item is at least partially visible through the portal in the view of the XR environment, and wherein the visual effect layer: Affects the appearance of the portal; Affects the appearance of the content visible through the portal in the view by providing an imaging effect that changes the appearance of the stereoscopic item; Or Affects the appearance of the content visible through the portal in the view by providing additional content visible through the portal in the view, the additional content being different from the stereoscopic item.

2. The method according to claim 1, wherein the visual effect layer is positioned between the portal and the stereoscopic item in the 3D coordinate system, and wherein the visual effect layer provides a blur effect based on the texture of one or more parts of the stereoscopic item.

3. The method according to claim 1, wherein the visual effect layer provides content outside the perimeter of the stereoscopic item on a background plane, and wherein the visual effect layer includes blurred content from a side region or a truncated region of the stereoscopic item.

4. The method according to claim 1, wherein the visual effect layer changes the appearance of the edge of the portal by increasing the display characteristics of the edge of the portal.

5. The method according to claim 1, further comprising: Expanding the portal; Removing the portal; Expanding the stereoscopic item; Removing the visual effect layer; And Providing a visual effect, wherein the visual effect affects the appearance of the XR environment visible around the stereoscopic item in the view.

6. The method according to claim 1, further comprising repositioning the stereoscopic item relative to the portal based on a scroll input, a distance from the viewpoint, and an angle at which the stereoscopic item is scrolled away.

7. The method according to claim 1, wherein the electronic device is a head-mounted device.

8. The method according to claim 1, wherein positioning the visual effect layer includes: [[ID= ​ ​ ​ ​ ​ ​ ​ ​ Position the stereoscopic item at a distance behind the portal within the 3D coordinate system; Position a visual effect layer within the 3D coordinate system, the visual effect layer being different from the stereoscopic item and the portal; And Provide a view of the XR environment based on a viewpoint in front of the portal within the 3D coordinate system, wherein the stereoscopic item is at least partially visible through the portal in the view of the XR environment, and wherein the visual effect layer: Affects the appearance of the portal; Affects the appearance of the content visible through the portal in the view by providing an imaging effect that changes the appearance of the stereoscopic item; Or Affects the appearance of the content visible through the portal in the view by providing additional content visible through the portal in the view, the additional content being different from the stereoscopic item.

10. The electronic system according to claim 9, wherein the visual effect layer is positioned between the portal and the stereoscopic item in the 3D coordinate system, and wherein the visual effect layer provides a blur effect based on the texture of one or more parts of the stereoscopic item.

11. The electronic system according to claim 9, wherein the visual effect layer provides content outside the perimeter of the stereoscopic item on a background plane, and wherein the visual effect layer includes blurred content from a side region or a truncated region of the stereoscopic item.

12. The electronic system according to claim 9, wherein the visual effect layer changes the appearance of the edge of the portal by increasing the display characteristics of the edge of the portal.

13. The electronic system according to claim 9, wherein the operation further includes: Expanding the portal; Removing the portal; Expanding the stereoscopic item; Removing the visual effect layer; And Providing a visual effect, wherein the visual effect affects the appearance of the XR environment visible around the stereoscopic item in the view.

14. The electronic system according to claim 9, wherein the operation further includes repositioning the stereoscopic item relative to the portal based on a scroll input, the distance of the viewpoint, and the angle by which the stereoscopic item is scrolled away.

15. The electronic system according to claim 9, wherein the electronic system is a head-mounted device.

16. The electronic system according to claim 9, wherein positioning the visual effect layer includes: Positioning an internal visual effect layer; Positioning a background visual effect layer; And Positioning an edge visual effect layer.

17. A non-transitory computer-readable storage medium storing program instructions that can be executed via one or more processors to perform operations including the following: Position a portal within a three-dimensional (3D) coordinate system corresponding to an extended reality (XR) environment; Position a stereoscopic item at a distance behind the portal within the 3D coordinate system; Position a visual effect layer within the 3D coordinate system, the visual effect layer being different from the stereoscopic item and the portal; And Provide a view of the XR environment based on a viewpoint in front of the portal within the 3D coordinate system, wherein the stereoscopic item is at least partially visible through the portal in the view of the XR environment, and wherein the visual effect layer: Affects the appearance of the portal; Affects the appearance of the content visible through the portal in the view by providing an imaging effect that changes the appearance of the stereoscopic item; Or Affects the appearance of the content visible through the portal in the view by providing additional content visible through the portal in the view, the additional content being different from the stereoscopic item.

18. The non-transitory computer-readable storage medium according to claim 17, wherein the visual effect layer is positioned between the portal and the stereoscopic item in the 3D coordinate system, and wherein the visual effect layer provides a blur effect based on the texture of one or more portions of the stereoscopic item.

19. The non-transitory computer-readable storage medium according to claim 17, wherein the visual effect layer provides content outside the perimeter of the stereoscopic item on a background plane, and wherein the visual effect layer includes blurred content from a side region or a truncated region of the stereoscopic item.

20. The non-transitory computer-readable storage medium according to claim 17, wherein the visual effect layer changes the appearance of the edge of the portal by increasing the display characteristics of the edge of the portal.

21. The non-transitory computer-readable storage medium according to claim 17, wherein the operation further includes: Expanding the portal; Removing the portal; Expanding the stereoscopic item; Removing the visual effect layer; And Providing a visual effect, wherein the visual effect affects the appearance of the XR environment visible around the stereoscopic item in the view.

22. The non-transitory computer-readable storage medium according to claim 17, wherein the operation further includes repositioning the stereoscopic item relative to the portal based on the distance of the viewpoint and the angle by which the stereoscopic item is scrolled away, based on a scroll input.

23. The non-transitory computer-readable storage medium according to claim 17, wherein positioning the visual effect layer includes: Positioning an internal visual effect layer; Positioning a background visual effect layer; [[ID= ​

Citation Information

Patent Citations

  • Displaying modified stereo visual content

    US20190238818A1

  • Vestibular anchoring

    US20190272026A1