Method and device for displaying a virtual display interface in an augmented reality space

By acquiring real-space map information and adjusting virtual display interface dimensions based on position and user visual range, the method and apparatus enhance user experience in augmented reality environments.

JP2025526806APending Publication Date: 2025-08-15BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2025507704
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-08-11
Filing Date
2023-08-07
Publication Date
2025-08-15

AI Technical Summary

Technical Problem

Existing methods for displaying virtual display interfaces in augmented reality environments result in poor user viewing experiences due to inadequate determination of interface dimensions based on the display position and user's visual range.

Method used

A method and apparatus that utilize an image capturing device to acquire map information of the real space, generate an augmented reality space using a rendering engine, and determine a target position for the virtual display interface, adjusting its dimensions based on the position and user's visual range, with optional adjustments via call and reset commands and movement detection.

Benefits of technology

Improves user viewing experience by ensuring more rational dimensions of the virtual display interface, enhancing comfort and clarity in augmented reality environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025526806000001_ABST
    Figure 2025526806000001_ABST
Patent Text Reader

Abstract

[0003] The present disclosure provides a method and apparatus for displaying a virtual display interface in an augmented reality space, which relates to the smart device technical field. The method includes: acquiring map information of a real space using an image capturing device; generating an augmented reality space using a rendering engine based on the map information of the real space; determining a target position of a virtual display interface in the augmented reality space; and displaying the virtual display interface at the target position, wherein dimensions of the virtual display interface are related to the target position where the virtual display interface is located and a user's visual range. The present disclosure can be used to solve the problem of users having a poor viewing experience of the virtual display interface.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This disclosure claims priority to Chinese Patent Application No. 202210960732.X, filed on August 11, 2022, entitled "Method and device for displaying virtual display interface in augmented reality space," the disclosure of which is incorporated herein by reference in its entirety.

[0002] [Technical field] The present disclosure relates to the field of smart device technology, and more particularly to a method and apparatus for displaying a virtual display interface in an augmented reality space. [Background technology]

[0003] Augmented reality refers to the creation of an augmented reality environment that combines real scenes with virtual content using a computer, enabling man-machine interaction. In some scenes, it is necessary to display some virtual display interfaces, such as a GUI (Graphical User Interface), in the augmented reality environment. Summary of the Invention

[0004] The technical solutions according to the embodiments of the present disclosure are as follows:

[0005] According to a first aspect, an embodiment of the present disclosure provides a method for displaying a virtual display interface in an augmented reality space, the method comprising: acquiring map information of the real space by an image collection device; generating an augmented reality space by a rendering engine based on map information of the real space; determining a target position in the augmented reality space for the virtual display interface and displaying the virtual display interface at the target position, wherein dimensions of the virtual display interface are related to the target position at which the virtual display interface is located and the user's visual range.

[0006] As an alternative embodiment of the present disclosure, the step of determining a target position in the augmented reality space of the virtual display interface and displaying the virtual display interface at the target position includes: The method includes determining distance information between the virtual display interface and an initial position of a head-mounted device based on attribute information of the virtual display interface, determining a target position of the virtual display interface in the augmented reality space based on the distance information, and displaying the virtual display interface at the target position.

[0007] As an alternative embodiment of the present disclosure, before determining distance information between the virtual display interface and an initial position of a head-mounted device based on attribute information of the virtual display interface, the method includes: The method further includes receiving a call command for a virtual display interface, and obtaining attribute information of the virtual display interface based on the call command.

[0008] In one alternative embodiment of the present disclosure, the method includes: The method further includes the step of returning to the step of acquiring map information of the real space by the image acquisition device and executing the acquiring step when the reset command is received.

[0009] As one alternative embodiment of the present disclosure, the horizontal dimension of the virtual display interface is determined based on the distance information and a predetermined horizontal visible angle, and the vertical dimension of the virtual display interface is determined based on the distance information and a predetermined vertical visible angle.

[0010] In one alternative embodiment of the present disclosure, the method includes: The method further includes adjusting dimensions of the virtual display interface based on a displacement of the head-mounted device when the movement of the head-mounted device in the augmented reality space is detected.

[0011] As an alternative embodiment of the present disclosure, when detecting a movement of a head-mounted device in the augmented reality space, adjusting the dimensions of the virtual display interface based on the displacement of the movement includes: reducing a dimension of the virtual display interface when the head-mounted device moves in the augmented reality space toward the virtual display interface; Increasing a dimension of the virtual display interface when the head-mounted device moves in the augmented reality space away from the virtual display interface.

[0012] According to a second aspect, an embodiment of the present disclosure provides an apparatus for displaying a virtual display interface in an augmented reality space, the apparatus comprising: a map information acquisition unit for acquiring map information of the real space by an image collection device; an augmented reality space generation unit for generating an augmented reality space by a rendering engine based on map information of the real space; and a virtual display interface display unit for determining a target position in the augmented reality space for the virtual display interface and displaying the virtual display interface at the target position, the dimensions of the virtual display interface being related to the target position at which the virtual display interface is located and the user's visual range.

[0013] As one alternative embodiment of the present disclosure, the virtual display interface display unit is specifically used to determine distance information between the virtual display interface and the initial position of a head-mounted device based on attribute information of the virtual display interface, determine a target position of the virtual display interface in the augmented reality space based on the distance information, and display the virtual display interface at the target position.

[0014] As one alternative embodiment of the present disclosure, the device further includes a call command receiving unit for receiving a call command of a virtual display interface, and obtaining attribute information of the virtual display interface based on the call command.

[0015] As one optional embodiment of the embodiment of the present disclosure, the device further includes a reset command receiving unit for returning to the process of acquiring map information of the real space by the image collection device and executing the acquisition process when receiving a reset command.

[0016] As one alternative embodiment of the present disclosure, the horizontal dimension of the virtual display interface is determined based on the distance information and a predetermined horizontal visible angle, and the vertical dimension of the virtual display interface is determined based on the distance information and a predetermined vertical visible angle.

[0017] As one optional embodiment of the present disclosure, the device further includes a virtual display interface dimension adjustment unit for adjusting dimensions of the virtual display interface based on a displacement of the movement when detecting a movement of the head-mounted device in the augmented reality space.

[0018] As one alternative embodiment of the present disclosure, the virtual display interface dimension adjustment unit is specifically used to reduce the dimension of the virtual display interface when the head-mounted device moves in a direction toward the virtual display interface in the augmented reality space, and to increase the dimension of the virtual display interface when the head-mounted device moves in a direction away from the virtual display interface in the augmented reality space.

[0019] According to a third aspect, an embodiment of the present disclosure provides an electronic device, the electronic device including a memory and a processor, the memory being used to store a computer program, and the processor being used, when executing the computer program, to cause the electronic device to realize a method for displaying a virtual display interface in an augmented reality space as described in any one of the above embodiments.

[0020] According to a fourth aspect, an embodiment of the present disclosure provides a non-transitory computer-readable storage medium having a computer program stored therein, the computer program, when executed by a computing device, causing the computing device to implement the method for displaying a virtual display interface in an augmented reality space described in any one of the above embodiments.

[0021] According to a fifth aspect, an embodiment of the present disclosure provides a computer program product, which, when a program included in the computer program product is run by a computer, causes the computer to implement the method for displaying a virtual display interface in an augmented reality space described in any one of the above embodiments.

[0022] According to a sixth aspect, an embodiment of the present disclosure provides a computer program that, when executed by a processor, realizes the method for displaying a virtual display interface in an augmented reality space described in any one of the above embodiments. [Brief explanation of the drawings]

[0023] The drawings herein are incorporated into and constitute a part of this specification, illustrate embodiments consistent with the present disclosure, and together with the specification serve to explain the principles of the present disclosure.

[0024] In order to more clearly describe the technical solutions in the embodiments or related art of the present disclosure, the following briefly introduces the drawings that need to be referred to in the description of the embodiments or related art. It is obvious that those skilled in the art can obtain other drawings based on these drawings without any creative efforts.

[0025] [Figure 1] 1 is a flowchart of a method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a first interface display diagram of a method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure. [Figure 3] FIG. 1 is an interface display principle diagram of a method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure. [Figure 4] FIG. 10 is a second interface display diagram of a method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure. [Figure 5] FIG. 10 is a third interface display diagram of a method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure. [Figure 6] FIG. 10 is a fourth interface display diagram of a method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure. [Figure 7] FIG. 1 is a schematic structural diagram of an apparatus for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure; [Figure 8] FIG. 1 is a schematic hardware structural diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0026] In order to make the above-mentioned objects, features and advantages of the present disclosure more clearly understood, the present disclosure will be further described below. It should be noted that, unless contradictory, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0027] In the following description, many specific details are set forth to provide a thorough understanding of the present disclosure, but the present disclosure may be implemented in ways different from those described herein. Obviously, the embodiments in the specification are only some embodiments of the present disclosure, but not all embodiments.

[0028] In the embodiments of the present disclosure, terms such as "exemplary" or "for example" are used to denote an example, illustration, or explanation. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present disclosure should not be construed as preferred or advantageous over other embodiments or design solutions. Rather, the invocation of terms such as "exemplary" or "for example" is intended to present the related concept in a concrete manner. Note that in the description of the embodiments of the present disclosure, unless otherwise specified, "plurality" means two or more than two.

[0029] In the related art, the dimensions of the virtual display interface shown in the augmented reality environment are determined based on experience, but when the related art is adopted, the user's viewing experience of the virtual display interface is poor.

[0030] In view of this, the embodiments of the present disclosure provide a method and apparatus for displaying a virtual display interface in an augmented reality space to solve the problem of a user's poor viewing experience of the virtual display interface.

[0031] A method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure includes first obtaining map information of the real space using an image capturing device, then generating an augmented reality space using a rendering engine based on the map information of the real space, and finally determining a target position in the augmented reality space for the virtual display interface, and displaying the virtual display interface at the target position. Since the dimensions of the virtual display interface are related to the target position where the virtual display interface is located and the user's visual range, more reasonable dimensions of the virtual display interface can be determined based on the target position where the virtual display interface is located and the user's visual range, thereby solving the problem of users' poor viewing experience of the virtual display interface.

[0032] In an augmented reality space, a virtual display interface is displayed in a three-dimensional space surrounded by 360°, and the virtual display interface is not constrained by the size of a physical device. Based on this, the present disclosure determines the dimensions of the virtual display interface in the augmented reality space based on the display position of the virtual display interface and the user's visual range, thereby making the setting of the dimensions of the virtual display interface more rational and improving the user's viewing experience of the virtual display interface.

[0033] The technical solution of the present disclosure may be applied to an augmented reality scene, where augmented reality includes but is not limited to AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), etc. The following describes the technical solution of the present disclosure through several embodiments.

[0034] FIG. 1 is a schematic flowchart of a method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure. Referring to FIG. 1, the method for displaying a virtual display interface in an augmented reality space includes the following steps S11 to S13.

[0035] S11: Obtain map information of the real space using an image collection device.

[0036] Here, the image collection device includes, but is not limited to, radar device, device with imaging function, etc. Here, the radar device may be a laser radar, and the device with imaging function may be a camera, a video capture card, a scanner, etc.

[0037] The map information of the real space includes, but is not limited to, three-dimensional coordinate information of each object in the real space or relative position information of each object.

[0038] S12: An augmented reality space is generated by a rendering engine based on the map information of the real space.

[0039] Here, the rendering engine may be a 3D rendering engine such as Unity or UE (Unreal Engine).

[0040] Specifically, an augmented reality space is generated by a rendering engine based on the map information of the real space acquired in the above steps. The head-mounted device may be in the form of glasses, and the position of the head-mounted device in the SLAM (simultaneous localization and mapping) environment is used as the initial alignment of the human eye, and mapping is performed by a 3D engine such as Unity or UE, and the augmented reality space can be constructed by performing accurate conversion to the distance data in the environment.

[0041] S13: Determine a target position in the augmented reality space for a virtual display interface, and display the virtual display interface at the target position, and the dimensions of the virtual display interface are related to the target position where the virtual display interface is located and the user's visual range.

[0042] Determining the target position in the augmented reality space of the virtual display interface includes, but is not limited to, the following possible implementations.

[0043] Based on the attribute information of the virtual display interface, distance information between the virtual display interface and the initial position of the head-mounted device is determined, and based on the distance information, a target position of the virtual display interface in the augmented reality space is determined, and the virtual display interface is displayed at the target position.

[0044] Here, the attribute information of the virtual display interface may be the type of the virtual display interface. For example, the attribute information of the virtual display interface may be a virtual display screen of a movie theater, a virtual display screen of an office, a virtual display screen of a real-life map of a department store, a virtual display screen of a topographical model of a tourist attraction, etc. The distance information between the virtual display interface and the initial position of the head-mounted device may be determined based on historical experience. Taking Table 1 as an example, the relationship between the attribute information of the virtual display interface and the distance information between the virtual display interface and the initial position of the head-mounted device may be as shown in Table 1. [Table 1]

[0045] Illustratively, taking FIG. 2 as an example, when the attribute information of the virtual display interface is a virtual display screen of a movie theater, it determines that the distance information between the virtual display interface and the initial position of the head-mounted device is 3 meters, and determines a target position in the augmented reality space of the virtual display interface based on the distance information, and displays the virtual display interface at the target position.

[0046] Furthermore, the shape of the virtual display interface is described as a rectangle by way of example, but may be other shapes, and the present disclosure is not limited thereto. The horizontal dimension of the virtual display interface refers to the maximum length in the horizontal direction, for example, a rectangle refers to the length of a side in the horizontal direction, and the vertical dimension of the virtual display interface refers to the maximum length in the vertical direction, for example, a rectangle refers to the length of a side in the vertical direction.

[0047] The horizontal dimension is determined based on the distance information and a predetermined horizontal viewing angle, and the vertical dimension of the virtual display interface is determined based on the distance information and a predetermined vertical viewing angle.

[0048] Specifically, according to ergonomic calculations, the optimal horizontal visual range for both eyes when the human head is not rotated is 60°, and the vertical clear vision range is 25° above to 30° below. Using Figure 3 as an example, the optimal visual range for each distance d can be calculated based on the ergonomically most comfortable angle α, i.e., w = 2d tan(α / 2), to obtain the optimal visual range for the human eyes in the augmented reality space. Therefore, the preset horizontal visual angle α can be set to 60°, and the preset vertical visual angle α can be set to 55°.

[0049] For example, when the dimensions of the virtual display screen of a real-life map of a department store are set, the preset horizontal visible angle α is 60°, the preset vertical visible angle α is 55°, and when the distance d is 1 meter, the horizontal dimension of the virtual display screen of the real-life map of the department store is w=2tan30°≒1.15 meters, and the vertical dimension of the virtual display screen of the real-life map of the department store is w=2tan27.5°≒1.04 meters. Therefore, the visual clear view range at 1 meter is 11.5×1.04m 2 Using this data in the rendering engine, we can indicate the canvas for the optimal viewing range at 1 meter, and infer other positions based on this.

[0050] In a method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure, first, map information of the real space is obtained by an image capturing device, then, an augmented reality space is generated by a rendering engine based on the map information of the real space, and finally, a target position of the virtual display interface in the augmented reality space is determined, and the virtual display interface is displayed at the target position. Since the dimensions of the virtual display interface are related to the target position where the virtual display interface is located and the user's visual range, more reasonable dimensions of the virtual display interface can be determined based on the target position where the virtual display interface is located and the user's visual range, thereby solving the problem of users' poor viewing experience of the virtual display interface.

[0051] As one optional embodiment of the present disclosure, the following steps may be further performed before determining distance information between the virtual display interface and the initial position of the head-mounted device based on attribute information of the virtual display interface.

[0052] A call command for a virtual display interface is received, and attribute information of the virtual display interface is obtained based on the call command.

[0053] For example, the command to call the virtual display interface may be a command issued by the user through voice or through a key on the terminal device.

[0054] In some embodiments, a user may move in the augmented reality space, and the user may be far away from the virtual display interface or close to the virtual display interface. Therefore, in order to achieve a better viewing experience for the user, the present disclosure provides an implementation method for readjusting the position information of the virtual display interface by setting a reset command. The reset command may be triggered by an interaction device, for example, the reset command may be triggered by a preset key on a steering wheel or a preset key on a head-mounted device, or may be triggered by a key on a displayed virtual interaction interface, or may even be triggered by a voice command. The present disclosure is not limited thereto.

[0055] After receiving the reset command, the process returns to S11 and executes S11 to S13.

[0056] Specifically, each time the virtual display device receives a reset command, it returns to the process of acquiring map information of the real space using the image collecting device, acquires the map information of the real space using the image collecting device, and generates an augmented reality space using the rendering engine based on the map information of the real space, and finally determines a target position of the virtual display interface in the augmented reality space, and displays the virtual display interface at the target position. Here, for detailed implementation of each step, you may refer to the description of the embodiment shown in Figure 1, and the description will be omitted here. By adjusting the target position of the virtual display interface using the reset command, a better viewing effect can be achieved when the user views the virtual display interface.

[0057] The present disclosure further provides an implementation in which, upon detecting movement of a head-mounted device in the augmented reality space, dimensions of the virtual display interface are adjusted based on the displacement of the movement.

[0058] Specifically, when the head-mounted device moves in the augmented reality space in a direction approaching the virtual display interface, the dimensions of the virtual display interface are reduced.

[0059] When the head-mounted device is moved in the augmented reality space away from the virtual display interface, the virtual display interface is enlarged in size.

[0060] To avoid frequent adjustment of the dimensions of the virtual display interface, the dimensions of the display interface may be adjusted when the distance of movement in a preset direction is greater than a preset distance. For example, the preset distance may be set to 2 meters. Assuming the initial position is 3 meters, the initial dimensions of the virtual display interface are as shown in FIG. 4. When the head-mounted device moves 2.5 meters toward the virtual display interface, the dimensions of the virtual display interface after the reduction are specifically tangent to 30° in the horizontal direction and tangent to 27.5° in the vertical direction, as shown in FIG. 5. When the head-mounted device moves 2 meters away from the virtual display interface, the dimensions of the virtual display interface after the reduction are specifically 10×tangent to 30° and 10×tangent to 27.5° in the vertical direction, as shown in FIG. 6.

[0061] To avoid causing the user to feel dazzled or the like by adjusting the dimensions of the virtual display interface while the user is moving, the dimensions of the virtual display interface may be adjusted after detecting that the head-mounted device is stationary, and may not be adjusted while the head-mounted device is moving.

[0062] The head-mounted device used in the embodiments of the present disclosure is an augmented reality device based on 6dof (degree of freedom) technology. The 6dof augmented reality device may be glasses or other reasonable devices, and can detect not only changes in the viewing angle due to head rotation but also changes in up / down, front / back, left / right displacement due to body movement. Therefore, the embodiments of the present disclosure not only maximize the user's eye comfort, but also enable more comfortable direction changes and improve the user experience.

[0063] A method for displaying a virtual display interface in an augmented reality space according to an embodiment of the present disclosure includes first obtaining map information of the real space using an image capturing device, then generating an augmented reality space using a rendering engine based on the map information of the real space, and finally determining a target position of the virtual display interface in the augmented reality space and displaying the virtual display interface at the target position. Since the dimensions of the virtual display interface are related to the target position where the virtual display interface is located and the user's visual range, the dimensions of the virtual display interface can be determined based on the target position where the virtual display interface is located and the user's visual range, thereby solving the problem of users' poor viewing experience of the virtual display interface.

[0064] According to the same inventive concept, as an implementation of the above method, an embodiment of the present disclosure further provides an apparatus for displaying a virtual display interface in an augmented reality space, which corresponds to the above-mentioned method embodiment. For ease of reading, this embodiment will not describe the detailed contents of the above-mentioned method embodiment one by one. However, it should be made clear that the display device for a virtual display interface in an augmented reality space in this embodiment can correspondingly realize all the contents of the above-mentioned method embodiment.

[0065] An embodiment of the present disclosure provides an apparatus for displaying a virtual display interface in an augmented reality space. FIG. 7 is a schematic structural diagram of the apparatus for displaying a virtual display interface in an augmented reality space. As shown in FIG. 7, the apparatus 700 for displaying a virtual display interface in an augmented reality space includes: a map information acquisition unit 710 for acquiring map information of the real space by an image acquisition device; an augmented reality space generation unit 720 for generating an augmented reality space by a rendering engine based on the map information of the real space; a virtual display interface display unit 730 for determining a target position in the augmented reality space of a virtual display interface and displaying the virtual display interface at the target position, the dimensions of the virtual display interface being related to the target position at which the virtual display interface is located and the user's visual range.

[0066] As one alternative embodiment of the present disclosure, the virtual display interface display unit 730 is specifically used to determine distance information between the virtual display interface and the initial position of a head-mounted device based on attribute information of the virtual display interface, determine a target position of the virtual display interface in the augmented reality space based on the distance information, and display the virtual display interface at the target position.

[0067] As one alternative embodiment of the present disclosure, the device further includes a call command receiving unit for receiving a call command of a virtual display interface, and obtaining attribute information of the virtual display interface based on the call command.

[0068] As one alternative embodiment of the present disclosure, the device further includes a reset command receiving unit for receiving a reset command and returning to the process of acquiring map information of the real space by the image acquisition device to perform the acquisition process.

[0069] As one alternative embodiment of the present disclosure, the horizontal dimension of the virtual display interface is determined based on the distance information and a predetermined horizontal visible angle, and the vertical dimension of the virtual display interface is determined based on the distance information and a predetermined vertical visible angle.

[0070] As one optional embodiment of the present disclosure, the device further includes a virtual display interface dimension adjustment unit for adjusting dimensions of the virtual display interface based on a displacement of the movement when detecting a movement of the head-mounted device in the augmented reality space.

[0071] As one alternative embodiment of the present disclosure, the virtual display interface dimension adjustment unit is specifically used to reduce the dimension of the virtual display interface when the head-mounted device moves in a direction toward the virtual display interface in the augmented reality space, and to increase the dimension of the virtual display interface when the head-mounted device moves in a direction away from the virtual display interface in the augmented reality space.

[0072] The device for displaying a virtual display interface in an augmented reality space according to this embodiment can execute the method for displaying a virtual display interface in an augmented reality space according to the above-mentioned method embodiment, and the realization principle and technical effect thereof are similar, so the description will be omitted here.

[0073] According to the same inventive concept, an embodiment of the present disclosure further provides an electronic device. Figure 8 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. As shown in Figure 8, the electronic device according to this embodiment includes a memory 81 and a processor 82, the memory 81 is used to store a computer program, and the processor 82 is used to realize the method for displaying a virtual display interface in an augmented reality space according to the embodiment when executing the computer program.

[0074] According to the same inventive concept, an embodiment of the present disclosure further provides a non-transitory computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computing device, causes the computing device to realize the method for displaying a virtual display interface in an augmented reality space according to the above embodiment.

[0075] According to the same inventive concept, an embodiment of the present disclosure further provides a computer program product, which, when a program included in the computer program product is run by a computer, causes the computer to realize a method for displaying a virtual display interface in an augmented reality space according to the above embodiment.

[0076] According to the same inventive concept, an embodiment of the present disclosure further provides a computer program, which, when executed by a processor, realizes the method for displaying a virtual display interface in an augmented reality space according to the above embodiment.

[0077] As will be appreciated by those skilled in the art, embodiments of the present disclosure may be provided as a method, a system, or a computer program product. As such, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. The present disclosure may also take the form of a computer program product embodied on one or more computer-usable storage medium(s) containing computer-usable program code.

[0078] The processor may be a Central Processing Unit (CPU), other general-purpose processor, Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc.

[0079] Memory may include forms of non-permanent memory, random access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM), in a computer-readable medium. Memory is an example of a computer-readable medium.

[0080] Computer-readable media include permanent and non-permanent, removable and non-removable storage media. Storage media may implement any method or technology for storing information, and information may be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, read-only optical disks (CD-ROMs), digital versatile optical disks (DVDs) or other optical storage, magnetic cartridges, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that may be used to store information accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

[0081] Finally, it should be noted that the above embodiments are only used to explain the technical solutions of the present disclosure, and are not intended to limit the same. Although the present disclosure has been described in detail with reference to the above embodiments, those skilled in the art can still understand that the technical solutions described in the above embodiments may be modified or equivalently substituted for some or all of the technical features thereof, but such modifications or substitutions will not cause the essence of the corresponding technical solutions to depart from the scope of the technical solutions of the embodiments of the present disclosure.

Claims

1. 1. A method for displaying a virtual display interface in an augmented reality space, the method comprising: acquiring map information of the real space by an image collection device; generating an augmented reality space by a rendering engine based on map information of the real space; determining a target position in the augmented reality space for the virtual display interface and displaying the virtual display interface at the target position, wherein dimensions of the virtual display interface are related to the target position at which the virtual display interface is located and a user's visual range; Including, method.

2. determining a target position in the augmented reality space for the virtual display interface and displaying the virtual display interface at the target position, The method of claim 1, further comprising the steps of: determining distance information between the virtual display interface and an initial position of a head-mounted device based on attribute information of the virtual display interface; determining a target position in the augmented reality space for the virtual display interface based on the distance information; and displaying the virtual display interface at the target position.

3. Before determining distance information between the virtual display interface and an initial position of a head-mounted device based on attribute information of the virtual display interface, the method includes: The method of claim 2 , further comprising: receiving a call command for a virtual display interface; and obtaining attribute information for the virtual display interface based on the call command.

4. The method comprises: The method according to claim 1 , further comprising the step of returning to the step of acquiring map information of the real space by the image capturing device when a reset command is received.

5. 3. The method of claim 2, wherein a horizontal dimension of the virtual display interface is determined based on the distance information and a preset horizontal view angle, and a vertical dimension of the virtual display interface is determined based on the distance information and a preset vertical view angle.

6. The method comprises: The method of claim 1 , further comprising the step of, when detecting a movement of a head-mounted device in the augmented reality space, adjusting a dimension of the virtual display interface based on a displacement of the movement.

7. When detecting a movement of a head-mounted device in the augmented reality space, adjusting a dimension of the virtual display interface based on a displacement of the movement includes: reducing a dimension of the virtual display interface when the head-mounted device moves in the augmented reality space toward the virtual display interface; and increasing a dimension of the virtual display interface when the head-mounted device moves in the augmented reality space away from the virtual display interface.

8. 1. An apparatus for displaying a virtual display interface in an augmented reality space, the apparatus comprising: a map information acquisition unit for acquiring map information of the real space by an image collection device; an augmented reality space generation unit for generating an augmented reality space by a rendering engine based on map information of the real space; a virtual display interface display unit for determining a target position in the augmented reality space for the virtual display interface and displaying the virtual display interface at the target position, wherein dimensions of the virtual display interface are related to the target position at which the virtual display interface is located and a visual range of a user; Including, Device.

9. 8. An electronic device comprising a memory and a processor, the memory being used to store a computer program, and the processor being used to cause the electronic device to implement the method of any one of claims 1 to 7 when executing the computer program.

10. 8. A non-transitory computer-readable storage medium having a computer program stored therein, the computer program, when executed by a computing device, causing the computing device to implement the method of any one of claims 1 to 7.

11. 8. An apparatus for displaying a virtual display interface in an augmented reality space, the apparatus comprising a memory and a processor, the memory being adapted to store a computer program that, when executed by the processor, causes the apparatus to perform the method of any one of claims 1 to 7.

12. A computer program which, when executed by a processor, implements the method of any one of claims 1 to 7.

Citation Information

Patent Citations

  • Virtual space display device, and method and program for virtual space display

    JP2016057947A

  • System and method for controlling system

    JP2016224810A

  • Display method and display system

    JP2022114697A

  • Coordinating cursor movement between a physical surface and a virtual surface

    US20220229534A1