Data display method and apparatus, augmented reality device, and storage medium
Patent Information
- Application Number
- PCT/CN2026/084220
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-03-27
- Filing Date
- 2026-03-18
- Publication Date
- 2026-10-01
Smart Images
Figure CN2026084220_01102026_PF_FP_ABST
Abstract
Description
Data display methods, apparatus, augmented reality devices and storage media
[0001] This application claims priority to Chinese Patent Application No. 2025103773052, filed on March 27, 2025, entitled “Data Display Method, Apparatus, Augmented Reality Device and Storage Medium”, the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of display technology, and in particular to a data display method, apparatus, augmented reality device, and storage medium. Background Technology
[0003] With the rapid development of Augmented Reality (AR) technology, AR devices, as a new generation of smart terminals, are gradually becoming an important carrier for integrating virtual information with real-world scenes. However, AR navigation in related technologies is mostly based on two-dimensional image recognition, and the displayed map data is two-dimensional. This means that the map data display effect during AR navigation is not significantly different from that of commonly used handheld smart terminals, such as mobile phones. Furthermore, since AR devices, such as AR glasses, are worn on the user's head, activating map data display and navigation functions is less convenient compared to handheld smart terminals. Therefore, improving the map data display effect of AR devices and simplifying the user's process of obtaining location information through AR devices are urgent problems to be solved. Summary of the Invention
[0004] This application provides a data display method, apparatus, augmented reality device, and storage medium, aiming to improve the display effect of map data on augmented reality devices and simplify the user's operation process for obtaining location information through augmented reality devices.
[0005] In a first aspect, embodiments of this application provide a data display method, the method being applied to an augmented reality device, the method comprising:
[0006] When the augmented reality device is in wearable mode and the target application is launched, obtain the current location information of the augmented reality device;
[0007] Obtain the 3D map data corresponding to the location information;
[0008] The 3D map data is displayed within the field of view of the augmented reality device.
[0009] Secondly, embodiments of this application provide a data display device, which is applied to an augmented reality device, and the device includes:
[0010] The location information acquisition module is used to acquire the current location information of the augmented reality device when the augmented reality device is in wearing mode and the target application is launched;
[0011] The map data acquisition module is used to acquire the three-dimensional map data corresponding to the location information;
[0012] The map data display module is used to display the three-dimensional map data within the field of view of the augmented reality device.
[0013] Thirdly, embodiments of the invention also provide an augmented reality device, the augmented reality device including a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for implementing communication between the processor and the memory, wherein when the computer program is executed by the processor, it implements the data display method as described in the first aspect.
[0014] Fourthly, embodiments of this application also provide a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement the data display method as described in the first aspect.
[0015] This application provides a data display method, apparatus, augmented reality device, and storage medium. In this embodiment, when the augmented reality device is in wearable mode and a target application is launched, the current location information of the augmented reality device is obtained, and then the corresponding 3D map data is obtained and displayed within the field of view of the augmented reality device. This achieves automatic acquisition of location information by the augmented reality device when it is in wearable mode and a target application is launched, without requiring the user to manually input their current location or a command to obtain location information. Furthermore, even if the target application is not a location-obtaining application, the user does not need to manually launch such an application, thus simplifying the user's operation process for obtaining location information through the augmented reality device. After obtaining the location information, the corresponding 3D map data is obtained and displayed within the field of view for easy viewing by the user. Since the map data displayed by the augmented reality device in this embodiment is three-dimensional instead of two-dimensional, the display effect of the map data is improved. At this time, the user wearing the augmented reality device can better understand the environment of the current location through the three-dimensional map data. Furthermore, in this embodiment, the three-dimensional map data is only obtained after the target application is launched when the augmented reality device is in wearing mode. That is, when the augmented reality device is not in wearing mode, even if the target application is launched, the three-dimensional map data will not be obtained, thereby reducing the power consumption of the augmented reality device. Attached Figure Description
[0016] Figure 1 is a schematic block diagram of an augmented reality device provided in an embodiment of this application;
[0017] Figure 2 is a flowchart illustrating a data display method provided in an embodiment of this application;
[0018] Figure 3 is a flowchart illustrating another data display method provided in an embodiment of this application;
[0019] Figure 4 is a schematic block diagram of a data display device provided in an embodiment of this application. Embodiments of the present invention
[0020] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0021] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.
[0022] This application provides a data display method, apparatus, augmented reality device, and storage medium. The technical solutions provided in this application are as follows.
[0023] In this embodiment of the application, the augmented reality device can be AR (Augmented Reality) glasses, AR helmets, etc.
[0024] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.
[0025] Figure 1 is a schematic block diagram of an augmented reality device provided in an embodiment of this application.
[0026] As shown in Figure 1, the augmented reality device 100 includes a processor 101 and a memory 102, which are connected via a bus 103, such as an I2C (Inter-integrated Circuit) bus.
[0027] Specifically, processor 101 provides computing and control capabilities to support the operation of the entire augmented reality device 100. Processor 101 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.
[0028] Specifically, the memory 102 can be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a portable hard drive, etc.
[0029] Those skilled in the art will understand that the structure shown in FIG1 is merely a block diagram of a portion of the structure related to the embodiments of this application, and does not constitute a limitation on the augmented reality device to which the embodiments of this application are applied. A specific augmented reality device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0030] The processor 101 is used to run a computer program stored in the memory 102. The computer program can be set in the augmented reality device, and the augmented reality device implements any of the data display methods provided in the embodiments of this application when executing the computer program.
[0031] In one embodiment, the processor is configured to run a computer program stored in memory, and to perform the following steps when executing the computer program:
[0032] When the augmented reality device is in wearable mode and the target application is launched, obtain the current location information of the augmented reality device;
[0033] Obtain the 3D map data corresponding to the location information;
[0034] The 3D map data is displayed within the field of view of the augmented reality device.
[0035] In one embodiment, after the step of displaying the three-dimensional map data within the field of view of the augmented reality device, the processor, while executing the computer program, is further configured to perform the following steps:
[0036] When the range of change in the user's gaze after the change is detected to be greater than a preset range, the center point of the user's gaze after the change is determined.
[0037] The 3D map data displayed within the field of view is updated based on the center point of the line of sight.
[0038] In one embodiment, after the step of displaying the three-dimensional map data within the field of view of the augmented reality device, the processor, while executing the computer program, is further configured to perform the following steps:
[0039] When a change in altitude of the location information is detected, the three-dimensional map data displayed within the field of view is updated according to the changed altitude.
[0040] In one embodiment, after the step of displaying the three-dimensional map data within the field of view of the augmented reality device, the processor, while executing the computer program, is further configured to perform the following steps:
[0041] When the scene where the augmented reality device is located is determined to change from an indoor scene to an outdoor scene based on the location information and / or the 3D map data, the augmented reality device is controlled to switch from a 3D navigation mode to a 2D navigation mode, wherein the map data corresponding to the 3D navigation mode is 3D map data and the map data corresponding to the 2D navigation mode is 2D map data.
[0042] In one embodiment, after the step of displaying the three-dimensional map data within the field of view of the augmented reality device, the processor, while executing the computer program, is further configured to perform the following steps:
[0043] Once a point of interest (POI) is determined within the field of view, virtual information related to the POI is displayed within the field of view.
[0044] In one embodiment, the step of displaying the three-dimensional map data within the field of view of the augmented reality device includes:
[0045] Determine the virtual identifier corresponding to the target information in the three-dimensional map data, and display the three-dimensional map data, the target information, and the virtual identifier within the field of view of the augmented reality device;
[0046] The virtual identifier is displayed in association with the corresponding target information within the field of view.
[0047] In one embodiment, the step of displaying the three-dimensional map data within the field of view of the augmented reality device further includes:
[0048] Determine the distance between the object corresponding to each target information in the three-dimensional map data and the location of the augmented reality device;
[0049] If the distance between the object corresponding to the target information and the location of the augmented reality device is less than or equal to a preset distance, then the display parameter of the target information within the field of view is determined to be the first parameter;
[0050] If the distance between the object corresponding to the target information and the location of the augmented reality device is greater than a preset distance, then the display parameter of the target information within the field of view is determined to be the second parameter;
[0051] The target information is controlled to be displayed within the field of view according to the determined display parameters.
[0052] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the augmented reality device described above can be referred to the corresponding process in the following data display method embodiments, and will not be repeated here.
[0053] The data display method provided by the embodiments of this application will be described in detail below with reference to the augmented reality device shown in Figure 1. It should be noted that the augmented reality device in Figure 1 is only used to explain the data display method provided by the embodiments of this application, but does not constitute a limitation on the application scenarios of the data display method provided by the embodiments of this application.
[0054] Please refer to Figure 2, which is a flowchart illustrating a data display method provided in an embodiment of this application.
[0055] As shown in Figure 2, this data display method is applied to an augmented reality device. The data display method includes steps S101, S102 and S103.
[0056] Step S101: When the augmented reality device is in wearable mode and the target application is launched, obtain the current location information of the augmented reality device.
[0057] When the augmented reality (AR) device is in wearable mode, it detects whether a target application has been launched. The target application is a pre-set specific application; its launch indicates that the user needs to view map data. The target application can be set according to specific needs, such as a food delivery app or a navigation app. There can be one or more target applications. The AR device uses an infrared sensor or a capacitive proximity sensor to detect the distance between itself and the user's face. When the distance is less than a set distance threshold, it indicates that the AR device is in wearable mode; when the distance is greater than or equal to the set distance threshold, it indicates that the AR device is not in wearable mode. The set distance threshold can be 5 mm, 7 mm, etc.
[0058] When the augmented reality device is in wearable mode and the target application is launched, the augmented reality device acquires its current location information. In this embodiment, the location information can be the latitude and longitude of the augmented reality device's current location. In other embodiments, the location information of the augmented reality device's current location can also be represented in other forms besides latitude and longitude.
[0059] When the augmented reality device (AR) is not in wearable mode and / or the target application is not running, the AR does not acquire its current location information. This allows the AR to automatically obtain location information in specific scenarios without requiring the user to manually input their current location or provide a command to retrieve it. Furthermore, if the target application is not a location-retrieval application, the user does not need to manually launch it, thus simplifying the process of obtaining location information through the AR device. It is understood that the application retrieving location information is a map application, such as Amap or Baidu Maps.
[0060] Step S102: Obtain the three-dimensional map data corresponding to the location information.
[0061] When an augmented reality device acquires location information, it acquires the corresponding 3D map data. The 3D map data includes at least one of the following: building images, street images, shop images, floor information, etc. at the current location.
[0062] In one embodiment, to save storage space for the augmented reality device (ARD), the 3D map data can be stored on a cloud server. After acquiring location information, the ARD sends this information to the cloud server. Upon receiving the location information, the cloud server retrieves the corresponding 3D map data and sends it to the ARD. Specifically, when the cloud server retrieves the 3D map data corresponding to the location information, it also retrieves 3D map data within a certain distance range from the ARD's location, thus enabling the ARD to acquire 3D map data within a specific distance range.
[0063] Step S103: Display the three-dimensional map data within the field of view of the augmented reality device.
[0064] Once the augmented reality device acquires 3D map data, it displays the 3D map data within its field of view (FOV). The field of view (FOV) refers to the visible angle within which the augmented reality device can present virtual information to the user, and is usually measured as the angle between the horizontal and vertical directions (unit: degrees) or the diagonal angle.
[0065] In one embodiment, in order to allow users to see the 3D map data more clearly, the augmented reality device can highlight the 3D map data within the field of view after obtaining it.
[0066] In another embodiment, in order to avoid the impact of displaying 3D map data on the user's view of the real scene when wearing augmented reality devices, the augmented reality devices can display the 3D map data in a non-central area of the field of view.
[0067] This embodiment obtains the current location information of the augmented reality device (AR device) when it is in wearable mode and the target application is launched, and then retrieves the corresponding 3D map data and displays the 3D map data within the AR device's field of view. This achieves automatic location information acquisition by the AR device when it is in wearable mode and the target application is launched, without requiring the user to manually input their current location or enter a location information acquisition command. Furthermore, even if the target application is not a location-requiring application, the user does not need to manually launch a location-requiring application, thus simplifying the user's operation process for obtaining location information through the AR device. After obtaining the location information, the corresponding 3D map data is retrieved and displayed within the field of view for easy viewing by the user. Since the map data displayed by the augmented reality device in this embodiment is three-dimensional instead of two-dimensional, the display effect of the map data is improved. At this time, the user wearing the augmented reality device can better understand the environment of the current location through the three-dimensional map data. Furthermore, in this embodiment, the three-dimensional map data will only be obtained after the target application is launched when the augmented reality device is in wearing mode. That is, when the augmented reality device is not in wearing mode, even if the target application is launched, the three-dimensional map data will not be obtained, thereby reducing the power consumption of the augmented reality device.
[0068] It is understood that, in conjunction with augmented reality technology, when a user wears an augmented reality device, the user does not need to look down at a handheld terminal device (mobile phone, watch, etc.), but can directly see three-dimensional map data in front of their eyes based on the information displayed by the augmented reality device, providing a more convenient and efficient immersive experience for scenarios such as shopping and travel.
[0069] In one embodiment, step S103 includes: determining a virtual identifier corresponding to the target information in the three-dimensional map data, and displaying the three-dimensional map data, the target information, and the virtual identifier within the field of view of the augmented reality device; wherein the virtual identifier is displayed in association with the corresponding target information within the field of view.
[0070] In one embodiment, after obtaining 3D map data, the augmented reality device determines target information within the 3D map data. This target information can be set according to specific needs, such as at least one of the following: building images, street images, shop images, floor information, etc., representing the current location of the augmented reality device. It is understood that the target information is at least a portion of the 3D map data.
[0071] Once the augmented reality (AR) device identifies the target information, it acquires the corresponding virtual identifier and displays the 3D map data, target information, and virtual identifier within its field of view. The virtual identifier is displayed in association with the corresponding target information within the field of view. Different target information corresponds to different virtual identifiers. For example, when the target information is a store image, the corresponding virtual identifier is the store name; when the target information is a floor, the corresponding virtual identifier is the floor number. The display method of the virtual identifier and target information also differs depending on the target information. For instance, when the target information is a store image, the corresponding virtual identifier can be displayed within the store image; while when the target information is floor information, the corresponding virtual identifier can be displayed at a specific location within the field of view, such as the upper right or upper left corner.
[0072] In this embodiment, the augmented reality device displays target information and corresponding virtual icons in the 3D map data within its field of view. This allows users to understand the specific environmental information of their current location through the virtual icons, such as the floor they are on and the name of the store they are in. This helps prevent users wearing augmented reality devices from getting lost and improves the navigation performance of the augmented reality device.
[0073] In one embodiment, step S103 further includes:
[0074] Step a1: Determine the distance between the object corresponding to each target information in the 3D map data and the location of the augmented reality device;
[0075] Step a2: If the distance between the object corresponding to the target information and the location of the augmented reality device is less than or equal to a preset distance, then the display parameter of the target information within the field of view is determined to be the first parameter.
[0076] Step a3: If the distance between the object corresponding to the target information and the location of the augmented reality device is greater than a preset distance, then the display parameter of the target information within the field of view is determined to be the second parameter.
[0077] Step a4: Control the target information to be displayed within the field of view according to the determined display parameters.
[0078] In one embodiment, after the augmented reality device obtains 3D map data, it determines the distance between the object corresponding to each target information in the 3D map data and its current location. This distance is understood to be the distance between the object corresponding to the target information and the augmented reality device in the real world. For example, if the object corresponding to the target information is a shop, the distance is the distance between the shop and the augmented reality device. After determining the distance, the augmented reality device judges whether the distance is less than or equal to a preset distance. The preset distance can be set according to specific needs; this embodiment does not impose specific limitations on the size of the preset distance. When the distance is determined to be less than or equal to the preset distance, the augmented reality device determines the display parameters of the corresponding target information within the field of view as a first parameter; when the distance is determined to be greater than the preset distance, the augmented reality device determines the display parameters of the corresponding target information within the field of view as a second parameter. The display parameters include at least one of the following: display area, display scale, display transparency, and display distance. The visibility of the first parameter is greater than the visibility of the second parameter. For example, when the first parameter is the first display area and the second parameter is the second display area, the first display area is larger than the second display area; when the first parameter is the first transparency and the second parameter is the second transparency, the first transparency is smaller than the second transparency, that is, the second transparency is higher; when the first parameter is the first display ratio and the second parameter is the second display ratio, the first display ratio is larger than the second display ratio; the display distance is the position of the center point corresponding to the target information from the center point of the field of view. When the first parameter is the first display distance and the second parameter is the second display distance, the first display distance is smaller than the second display distance.
[0079] Once the augmented reality (AR) device determines the display parameters corresponding to each target information, it displays the corresponding target information within the field of view according to the determined display parameters, thereby displaying the 3D map data within the field of view. It can be understood that when the displayed target information constitutes complete 3D map data, the AR device's display of the corresponding target information within the field of view according to the determined display parameters indicates that the AR device has already displayed the 3D map data within the field of view. However, when the displayed target information is only partial 3D map data, the AR device, while displaying the corresponding target information within the field of view according to the determined display parameters, also needs to display the other 3D map data besides the target information simultaneously within the field of view to achieve the complete display of 3D map data.
[0080] This embodiment determines the display parameters of target information based on the distance between the object corresponding to each target information in the 3D map data and the current location information of the augmented reality device, and then controls the display of target information according to the display parameters, thereby improving the intelligence of the display of 3D map data in the augmented reality device.
[0081] In one embodiment, a user wearing an augmented reality device can trigger zoom-in or zoom-out commands as needed to enlarge or reduce the target information in the 3D map data, thereby achieving intelligent control of the 3D map data. This embodiment does not impose specific restrictions on the triggering methods for zoom-in and zoom-out commands; they can be triggered via eye tracking, manual operation, or a ring connected to the augmented reality device.
[0082] Referring to Figure 3, in one embodiment, the method further includes:
[0083] Step S104: When the range of change in the user's gaze after wearing the augmented reality device is detected to be greater than a preset range, determine the center point of the user's gaze after the change.
[0084] Step S105: Update the three-dimensional map data displayed within the field of view based on the center point of the line of sight.
[0085] In one embodiment, when the augmented reality device displays 3D map data within its field of view, the device detects the user's gaze direction and determines whether the range of gaze change exceeds a preset range. The size of the preset range can be set according to specific needs; this embodiment does not impose a specific limitation on the size of the preset range. It is understood that the augmented reality device can detect the user's gaze direction using eye-tracking technology, and the range of gaze change can be determined by the detected gaze direction at different time points. In this embodiment, the range of gaze change can be represented by angles. When the augmented reality device determines that the user's range of gaze change exceeds the preset range, it determines the center point of the user's changed gaze and updates the 3D map data displayed within the field of view based on the center point. When updating the 3D map data displayed within the field of view, the augmented reality device can also obtain corresponding 3D map data from a cloud server. However, when obtaining 3D map data from the cloud server, in addition to the user's current location information, direction information is also required.
[0086] Understandably, when the user's line of sight changes beyond a preset range, it indicates that at least some of the objects corresponding to the 3D map data previously displayed in the augmented reality device's field of view are no longer within the user's line of sight, while objects previously outside the user's field of view have now entered the user's field of view. Therefore, it is necessary to update the 3D map data displayed within the field of view to improve the adaptability of the 3D map data displayed by the augmented reality device to the user's environment. When the augmented reality device determines that the user's line of sight changes is less than or equal to the preset range, the augmented reality device may not update the 3D map data displayed within the field of view.
[0087] This embodiment determines the center point of the user's changed gaze when the range of the user's gaze changes beyond a preset range, and updates the 3D map data displayed within the field of view based on the center point of the gaze. This enables the augmented reality device to update the 3D map data displayed within its field of view according to the change in the user's gaze, even when the user's location information remains unchanged but the direction information changes. This improves the adaptability of the 3D map data displayed by the augmented reality device to the user's environment.
[0088] In one embodiment, the method further includes:
[0089] Step b: After detecting a change in the altitude of the location information, update the 3D map data displayed within the field of view according to the changed altitude.
[0090] In one embodiment, the location information includes altitude. When the augmented reality device displays 3D map data within its field of view based on its current location information, the augmented reality device detects whether the altitude in its location information has changed. Altitude changes include both increases and decreases in altitude. It is understood that when a user wearing the augmented reality device is indoors, i.e., when the augmented reality device is in an indoor scene, a change in altitude may indicate a change in the user's floor level. Even if the user's location information has not changed, the scene the user sees has changed, therefore, the 3D map data displayed within the augmented reality device's field of view needs to be updated. The augmented reality device can be equipped with a sensor that has altitude and / or detection functions to detect changes in altitude; details can be found in the description of related technologies and will not be repeated here. Alternatively, the augmented reality device can identify the user's floor level based on multi-sensor fusion data and environmental features to determine whether the altitude in the location information has changed. Identifying the user's floor level based on multi-sensor fusion data and environmental features can also be found in the description of related technologies and will not be repeated here. For example, when a user takes an elevator or escalator, the augmented reality device can identify that a floor has been switched based on multi-sensor fusion data and environmental features.
[0091] When the augmented reality device detects a change in altitude at its current location, it updates the 3D map data displayed within its field of view based on the changed altitude. Specifically, when acquiring the 3D map data corresponding to the changed altitude, the augmented reality device needs to obtain the corresponding 3D map data based on both latitude and longitude.
[0092] In another embodiment, to ensure accurate identification of changes in the user's floor level, the augmented reality device updates the displayed 3D map data within the field of view only when it detects an elevation change greater than a preset height. If the detected elevation change is less than or equal to the preset height, the device does not update the displayed 3D map data. The preset height can be set to 2 meters, 2.5 meters, etc.
[0093] This embodiment improves the intelligence of 3D map data display by updating the displayed 3D map data within the field of view based on the altitude change of the augmented reality device's current location information after detecting the change in altitude. This allows the augmented reality device to update the displayed 3D map data within the field of view according to the change in altitude (change in the user's floor) in indoor scenes.
[0094] In one embodiment, the method further includes:
[0095] Step c: After determining that the scene where the augmented reality device is located has changed from an indoor scene to an outdoor scene based on the location information and / or the 3D map data, control the augmented reality device to switch from a 3D navigation mode to a 2D navigation mode, wherein the map data corresponding to the 3D navigation mode is 3D map data, and the map data corresponding to the 2D navigation mode is 2D map data.
[0096] In one embodiment, when the augmented reality device determines that its scene has changed from an indoor scene to an outdoor scene based on its location information and / or 3D map data, the augmented reality device controls its navigation mode to switch from a 3D navigation mode to a 2D navigation mode. The map data corresponding to the 3D navigation mode is 3D map data, and the map data corresponding to the 2D navigation mode is 2D map data. It is understood that the power consumption required for the augmented reality device to display 3D map data is greater than the power consumption required to display 2D map data.
[0097] In this embodiment, when the user moves from indoors to outdoors, the augmented reality device switches the navigation mode from 3D navigation mode to 2D navigation mode. It is understood that the indoor environment is more complex than the outdoor environment. Therefore, the augmented reality device displays 3D map data in indoor scenes and 2D map data in outdoor scenes, which reduces the power consumption of the augmented reality device and improves its battery life.
[0098] In one embodiment, if the augmented reality device receives a route navigation command, it determines a navigation route based on the command and displays the determined route within its field of view. The route navigation command can be triggered by the user's eye-tracking technology capturing their gaze, or by a specific gesture. This embodiment does not impose specific limitations on the triggering method. The route navigation command includes a start point and an end point. The start point may or may not be the current location of the augmented reality device. The navigation route determined by the augmented reality device based on the route navigation command is the optimal route from the start point to the end point. This optimal route can be the shortest distance or the most unobstructed route. In one embodiment, when displaying the navigation route, the augmented reality device can display it within the field of view using virtual arrows or path lines, thereby improving the visibility of the navigation route. In another embodiment, if the augmented reality device is in an indoor scene, it can provide dynamic navigation information based on its current location, such as "turn left in 10 meters" or "take the escalator on the right to the third floor." When a user goes in the wrong direction, the augmented reality device will re-determine the navigation route based on the user's current location information, thereby improving the accuracy of the navigation route and allowing the user to reach the destination by following the new navigation route.
[0099] In one embodiment, the method further includes:
[0100] Step d: After determining the point of interest (POI) within the field of view, display virtual information related to the POI within the field of view.
[0101] In one embodiment, the augmented reality device can also display virtual information related to POIs (Points of Interest). The augmented reality device can determine the POI within its field of view using a point of interest confirmation command, and then display the virtual information related to that POI within the field of view. The point of interest confirmation command can be triggered by the user's gaze captured through eye-tracking technology, or by the user through a specific gesture; this embodiment does not impose specific limitations on the triggering method of the point of interest confirmation command. The virtual information related to the POI can include the store name, store opening hours, current foot traffic, store promotional information, elevator location information, etc. For example, when a user looks at a store, a floating information box will pop up within the augmented reality device's field of view, displaying the store name, store opening hours, current foot traffic, store promotional information, etc. If the user needs to find facilities such as restrooms, elevators, or parking lots, the augmented reality device can also intelligently recommend the nearest option and provide detailed navigation routes; in densely populated areas, the augmented reality device can output prompts within its field of view, suggesting available detour routes to help users avoid congested routes and improve travel efficiency.
[0102] This embodiment displays virtual information related to the Point of Interest (POI) within the field of view of the augmented reality device after determining the POI, making it easier for users to quickly learn about relevant information of interest and improving the accuracy of information recommendations from the augmented reality device.
[0103] Please refer to Figure 4, which is a schematic block diagram of a data display device provided in an embodiment of this application.
[0104] As shown in Figure 4, the data display device 400 is applied to an augmented reality device, and the data display device 400 includes:
[0105] The location information acquisition module 410 is used to acquire the current location information of the augmented reality device when the augmented reality device is in wearing mode and the target application is launched;
[0106] Map data acquisition module 420 is used to acquire three-dimensional map data corresponding to the location information;
[0107] The map data display module 430 is used to display the three-dimensional map data within the field of view of the augmented reality device.
[0108] In one embodiment, the data display device 400 further includes:
[0109] The gaze center point determination module is used to determine the gaze center point of the user after the change when the range of gaze change of the user wearing the augmented reality device is detected to be greater than a preset range.
[0110] The first map data update module is used to update the three-dimensional map data displayed within the field of view based on the center point of the line of sight.
[0111] In one embodiment, the data display device 400 further includes:
[0112] The second map data update module is used to update the three-dimensional map data displayed in the field of view according to the changed altitude after detecting a change in the altitude of the location information.
[0113] In one embodiment, the data display device 400 further includes:
[0114] The mode control module is used to control the augmented reality device to switch from a three-dimensional navigation mode to a two-dimensional navigation mode when the scene where the augmented reality device is located is determined to change from an indoor scene to an outdoor scene based on the location information and / or the three-dimensional map data. The map data corresponding to the three-dimensional navigation mode is three-dimensional map data, and the map data corresponding to the two-dimensional navigation mode is two-dimensional map data.
[0115] In one embodiment, the data display device 400 further includes:
[0116] The virtual information display module is used to display virtual information related to a point of interest (POI) within the field of view after a POI is determined.
[0117] In one embodiment, the map data display module 430 is further configured to determine the virtual identifier corresponding to the target information in the three-dimensional map data, and display the three-dimensional map data, the target information, and the virtual identifier within the field of view of the augmented reality device; wherein the virtual identifier is displayed in association with the corresponding target information within the field of view.
[0118] In one embodiment, the map data display module 430 includes:
[0119] A distance determination unit is used to determine the distance between the object corresponding to each target information in the three-dimensional map data and the location of the augmented reality device.
[0120] The parameter determination unit is configured to determine the display parameters of the target information within the field of view as a first parameter if the distance between the object corresponding to the target information and the location of the augmented reality device is less than or equal to a preset distance; and to determine the display parameters of the target information within the field of view as a second parameter if the distance between the object corresponding to the target information and the location of the augmented reality device is greater than the preset distance.
[0121] The parameter display unit is used to control the target information to be displayed within the field of view according to the determined display parameters.
[0122] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the data display device described above can be referred to the corresponding process in the aforementioned data display method embodiments, and will not be repeated here.
[0123] This application also provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement any of the data display methods provided in the specification of this application.
[0124] The storage medium can be the internal storage unit of the augmented reality device described in the foregoing embodiments, such as the hard drive or memory of the augmented reality device. Alternatively, the storage medium can be an external storage device of the augmented reality device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card.
[0125] Those skilled in the art will understand that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware embodiments, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.
[0126] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The above descriptions are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A data display method, wherein, The method is applied to an augmented reality device, and the method comprises: When the augmented reality device is in a wearing mode and a target application is started, obtaining position information in which the augmented reality device is currently located; Obtaining three-dimensional map data corresponding to the position information; Displaying the three-dimensional map data in a field of view angle of the augmented reality device.
2. The data display method according to claim 1, wherein After the step of displaying the three-dimensional map data in the field of view angle of the augmented reality device, the method further comprises: When it is detected that a user's line-of-sight range of wearing the augmented reality device is greater than a preset range, determining a line-of-sight center point of the user after the change; Updating the three-dimensional map data displayed in the field of view angle according to the line-of-sight center point.
3. The data display method of claim 1, wherein, After the step of displaying the three-dimensional map data in the field of view angle of the enhanced reality device, the method further comprises: When it is detected that the altitude of the position information changes, updating the three-dimensional map data displayed in the field of view angle according to the changed altitude.
4. The data display method of claim 1, wherein, After the step of displaying the three-dimensional map data in the field of view angle of the device, the method further comprises: When it is determined that a scene in which the augmented reality device is located is switched from an indoor scene to an outdoor scene according to the position information and / or the three-dimensional map data, controlling the augmented reality device to switch from a three-dimensional navigation mode to a two-dimensional navigation mode, wherein the three-dimensional navigation mode corresponds to three-dimensional map data, and the two-dimensional navigation mode corresponds to two-dimensional map data.
5. The data display method of claim 1, wherein, After the step of displaying the three-dimensional map data in the field of view angle of the data display device, the method further comprises: When a point of interest (POI) in the field of view angle is determined, displaying virtual information related to the POI in the field of view angle.
6. The data display method of claim 1, wherein, The step of displaying the three-dimensional map data in the field of view angle of the augmented reality device comprises: Determining a virtual identifier corresponding to target information in the three-dimensional map data, and displaying the three-dimensional map data, the target information and the virtual identifier in the field of view angle of the augmented reality device; The virtual identifier is displayed in the field of view angle in association with the corresponding target information.
7. The data display method of claim 1, wherein, The step of displaying the three-dimensional map data in the field of view angle of the augmented realty device further comprises: Determining distances between objects corresponding to each target information in the three-dimensional map data and a location of the augmented reality device; If the distance between the object corresponding to the target information and the location of the augmented reality device is less than or equal to a preset distance, determining that a display parameter of the target information in the field of view angle is a first parameter; If the distance between the object corresponding to the target information and the location of the augmented reality is greater than the preset distance, determining that a display parameter of the target information in the field of view angle is the second parameter; Controlling the target information to be displayed in the field of view angle according to the determined display parameter.
8. A data display device, wherein, The data display device is applied to an augmented reality device, and the data display device comprises: The position information acquisition module is configured to acquire position information of the augmented reality device when the augmented reality device is in a wearing mode and a target application is started. The map data acquisition module is configured to acquire three-dimensional map data corresponding to the position information. The map data display module is configured to display the three-dimensional map data within a field of view angle of the augmented reality device.
9. An augmented reality device, wherein, The augmented reality device comprises a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for connecting and communicating between the processor and the memory, wherein the computer program is executed by the processor to implement the following steps: acquire position information of the augmented reality device when the augmented reality device is in a wearing mode and a starting target application; acquire three-dimensional map data corresponding to the position information; display the three-dimensional map data within a field of view angle of the augmented reality device.
10. The augmented reality device of claim 9, wherein, After the step of displaying the three-dimensional map data within the field of view angle of the augmented reality device, the method further comprises: determine a user's changed line of sight center point when it is detected that the user's line of sight range changes by more than a preset range while wearing the augmented reality device; update the three-dimensional map data displayed within the field of view angle according to the line of sight center point.
11. The augmented reality device of claim 9, wherein, After the step of displaying the three-dimensional map data within the field of view angle of the enhanced reality device, the method further comprises: update the three-dimensional map data displayed within the field of view angle according to the changed altitude when it is detected that the altitude of the position information changes.
12. The augmented reality device of claim 9, wherein, After the step of displaying the three-dimensional map data within the field of view angle of the device, the method further comprises: After determining that the scene where the augmented reality device is located is switched from an indoor scene to an outdoor scene according to the position information and / or the three-dimensional map data, control the augmented reality device to switch from a three-dimensional navigation mode to a two-dimensional navigation mode, wherein the three-dimensional navigation mode corresponds to three-dimensional map data, and the two-dimensional navigation mode corresponds to two-dimensional map data.
13. The augmented reality device of claim 9, wherein, After the step of displaying the three-dimensional map data within the field of view angle of the increased reality device, the method further comprises: When a point of interest (POI) within the field of view angle is determined, display virtual information related to the POI within the field of view angle.
14. The augmented reality device of claim 9, wherein, The step of displaying the three-dimensional map data within the field of view angle of the augmented reality device comprises: determine a virtual identifier corresponding to target information in the three-dimensional map data, and display the three-dimensional map data, the target information, and the virtual identifier within the field of view angle of the augmented reality device; The virtual identifier is displayed within the field of view angle in association with the corresponding target information.
15. The augmented reality device of claim 9, wherein, The step of displaying the three-dimensional map data within the field of view angle of the augmented device further comprises: determine the distance between each target information corresponding object in the three-dimensional map data and the location of the augmented reality device; If a distance between the object corresponding to the target information and a position where the augmented reality device is located is less than or equal to a preset distance, a display parameter of the target information in the field of view angle is determined as a first parameter; If the distance between the object corresponding to the target information and the position where the augmented reality device is located is greater than the preset distance, the display parameter of the target information in the field of view angle is determined as a second parameter; The target information is displayed in the field of view angle according to the determined display parameter.
16. A storage medium for computer readable storage, wherein, The storage medium stores one or more programs, which can be executed by one or more processors to implement the following steps: When the augmented reality device is in a wearing mode and a target application is started, position information where the augmented reality device is currently located is acquired; Three-dimensional map data corresponding to the position information is acquired; The three-dimensional map data is displayed in a field of view angle of the augmented reality device.
17. The storage medium of claim 16, wherein, After the step of displaying the three-dimensional map data in the field of view angle of the augmented reality device, the method further includes: When it is detected that a user's line-of-sight change range when wearing the augmented reality device is greater than a preset range, a line-of-sight center point after the change of the user is determined; The three-dimensional map data displayed in the field of view angle is updated according to the line-of-sight center point.
18. The storage medium of claim 16, wherein, After the step of displaying the three-dimensional map data in the field of view angle of the enhanced reality device, the method further includes: When it is detected that an altitude of the position information changes, the three-dimensional map data displayed in the field of view angle is updated according to the changed altitude.
19. The storage medium of claim 16, wherein, After the step of displaying the three-dimensional map data in the field of view angle of the device, the method further includes: When it is determined that a scene where the augmented reality device is located is switched from an indoor scene to an outdoor scene according to the position information and / or the three-dimensional map data, the augmented reality device is controlled to be switched from a three-dimensional navigation mode to a two-dimensional navigation mode, wherein map data corresponding to the three-dimensional navigation mode is three-dimensional map data, and map data corresponding to the two-dimensional navigation mode is two-dimensional map data.
20. The storage medium of claim 16, wherein, After the step of displaying the three-dimensional map data in the field of view angle of the increased reality device, the method further includes: When a point of interest (POI) in the field of view angle is determined, virtual information related to the POI is displayed in the field of view angle.