Data processing method and apparatus, and device and readable storage medium

Abstract

A data processing method and apparatus, and a device and a readable storage medium. The method comprises: in response to a navigation request of a target object for a target article, collecting first environmental change information of the target object during a first movement process by means of an augmented reality device worn by the target object, wherein the first movement process refers to the process of moving from a starting position point to a parking position point of the target article (S101); and when the first environmental change information, which is collected by the augmented reality device, includes a target key position point, outputting movement guidance prompt information associated with the target key position point, wherein the movement guidance prompt information is used for guiding the target object to reach the parking position point, the target key position point refers to a position point which includes target identification degree information and is collected by means of the augmented reality device during the process of moving from the parking position point to a destination position point, and the starting position point refers to any position point where the target object is located during the process of the target object moving from the destination position point to the parking position point (S102). The method can improve the efficiency of searching for the target article.

Description

Data processing method, device, equipment and readable storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on August 1, 2023, with application number 2023109648432 and application name “A data processing method, device, equipment and readable storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of computer technology, and in particular to a data processing method, apparatus, device, and readable storage medium. Background Art

[0003] With the rapid development of computer technology, a large number of navigation applications have been launched online. The navigation functions provided by these navigation applications meet people's diverse needs. In real life, when someone wants to reach a certain location (such as a parked car), they can use a navigation application to get route guidance to that location.

[0004] In the related technology, the premise for using a navigation application to obtain route guidance to a certain location point is that the location point has a Global Navigation Satellite System (GNSS) signal. If the location point does not have a GNSS signal, the navigation application cannot identify the coordinates of the location point, resulting in an inability to provide corresponding route guidance. At this time, the object needs to find a path to the location point where the item is parked and find the item without route guidance. It can be seen that for a location point without a GNSS signal, the object needs to find a path to the location point by itself, which consumes a very high time cost and the search efficiency is not high.

[0005] Summary of the Invention

[0006] The embodiments of the present application provide a data processing method, apparatus, device, and readable storage medium, which can improve the efficiency of finding target objects.

[0007] On the one hand, an embodiment of the present application provides a data processing method, including:

[0008] In response to a navigation request from a target object for a target item, first environmental change information of the target object during a first movement process is collected by the augmented reality device worn by the target object; the first movement process is a process of moving from a starting location to a parking location of the target item;

[0009] When the first environmental change information collected by the augmented reality device includes a target key position point, movement guidance prompt information associated with the target key position point is output; the movement guidance prompt information is used to guide the target object to reach the parking position point; the target key position point refers to a position point containing target recognition information collected by the augmented reality device during the process of moving from the parking position point to the destination position point; the starting position point refers to any position point where the target object is located during the process of moving from the destination position point to the parking position point.

[0010] In one aspect, an embodiment of the present application provides a data processing device, including:

[0011] a response module, configured to respond to a target subject's navigation request for a target object, and collect, through an augmented reality device worn by the target subject, first environmental change information of the target subject during a first movement process; the first movement process being a process of moving from a starting location to a parking location of the target object;

[0012] A prompt output module is used to output movement guidance prompt information associated with the target key position point when the first environmental change information collected by the augmented reality device includes the target key position point; the movement guidance prompt information is used to guide the target object to reach the parking position point; the target key position point refers to the position point containing target recognition information collected by the augmented reality device during the process of the target object moving from the parking position point to the destination position point; the starting position point is included in the path between the destination position point and the parking position point.

[0013] In one embodiment, the movement guidance prompt information associated with the target key position point refers to a recorded video associated with the target key position point; the recorded video refers to a video captured by the augmented reality device during the process of the target object moving from the parking position point to the destination position point, used to record the target recognition information and the surrounding environment where the target recognition information is located;

[0014] The specific implementation method of the prompt output module outputting the movement guidance prompt information associated with the target key position point when the first environmental change information collected by the augmented reality device includes the target key position point includes:

[0015] When the first environmental change information collected by the augmented reality device includes the target key location point, displaying a first playback control for the recorded video;

[0016] In response to the triggering operation of the target object on the first playback control, the playback recorded video is output.

[0017] In one embodiment, the movement guidance prompt information associated with the target key position point refers to audio guidance prompt information associated with the target key position point; the audio guidance prompt information is generated based on the target key position point and a predecessor key position point; the predecessor key position point refers to a position point containing predecessor recognition information during the process of the target object moving from the parking position point to the destination position point; during the process of the target object moving from the parking position point to the destination position point, the time when the target object arrives at the target key position point is later than the time when the target object arrives at the predecessor key position point;

[0018] The specific implementation method of the prompt output module outputting the movement guidance prompt information associated with the target key position point when the first environmental change information collected by the augmented reality device includes the target key position point includes:

[0019] When the first environmental change information collected by the augmented reality device includes a target key position point, audio guidance prompt information is output and played; the audio guidance prompt information is used to instruct the target object to move from the target key position point to the previous key position point.

[0020] In one embodiment, the movement guidance prompt information carries a second playback control for a global video; the global video refers to a video captured by an augmented reality device to record the movement path of the target object during the process of the target object moving from a parking location to a destination location; the movement path recorded by the global video includes key target locations;

[0021] In one embodiment, after the prompt output module outputs the movement guidance prompt information associated with the target key position point, the data processing device further includes:

[0022] A video reverse processing module, configured to respond to a trigger operation of the target object on the second playback control, reverse the global video, and obtain a reversed video corresponding to the global video;

[0023] The video output module is used to output and play reverse-order video; the reverse-order video is used to indicate the global route of the target object moving from the target key position point to the parking position point.

[0024] In one embodiment, when the first environmental change information collected by the augmented reality device includes a target key location point, the prompt output module outputs the movement guidance prompt information associated with the target key location point in a specific manner, including:

[0025] When the first environmental change information collected by the augmented reality device includes a target key location point, a guidance control for an optimal movement route is displayed; the consumption time indicated by the optimal movement route is the minimum consumption time; the consumption time indicated by the optimal movement route refers to the time consumed to move from the target key location point to the parking location point;

[0026] In response to a triggering operation of the guidance control by the target object, the guidance prompt information including the optimal movement route is determined as the movement guidance prompt information associated with the target key location point;

[0027] Output the movement guidance prompt information associated with the target key position points.

[0028] In one embodiment, when the first environmental change information collected by the augmented reality device includes a target key location point, the prompt output module displays a guidance control for the optimal movement route in a specific manner, including:

[0029] When the first environmental change information collected by the augmented reality device includes a target key location point, obtaining a global video associated with the target object; the global video refers to a video collected by the augmented reality device to record the movement path of the target object during the process of the target object moving from the parking location point to the destination location point;

[0030] Determine the target movement route of the target object from the target key position point to the parking position point through the global video;

[0031] Comparing the target movement route with each historical movement route in the historical movement route set to obtain the optimal movement route; a historical movement route in the historical movement route set refers to a movement route of a historical object stored in the augmented reality device from the target key position point to the parking position point;

[0032] Displays guidance controls for optimal movement routes.

[0033] In one embodiment, the prompt output module compares the target movement route with each historical movement route in the historical movement route set to obtain the optimal movement route in a specific manner including:

[0034] Determine each historical movement route in the historical movement route set and the target movement route as a candidate movement route to obtain a candidate movement route set;

[0035] Counting the time required for each candidate moving route in the candidate moving route set to obtain a set of time required;

[0036] The candidate moving route indicated by the minimum consumed time in the consumed time set is determined as the optimal moving route.

[0037] In one embodiment, when the first environmental change information collected by the augmented reality device includes a target key location point, the prompt output module outputs the movement guidance prompt information associated with the target key location point in a specific manner, including:

[0038] When the first environmental change information collected by the augmented reality device includes a target key location point, determining movement guidance prompt information associated with the target key location point according to the navigation signal attribute of the area to which the target key location point belongs;

[0039] Output the movement guidance prompt information associated with the target key position points.

[0040] In one embodiment, the prompt output module determines the specific manner of the movement guidance prompt information associated with the target key location point according to the navigation signal attributes of the area to which the target key location point belongs, including:

[0041] Obtain the navigation signal attributes of the area to which the target key location point belongs;

[0042] If the navigation signal attribute is a valid navigation signal attribute, obtaining a regional navigation map of the area to which the target key location point belongs, and determining the regional navigation map as movement guidance prompt information associated with the target key location point;

[0043] If the navigation signal attribute is a navigation signal missing attribute, then the recorded video associated with the target key position point is obtained, and the recorded video is determined as the movement guidance prompt information associated with the target key position point; the recorded video refers to the video collected by the augmented reality device during the process of the target object moving from the parking position point to the destination position point, which is used to record the target recognition information and the surrounding environment where the target recognition information is located.

[0044] In one embodiment, before the response module responds to the target object's navigation request for the target item and collects first environmental change information of the target object during the first movement process through the augmented reality device worn by the target object, the data processing device further includes:

[0045] an information collection module configured to, upon detecting a target object's location recording signal, collect, via the augmented reality device worn by the target object, second environmental change information of the target object during a second movement process; the second movement process being a process of moving the target object from a parking location to a destination location;

[0046] a position point determination module, configured to, when a position point containing target recognition information exists in the second environment change information collected by the augmented reality device, determine the position point containing the target recognition information as a target key position point;

[0047] The location point storage module is used to store and record target key location points.

[0048] In one embodiment, the target item is a vehicle;

[0049] When the information collection module detects the position recording signal of the target object, before collecting the second environmental change information of the target object during the second movement process through the augmented reality device worn by the target object, the data processing device further includes:

[0050] An analysis module is used to obtain the target object's driving data for the vehicle, perform state analysis on the target object's driving data, and obtain the target object's driving state;

[0051] The signal conversion module is used to convert the first state switching signal into a position recording signal for the target object when a first state switching signal indicating that the driving state is switched from the driving proceeding state to the driving stopped state is detected.

[0052] In one embodiment, after the location point storage module stores and records the target key location points, the data processing device further includes:

[0053] a destination point determination module, configured to determine the current location of the target object as the destination point upon receiving a position stop recording signal;

[0054] The instruction generation module is used to generate an acquisition stop instruction; the acquisition stop instruction is used to instruct the augmented reality device to stop acquiring the second environment change information of the target object during the second movement process.

[0055] In one embodiment, when the destination point determination module receives the position stop recording signal, before determining the current position of the target object as the destination position, the data processing device further includes:

[0056] a data analysis module, configured to obtain movement data of the target object during the second movement process, perform state analysis on the movement data of the target object, and obtain a movement state of the target object;

[0057] The first conversion module is configured to convert the second state switching signal for stopping recording the position of the target object into a signal for stopping recording the position of the target object when a second state switching signal for switching the moving state from the continuous moving state to the continuous stationary state is detected.

[0058] In one embodiment, when the destination point determination module receives the position stop recording signal, before determining the current position of the target object as the destination position, the data processing device further includes:

[0059] The attribute detection module is used to detect the attributes of the navigation signal in the area where the target key position point belongs;

[0060] The second conversion module is configured to convert the attribute switching signal into a signal for stopping recording the position of the target object if an attribute switching signal indicating that the attribute of the navigation signal is switched from the navigation signal missing attribute to the navigation signal valid attribute is detected.

[0061] In one aspect, an embodiment of the present application provides a computer device, including: a processor and a memory;

[0062] The memory stores a computer program, and when the computer program is executed by the processor, the processor executes the method in the embodiment of the present application.

[0063] On one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program includes program instructions. When the program instructions are executed by a processor, the method in the embodiment of the present application is executed.

[0064] In one aspect of the present application, a computer program product is provided, comprising a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the method provided in one aspect of the embodiments of the present application.

[0065] In an embodiment of the present application, during the process of the target object moving from the parking location of the target item to the destination location, the augmented reality device can be used to continuously collect and record whether there is a location point containing target recognition information. If so, the location point can be used as a key location point. Then, during the process of the target object moving from the starting location to the parking location, if there is a need to find the target item, a navigation request for the target item can be initiated, and the augmented reality device can respond to the navigation request and collect the first environmental change information of the target object in the process of moving to the parking location. When it is identified that the first environmental change information contains a certain target key location point, the augmented reality device can determine that the target object has reached the same key location point during the round trip. At this time, the movement guidance prompt information related to the target key location point can be output to guide the target object to reach the parking location more quickly and accurately. It should be understood that by continuously recording the key position points of the target object in the process of moving from the parking position to the destination position through the augmented reality device, the target object can provide intelligent guidance for returning to the parking position of the target object through the above series of key position points when searching for the target item. This can greatly assist the target object in reaching the parking position of the target item. Even if there is no navigation satellite signal or other navigation coordinate signal during the round trip, the parking position can be reached quickly and accurately with the help of the intelligent guidance provided by a series of key position points. There is no need to manually find the path to the parking position, which can greatly improve the efficiency of finding the target object. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] FIG1 is a network architecture diagram of a data processing system provided in an embodiment of the present application;

[0067] FIG2a is a schematic diagram of a scenario for recording key locations provided by an embodiment of the present application;

[0068] FIG2 b is a schematic diagram of a scenario providing intelligent guidance based on key locations provided by an embodiment of the present application;

[0069] FIG3 is a flow chart of a data processing method provided in an embodiment of the present application;

[0070] FIG4 is a schematic diagram of a scenario in which video guidance is provided to a target object according to an embodiment of the present application;

[0071] FIG5 is a schematic diagram of a process for outputting moving guidance prompt information of a target key position point according to an embodiment of the present application;

[0072] FIG6 is a schematic diagram of a scenario for outputting movement guidance prompt information provided by an embodiment of the present application;

[0073] FIG7 is a schematic diagram of a process for identifying and recording key locations provided by an embodiment of the present application;

[0074] FIG8 is a schematic diagram of the architecture of an augmented reality device provided in an embodiment of the present application;

[0075] FIG9 is a system logic flow chart provided in an embodiment of the present application;

[0076] FIG10 is a schematic structural diagram of a data processing device provided in an embodiment of the present application;

[0077] FIG11 is a schematic structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0078] This application involves augmented reality (AR) and other related technologies. For ease of understanding, the following will give priority to a brief explanation of the concepts of augmented reality and other related technologies:

[0079] Augmented Reality (AR) technology, also known as augmented reality, cleverly blends virtual information with the real world. It utilizes a wide range of technologies, including multimedia, 3D modeling, real-time registration, intelligent interaction, and sensing. It simulates computer-generated virtual information, such as text, images, 3D models, music, and video, and then applies it to the real world. The two types of information complement each other, thereby "enhancing" the real world. It facilitates the integration of real-world and virtual-world information. Based on computer science and technology, it simulates physical information, previously difficult to experience within the spatial confines of the real world, effectively applying virtual information to the real world. This process allows human senses to perceive the virtual world, creating a sensory experience beyond reality. The real environment and virtual objects overlap, allowing them to coexist within the same image and space.

[0080] Wearable AR devices: Wearable AR devices are wearable devices typically consisting of a head-mounted display (HMD), cameras, sensors, and a computer processor. A wearable AR device uses cameras and sensors to capture information about a subject (such as a user)'s head movements and surrounding environment, then transmits this information to a computer processor for processing. The processor then generates virtual reality content based on the subject's head movements and surrounding environment, and displays it on the HMD.

[0081] The embodiments of the present application also involve related technologies such as artificial intelligence. For ease of understanding, artificial intelligence and its related concepts are explained below:

[0082] Artificial Intelligence (AI) refers to the theories, methods, techniques, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, to perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that seeks to understand the essence of intelligence and produce new intelligent machines that can respond in a manner similar to human intelligence. AI also involves studying the design principles and implementation methods of various intelligent machines, enabling them to possess the capabilities of perception, reasoning, and decision-making.

[0083] Artificial intelligence (AI) technology is a comprehensive discipline encompassing a wide range of fields, encompassing both hardware and software technologies. Foundational AI technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, and machine learning / deep learning.

[0084] With the research and advancement of artificial intelligence technology, artificial intelligence technology has been studied and applied in many fields, such as common smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, unmanned driving, autonomous driving, drones, robots, smart medical care, smart customer service, etc. It is believed that with the development of technology, artificial intelligence technology will be applied in more fields and play an increasingly important role.

[0085] The solution provided in the embodiments of the present application belongs to computer vision technology (CV) and speech technology in the field of artificial intelligence.

[0086] Computer vision (CV) is the science of making machines "see." Specifically, it refers to using cameras and computers to replace the human eye in identifying and measuring objects, and then further processing them to produce images more suitable for human observation or transmission to instrumentation. As a scientific discipline, computer vision studies related theories and technologies, aiming to build artificial intelligence systems that can extract information from images or multidimensional data. Computer vision technologies generally include image processing, image recognition, image semantic understanding, image retrieval, optical character recognition (OCR), video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, autonomous driving, and smart transportation.

[0087] Key technologies in speech technology include automatic speech recognition, speech synthesis, and voiceprint recognition. Enabling computers to hear, see, speak, and feel is the future direction of human-computer interaction, with speech becoming one of the most promising methods of human-computer interaction.

[0088] The embodiment of the present application can specifically use computer vision technology to identify and obtain the environmental change information of the target object (which can refer to any object, any object such as a user or an intelligent robot) during the movement (as the target object moves, the environment in which the target object is located will change, and the environmental change information here refers to the change information of the environment in which the target object is located recorded by computer vision technology), and use voice technology to identify and obtain the voice data of the target object.

[0089] For ease of understanding, please refer to Figure 1, which is a network architecture diagram of a data processing system provided in an embodiment of the present application. As shown in Figure 1, the network architecture may include a business server 1000 and an augmented reality device cluster. The augmented reality device cluster may include one or more augmented reality devices. The number of augmented reality devices will not be limited here. As shown in Figure 1, multiple augmented reality devices may include augmented reality device 100a, augmented reality device 100b, augmented reality device 100c, ..., augmented reality device 100n; as shown in Figure 1, augmented reality device 100a, augmented reality device 100b, augmented reality device 100c, ..., augmented reality device 100n can be respectively connected to the business server 1000 through a network, so that each augmented reality device can exchange data with the business server 1000 through the network connection.

[0090] It can be understood that each augmented reality device as shown in Figure 1 can be installed with components such as cameras and sensors for collecting real environment information (real environment information may refer to information about the environment in the real world). Thus, each augmented reality device can have the function of collecting environmental information through the camera and sensor components, and the business server 1000 can receive the environmental information collected from each augmented reality device.

[0091] In an embodiment of the present application, an augmented reality device can be selected from multiple augmented reality devices as a target augmented reality device. The augmented reality device may include: smart glasses, smart watches, and other smart devices with multimedia data processing functions (for example, video data playback function, music data playback function, text data playback function), but is not limited to this. For example, in an embodiment of the present application, the augmented reality device 100a shown in Figure 1 can be used as the target augmented reality device. The target augmented reality device can be integrated with components such as a head-mounted display, a camera, a sensor, and a computer processor. At this time, the target augmented reality device can use the camera and the sensor to collect information about the target object's head movement and the surrounding environment. The target augmented reality device can transmit this information to the computer processor for processing. The computer processor can generate virtual reality content based on the target object's head movement and the surrounding environment information, and display it on the head-mounted display. Thus, the target object can view the virtual reality content based on the head-mounted display. It should be noted that the virtual reality content generated by the augmented reality device can be uploaded to the business server 1000 and stored uniformly by the business server 1000. Of course, after collecting information about the target object's head movement and surrounding environment, the target augmented reality device can send this information to the business server 1000, and the business server 1000 can generate virtual reality content. The business server 1000 can return the virtual reality content to the target augmented reality device, and the target augmented reality device can display the virtual reality content on a head-mounted display.

[0092] It should be understood that the virtual reality content in this application can refer to media content presented in any media presentation format, including but not limited to image, video, text, and audio. A media presentation format can also refer to a combination of any two or more of the above formats. In other words, the virtual reality content in this application can refer to video content presented in video format, image content presented in image format, text content presented in text format, and audio content presented in audio format. It should be understood that the present application can use an augmented reality device to collect environmental change information of a target object (which can refer to any object, wherein the object in the present application can refer to a user, an intelligent robot, etc.) during the movement process (wherein, the movement process here can refer to the process in which the target object parks an item at a certain location and moves from the location where the item is parked to another location (such as the process of walking to another location). In the present application, the item parked by the target object can be referred to as the target item, the location where the item is parked can be referred to as the parking location, and the other location reached can be referred to as the destination location). For the collected environmental change information, a computer processor can be used to perform data recognition and calculation from the environmental change information to obtain key location points in the environmental change information. When the target object needs to return from the destination location to the parking location to find the target item, the series of recorded key location points can be used to provide the target object with intelligent guidance information for returning to the parking location (the intelligent guidance information here is the route guidance information obtained based on the series of key location points recorded by the computer processor. The target object can use this route guidance information as a path reference to return to the parking location to return to the parking location).

[0093] For ease of understanding, the embodiment of the present application will take the target object as a means of transportation (such as a vehicle) as an example to illustrate the data processing method provided by the present application. Specifically, assuming that the target object parks the means of transportation at a certain location (such as a parking space B in parking lot A), the target object will walk to shopping mall C, then the parking space B here can be understood as the parking location point, and the location point where shopping mall C is located can be understood as the destination location point. The process of the target object walking from parking space B in parking lot A to shopping mall C can be understood as a movement process of the target object (that is, the process of moving from the parking location point to the destination location point, which can be referred to as the second movement process in this application). It should be understood that the target object can wear an augmented reality device and use the augmented reality device to collect the environmental change information of the target object during the second movement process (for ease of distinction, it is referred to as the second environmental change information here). The augmented reality device can continuously identify and record a series of key location points in the second environmental change information, wherein the key location points here can refer to location points containing recognition information. For example, the augmented reality device recognizes that the surrounding environment information of the target object contains a numbered electric pole, and the numbered electric pole is highly recognizable, then the numbered electric pole can be used as recognition information, and the location point of the numbered electric pole can be used as a key location point and stored and recorded; for another example, the augmented reality device recognizes that the surrounding environment information arrived at by the target object (second environmental change information) contains a special voice feature signal (such as the "Welcome" voice feature signal of a shopping mall), and the voice feature signal of the shopping mall can clearly represent the current location of the target object, and the voice feature signal is highly recognizable, then the voice feature signal can also be used as recognition information, and the location point where the voice feature signal is recognized can be used as a key location point and stored and recorded. In other words, the recognizable information here may refer to recognizable and easy-to-remember information, specifically including but not limited to text information that can be recognized by augmented reality devices (such as the number of a certain electric pole, the name of a certain shopping mall, etc.), a certain building (such as an elevator, a certain building, etc.), sensor signals (such as WIFI SSID and MAC address, Bluetooth UUID or other hardware information, etc.), magnetic field characteristic signals, voice characteristic signals (such as "Welcome" in a shopping mall), etc.During the second movement process of the target object, the augmented reality device can continuously collect the second environmental change information of the target object. When a certain position point reached by the target object contains recognition information, the augmented reality device can regard it as a key position point and store and record it until the target object reaches the destination position point. Therefore, a series of key position points can be generated in the journey of the target object from parking space B to shopping mall C. Based on the order from early to late between the time when each key position point is identified and recorded, the key position points can be sorted, thereby generating a key path composed of each key position point. For example, when the target object moves from parking space B to shopping mall C, the augmented reality device first identifies the key position point v, and the augmented reality device can store and record the key position point v. After identifying the key position point, the augmented reality device identifies the key position point d, and the augmented reality device can store and record the key position point d. After that, the augmented reality device identifies the key position point e, and the augmented reality device can store and record the key position point e. It can be seen that the time when the key position point v is identified and recorded by the augmented reality device is earlier than the time when the key position point d is identified and recorded by the augmented reality device. The time when the key position point d is recognized and recorded by the augmented reality device is earlier than the time when the key position point e is recognized and recorded by the augmented reality device. Based on this, the key position points v, key position points d, and key position points e are sorted in order from early to late between the times when the key position points are recognized and recorded, and a key path can be generated: {key position point v—>key position point d—>key position point e}. This key path {key position point v—>key position point d—>key position point e} is the path of the target object moving from parking space B to shopping mall C.

[0094] Furthermore, in the process of the target object returning from the destination position to the parking position, if the target object is not clear about how to reach the parking position at a certain position, then it can be considered that the target object has a need to find the vehicle at this time. At this time, the target object can initiate a navigation request for the vehicle, and then the augmented reality device can respond to the navigation request and collect the target object in the process of moving (that is, from the current position point (the current position point of the target object is the process of returning from the target position point to the parking position point, the target object reaches a certain position point, this position point may include the destination position point, that is, the target object can initiate a navigation request at the destination position point, and this application may also refer to the current position point of the target object as the starting position point) to the parking position point, which may be referred to as the first movement process in this application). The augmented reality device can continuously identify whether the first environmental change information of the first movement process contains a key position point of the second movement process stored and recorded by the augmented reality device based on the series of key position points generated by the target object during the second movement process recorded by the augmented reality device. That is, during the second movement process of the target object moving from the parking position to the destination position, the augmented reality device can store and record a series of key position points based on the second environmental change information to generate a key path. During the first movement process of the target object returning from the destination position to the parking position, the second environmental change information of the target object can be identified based on the key path stored and recorded during the second movement process to determine whether the target object has reached a key position point in the key path. If it is identified that the first environmental change information contains a key position point recorded during the second movement process (referred to as the target key position point), the augmented reality device can determine that the target object has reached the same position point during both round trips. The augmented reality device can output movement guidance prompt information associated with the target key position point to guide the target object to reach the parking position of the parked vehicle more quickly.

[0095] It should be understood that the present application can use augmented reality equipment to continuously record environmental change information during the process of the target object moving from the parking location to the destination location, and identify and record a series of key location points. When the target object returns to find the target item, the above-mentioned recorded series of key location points can provide intelligent guidance for returning to the parking location of the target item, thereby greatly assisting the target object in finding the target item and improving the efficiency of finding the target item. At the same time, the method for finding the target item provided by the present application does not require a GNSS signal. Therefore, for any location point (such as a parking location point, a destination location point, or any key location point reached during the movement), if this location point does not have a GNSS signal, the solution provided by the present application can still be used to provide the target object with route guidance for finding the target item, thereby assisting the target object to quickly reach the location point where the target item is parked.

[0096] It is understood that the methods provided in the embodiments of the present application can be executed by a computer device, including but not limited to an augmented reality device or a business server. The business server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0097] The augmented reality device and the service server may be connected directly or indirectly via wired or wireless communication, which is not limited in this application.

[0098] Optionally, it is understood that the above-mentioned computer device (such as the above-mentioned business server 1000, augmented reality device 100a, augmented reality device 100b, etc.) can be a node in a distributed system, wherein the distributed system can be a blockchain system, and the blockchain system can be a distributed system formed by connecting multiple nodes through network communication. In a distributed system, any form of computer device, such as a business server, terminal device, and other electronic devices, can become a node in the blockchain system by joining the peer-to-peer network. For ease of understanding, the concept of blockchain will be explained below: Blockchain is a new application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, and encryption algorithm. It is mainly used to organize data in chronological order and encrypt it into a ledger to make it tamper-proof and forged. At the same time, it can verify, store, and update data. When the computer device is a blockchain node, due to the tamper-proof and anti-counterfeiting characteristics of the blockchain, the data in this application (such as the first environmental change information, the second environmental change information, a series of key location points in the second environmental change information, the generated key path, etc.) can be made authentic and secure, so that the results obtained after performing relevant data processing based on these data can be more reliable.

[0099] It should be noted that, in the specific implementation of this application, data related to user information, user data (information about environmental changes during the user's movement), etc., all require manual authorization and permission from the user (i.e., user consent) before they can be obtained. In other words, when the above embodiments of this application are applied to specific products or technologies, the methods and related functions provided by the embodiments of this application are operated with the permission or consent of the user (the user can actively enable the functions provided by the embodiments of this application), and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0100] The embodiments of the present application can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, assisted driving, etc. For ease of understanding, please refer to Figure 2a. Figure 2a is a scene schematic diagram of recording key position points provided by an embodiment of the present application. Among them, the scene shown in Figure 2a is a scene illustrated by taking the target object as a vehicle as an example. As shown in Figure 2a, after the object 20a (target object) drives the vehicle 20a (target object) to the parking lot and parks it in the parking space PM1, the object 20a gets off the vehicle and walks to the location point Locn where the shopping mall is located. Then the location point locn can be understood as the destination location point of the target object, and the location point Loc1 where the object 20a is located next to the parking space PM2 can be understood as the parking location point of the target object.

[0101] It should be understood that when the object 20a is at the parking location Loc1, the object 20a can wear the augmented reality device 200, and the augmented reality device 200 can collect the environmental change information of the object 20a moving from the parking location Loc1 to the destination location Locn. The augmented reality device 200 can identify whether a certain location point where the object 20a is located contains recognizable information (recognizable information can be called recognition information). If a certain location point contains recognition information, the augmented reality device 200 can use the location point as a key location point in the movement process, thereby identifying a series of key location points until the object 20a reaches the destination location Locn. For example, as shown in Figure 2a, when the object 20a moves along the moving direction shown in Figure 2a, when it reaches the location point Loc2, the augmented reality device recognizes that there is a numbered pole at the location point Loc2. The numbered pole is recognizable and can be used as a recognition information. Then the augmented reality device can use the location point Loc2 as a key location point. As shown in FIG2a , until the object 20a reaches the destination location Locn, the augmented reality device can obtain a series of key locations, specifically including {key location 1, key location 2, …, key location m}. The augmented reality device can store and record these key locations. It is worth noting that when the augmented reality device stores and records the above key locations, it can store and record them according to the time when the key locations were identified. For example, the key locations can be stored and recorded in order from the earliest to the latest time of identification.

[0102] It should be understood that when object 20a is searching for vehicle 2a, intelligent guidance can be provided to object 20a based on the aforementioned key locations to guide object 20a to the parking location Loc1 (i.e., parking space PM1) where vehicle 2a is parked. For ease of understanding, please also refer to Figure 2b, which is a schematic diagram of a scenario providing intelligent guidance based on key locations, provided in an embodiment of the present application. As shown in Figure 2b, assuming that the object 20a is in the process of returning from the location point Locn where the shopping mall is located to the parking location point Loc1 where the vehicle 2a is located, when the object 20a is at the location point Loc(n-1), it is unclear about the moving path to the parking location point Loc1, then the object 20a can initiate a navigation request for the vehicle 2a (equivalent to a navigation request for the parking location point Loc1 where the vehicle 2a is located), and the augmented reality device 200 can respond to the navigation request and start collecting environmental change information of the object 20a moving from the location point (n-1). Whenever the object 20a moves to a key location point in the above series of key location points (including {key location point 1, key location point 2,…, key location point m}), the augmented reality device 200 can output movement guidance prompt information for the key location point. The movement guidance prompt information here can be determined based on a series of key position points recorded by the augmented reality device. Specifically, it can be seen from the above description that: in the process of the object 20a reaching the destination position point Locn, the augmented reality device records a series of key position points in chronological order, and in the process of the object 20a returning from the destination position point Locn to the parking position point Loc1, the augmented reality device can sort the recorded key position points in chronological order from late to early, thereby obtaining an auxiliary position point sequence, and the movement guidance prompt information can be determined based on this auxiliary position point sequence. For example, this movement guidance prompt information may include information about the next key position point of the key position point where the target object is currently located (that is, the next key position point of the current key position point in the above auxiliary position point sequence). In this way, it can not only prompt the object 20a to reach the same key position point in both round trip movements, but also guide the position point that the object 20a should reach subsequently (that is, the next key position point of the key position point currently reached), thereby guiding the subsequent movement route of the object 20a. For example, as shown in Figure 2b, when object 20a reaches location Loc2, the augmented reality device 200 identifies location Loc2 as a key location. The augmented reality device 200 can then output movement guidance information for location Loc2 to indicate that object 20a has reached the same location. This series of key locations allows for intelligent guidance of object 20a to its parking location Loc1 until it reaches the parking location.

[0103] For ease of understanding, the data processing method provided in the embodiment of the present application will be described in detail below with reference to the accompanying drawings. Please refer to Figure 3, which is a flow chart of a data processing method provided in the embodiment of the present application. The process can be executed by a computer device, which can be an augmented reality device as shown in Figure 1, or a business server as shown in Figure 1. As shown in Figure 3, the process can include at least the following steps S101-S102:

[0104] Step S101, in response to a target object's navigation request for a target item, first environmental change information of the target object during a first movement process is collected through the augmented reality device worn by the target object; the first movement process refers to the process of moving from a starting position to a parking position of the target item.

[0105] In the present application, the data processing method provided may refer to a method for finding and guiding a target object, which may be implemented in a scenario where, after a target object parks a target object at a certain location and goes to another location, it needs to return from another location to the parking location of the target object. For example, taking the target object as a vehicle, assuming that the target object parks the vehicle in a parking space in a parking lot of a shopping mall, the target object goes to the interior of the shopping mall to shop, and after the target object finishes shopping, the target object wants to return to the parking lot of the shopping mall and find a parking space where his vehicle is parked, then the car-finding scenario can be applied to the method provided in the embodiment of the present application. Wherein, the target object may refer to any object, and the object may refer to a user, an intelligent robot, etc. In other words, the target object may refer to any user, any intelligent robot, etc. The target item can refer to any item, and the item can refer to a means of transportation (such as a vehicle), a painting, a skateboard, etc. When the target object has a need to find the target item, the target object can initiate a navigation request for the target item on the augmented reality device worn, and the augmented reality device can respond to the navigation request and collect environmental change information of the target object moving from the starting position to the parking position of the target item (for the sake of distinction from the subsequent, the environmental change information is referred to as the first environmental change information here).

[0106] It should be noted that an augmented reality device may refer to a wearable device that integrates components such as a head-mounted display, a camera, a sensor, and a computer processor. The camera and the sensor may capture and collect information about the surrounding environment of the target object, and the computer processor may perform computational processing on the collected surrounding environment information to generate virtual reality content and display it on the head-mounted display. It should be understood that the augmented reality device may detect whether the target object has a need to obtain guidance information for finding the target object. When it is detected that the target object has initiated a navigation request for the target object, it will be clear that the target object has a need to obtain guidance information for finding the target object, and thus the navigation request of the target object may be responded to by collecting the first environmental change information of the target object starting from the starting point (the starting point is the location at which the target object initiates the navigation request for the target object during the process of the target object returning from the destination point to the parking location of the target object) through the augmented reality device until the target object successfully reaches the parking location of the target object. That is to say, the augmented reality device can continuously collect the surrounding environment information of the target object moving from the starting position to the parking position to obtain the first environmental change information (that is, the first environmental change information refers to the continuously changing surrounding environment information collected during the process of the target object moving from the starting position to the parking position). The augmented reality device can give the target object corresponding movement guidance information through the collected first environmental change information, so that the target object can quickly reach the parking position of the target object.

[0107] Among them, the way in which the target object initiates a navigation request for the target item can be achieved by triggering the navigation control in the augmented reality device, wherein the triggering operation can include contact operations such as clicking or long pressing, and can also include non-contact operations such as voice or gestures, which will not be limited here.

[0108] Step S102: When the first environmental change information collected by the augmented reality device includes a target key position point, the movement guidance prompt information associated with the target key position point is output; the movement guidance prompt information is used to guide the target object to reach the parking position point; the target key position point refers to a position point containing target recognition information collected by the augmented reality device during the process of moving from the parking position point to the destination position point; the starting position point refers to any position point where the target object is located during the process of moving from the destination position point to the parking position point.

[0109] In the present application, the process of the target object moving from the starting position to the parking position of the target item can be referred to as the first movement process, the first environmental change information can refer to the continuously changing surrounding environment information collected by the augmented reality device during the first movement process, and the key position point in the present application can refer to the key position point determined by the augmented reality device based on the environmental change information collected during the second movement process (referred to as the second environmental change information). Specifically, the parking location of the target item may refer to the location where the target object parks the target item (such as the location where the target object parks the vehicle). After parking the target item, the target object will go from the parking location to another location to perform corresponding activities (such as going to a shopping mall to perform shopping activities). The other location to which the target object goes from the parking location can be used as the destination of the target object. Then the location to which the target object goes can be called the destination location. The second movement process refers to the process of the target object moving from the parking location to the destination location. In the process of the target object moving to the destination location, the target object can choose to use an augmented reality device to continuously collect surrounding environment information in this process to obtain second environment change information, so that the augmented reality device can continuously identify a series of key location points reached by the target object in this process based on the second environment change information. Then, in the process of the target object returning from the destination location to the parking location of the target item, intelligent guidance for reaching the parking location can be obtained through this series of key location points.

[0110] That is to say, the present application can collect second environmental change information through the augmented reality device and identify the second environmental change information in the process of the target object moving from the parking position to the destination position. If the target object arrives at a certain position point, the augmented reality device detects the surrounding environmental information of the position point by identifying and detecting it, and determines that the surrounding environmental information contains recognizable information (referred to as recognition information), then the augmented reality device can determine the position point as a key position point. It should be understood that since the recognition information is recognizable, the target object can determine its current position well through the recognition information in the key position point. Based on this, the augmented reality device can continuously identify a series of key position points during the second movement of the target object. The augmented reality device can store and record each key position point in the order from early to late between the times when each key position point is identified.

[0111] Based on the above, it can be seen that in the process of the target object moving from the starting position to the parking position of the target object, if the first environmental change information collected by the augmented reality device includes a key position recorded in the second movement process, the augmented reality device can output movement guidance prompt information associated with the key position to prompt the target object to arrive at the same position in the second movement process. That is, the target key position here can refer to any key position recorded in the second movement process, and the target recognition information is the recognition information contained in the target key position. Since the target object is moving from the parking position to the destination position, the path of the target object from the destination position back to the parking position can be the opposite path from the parking position to the destination position. For the starting position, it is a position point on the way from the destination position back to the parking position. It can be seen that the starting position is located in the path between the destination position and the parking position. In other words, the path between the destination position and the parking position will include the starting position.

[0112] It is understandable that when the target key position point is included in the first environmental change information, the movement guidance prompt information associated with the target key position point can be output to guide the target object, wherein the movement guidance prompt information associated with the target key position point here refers to the guidance prompt information that can only be determined based on the target key position point, and this guidance prompt information contains prompt content for this target key position point. Specifically, the augmented reality device can capture the environmental change information of the process during which the target object moves from the parking position point to the destination position point through the camera and sensor. That is to say, the camera and sensor can capture a video containing environmental change information. For each key position point, a video recording its surrounding environment information will be generated. In this application, the video recording the surrounding environment information may be referred to as a recorded video. Based on this, it can be seen that for the target key position point, the augmented reality device records a recorded video of the target key position point. The recorded video records the video of the surrounding environment where the target recognition information is located, which is collected by the augmented reality device during the process of the target object moving from the parking position point to the destination position point. In the present application, in the process of the target object returning to the parking location, if the target object reaches a certain target key location point, in order to facilitate the intuitive and clear presentation of route guidance for the target object, the mobile guidance prompt information of the target key location point output by the present application may refer to the recorded video associated with the target key location point. In other words, in the process of the target object searching for the target item, each time the target object reaches a certain target key location point, a recorded video can be obtained as an intelligent guidance.

[0113] Specifically, when the movement guidance prompt information associated with the target key position point refers to the recorded video associated with the target key position point, when the target key position point is included in the first environmental change information collected by the augmented reality device, the specific method of outputting the movement guidance prompt information associated with the target key position point can be: the augmented reality device can first obtain the recorded video associated with the target key position point, and output and display the playback control for the recorded video (for the convenience of distinction from the subsequent, it is referred to as the first playback control here), and the target object can play and watch the recorded video by triggering the first playback control. After the target object triggers the first playback control, the augmented reality device can respond to this trigger operation and output the playback of the recorded video.

[0114] In an optional embodiment, the augmented reality device can also obtain the next key position point of the target key position point (that is, the next key position point that the target object should return to when returning to the parking position point). It should be noted that since each key position point is identified and recorded one by one by the augmented reality device when the target object moves from the parking position point to the destination position point, each key position point has a time sequence, and in the process of the target object moving from the destination position point to the parking position point, the moving path of the target object returning to the parking position point is opposite to the path to the destination position point. For the above-mentioned path to the destination position point, The target object should arrive at each key position point identified and recorded in the process of the target object returning to the parking position point one by one in reverse order. Based on this, in the process of the target object returning to the parking position point, the augmented reality device can store and record the key position point sequence (the sequence obtained by sorting the key position points in chronological order) and use the previous key position point of the target key position point as the position point that the target object should go to (which can be called the expected arrival position point). Similarly, the present application can also output the recorded video of the expected arrival position point to prompt the target object that it has currently arrived at the target key position point, and the next position point to be arrived at is the expected arrival position point. In other words, the movement guidance prompt information associated with the target key position point can include the recorded video of the target key position point and the recorded video of the expected arrival position point. The two recorded videos can intuitively and clearly give the target object intelligent guidance, so that the target object can reach the parking position point more quickly. In summary, the mobile guidance prompt information associated with the target key position point in this application may refer to the recorded video associated with the target key position point, which includes a recorded video for recording the surrounding environment information of the target key position point, and may also include a recorded video for recording the surrounding environment information of the expected arrival point (i.e., the previous key position point of the target key position point in the key position point sequence).

[0115] For ease of understanding, please refer to Figure 4, which is a schematic diagram of a scenario provided by an embodiment of the present application for providing video guidance to a target object. As shown in Figure 4, assuming that the target object is in the process of returning to the parking position, when it reaches a certain position point, the augmented reality device 400 recognizes that the position point is a key position point, then the augmented reality device 400 can obtain the recorded video associated with the key position point (assuming it is the recorded video Vid2), and then the augmented reality device 400 can display the playback prompt information for the recorded video Vid2 in the display area as shown in Figure 4 through the head-mounted display "Identify the key position point, whether to play the related video", as well as the confirmation control and cancel control for the playback prompt information. The target object can play and watch the recorded video Vid2 by triggering the confirmation control, or refuse to play the recorded video Vid2 by triggering the cancel control. As shown in Figure 4, after the target object triggers the confirmation control, the augmented reality device 400 can play the recorded video Vid2 in the display area. The target object can clearly and intuitively see the relevant process of passing through the target location on the way to the destination through the recorded video Vid2, thereby receiving guidance to return to the parking location. Of course, the augmented reality device 400 can also obtain the location point that the target object should reach next to the location point and obtain the recorded video of this location point. After playing the recorded video Vid2 of the current location point, the augmented reality device 400 can then play the recorded video of the next key location point to guide the target object's subsequent movement direction.

[0116] Of course, it is understandable that the moving guidance prompt information of the target key position point is not limited to being presented in the form of video. The moving guidance prompt information of the target key position point can also be presented in the form of audio. The audio can prompt that the target object has reached the target key position point and guide the target object to the next key position point to which it needs to move. The next key position point here is the previous key position point of the target key position point in the key position point sequence stored and recorded during the second movement process (which can be called the predecessor key position point, that is, the next expected arrival position point in the process of returning to the parking position point). In other words, the audio prompt information can include relevant information of the target key position point and the predecessor key position point at the same time. Based on the above, it can be known that the mobile guidance prompt information associated with the target key position point refers to the audio guidance prompt information associated with the target key position point, and the audio guidance prompt information can be generated based on the target key position point and the predecessor key position point, and the predecessor key position point also contains recognition information (this application can refer to the recognition information contained in the predecessor key position point as predecessor recognition information). In the process of the target object moving from the parking position point to the destination position point, the time when the target object arrives at the target key position point is later than the time when it arrives at the predecessor key position point. In this case, when the target key position point is included in the first environmental change information collected by the augmented reality device, the specific implementation method of outputting the mobile guidance prompt information associated with the target key position point can be: when the target key position point is included in the first environmental change information collected by the augmented reality device, the audio guidance prompt information can be output and played; wherein, the audio guidance prompt information is used to instruct the target object to move from the target key position point to the predecessor key position point. For example, taking the target key location point as the shopping center CG, and assuming that the previous key location point is the Central Park MU, the audio guidance prompt information can be "You have arrived at the shopping center CG, and you can go to the Central Park MU next." Then the target object can use the audio guidance prompt information to clearly understand the location point he or she will go to next.

[0117] Of course, when the target object reaches the target key position, the augmented reality device can synchronously output recorded video and audio guidance prompt information. Through the synchronous output of picture and sound, the target object can be given more intuitive intelligent guidance to the parking location.

[0118] In addition, as can be seen from the above, the augmented reality device records a complete video of the target object traveling from the parking location to the destination location. When the target object returns from the destination location to the parking location, the target object can also choose to play and watch the complete video to clarify the path to the parking location. The complete video recorded from the parking location to the destination location is referred to as a global video in this application. In order to clearly present the path to the parking location, this application can reverse the global video to convert it into a video from the destination location to the parking location, thereby presenting the global route from the destination location to the parking location. Specifically, the target object can actively initiate a playback request for the global video (for example, actively initiate a playback request for the global video at the destination location or any other location), or passively initiate a playback request for the global video. For example, the movement guidance prompt information output by the augmented reality device can carry a second playback control for the global video (the global video refers to the video used to record the movement path of the target object collected by the augmented reality device during the process of the target object moving from the parking location to the destination location, and the movement path recorded by the global video includes the target key location). The target object can play and watch the global video by triggering the second playback control. After the target object triggers the second playback control, the augmented reality device can respond to this trigger operation and reverse process the global video, thereby obtaining a reverse video of the global video; then, the augmented reality device can output and play the reverse video, wherein the reverse video is used to indicate the global route of the target object moving from the target key location to the parking location, so that the target object can gradually reach the parking location according to the global route.

[0119] It should be noted that, in the process of the target object moving from the destination location to the parking location, a certain location point reached may or may not have a GNSS signal. For a location point with a GNSS signal, there may be a corresponding navigation map. In this case, the present application can obtain the navigation map containing the location point and display it to the target object, so that the target object can use the navigation map to determine its subsequent movement route. If the location point does not have a GNSS signal, the present application can output the recorded video or audio guidance prompt information of the location point in the above manner to guide the target object's next movement route. In other words, when the first environmental change information collected by the augmented reality device includes the target key location point, the specific method of outputting the movement guidance prompt information associated with the target key location point can also be: when the first environmental change information collected by the augmented reality device includes the target key location point, the movement guidance prompt information associated with the target key location point can be determined according to the navigation signal attributes of the area to which the target key location point belongs; and then the movement guidance prompt information associated with the target key location point can be output.

[0120] Among them, the specific method for determining the mobile guidance prompt information associated with the target key position point according to the navigation signal attribute of the area to which the target key position point belongs can be: the navigation signal attribute of the area to which the target key position point belongs can be obtained; if the navigation signal attribute is a valid navigation signal attribute, the regional navigation map of the area to which the target key position point belongs can be obtained, and then the regional navigation map can be determined as the mobile guidance prompt information associated with the target key position point; and if the navigation signal attribute is a missing navigation signal attribute, the recorded video associated with the target key position point can be obtained (the recorded video refers to the video collected by the augmented reality device to record the target recognition information and the surrounding environment where the target recognition information is located during the process of the target object moving from the parking position to the destination position), and the recorded video is determined as the mobile guidance prompt information associated with the target key position point.

[0121] It is understandable that the navigation signal attribute of the area to which the target key position point belongs can be understood as the attribute of whether the target key position point has a GNSS signal. If the area where the target key position point is located has a GNSS signal, then its navigation signal attribute can be a navigation signal validity attribute, and if the area where the target key position point is located does not have a GNSS signal, then the navigation signal attribute can be a navigation signal missing attribute. The present application can decide whether the mobile guidance prompt information output to the target object is a recorded video, audio guidance prompt information or a regional navigation map based on the navigation signal attribute of the area to which the target key position point belongs. Of course, the recorded video, audio guidance prompt information and regional navigation map can be displayed to the target object at the same time to better guide the target object.

[0122] In an embodiment of the present application, an augmented reality device is used to continuously record key position points of the target object in the process of moving from the parking position to the destination position. When the target object is looking for the target item, the above series of key position points can provide intelligent guidance for returning to the parking position of the target item. This can effectively assist the target object in reaching the parking position of the target item. Even if there is no navigation satellite signal (such as a GNSS signal) or other navigation coordinate signal during the round trip, the parking position can be reached quickly and accurately with the help of the intelligent guidance provided by a series of key position points. There is no need to manually find the path to the parking position, which can greatly improve the efficiency of finding the target item.

[0123] Furthermore, it can be understood that due to the diversity and complexity of traffic roads, the route from the parking location to the destination location may not be just the movement route of the target object. The present application can collect and record the movement paths of different objects from the parking location to the destination location (specifically, other objects can also collect environmental change information from the parking location to the destination location by wearing augmented reality devices, thereby generating movement routes of different objects). Then, for the target object, in the process of returning from the destination location to the parking location, the augmented reality device can determine an optimal movement route (such as the shortest route, the route with the fewest alleys, the route with the most shady areas, etc.) based on the movement routes of the above-mentioned different objects and the movement route of the target object from the parking location to the destination location, and the augmented reality device can output the optimal movement route to the target object, so that the target object can follow the guidance of the optimal movement route to reach the parking location. It should be understood that there may be the same location points in the movement routes of the above-mentioned different objects. For the target object, assuming that the target object initiates a navigation request for the target item when it arrives at a certain location point on the way from the destination location point to the parking location point, the augmented reality device can find the movement route containing the target key location point based on the movement routes of the above-mentioned different objects, and then determine an optimal movement route based on these movement routes containing the target key location points and the movement route of the target object itself. The augmented reality device can use the guidance prompt information of the optimal movement route as the movement guidance prompt information of the target key location point.

[0124] For ease of understanding, please refer to Figure 5, which is a schematic diagram of a process for outputting mobile guidance prompt information of a target key location point provided by an embodiment of the present application. This process is described by taking the mobile guidance prompt information of the target key location point as the guidance prompt information containing the optimal movement route as an example, and this process can correspond to the process for outputting mobile guidance prompt information of the target key location point in step S102 of the embodiment corresponding to Figure 3 above. As shown in Figure 5, the process can include at least the following steps S501-S503:

[0125] Step S501: When the first environmental change information collected by the augmented reality device includes a target key position point, a guidance control for the optimal movement route is displayed; the consumption time indicated by the optimal movement route is the minimum consumption time; the consumption time indicated by the optimal movement route refers to the time consumed to move from the target key position point to the parking position point.

[0126] Specifically, based on the above, when the first environmental change information collected by the augmented reality device includes a target key position point, the optimal moving route from the target key position point to the parking position point can be determined first, and then a guidance control for the optimal moving route can be output. The target object can determine whether to view the optimal moving route based on the guidance control. If the target object triggers the guidance control, it can be considered that the target object has a need to view the optimal moving route. Specifically, the specific method for determining the optimal movement route and displaying the guidance control for the optimal movement route may be: when the first environmental change information collected by the augmented reality device includes a target key position point, a global video associated with the target object may be obtained; wherein the global video refers to a video collected by the augmented reality device to record the movement path of the target object in the process of the target object moving from the parking position point to the destination position point; through the global video, the target movement route of the target object moving from the target key position point to the parking position point may be determined; then, the target movement route may be compared with each historical movement route in the historical movement route set, thereby obtaining the optimal movement route; wherein, a historical movement route in the historical movement route set refers to the movement route of a historical object stored by the augmented reality device from the target key position point to the parking position point; and the guidance control for the optimal movement route is displayed.

[0127] It can be understood that the present application can first reverse process the global video to obtain a reverse video, and then obtain the key position points contained in the reverse video in sequence, thereby determining a movement route based on the key position points, and the movement route can be used as the target movement route of the target object. Among them, before the target object, there may be other objects moving from the parking position point to the destination position point (wherein, the target key position point will be passed in the process of moving from the parking position point to the destination position point), or moving from the parking position point to the target key position point. There may also be some objects moving from the destination position point to the parking position point (wherein, the target key position point will be passed in the process of moving from the destination position point to the parking position point), or moving from the target key position point to the parking position point. These objects can be understood in this application as historical objects whose movement time is earlier than that of the target object. This application can collect environmental change information of historical objects in different movement processes in the same way (such as using augmented reality equipment to collect environmental change information), thereby determining the movement route of each historical object from the target key position point to the parking position point. The movement route of the historical object from the target key position point to the parking position point can be called a historical movement route in this application, and the historical movement routes of different historical objects can constitute a historical movement route set.

[0128] Furthermore, each historical movement route can be compared with the target movement route to determine an optimal movement route among the historical movement routes and the target movement route. Specifically, when comparing each historical movement route with the target movement route, the comparison can be performed according to preset conditions. For example, the duration of each route, the number of shaded areas passed through, the number of gas stations passed through, the number of shopping malls passed through, etc. can be compared. Taking the comparison of the duration of each route as an example, the target movement route can be compared with each historical movement route in the set of historical movement routes to determine the optimal movement route. The specific method for determining the optimal movement route by comparing the target movement route with each historical movement route in the set of historical movement routes is as follows: each historical movement route in the set of historical movement routes and the target movement route can be determined as a candidate movement route, thereby obtaining a set of candidate movement routes; then, the duration required for each candidate movement route in the set of candidate movement routes can be calculated, thereby obtaining a set of durations; finally, the candidate movement route indicated by the minimum duration in the set of durations can be determined as the optimal movement route. In other words, among the candidate movement routes, the candidate movement route with the minimum duration can be selected as the optimal movement route.

[0129] Step S502 : In response to the triggering operation of the target object on the guidance control, the guidance prompt information including the optimal movement route is determined as the movement guidance prompt information associated with the target key location point.

[0130] Specifically, after the target object triggers the guidance control, the present application can respond to the triggering operation of the target object and determine the guidance prompt information containing the optimal movement route as the movement guidance prompt information associated with the target key location point.

[0131] Step S503: outputting movement guidance prompt information associated with the target key position point.

[0132] Specifically, guidance prompt information including the optimal moving route may be output, based on which the target object may move along the route indicated by the viewed optimal moving route, thereby reaching the parking location in the shortest time.

[0133] For ease of understanding, please also refer to Figure 6, which is a schematic diagram of a scenario for outputting movement guidance prompt information provided by an embodiment of the present application. This scenario is illustrated by taking the movement guidance prompt information of a target key location point as an example of the guidance prompt information including the optimal movement route. As shown in Figure 6, assuming that the target object (object 60a as shown in Figure 6) is returning to the parking position point A, when it reaches a certain position point B1, the augmented reality device 600 recognizes the position point B1 as a key position point, then the augmented reality device 600 can collect the various historical movement routes of the historical object moving from the key position point B1 to the parking position point A, and can also determine the target movement route of the target object 60a moving from the key position point B1 to the parking position point A based on the global video of the target object 60a moving from the parking position point A to the destination point. Subsequently, the augmented reality device 600 can compare the time consumed by these historical movement routes and the target movement route (that is, the time consumed to reach the parking position point A, referred to as the consumed time), and the augmented reality device can determine the movement route with the minimum consumed time as the optimal movement route.

[0134] Furthermore, the augmented reality device 600 can display a prompt message for the optimal moving route in the display area as shown in Figure 6, "The optimal moving route to point A has been identified, do you want to view it?", and at the same time display a confirmation control and a cancel control. The target object 60a can view the optimal moving route by triggering the confirmation control, and can also refuse to view the optimal moving route by triggering the cancel control. The confirmation control can be understood as a guidance control for the optimal moving route. As shown in Figure 6, after the target object 60a triggers the confirmation control, the augmented reality device 600 can respond to this trigger operation and display the optimal movement route in the display area. As shown in Figure 6, the optimal movement route is the route from the key position point B1 to the parking position point A, and the route also includes the key position point B2, the key position point B3 and the key position point B4. Then the target object 60a can follow the guidance of the optimal movement route, first moving from the current key position point B1 to the key position point B2, then from the key position point B2 to the key position point B3, then from the key position point B3 to the key position point B4, and finally moving from the key position point B4 to the parking position point A.

[0135] It should be noted that after the target object selects the optimal movement route as the movement route to the parking location, when the target object reaches any subsequent key location, the optimal movement route for the subsequent key location is no longer determined. The target object only needs to continue moving according to the optimal movement route for the target key location. For example, in the embodiment corresponding to Figure 6, when the target object 60a reaches key location B2 according to the optimal movement route, the augmented reality device only needs to prompt the target object 60a that it has reached key location B2 and can then proceed to key location B3. The augmented reality device does not need to determine the optimal movement route for the target object at key location B2 again in the above manner.

[0136] In an embodiment of the present application, an augmented reality device is used to continuously record key position points of the target object in the process of moving from the parking position to the destination position. When the target object is looking for the target item, the above series of key position points provide intelligent guidance for returning to the parking position of the target item. This can effectively assist the target object in reaching the parking position of the target item. Even if there is no navigation satellite signal (such as a GNSS signal) or other navigation coordinate signal during the round trip, the parking position can be reached quickly and accurately with the help of the intelligent guidance provided by a series of key position points. There is no need to manually find the path to the parking position, which can greatly improve the efficiency of finding the target item. In addition, in the process of assisting the target object to reach the parking position of the target item, the present application can also refer to the moving routes of other objects to reach the parking position. In this way, the target object can return to the parking position in a sufficiently short time, thereby further improving the efficiency of finding the target item.

[0137] Further, please refer to Figure 7, which is a schematic diagram of a process for identifying and recording key location points provided by an embodiment of the present application. This process may correspond to the process in the embodiment corresponding to Figure 3 above, in which, in response to the target object's navigation request for the target item, the target object's first environmental change information during the first movement is collected by the augmented reality device worn by the target object. Specifically, it may refer to the process of identifying and recording the key location points reached by the target object during the second movement of the target object. As shown in Figure 7, the process may include at least the following steps S701-S703:

[0138] Step S701, when the location recording signal of the target object is detected, the second environmental change information of the target object during the second movement process is collected through the augmented reality device worn by the target object; the second movement process refers to the process of moving from the parking position point of the target object to the destination position point.

[0139] Specifically, the location recording signal here can refer to a location recording instruction issued by the target object. For example, the target object can issue a request to record key location points, and the augmented reality device can be considered to have issued a location recording instruction by the target object, and the location recording instruction can be used as a location recording signal. In some specific scenarios, the location recording signal can also refer to other specific signals. For example, in the scenario where the target object is a vehicle, the location recording signal can also be a signal that recognizes that the vehicle (such as a car) has entered the parking lot. Once it is recognized that the target object is driving the vehicle into the parking lot, the augmented reality device can be activated to collect environmental change information. Here, a camera and a deep learning classification model (specifically, a deep learning model with recognition function can be used to identify whether the vehicle has entered the parking lot); in addition, the location recording signal can also refer to a signal that the vehicle is turned off; a signal that the target object has switched from a driving state to a walking state, etc. That is, in the scenario where the target object is a vehicle, the location recording signal can refer to a signal that the vehicle has entered the parking lot, a signal that the vehicle has turned off, a signal that the target object has switched from a driving state to a walking state, etc.

[0140] For example, taking the target object as a vehicle, the specific implementation method for detecting the position recording signal may be: the driving data of the target object with respect to the vehicle may be obtained, and then the driving data of the target object may be subjected to state analysis processing (that is, the driving state of the target object with respect to the vehicle is analyzed through the driving data of the target object), thereby obtaining the driving state of the target object; then, when a first state switching signal is detected indicating that the driving state switches from a driving state to a driving stop state, the first state switching signal may be converted into a position recording signal for the target object.

[0141] The driving data here can refer to the data of the inertial measurement unit (IMU) or GNSS data. The IMU can measure the angular velocity and linear acceleration of the body and is not affected by the external environment. By analyzing the IMU of the target object, it can be determined whether the target object is in the driving state or the driving stop state (usually, the angular velocity and linear acceleration of the target object in the driving state are both large values); and the GNSS data can record the speed. Usually, the walking speed of the target object will be much lower than the speed in the driving state. Therefore, by analyzing the GNSS data of the target object, it can also be determined whether the target object is in the driving state or the driving stop state. When it is detected that the driving state switches from the driving state to the driving stop state, it can be used as a position recording signal. In other words, once it is detected that the driving state switches from the driving state to the driving stop state, the environmental change information can be collected through the augmented reality device.

[0142] Step S702: When a position point containing target recognition information exists in the second environment change information collected by the augmented reality device, the position point containing the target recognition information is determined as a target key position point.

[0143] Specifically, when the target object reaches a certain position point, if it is recognized that the position point contains certain recognition information (such as target recognition information), then the position point can be determined as a key position point (such as a target key position point).

[0144] Step S703: storing and recording the target key position points.

[0145] Specifically, each key position point including the target key position point can be stored and recorded. When a position stop recording signal is received, it can be determined that the target object has reached the destination position point, and the position point of the target object at the current moment (the current moment can be understood as the moment when the position stop recording signal is received) can be determined as the destination position point. Subsequently, a collection stop instruction can be generated to instruct the augmented reality device to stop collecting the second environmental change information of the target object during the second movement process.

[0146] The position stop recording signal here may also refer to a position stop recording instruction issued by the target object. For example, after the target object reaches the destination location, the target object may issue a request to stop recording the location, and the augmented reality device may deem that the target object has issued a position stop recording instruction, and the position stop recording instruction may serve as a position stop recording signal. Of course, the position stop recording signal may also refer to the detection of other signals. For example, if the augmented reality device detects that the target object has not moved after reaching a certain location and has been stationary for a long period of time, then the augmented reality device may deem that the target object has reached the destination location, and the signal indicating that the target object has been stationary for a long period of time may serve as a position stop recording signal. For another example, after the target object reaches a certain location, the augmented reality device recognizes that a large area where the location is located has a GNSS signal. In this case, the target object can navigate to the location based on the GNSS signal, without wasting resources on collecting environmental change information. Therefore, the augmented reality device may implicitly deem that the target object has reached the destination location, and may stop collecting environmental change information and stop recording subsequent key location points. For another example, after the target object reaches a certain location, the augmented reality device may stop collecting environmental change information and stop recording subsequent key location points. If it is detected that the location point is associated with a point of interest in the online map (a point of interest may refer to a recognizable location point included in the online map, such as a bus stop, a shop, a mailbox, etc.), the target object can navigate through the online map where the associated point of interest is located, without wasting resources on collecting environmental change information. Therefore, the augmented reality device can implicitly deem that the target object has arrived at the destination location point, and can stop collecting environmental change information and stop recording subsequent key location points. For example, after the target object arrives at a certain location point, the augmented reality device detects that the location point can be located through images, Bluetooth beacons, navigation maps, etc., and the location point has navigation attributes. The target object can directly perform positioning and navigation, so the augmented reality device can implicitly deem that the target object has arrived at the destination location point, and can stop collecting environmental change information and stop recording subsequent key location points.

[0147] That is to say, the method for detecting the position stop recording signal can be specifically as follows: the movement data of the target object in the second movement process can be obtained, and then the movement data of the target object can be subjected to state analysis processing, thereby obtaining the movement state of the target object; then, when a second state switching signal is detected in which the movement state switches from a continuous moving state to a continuous stationary state, the second state switching signal can be converted into a position stop recording signal for the target object.

[0148] Among them, the movement data of the target object may refer to walking data. By performing state analysis and processing on the movement data of the target object, it can be determined whether the target object has been stationary for a long time. When the target object has been stationary for a long time, it can be determined that the target object is in a continuous stationary state. Once it is detected that the target object is in a continuous stationary state, the collection of the second environmental change information can be stopped.

[0149] Based on the above, the method for detecting the position stop recording signal can be specifically as follows: the navigation signal attributes of the area to which the target key position point belongs can be detected; if an attribute switching signal is detected that the navigation signal attribute switches from the navigation signal missing attribute to the navigation signal valid attribute, the attribute switching signal can be converted into a position stop recording signal for the target object.

[0150] Specifically, the navigation signal attribute here may refer to the attribute of whether the target key position point can be positioned and navigated. When the target key position point has a GNSS signal, there is an associated point of interest, or the position point can be positioned, the target key position point can be considered to have a navigation signal, and its navigation signal attribute can be understood as a valid navigation signal attribute. If the target key position point does not have a GNSS signal, does not have an associated point of interest, and cannot be positioned, it can be considered that the target key position point does not have a navigation signal, and the navigation signal attribute is a missing navigation signal attribute. During the second movement of the target object, once it is detected that the position point where the target object is located has switched from the missing navigation signal attribute to the valid navigation signal attribute, it can be considered that the target object has arrived in an area where navigation and positioning can be performed, and there is no need to collect environmental change information to record key position points.

[0151] In an embodiment of the present application, an augmented reality device is used to continuously record the key position points of the target object in the process of moving from the parking position to the destination position, so that when the target object is looking for the target item, the above series of key position points can provide intelligent guidance for returning to the parking position of the target item, thereby assisting the target object to reach the parking position of the target item. Even if there is no navigation satellite signal (such as GNSS signal) or other navigation coordinate signal during the round trip, the target object can quickly and accurately reach the parking position with the help of the intelligent guidance provided by a series of key position points, without the need to manually find the path to the parking position, which can greatly improve the efficiency of finding the target item. In this process, the present application can use a variety of methods to determine whether the target object has set out for the destination position and whether it has arrived at the destination position, thereby reasonably starting or stopping the collection of environmental information to save equipment resources.

[0152] Further, please refer to Figure 8, which is a schematic diagram of the architecture of an augmented reality device provided in an embodiment of the present application. As shown in Figure 8, the augmented reality device may include at least: a sensor, a display, a communication component, a heat dissipation component, an interaction component, a computer processor, and an energy storage component. The following will describe the various components of this architecture:

[0153] Sensors: Sensors can include at least one camera, IMU, GNSS, microphone, air pressure sensor, IR camera, lidar sensor, ultra-wideband (UWB) technology, etc. The sensors can collect environmental change information of the target object.

[0154] Display: The display should at least be able to play media data such as videos, images, and text. It can be used to display relevant content.

[0155] Communication components: Communication components may include at least but not limited to WIFI, cellular network, Bluetooth, Near Field Communication (NFC), infrared sensor, etc.

[0156] Interaction components: Interaction components may include at least buttons, speakers, vibration motors, etc., which can be used to interact with target objects.

[0157] Computer processor: The computer processor can be used to process environmental change information, obtain a series of key location points, and generate a critical path.

[0158] Energy storage component: The energy storage component can be used to store energy.

[0159] Heat dissipation component: The heat dissipation component can be used to dissipate heat.

[0160] It should be noted that the environmental change information and a series of key location points collected by the augmented reality device can be uploaded to the business server or terminal device. Then, when the energy (such as power) of the augmented reality device is too low, the display capacity of the display is limited or it fails, the corresponding services can be provided through the data stored on the business server or terminal device.

[0161] For the functions provided by the various components of the augmented reality device in the embodiments of the present application, please refer to the descriptions in the above embodiments, and will not be elaborated here.

[0162] In an embodiment of the present application, an augmented reality device is used to continuously record key position points of the target object in the process of moving from the parking position to the destination position. When the target object is looking for the target item, the above series of key position points can provide intelligent guidance for returning to the parking position of the target item. This can effectively assist the target object in reaching the parking position of the target item. Even if there is no navigation satellite signal (such as a GNSS signal) or other navigation coordinate signal during the round trip, the parking position can be reached quickly and accurately with the help of the intelligent guidance provided by a series of key position points. There is no need to manually find the path to the parking position, which can greatly improve the efficiency of finding the target item.

[0163] Further, to facilitate understanding of the overall process, please refer to Figure 9, which is a system logic flow chart provided in an embodiment of the present application. As shown in Figure 9, the system flow may include at least the following steps S91-S96:

[0164] Step S91: receiving a location recording signal.

[0165] Specifically, when a location recording signal is received, the environment change information of the target object can be collected and key location points can be identified and recorded.

[0166] Step S92, determining whether there is a navigation signal.

[0167] Specifically, for each location point where the target object is located (such as the location point where the target object is located when the location recording signal is received), it can be identified and detected whether it has a navigation signal (such as whether it has a GNSS signal). If it has a navigation signal, the subsequent step S93 can be executed; if it does not have a navigation signal, the subsequent step S94 can be executed.

[0168] Step S93: record the navigation signal.

[0169] Specifically, for location points with navigation signals, the navigation signals can be recorded together.

[0170] Step S94: identifying and recording key location points.

[0171] Specifically, when there is no navigation signal at the location of the target object, the key location points may continue to be identified and recorded.

[0172] Step S95: Determine whether the end condition is met.

[0173] Specifically, during the movement of the target object, key position points may be continuously identified and recorded until a position stop recording signal is received. The termination condition here is whether the position stop recording signal is received. If the position stop recording signal is received, the termination condition may be considered to have been met, and the subsequent step S96 may be executed. If the position stop recording signal is not received, the termination condition may be considered to have not been met, and step S95 may be continued, i.e., identification and recording of key position points may continue.

[0174] Step S96, stop recording and upload the record.

[0175] Specifically, each key location point recorded can be uploaded to a terminal device or a business server.

[0176] For the specific implementation of steps S91 to S96, please refer to the description of the above embodiments, which will not be described in detail here. The beneficial effects brought about by them will also not be described in detail here.

[0177] Further, please refer to Figure 10, which is a schematic diagram of the structure of a data processing device provided in an embodiment of the present application. The data processing device can be a computer program (including program code) running on a computer device, for example, the data processing device is an application software; the data processing device can be used to execute the method shown in Figure 3. As shown in Figure 10, the data processing device 1 can include: a response module 11 and a prompt output module 12.

[0178] A response module 11 is configured to respond to a navigation request from a target object for a target item, and collect, through an augmented reality device worn by the target object, first environmental change information of the target object during a first movement process; the first movement process being a process of moving from a starting location to a parking location of the target item;

[0179] The prompt output module 12 is used to output movement guidance prompt information associated with the target key position point when the first environmental change information collected by the augmented reality device includes the target key position point; the movement guidance prompt information is used to guide the target object to reach the parking position point; the target key position point refers to the position point containing target recognition information collected by the augmented reality device during the process of the target object moving from the parking position point to the destination position point; the starting position point refers to any position point where the target object is located during the process of the target object moving from the destination position point to the parking position point.

[0180] The specific implementation of the response module 11 and the prompt output module 12 can refer to the description of step S101 to step S102 in the embodiment corresponding to FIG3 , and will not be repeated here.

[0181] In one embodiment, the movement guidance prompt information associated with the target key position point refers to a recorded video associated with the target key position point; the recorded video refers to a video captured by the augmented reality device during the process of the target object moving from the parking position point to the destination position point, used to record the target recognition information and the surrounding environment where the target recognition information is located;

[0182] When the first environmental change information collected by the augmented reality device includes a target key position point, the prompt output module 12 outputs the movement guidance prompt information associated with the target key position point, including:

[0183] When the first environmental change information collected by the augmented reality device includes the target key location point, displaying a first playback control for the recorded video;

[0184] In response to the triggering operation of the target object on the first playback control, the playback recorded video is output.

[0185] In one embodiment, the movement guidance prompt information associated with the target key position point refers to audio guidance prompt information associated with the target key position point; the audio guidance prompt information is generated based on the target key position point and a predecessor key position point; the predecessor key position point refers to a position point containing predecessor recognition information during the process of the target object moving from the parking position point to the destination position point; during the process of the target object moving from the parking position point to the destination position point, the time when the target object arrives at the target key position point is later than the time when the target object arrives at the predecessor key position point;

[0186] When the first environmental change information collected by the augmented reality device includes a target key position point, the prompt output module 12 outputs the movement guidance prompt information associated with the target key position point, including:

[0187] When the first environmental change information collected by the augmented reality device includes a target key position point, audio guidance prompt information is output and played; the audio guidance prompt information is used to instruct the target object to move from the target key position point to the previous key position point.

[0188] In one embodiment, the movement guidance prompt information carries a second playback control for a global video; the global video refers to a video captured by an augmented reality device to record the movement path of the target object during the process of the target object moving from a parking location to a destination location; the movement path recorded by the global video includes key target locations;

[0189] In one embodiment, after the prompt output module 12 outputs the movement guidance prompt information associated with the target key position point, the data processing device 1 further includes: a video reverse processing module 13 and a video output module 14 .

[0190] The video reverse processing module 13 is used to respond to the triggering operation of the target object on the second playback control, reverse the global video, and obtain a reversed video corresponding to the global video;

[0191] The video output module 14 is used to output and play the reverse sequence video; the reverse sequence video is used to indicate the global route of the target object moving from the target key position point to the parking position point.

[0192] The specific implementation of the video reverse processing module 13 and the video output module 14 can refer to the description of step S102 in the embodiment corresponding to FIG3 , and will not be repeated here.

[0193] In one embodiment, when the first environmental change information collected by the augmented reality device includes a target key location point, the prompt output module 12 outputs the movement guidance prompt information associated with the target key location point in a specific manner, including:

[0194] When the first environmental change information collected by the augmented reality device includes a target key location point, a guidance control for an optimal movement route is displayed; the consumption time indicated by the optimal movement route is the minimum consumption time; the consumption time indicated by the optimal movement route refers to the time consumed to move from the target key location point to the parking location point;

[0195] In response to a triggering operation of the guidance control by the target object, the guidance prompt information including the optimal movement route is determined as the movement guidance prompt information associated with the target key location point;

[0196] Output the movement guidance prompt information associated with the target key position points.

[0197] In one embodiment, when the first environmental change information collected by the augmented reality device includes a target key location point, the prompt output module 12 displays a guidance control for the optimal movement route in a specific manner, including:

[0198] When the first environmental change information collected by the augmented reality device includes a target key location point, obtaining a global video associated with the target object; the global video refers to a video collected by the augmented reality device to record the movement path of the target object during the process of the target object moving from the parking location point to the destination location point;

[0199] Determine the target movement route of the target object from the target key position point to the parking position point through the global video;

[0200] Comparing the target movement route with each historical movement route in the historical movement route set to obtain the optimal movement route; a historical movement route in the historical movement route set refers to a movement route of a historical object stored in the augmented reality device from the target key position point to the parking position point;

[0201] Displays guidance controls for optimal movement routes.

[0202] In one embodiment, the prompt output module 12 compares the target movement route with each historical movement route in the historical movement route set to obtain the optimal movement route in a specific manner including:

[0203] Determine each historical movement route in the historical movement route set and the target movement route as a candidate movement route to obtain a candidate movement route set;

[0204] Counting the time required for each candidate moving route in the candidate moving route set to obtain a set of time required;

[0205] The candidate moving route indicated by the minimum consumed time in the consumed time set is determined as the optimal moving route.

[0206] In one embodiment, when the first environmental change information collected by the augmented reality device includes a target key location point, the prompt output module 12 outputs the movement guidance prompt information associated with the target key location point in a specific manner, including:

[0207] When the first environmental change information collected by the augmented reality device includes a target key location point, determining movement guidance prompt information associated with the target key location point according to the navigation signal attribute of the area to which the target key location point belongs;

[0208] Output the movement guidance prompt information associated with the target key position points.

[0209] In one embodiment, the prompt output module 12 determines the specific manner of the movement guidance prompt information associated with the target key location point according to the navigation signal attributes of the area to which the target key location point belongs, including:

[0210] Obtain the navigation signal attributes of the area to which the target key location point belongs;

[0211] If the navigation signal attribute is a valid navigation signal attribute, obtaining a regional navigation map of the area to which the target key location point belongs, and determining the regional navigation map as movement guidance prompt information associated with the target key location point;

[0212] If the navigation signal attribute is a navigation signal missing attribute, then the recorded video associated with the target key position point is obtained, and the recorded video is determined as the movement guidance prompt information associated with the target key position point; the recorded video refers to the video collected by the augmented reality device during the process of the target object moving from the parking position point to the destination position point, which is used to record the target recognition information and the surrounding environment where the target recognition information is located.

[0213] In one embodiment, before the response module 11 responds to the target object's navigation request for the target item and collects the first environmental change information of the target object during the first movement process through the augmented reality device worn by the target object, the data processing device 1 also includes: an information collection module 15, a position point determination module 16 and a position point storage module 17.

[0214] The information collection module 15 is configured to collect, when detecting a target object's location recording signal, second environmental change information of the target object during a second movement process through the augmented reality device worn by the target object; the second movement process is a process of moving the target object from a parking location to a destination location;

[0215] a position point determination module 16 configured to, when a position point containing target recognition information exists in the second environment change information collected by the augmented reality device, determine the position point containing the target recognition information as a target key position point;

[0216] The position point storage module 17 is used to store and record target key position points.

[0217] The specific implementation of the information collection module 15, the location point determination module 16 and the location point storage module 17 can be found in the description of steps S701 to S703 in the embodiment corresponding to FIG7 above, and will not be repeated here.

[0218] In one embodiment, the target item is a vehicle;

[0219] When the information acquisition module 15 detects the position recording signal of the target object, before collecting the second environmental change information of the target object during the second movement process through the augmented reality device worn by the target object, the data processing device 1 also includes: an analysis module 18 and a signal conversion module 19.

[0220] An analysis module 18 is configured to obtain driving data of a target object with respect to a vehicle, perform state analysis on the driving data of the target object, and obtain a driving state of the target object;

[0221] The signal conversion module 19 is configured to convert the first state switching signal, when detecting a first state switching signal indicating that the driving state switches from the driving proceeding state to the driving stopped state, into a position recording signal for the target object.

[0222] The specific implementation of the analysis module 18 and the signal conversion module 19 can be found in the description of step S701 in the embodiment corresponding to FIG. 7 , and will not be described in detail here.

[0223] In one embodiment, after the location point storage module 17 stores and records the target key location points, the data processing device 1 further includes: a destination point determination module 20 and an instruction generation module 21 .

[0224] The destination point determination module 20 is configured to determine the current location of the target object as the destination point when receiving the position stop recording signal;

[0225] The instruction generation module 21 is used to generate a collection stop instruction; the collection stop instruction is used to instruct the augmented reality device to stop collecting the second environment change information of the target object during the second movement process.

[0226] The specific implementation of the destination determination module 20 and the instruction generation module 21 can be found in the description of step S703 in the embodiment corresponding to FIG. 7 , and will not be described in detail here.

[0227] In one embodiment, before the destination point determination module 20 determines the current location of the target object as the destination location when receiving the location stop recording signal, the data processing device 1 further includes: a data analysis module 22 and a first conversion module 23 .

[0228] A data analysis module 22 is configured to obtain movement data of the target object during the second movement process, perform state analysis on the movement data of the target object, and obtain a movement state of the target object;

[0229] The first conversion module 23 is configured to convert the second state switching signal, when detecting a second state switching signal indicating that the moving state switches from the continuous moving state to the continuous stationary state, into a signal for stopping recording the position of the target object.

[0230] The specific implementation of the data analysis module 22 and the first conversion module 23 can be found in the description of step S703 in the embodiment corresponding to FIG7 , and will not be described in detail here.

[0231] In one embodiment, when the destination point determination module 20 receives the position stop recording signal, before determining the current position of the target object as the destination position, the data processing device 1 further includes: an attribute detection module 24 and a second conversion module 25 .

[0232] The attribute detection module 24 is used to detect the attributes of the navigation signal in the area where the target key position point belongs;

[0233] The second conversion module 25 is configured to convert the attribute switching signal into a signal for stopping recording the position of the target object if an attribute switching signal indicating that the attribute of the navigation signal is switched from the navigation signal missing attribute to the navigation signal valid attribute is detected.

[0234] The specific implementation of the attribute detection module 24 and the second conversion module 25 can refer to the description of step S703 in the embodiment corresponding to FIG. 7 , and will not be described in detail here.

[0235] In an embodiment of the present application, an augmented reality device is used to continuously record key position points of the target object in the process of moving from the parking position to the destination position. When the target object is looking for the target item, the above series of key position points can provide intelligent guidance for returning to the parking position of the target item. This can effectively assist the target object in reaching the parking position of the target item. Even if there is no navigation satellite signal (such as a GNSS signal) or other navigation coordinate signal during the round trip, the parking position can be reached quickly and accurately with the help of the intelligent guidance provided by a series of key position points. There is no need to manually find the path to the parking position, which can greatly improve the efficiency of finding the target item.

[0236] Further, please refer to Figure 11, which is a structural diagram of a computer device provided in an embodiment of the present application. As shown in Figure 11, the above-mentioned computer device 8000 may include: a processor 8001, a network interface 8004 and a memory 8005. In addition, the above-mentioned computer device 8000 also includes: a user interface 8003, and at least one communication bus 8002. Among them, the communication bus 8002 is used to realize the connection and communication between these components. Among them, the user interface 8003 may include a display screen (Display), a keyboard (Keyboard), and the optional user interface 8003 may also include a standard wired interface and a wireless interface. The network interface 8004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 8005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 8005 may also be at least one storage device located away from the aforementioned processor 8001. As shown in Figure 11, the memory 8005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module and a device control application.

[0237] In the computer device 8000 shown in FIG11 , the network interface 8004 can provide network communication functions; the user interface 8003 is mainly used to provide an interface for user input; and the processor 8001 can be used to call the device control application stored in the memory 8005 to achieve:

[0238] In response to a navigation request from a target object for a target item, first environmental change information of the target object during a first movement process is collected by the augmented reality device worn by the target object; the first movement process is a process of moving from a starting location to a parking location of the target item;

[0239] When the first environmental change information collected by the augmented reality device includes a target key position point, movement guidance prompt information associated with the target key position point is output; the movement guidance prompt information is used to guide the target object to reach the parking position point; the target key position point refers to a position point containing target recognition information collected by the augmented reality device during the process of moving from the parking position point to the destination position point; the starting position point refers to any position point where the target object is located during the process of moving from the destination position point to the parking position point.

[0240] It should be understood that the computer device 8000 described in the embodiments of the present application can execute the data processing method described in the embodiments corresponding to Figures 3 to 9 above, and can also execute the data processing device 1 described in the embodiment corresponding to Figure 10 above, and the description thereof will not be repeated here. In addition, the description of the beneficial effects of using the same method will not be repeated here.

[0241] In addition, it should be pointed out here that: the embodiment of the present application also provides a computer-readable storage medium, and the above-mentioned computer-readable storage medium stores a computer program executed by the computer device 8000 for data processing mentioned above, and the above-mentioned computer program includes program instructions. When the above-mentioned processor executes the above-mentioned program instructions, it can execute the description of the above-mentioned data processing method in the embodiments corresponding to Figures 3 to 9 above. Therefore, it will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application.

[0242] The computer-readable storage medium may be the data processing device provided in any of the aforementioned embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device. Furthermore, the computer-readable storage medium may also include both the internal storage unit of the computer device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0243] In one aspect of the present application, a computer program product is provided, comprising a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the method provided in one aspect of the embodiments of the present application.

[0244] The terms "first", "second", etc. in the description, claims, and drawings of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other step units inherent to these processes, methods, apparatuses, products, or devices.

[0245] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0246] The method and related apparatus provided in the embodiment of the present application are described with reference to the method flow chart and / or structural diagram provided in the embodiment of the present application, and specifically can be implemented by computer program instructions for each process and / or box of the method flow chart and / or structural diagram, and the combination of the process and / or box in the flow chart and / or block diagram. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the function specified in one process or multiple processes of the flow chart and / or one box or multiple boxes of the structural diagram. These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device, and the instruction device implements the function specified in one process or multiple processes of the flow chart and / or one box or multiple boxes of the structural diagram. These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the structural diagram.

[0247] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A data processing method, characterized in that: The method is performed by a computer device, and the method includes: In response to a navigation request of a target object for a target item, first environmental change information of the target object in a first movement process is collected through an augmented reality device worn by the target object; the first movement process refers to a process of moving from a starting position point to a parking position point of the target item; When the first environmental change information collected by the augmented reality device includes a target key position point, the movement guidance prompt information associated with the target key position point is output; the movement guidance prompt information is used to guide the target object to reach the parking position point; the target key position point refers to a position point containing target recognition information collected by the augmented reality device during the process of moving from the parking position point to the destination position point; the starting position point refers to any position point where the target object is located during the process of moving from the destination position point to the parking position point.

2. The method according to claim 1, characterized in that The movement guidance prompt information associated with the target key position point refers to the recorded video associated with the target key position point; the recorded video refers to the video collected by the augmented reality device during the process of the target object moving from the parking position point to the destination position point for recording the target recognition information and the surrounding environment where the target recognition information is located; When the first environment change information collected by the augmented reality device includes a target key position point, outputting movement guidance prompt information associated with the target key position point includes: When the first environmental change information collected by the augmented reality device includes a target key position point, displaying a first playback control for the recorded video; In response to the triggering operation of the target object on the first playback control, the recorded video is output and played.

3. The method according to any one of claims 1 to 2, characterized in that: The movement guidance prompt information associated with the target key position point refers to the audio guidance prompt information associated with the target key position point; the audio guidance prompt information is generated based on the target key position point and the predecessor key position point; the predecessor key position point refers to the position point containing the predecessor recognition information during the process of the target object moving from the parking position point to the destination position point; In the process of the target object moving from the parking position to the destination position, the time when the target object arrives at the target key position is later than the time when the target object arrives at the successor key position; When the first environment change information collected by the augmented reality device includes a target key position point, outputting movement guidance prompt information associated with the target key position point includes: When the first environmental change information collected by the augmented reality device includes a target key position point, outputting and playing the audio guidance prompt information; The audio guidance prompt information is used to instruct the target object to move from the target key position point to the predecessor key position point.

4. The method according to any one of claims 1 to 3, characterized in that: The movement guidance prompt information carries a second playback control for a global video; the global video refers to a video collected by the augmented reality device for recording a moving path of the target object during the process of the target object moving from the parking position to the destination position; The moving path recorded by the global video includes the target key position point; After outputting the movement guidance prompt information associated with the target key position point, the method further includes: In response to the triggering operation of the target object on the second playback control, the global video is processed in reverse order to obtain a reverse order video corresponding to the global video; The reverse video is output for playing; the reverse video is used to indicate the global route of the target object moving from the target key position point to the parking position point.

5. The method according to any one of claims 1 to 4, characterized in that: When the first environment change information collected by the augmented reality device includes a target key position point, outputting movement guidance prompt information associated with the target key position point includes: When the first environmental change information collected by the augmented reality device includes a target key position point, a guidance control for an optimal moving route is displayed; the consumption time indicated by the optimal moving route is the minimum consumption time; the consumption time indicated by the optimal moving route refers to the time consumed to move from the target key position point to the parking position point; In response to a triggering operation of the target object on the guidance control, determining the guidance prompt information including the optimal moving route as the moving guidance prompt information associated with the target key position point; Output the movement guidance prompt information associated with the target key position point.

6. The method according to claim 5, characterized in that When the first environmental change information collected by the augmented reality device includes a target key location point, displaying a guidance control for an optimal moving route includes: When the first environmental change information collected by the augmented reality device includes a target key position point, a global video associated with the target object is obtained; the global video refers to a video collected by the augmented reality device for recording a moving path of the target object during the process of the target object moving from the parking position point to the destination position point; Determining a target moving route of the target object from the target key position point to the parking position point through the global video; Comparing the target moving route with each historical moving route in the historical moving route set to obtain an optimal moving route; a historical moving route in the historical moving route set refers to a moving route of a historical object stored in the augmented reality device from the target key position point to the parking position point; A guidance control for the optimal movement route is displayed.

7. The method according to claim 6, characterized in that The step of comparing the target moving route with each historical moving route in the historical moving route set to obtain the optimal moving route includes: Determine each historical moving route in the historical moving route set and the target moving route as candidate moving routes to obtain a candidate moving route set; Counting the time consumption required for each candidate moving route in the candidate moving route set to obtain a set of consumed time consumptions; The candidate moving route indicated by the minimum consumed time in the consumed time set is determined as the optimal moving route.

8. The method according to any one of claims 1 to 7, characterized in that: When the first environment change information collected by the augmented reality device includes a target key position point, outputting movement guidance prompt information associated with the target key position point includes: When the first environment change information collected by the augmented reality device includes a target key position point, determining movement guidance prompt information associated with the target key position point according to a navigation signal attribute of an area to which the target key position point belongs; Output the movement guidance prompt information associated with the target key position point.

9. The method according to claim 8, characterized in that The step of determining the movement guidance prompt information associated with the target key position point according to the navigation signal attribute of the area to which the target key position point belongs includes: Obtaining the navigation signal attributes of the area to which the target key position point belongs; If the navigation signal attribute is a valid navigation signal attribute, obtaining a regional navigation map of the area to which the target key position point belongs, and determining the regional navigation map as movement guidance prompt information associated with the target key position point; If the navigation signal attribute is a navigation signal missing attribute, a recorded video associated with the target key position point is obtained, and the recorded video is determined as the movement guidance prompt information associated with the target key position point; the recorded video refers to the movement guidance prompt information associated with the target key position point when the target object moves from the In the process of moving the parking position point to the destination position point, the video collected by the augmented reality device is used to record the target recognition information and the surrounding environment where the target recognition information is located.

10. The method according to any one of claims 1 to 9, characterized in that: Before responding to a navigation request of the target object for the target item and collecting first environmental change information of the target object during a first movement through an augmented reality device worn by the target object, the method further includes: When the position recording signal of the target object is detected, the second environmental change information of the target object in the second movement process is collected through the augmented reality device worn by the target object; the second movement process refers to the process of moving from the parking position point of the target object to the destination position point; When there is a position point containing target recognition information in the second environment change information collected by the augmented reality device, determining the position point containing the target recognition information as a target key position point; The target key position points are stored and recorded.

11. The method according to claim 10, characterized in that The target object is a means of transportation; When the location recording signal of the target object is detected, before collecting second environment change information of the target object in the second movement process through the augmented reality device worn by the target object, the method further includes: Acquiring driving data of the target object for the vehicle, performing state analysis processing on the driving data of the target object, and obtaining the driving state of the target object; When a first state switching signal indicating that the driving state is switched from a driving-in-progress state to a driving-stopped state is detected, the first state switching signal is converted into a position recording signal for the target object.

12. The method according to any one of claims 10 to 11, characterized in that: After storing and recording the target key position points, the method further includes: When a position stop recording signal is received, the position point of the target object at the current moment is determined as the destination position point; Generate a collection stop instruction; the collection stop instruction is used to instruct the augmented reality device to stop collecting the second environment change information of the target object during the second movement process.

13. The method according to claim 12, characterized in that When the position stop recording signal is received, before determining the position point of the target object at the current moment as the destination position point, the method further includes: Acquiring movement data of the target object during the second movement process, performing state analysis processing on the movement data of the target object, and obtaining a movement state of the target object; When a second state switching signal is detected in which the moving state switches from the continuous moving state to the continuous stationary state, the second state switching signal is converted into a signal for stopping recording the position of the target object.

14. The method according to any one of claims 12 to 13, characterized in that: When the position stop recording signal is received, before determining the position point of the target object at the current moment as the destination position point, the method further includes: Detecting the navigation signal attributes of the area to which the target key position point belongs; If an attribute switching signal is detected, indicating that the attribute of the navigation signal is switched from the navigation signal missing attribute to the navigation signal valid attribute, the attribute switching signal is converted into a signal for stopping recording the position of the target object.

15. A data processing device, characterized in that: The device is applied to a computer device, and comprises: A response module, used to respond to a navigation request of a target object for a target item, and collect first environmental change information of the target object in a first movement process through an augmented reality device worn by the target object; the first movement process refers to a process of moving from a starting position point to a parking position point of the target item; A prompt output module is used to output movement guidance prompt information associated with the target key position point when the first environmental change information collected by the augmented reality device includes the target key position point; the movement guidance prompt information is used to guide the target object to reach the parking position point; the target key position point refers to a position point containing target recognition information collected by the augmented reality device during the process of moving from the parking position point to the destination position point; the starting position point refers to any position point where the target object is located during the process of moving from the destination position point to the parking position point.

16. A computer device, characterized in that: include: Processor, memory, and network interface; The processor is connected to the memory and the network interface, wherein the network interface is used to provide a network communication function, the memory is used to store a computer program, and the processor is used to call the computer program so that the computer device executes the method described in any one of claims 1-14.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and executing the method according to any one of claims 1 to 14.

18. A computer program product, characterized in that The computer program product comprises a computer program, which is stored in a computer-readable storage medium. The computer program is suitable for being read and executed by a processor, so that a computer device having the processor executes the method according to any one of claims 1 to 14.

Images