Service guiding method and device, electronic equipment and computer readable storage medium

Abstract

The embodiment of the invention discloses a service guiding method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of augmented reality. The method comprises the following steps: determining a target service, and obtaining preparatory work required by the target service from a target system of the target service; intelligently guiding the user to complete preparatory work based on the AR technology, and detecting whether the preparatory work is completed or not; sending an online queuing request of a user to a target system, obtaining number calling information returned by the target system, and displaying the number calling information in real time by using a virtual screen of the AR equipment; and when the number calling information is about to call the user and the preparatory work is completed, displaying a virtual navigation element in a real environment through a virtual screen so as to guide the user to go to a providing place of the target service. Therefore, the scheme can effectively improve the service efficiency.

Description

Technical Field

[0001] This application relates to the field of augmented reality technology, specifically to a service guidance method, apparatus, electronic device, and computer-readable storage medium. Background Technology

[0002] In offline service scenarios such as banking transactions and hospital checkups, there is a technical pain point of information asymmetry. Users often only learn about the necessary preparations after arriving at the service location. For example, a user may only learn that a company seal is required for corporate transactions after arriving at a bank, or that fasting is required for imaging examinations after arriving at a hospital.

[0003] In related technologies, users can only search for relevant information online beforehand. However, online information is often complex and difficult for users to find accurate and effective information. For example, the internet may only state that "a company seal is required for corporate transfers," but it does not clearly distinguish between the company seal, the financial seal, and the legal representative's seal. Therefore, there are problems such as users being unable to complete their business upon arrival, having to make multiple trips and wasting time, and staff having to repeatedly explain the rules, increasing communication costs and reducing service efficiency. Summary of the Invention

[0004] This application provides a service guidance method, apparatus, electronic device, and computer-readable storage medium, which can effectively improve service efficiency.

[0005] In a first aspect, embodiments of this application provide a service guidance method applied to an AR device; the method includes: Identify the target service and obtain information on the preparatory work required for the target service from the target system of the target service; The system uses AR technology to intelligently guide users to complete the preparation work and detects whether the preparation work is completed. Send the user's online queuing request to the target system, obtain the call number information returned by the target system, and display the call number information in real time using the virtual screen of the AR device; When the call number is about to call the user and the preparation work is completed, virtual navigation elements are displayed in the real environment through the virtual screen to guide the user to the location where the target service is provided.

[0006] Secondly, embodiments of this application provide a service guidance device applied to an AR device; the device includes: The service determination module is used to determine the target service and obtain information on the preparatory work required for the target service from the target system of the target service. The preparation guidance module is used to intelligently guide the user to complete the preparation work based on AR technology, and to detect whether the preparation work is completed. The online queuing module is used to send the user's online queuing request to the target system, obtain the call number information returned by the target system, and display the call number information in real time using the virtual screen of the AR device; The navigation display module is used to display virtual navigation elements in the real environment through the virtual screen when the queuing information is about to call the user and the preparation work is completed, so as to guide the user to the location where the target service is provided.

[0007] Thirdly, embodiments of this application also provide an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps in the above-described service bootstrapping method.

[0008] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in the above-described service bootstrapping method.

[0009] Fifthly, embodiments of this application also provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described in embodiments of this application.

[0010] The embodiments of this application have the following beneficial effects: The system can identify the target service and retrieve necessary preparation information from its target system. This information, obtained directly from the target system, is professional, accurate, and effective. Combining this information with AR technology provides users with clear, straightforward, and visual guidance, enabling them to complete preparations in advance and improving processing efficiency upon arrival at the service location. This eliminates the need for staff to repeatedly explain rules, reducing communication costs. The system can automatically create online queues on the target system and display call numbers in real-time on the AR device's virtual screen, avoiding wasted time queuing upon arrival and preventing multiple users from crowding together. When a user is about to be called and preparations are complete, virtual navigation elements are overlaid on the real environment to accurately guide them to the service location, preventing difficulties in finding the location due to its complexity. This reduces unnecessary waiting time (including waiting for staff to explain preparation information and queuing time) and lowers on-site inquiry and communication costs, significantly improving offline service efficiency and user experience. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a schematic diagram of the steps of a service bootstrapping method provided in an embodiment of this application; Figure 2 This is a schematic diagram illustrating the instructions for filling out the form, provided in one embodiment of this application. Figure 3 This is a schematic diagram of a virtual guidance element provided in an embodiment of this application; Figure 4 This is a schematic diagram illustrating a method of medication administration provided in an embodiment of this application; Figure 5 This is a schematic diagram of the structure of a service guidance device provided in an embodiment of this application; Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0013] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0014] In one embodiment, such as Figure 1 As shown, a service guidance method is provided. Although the logical order is illustrated in the step diagram, in some cases, the steps shown or described can be performed in a different order than that shown in the diagram. Specifically, this service guidance method can be applied to augmented reality (AR) devices, where the AR device may include, but is not limited to, near-eye display terminals worn on the human head, such as glasses-shaped displays, helmet-shaped displays, etc. In this embodiment, the hardware structure of the AR device is described using an optically see-through glasses-shaped display, i.e., AR glasses, as an example.

[0015] AR glasses include a frame, consisting of temples and a frame, to support the glasses when worn on the head; an optical display module, primarily composed of microdisplays, optical lenses, and waveguides, to display virtual content to the user; an audio module, primarily composed of microphones and speakers, to collect and play sound; sensors, primarily composed of cameras, gyroscopes, barometers, and infrared emitters and receivers, to collect information about the human body, the glasses themselves, and the external environment; an integrated processor, centered on a microcontroller unit (MCU) or a central processing unit (CPU), for data processing and computation; circuit boards, flexible or rigid, to connect other electronic components and form an electronic circuit system, typically housed within the frames and temples; and a battery power supply.

[0016] Optionally, the sensors built into the AR glasses may include, but are not limited to, electromyography (EMG) sensors, heart rate monitors, blood glucose meters, and / or eye trackers. The sensors based on the AR glasses can collect the user's physiological characteristics, which may include, but are not limited to, EMG, heart rate, blood glucose, and / or eye movements.

[0017] AR devices include virtual screens. These virtual screens are not traditional physical screens, but rather simulated and generated using technology. They utilize elements such as light and images to create a display area that can show various virtual information, images, videos, and interactive interfaces. AR devices can have a sufficiently large field of view, which determines the size of the virtual screen's coverage within the user's field of vision. A larger field of view allows the user to experience a wider virtual space.

[0018] AR glasses' virtual screens can spatially display virtual elements (such as displaying rendered virtual instructions next to real content to be filled in). Spatial display refers to using AR technology to display images in space, allowing virtual elements to be precisely anchored to their corresponding positions in the real physical space. Through spatial positioning and environmental perception technologies, spatial display transforms virtual elements from isolated screen content into extensions of the real environment. Visually, the virtual elements appear to exist inherently in the real world. By naturally integrating virtual elements into the real world, an interactive resonance is created between the virtual and real worlds. This preserves the practicality of the real world while enriching information retrieval and scene experience through the addition of virtual elements. The core of spatial display is AR technology, which combines the real and virtual worlds, displaying virtual elements within a real environment.

[0019] In one embodiment, the AR device can have a built-in lightweight large model to achieve low-latency computation using local computing power, or it can call a high-performance large model in the cloud via the network. With the powerful semantic understanding, image recognition, logical reasoning and real-time decision-making capabilities of the large model, the AR device can perform various intelligent analysis and intelligent guidance tasks, such as intelligently analyzing the information transmitted by the target system, identifying object attributes, parsing environmental information and / or predicting potential risks, and intelligently guiding users to complete preparation work, guiding users to use various devices and / or providing navigation guidance, thereby greatly improving interaction efficiency and ease of operation.

[0020] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0021] according to Figure 1 The service bootstrapping method shown includes at least steps S110 to S140, which are described in detail below: In step S110, a target service is determined, and information on the preparation work required for the target service is obtained from the target system of the target service.

[0022] The target service may include public services, banking services, and / or medical services. Users need to prepare in advance to obtain the target service. Preparation may include, but is not limited to, document preparation and / or physical preparation. Document preparation may include, but is not limited to, preparing supporting documents, relevant application forms, proof of assets, and / or relevant electronic vouchers. Physical preparation may include, but is not limited to, fasting beforehand, ensuring sufficient sleep, discontinuing certain medications, and / or tidying up one's appearance before taking passport photos.

[0023] Users (the wearers of the AR glasses) can specify the target service they wish to access via voice, gestures, or text. In response to the user's specified target service, the AR glasses can register and log in to the target system (or log in directly if pre-registered), thereby obtaining information on the necessary preparations for the target service. The target system can be the official system of the target service; for example, if the target service is banking, the target system could be the bank's system; if the target service is a medical examination, the target system could be the hospital's system. Because the target system is an official system, it provides accurate and standardized information on the preparations required for various services offered by that system. The AR glasses can send the target service information to the target system to obtain the corresponding preparation information.

[0024] In one embodiment, the target system is Hospital A, and the target service is a blood test service. Hospital A's database stores accurate information about the preparation work for the blood test, which may include "fasting for at least 8 hours before the test." A user can input the voice command "I need to have a blood test at Hospital A tomorrow morning at 9 am, please help me find the preparation information" into the AR glasses. The AR glasses can then log into Hospital A's system based on the user's account and request the preparation information, obtaining the message "fasting for at least 8 hours before the blood test." The AR glasses can render and display this text information, which can be done using the AR glasses' virtual screen. Optionally, the AR glasses can also intelligently analyze the obtained preparation information and display the results, providing the user with more intuitive preparation prompts. For example, based on the information that "fasting for at least 8 hours before the blood test" and "the blood test will be conducted at 9 a.m. tomorrow", AR glasses can intelligently analyze that the latest time to eat is 1 a.m. tomorrow, and then render the intelligent analysis text information that "no eating after 1 a.m. tomorrow and before the blood test", and display this intelligent analysis text information together with the text information corresponding to the preparation work.

[0025] In step S120, the user is intelligently guided to complete the preparation work based on AR technology, and the completion of the preparation work is detected.

[0026] After obtaining the information about the preparation work, the AR glasses can intelligently analyze the preparation work and then use AR technology to intelligently guide the user to complete the preparation work according to the information. The glasses can also detect whether the preparation work has been completed.

[0027] AR glasses can provide different intelligent guidance for different types of preparation work. For example, for preparation work on an empty stomach, AR glasses can display a prompt on a virtual screen indicating that an empty stomach is required, and issue a "no eating" prompt when the user is about to eat; for preparation work involving documents, AR glasses can download the corresponding standard template from the target system, render the image of the standard template, and use AR technology to display the image in the user's field of vision, so that the user can intuitively determine what specific documents are needed and avoid ambiguity; for preparation work involving filling out forms, AR glasses can intelligently generate filling instructions and display the instructions next to the content to be filled out using AR technology, so that the user can intuitively determine how to fill out the content.

[0028] AR glasses can intelligently detect whether the user has completed the preparation work, and can also display a list of preparation work, allowing the user to select whether each preparation work in the list has been completed, thereby determining whether the preparation work is complete.

[0029] In step S130, the user's online queuing request is sent to the target system, the call number information returned by the target system is obtained, and the call number information is displayed in real time using the virtual screen of the AR device.

[0030] After a user issues an online queuing command for a target service, the AR glasses send an online queuing request for that service to the target system. This online queuing command can be used for real-time queuing of the target service or for scheduled queuing, such as scheduling an online queue for the target service at 8 AM tomorrow.

[0031] The target system receives an online queuing request from the AR glasses, can queue the user account logged into the AR glasses online, and return the queue number corresponding to the user account to the AR glasses. Each time a number is called, the system sends the call number information to the AR glasses. It's understandable that queuing is a prerequisite for calling a number; users create a service priority queue through queuing. Calling a number is the execution step of the queuing process; the system triggers the call command according to the queue order to ensure that services are provided in sequence. Based on the call number information and the user's queue number, it can be determined whether the user is about to be called.

[0032] The latest queuing information can be displayed in real time using the virtual screen of an AR device. Specifically, the virtual screen can be fixed in the upper right of the user's field of view to display the latest queuing information and the user's queue number. When the queuing information indicates that the user is about to be called, a conspicuous effect (such as a flashing effect) can be used to prompt the user to avoid missing the call.

[0033] In step S140, when the queuing information is about to call the user and the preparation work is completed, virtual navigation elements are displayed in the real environment through the virtual screen to guide the user to the location where the target service is provided.

[0034] A call to a user indicates that the current call number matches the user's queue number. An imminent call to a user indicates that the absolute value of the difference between the current call number and the user's queue number is less than a call threshold. This call threshold can be set according to actual needs. For example, if the current call number is 7, the user's queue number is 9, the call threshold is 3, and the absolute value of the difference between the current call number and the user's queue number is 2, which is less than the call threshold, then it can be determined that a call to the user is imminent.

[0035] If preparations are not completed, the target service cannot be obtained even if the user travels to the location where the target service is provided. Therefore, when the user is about to be called and preparations are complete, virtual navigation elements can be overlaid on a virtual screen in the real environment to guide the user to the location where the target service is provided.

[0036] In one embodiment, the queuing threshold can be dynamically set based on the distance between the user's current location and the location where the target service is provided. The queuing threshold is positively correlated with the distance. The farther the distance, the earlier the user is guided to the location where the target service is provided, thereby avoiding missing the number.

[0037] In one embodiment, the user's current location can be within a target area where the target service is provided. For example, if the target service is banking, the service location can be a specific service window. If the user is already inside the bank, AR-enabled virtual navigation elements can guide them to accurately find that service window. For larger and more complex environments, such as large bank branches with multiple floors, different services may be offered on different floors, in different offices, or at different windows. Similarly, a hospital may have multiple examination rooms, and users may have difficulty distinguishing between a magnetic resonance imaging (MR1) room and an MRI room. Therefore, users may have difficulty accurately finding the target service location. In such cases, AR navigation can be used to guide the user quickly to the target service location.

[0038] In another embodiment, the user's current location may be outside the target area where the target service is provided. For example, if the target service is banking services and the target service is provided at a specific service window, and the user is not currently in the bank, AR can be used to display virtual navigation elements to guide the user to the bank and then guide the user to accurately find the service window.

[0039] AR navigation for users refers to generating and displaying virtual navigation elements on the virtual screen of an AR device. These virtual navigation elements are precisely overlaid on the real physical environment, achieving real-time fusion of virtual information and real-world scenes. Virtual navigation elements can include, but are not limited to, arrows, routes, signs, and text.

[0040] This involves acquiring a pre-built indoor map, the user's current location, and the location of the target service. Based on the user's physical condition, it intelligently plans a navigation route suitable for that condition. For example, if a user has a foot injury, it will prioritize elevator routes over stair routes. Following the planned route, virtual navigation elements are generated and displayed in the real physical environment to guide the user to the target service location.

[0041] For example, in hospital settings, AR devices can acquire a pre-modeled indoor map of the hospital using Simultaneous Localization and Mapping (SLAM) algorithms, along with the user's current location and the location of the target service. Furthermore, considering the user's specific physical condition, the device can plan a suitable navigation route. A highlighted dynamic navigation route (virtual navigation elements) can be overlaid on a virtual screen within the real physical environment. These virtual navigation elements dynamically adjust based on the patient's real-time location. Simultaneously, virtual text such as "Waiting for Elevator" can be displayed next to real elevators, "Turn Here" can be marked at real corners, and a turning arrow can be displayed on the ground. The device can also provide real-time updates on queue conditions and recommend optimal detours. It can integrate real-time scheduling information from operating rooms, pharmacies, and wards to quickly plan efficient routes that avoid peak hours, reducing turnaround time. This hybrid AR navigation method breaks the limitations of traditional electronic device navigation, significantly improving the efficiency of personnel movement within hospitals and optimizing medical treatment and workflows.

[0042] The technical solution of this application embodiment can identify the target service and obtain the information on the preparation work required for the target service from the target system of the target service. Because the information on the preparation work is obtained from the target system, it has the advantages of being professional, accurate, and effective. Based on AR technology and combined with the information on the preparation work, clear, straightforward, and visual guidance can be given to users, thereby guiding users to complete the preparation work in advance, improving the processing efficiency after arriving at the service site, and eliminating the need for staff to repeatedly explain the rules, thus reducing communication costs. Online queuing can be automatically performed on the target system, and the call number information can be displayed in real time on the virtual screen of the AR device, avoiding the time wasted by queuing after arriving at the site, and avoiding multiple users crowding together on site. When a user is about to be called and the preparation work is completed, virtual navigation elements are superimposed on the real environment to accurately guide the user to the location where the target service is provided, avoiding the problem of users having difficulty finding the location due to the complexity of the environment. In this way, both the invalid waiting time (including the time waiting for staff to inform about the preparation work and the queuing time) and the on-site inquiry and communication costs are reduced, which greatly improves the efficiency of offline service processing and user experience.

[0043] Based on the above technical solution, as an embodiment, the target service can be banking services, and the preparation work can include filling in information. The AR-based intelligent guidance for users to complete the preparation work can include: capturing a first image of the information to be filled in using a camera; recognizing characters in the first image and intelligently analyzing the recognized characters to automatically generate filling guidance for each item to be filled in; displaying the filling guidance next to the actual content to be filled in using the virtual screen; capturing a second image of the filled information in real time; obtaining a standard template corresponding to the information; comparing the second image and the standard template to determine the target content where the user has filled in an error; and displaying a virtual error message next to the actual target content of the information to guide the user in correcting the target content.

[0044] The target service can be public services, medical services, or banking services, and the preparation work for these target services may include filling out forms. An intelligent guidance mechanism based on AR technology can significantly reduce the difficulty of filling out forms and improve preparation efficiency.

[0045] AR devices can be equipped with built-in high-definition cameras to accurately capture the first image of the information to be filled in. Optionally, the first image capture process can be intelligently adaptive, automatically adjusting the shooting angle and lighting parameters to ensure the clarity of the first image. The AR device can also use image correction technology to restore the original view of the text. Based on Optical Character Recognition (OCR) technology, the AR device can quickly extract character information from the first image, including key content such as the document name, section titles, and filling instructions. The AR device can perform in-depth analysis of the information to be filled in, taking into account the specific characteristics of the target service scenario, to provide filling guidance. For example, when registering for medical appointments, it can automatically identify special sections such as "allergy history" and "past medical history"; when conducting banking transactions, it can highlight key fields such as "account information" and "amount in words and figures," ultimately generating precise filling guidance for each item to be filled in.

[0046] Figure 2 This is a schematic diagram illustrating the instructions for filling out the form, provided in one embodiment of this application. Figure 2 as well as Figure 3 , Figure 4 Dashed boxes represent virtual elements displayed on the virtual screen of AR devices, while solid boxes represent real objects existing in the real environment. For example... Figure 2As shown, the display of the filling guidance is based on virtual-real fusion technology. From the wearer's perspective, the displayed virtual elements (the virtual filling guidance displayed by the AR device) can be superimposed on the real data, achieving the visual effect that the virtual filling guidance is exactly next to the corresponding real content to be filled in. This allows the user to intuitively determine that the filling guidance is for that specific content. The AR device can use spatial positioning technology to lock the position of the real data in three-dimensional space and display the filling guidance as virtual text next to the corresponding content to be filled in. Taking the social security application form as an example, next to the "Contribution Base" column, a prompt can be displayed: "Please fill in the average monthly salary of the previous year, in yuan, rounded to the nearest integer." Next to the "Household Registration Type" option, a detailed explanation can pop up: "Select A for agricultural household registration, select B for non-agricultural household registration, and supplement the residence permit number for out-of-town household registration." Users do not need to frequently flip through paper guides or consult staff; they can obtain all the guidance information simply by focusing their gaze on the data.

[0047] After users complete the form following the instructions, the completed information can be verified in real time. The AR device can capture a second image of the completed information in real time and automatically call the corresponding standard template in the background database. This template contains complete information such as the filling specifications, format requirements, and examples of common filling errors, such as the requirement that the ID number must be 18 digits, the contact number must be a local number, and the signature must be handwritten in regular script. Optionally, this standard template can be obtained from the target system. The AR device can use image comparison algorithms to compare the second image with the standard template column by column, accurately identifying target content that may contain errors, including format errors (such as writing the date as "2024.5.20" instead of "2024-05-20"), missing information (such as not filling in the contact address), and content errors (such as insufficient digits in the ID number), among other problems.

[0048] For identified errors, AR devices can use virtual screens to display virtual error messages next to the target content of real data, based on virtual-real fusion technology. Different error messages can be displayed for different error types. For example, formatting errors can be marked with a red dotted box and a correction guide can be displayed; missing information can be displayed with a yellow exclamation mark icon and a message saying "This field is required, please do not omit it"; and content errors can be marked with the location of the error and a correct example can be given.

[0049] By adopting the technical solution of this application embodiment, when the user fills in the form, the AR device can provide targeted guidance in real time to help the user quickly understand the requirements without consulting or looking up the guide, thus improving the filling efficiency. After the user fills in the form, the AR device can accurately correct errors by comparing with the standard template, and the virtual prompts mark the problems and provide correction solutions to avoid incorrect or missing information. Through dual guidance, the processing delay can be greatly reduced, and the user experience and service efficiency can be improved.

[0050] Based on the above technical solution, as an embodiment, the AR-based intelligent guidance for users to complete the preparation work may include: responding to the user's request for expert assistance, connecting the expert terminal, and transmitting the real-time image of the data captured by the camera to the expert terminal; receiving virtual guidance elements marked on the data displayed on the real-time image by the expert terminal; and displaying the virtual guidance elements superimposed on the real data.

[0051] Users can trigger expert assistance requests based on preset voice, gesture, or touch operations. After responding to the expert assistance request, the AR device can establish a communication link with the expert terminal through its communication module. The AR device's camera can activate a real-time acquisition mode to continuously capture the data currently being processed by the user, obtain a real-time image data stream, and transmit this real-time image data stream to the expert terminal.

[0052] The expert terminal can be configured with a screen display module and an annotation interaction module. The screen display module can receive and present the real-time screen transmitted by the AR device. Experts can use the annotation interaction module to annotate the data in the real-time screen and generate virtual guidance elements. Virtual guidance elements can include, but are not limited to, virtual boxes, virtual arrows, virtual text annotations, virtual highlight layers, etc. The annotation interaction module supports adjusting the attributes of virtual guidance elements, including parameters such as color, line thickness, transparency, and display duration, to adapt to different data types and guidance needs. Figure 3 This is a schematic diagram of a virtual guidance element provided in an embodiment of this application; see reference. Figure 3 After generating the virtual guidance element, the expert terminal associates and binds it with the coordinate information of the real-time screen to form a virtual guidance element with coordinate identifiers, and then sends it to the AR device.

[0053] The AR device's positioning and rendering module receives virtual guidance data transmitted from the expert terminal. Based on SLAM technology, it obtains the position coordinates of the real data in 3D space and matches and calibrates the coordinate markers in the virtual guidance data with the spatial coordinates of the real data, ensuring that the deviation between the corresponding positions of the virtual guidance elements and the real data is less than a preset threshold (preferably 1mm). After calibration, the AR device overlays the virtual guidance elements onto the corresponding positions of the real data on a virtual screen for real-time display, allowing users to intuitively observe the guidance information marked by the expert terminal. The AR device supports users providing feedback to the expert terminal via voice, gestures, and / or text, enabling two-way real-time interaction until the user completes data processing and other preparatory work.

[0054] Optionally, the system can intelligently summarize expert guidance and iteratively update the large model based on that guidance.

[0055] The technical solution adopted in this application embodiment can build a real-time interactive bridge between users and experts through AR devices. With the help of precise image transmission and virtual-real overlay technology, expert guidance can be accurately applied to real data scenarios, effectively improving the processing efficiency and accuracy of complex preparation work, reducing the user's operation threshold, and is applicable to various scenarios such as medical data filling and government affairs procedures. It has high practicality and scalability.

[0056] Based on the above technical solution, as an embodiment, the target service can be a physical examination service; the information for the preparation work can include: the target physiological characteristics, contraindications, and special needs corresponding to the physical examination service. The step of intelligently guiding the user to complete the preparation work based on AR technology and detecting whether the preparation work is completed can include: collecting the user's physiological characteristics based on the sensors of the AR device; detecting whether the user's physiological characteristics match the target physiological characteristics; obtaining the user's information and intelligently determining whether the user has passed the contraindication screening of the physical examination service based on the user's information and the contraindications; according to the special needs, displaying virtual guidance elements in the real environment through the virtual screen to guide the user to complete the preparation work corresponding to the special needs, and issuing a prompt to the user when it is detected that the user has disrupted the preparation work.

[0057] The target service can be a physical examination service. The target system can store information on the preparation work corresponding to this physical examination service. This preparation information may include, but is not limited to: the target physiological characteristics, contraindications, and special needs corresponding to the physical examination service. Among them, the target physiological characteristics can be the basic physiological indicator benchmark range required for the physical examination items, the contraindications may include, but are not limited to, prohibitions on diet, medication, exercise, etc., and the special needs may include, but are not limited to, the adaptation preparation requirements for special populations (such as the elderly and pregnant women) or the specific preparation requirements for specific physical examination items.

[0058] AR devices can collect users' physiological characteristics through built-in multi-dimensional sensor modules. These sensors may include, but are not limited to, electromyography (EMG) sensors, heart rate monitors, blood glucose meters, and / or eye trackers. The sensors based on AR glasses can collect users' physiological characteristics, including but not limited to EMG, heart rate, blood glucose, and / or eye movements. The corresponding sensors can be adaptively selected according to different physical examination items. During the collection process, the sensors can collect users' physiological data at a preset sampling frequency. After the data filtering module removes abnormal data, the user's physiological characteristics are obtained. The AR device can compare the collected user's physiological characteristics with the target physiological characteristics from the preparation information, calculate the deviation value between each physiological characteristic and the target physiological characteristic. If the deviation value is within a preset allowable threshold, it is determined that the user's physiological characteristics match the target physiological characteristics, and the user has completed the preparation work for the physiological characteristic dimension. If the deviation value exceeds the threshold, a physiological characteristic mismatch prompt is output, and it is determined that the user has not completed the preparation work for the physiological characteristic dimension.

[0059] AR devices can acquire user information such as identity information, past medical history, and current medication information, and then perform correlation analysis with contraindication prompts retrieved from the physical examination service system. A semantic matching algorithm is used to extract key information from the user information (such as the user's current anticoagulant medication) and match it with contraindication items in the contraindication prompts (such as the prohibition of anticoagulant medication before a routine blood test). If a match is found, the user is determined to have failed the contraindication screening, a contraindication warning is generated, and the reason for the warning is clarified, confirming that the user has not completed the preparation work for the contraindication screening dimension. If no match is found, the user is determined to have passed the contraindication screening, confirming that the user has completed the preparation work for the contraindication screening dimension.

[0060] AR devices can generate virtual guidance elements based on the specific needs of physical examination services and display these elements on a virtual screen. These virtual guidance elements can guide users through the preparation work corresponding to the specific requirements. The virtual guidance elements can include virtual text instructions and / or animated virtual operation steps. For example, for the specific requirement of "10 minutes of rest before the physical examination," the AR device can display a virtual countdown timer and the text "Please remain quiet, X minutes remaining" next to the user's current seat. When it detects that the user is getting up or moving around, disrupting the preparation work, the AR device will issue a prompt through its voice broadcast module, "Please comply with the rest requirement to avoid affecting the examination results," while simultaneously flashing the virtual guidance elements to reinforce the warning.

[0061] The technical solution adopted in this application embodiment intelligently guides users to complete the preparation work for physical examination services based on AR technology and detects the completion status of the preparation. This can solve the technical problems in related technologies, such as inaccurate acquisition of user information, untimely screening of contraindications, and inadequate implementation of special needs during the preparation stage of physical examinations, thereby improving the efficiency of physical examination preparation and the accuracy of subsequent physical examination data. Through the synergistic effect of physiological feature collection and comparison, intelligent screening of contraindications, and precise guidance for special needs, intelligent management and control of the entire process of physical examination preparation is realized. This not only reduces the difficulty of operation for users but also ensures the standardization of physical examination preparation work, providing reliable support for the smooth implementation of subsequent physical examination services.

[0062] Based on the above technical solution, as an embodiment, when the target service includes multiple physical examination services, sending the user's online queuing request to the target system may include: obtaining the real-time queuing number and estimated waiting time for each of the physical examination services from the target system; obtaining the location distribution of the examination rooms for each of the physical examination services; detecting the user's current location and movement speed; calculating the optimal triage process based on the real-time queuing number, estimated waiting time, location distribution of the examination rooms, the user's location, and movement speed, and determining the target physical examination service currently being queued; and sending the user's online queuing request for the target physical examination service to the target system.

[0063] When the target service includes multiple physical examination services, and multiple physical examination services require queuing, the queuing order of different physical examination services will have a significant impact on service efficiency and user experience. Therefore, the optimal triage process can be calculated and queuing can be carried out according to the optimal triage process, thereby improving service efficiency and user experience.

[0064] The AR device can send a request to the target system to obtain queuing information for multiple physical examination services. The request carries the identifiers of multiple physical examination services. The target system matches the corresponding service nodes based on the service identifiers, extracts the real-time queuing number of people (including the number of people who have been queued but not yet examined and the number of people who are being examined) and the estimated waiting time of each service node, and sends the real-time queuing number and the estimated waiting time to the AR device.

[0065] AR devices can acquire pre-built hospital indoor maps and the location distribution of examination rooms corresponding to various physical examination services, including specific coordinates, floor distribution, and access information. They can also obtain the user's current location and daily movement speed in real time. The AR device can calculate the optimal triage process, using real-time queue numbers, estimated waiting times, examination room location distribution data, the user's current location, and movement speed as input parameters. Based on a large model, it performs multi-objective optimization, aiming to minimize total waiting time, minimize movement distance, and optimize the connection between queuing and movement. It iteratively calculates the execution order and queuing timing of various physical examination services, outputting the optimal triage process. The optimal triage process includes the recommended execution order of various physical examination services and the target physical examination service that should be prioritized in the queue.

[0066] Based on the identified target health check service, the system prioritizes online queuing for that service and sends a queuing request from the user to the target system. Upon receiving the request, the target system enters the user information into the queuing queue for the target health check service, generates a queue number and call number information, and displays this information on the AR device for the user to view.

[0067] The technical solution adopted in this application addresses issues such as disordered queuing processes, excessively long waiting times, and unreasonable route planning in various physical examination service scenarios. Through collaborative analysis and intelligent calculation of multi-dimensional data, the queuing process for various physical examination services is dynamically optimized, effectively shortening the overall examination time for users and improving their physical examination service experience.

[0068] Based on the above technical solution, as an embodiment, the target service is a medical service; the method may further include: acquiring a drug packaging image, automatically identifying the target drug based on the drug packaging image; obtaining the medication method of the target drug from the target system, and displaying virtual elements of the medication method next to the actual target drug; determining the medication time based on the medication method, and issuing a medication reminder to the user when the medication time arrives.

[0069] After the user obtains the medicine, the AR device can capture images of the medicine packaging using its built-in high-definition camera, and then use an image recognition model to extract and match the drug name, specifications, and other features on the packaging to automatically identify the target drug.

[0070] AR devices can retrieve the medication instructions for the target drug from the database of the target system based on the user's identity information, including core information such as dosage, frequency of administration, time of administration, and contraindications. The medication instructions can be entered into the database of the target system by medical staff for the user, so retrieving the medication instructions for the target drug from the database of the target system can be the medication instructions for the user.

[0071] Figure 4 This is a schematic diagram illustrating a method of medication administration provided in an embodiment of this application; see reference. Figure 4 This technology can pinpoint the spatial location of a real medication and display the dosage instructions as virtual text, icons, and other virtual elements next to the target medication packaging. This allows users to immediately identify the dosage upon seeing the medication. It is particularly useful when multiple medications are present, as users may struggle to accurately determine which dosage applies to which drug.

[0072] AR devices can automatically analyze and generate medication time points based on the acquired medication methods and record them into the local smart reminder module. When the system detects that the current time has reached the preset medication time, it can issue medication reminders to the user through voice broadcast, virtual pop-up flashing, etc., to ensure that the user takes medication on time and in accordance with regulations.

[0073] The technical solution adopted in this application can solve the problems of non-standard medication operation and easy omission of medication time by users, ensure that users receive accurate guidance on medication methods, and improve the continuity and accuracy of medical services.

[0074] Based on the above technical solution, as an embodiment, the method may further include: modeling a building map corresponding to the target service, the building map including the location distribution of one or more categories of self-service terminals; determining the target self-service terminal corresponding to the target service; displaying virtual navigation elements leading to the target self-service terminal in a real environment through the virtual screen to guide the user to the target self-service terminal; scanning the page of the target self-service terminal in real time, and performing intelligent analysis on the target service and the page of the target self-service terminal, and guiding the user to complete the target service on the target self-service terminal through AR technology.

[0075] AR devices can employ SLAM algorithms to scan the interior environment of buildings (such as hospitals) corresponding to target services (e.g., medical registration, report printing) in real time using the glasses' high-definition cameras, collecting continuous frame image data. The algorithm extracts key points and matches features from the image data, combining this with inter-frame pose estimation to achieve device self-localization. Simultaneously, it calculates the 3D coordinates of spatial points through triangulation, gradually building and generating a sparse map of the building's interior. During the modeling process, image recognition technology automatically detects various self-service terminals within the building (e.g., self-service registration machines, payment machines, report printers), extracting their appearance features, identification information, and spatial coordinates. These are then associated with terminal categories (registration, payment, report printing, etc.) and entered into the map, forming a complete building map containing the location distribution of various self-service terminals.

[0076] AR devices can obtain the mapping relationship between service type and terminal category from the target system based on the user's triggered target service request (such as "register for a self-service appointment"), and then filter the target self-service terminal that matches the service from the building map. The AR device can combine the real-time operating status of each target self-service terminal (obtained from the target system, including idle / busy status) and prioritize the idle terminal that is closer to the user's current location as the final target self-service terminal, and extract the spatial coordinates of the target self-service terminal.

[0077] AR devices can integrate visual SLAM data, WiFi fingerprint positioning data, and inertial navigation data. Using a Kalman filter algorithm, they fuse multi-source data to achieve real-time user positioning within a building with an accuracy of ±0.5 meters. Based on the user's current location and the coordinates of the target self-service terminal, the optimal navigation route is calculated, and virtual navigation elements are generated. These virtual navigation elements can include, but are not limited to, virtual arrows, highlighted path lines, turn prompt icons, and / or distance prompt text. Using SLAM spatial positioning technology, these virtual navigation elements are overlaid on the real-world environment. Users can intuitively see navigation guidance that fits the actual scene through the AR device's virtual screen, thus guiding them to the target self-service terminal.

[0078] Once a user arrives at the target self-service terminal, the AR device can capture real-time images of the terminal's interface using a camera. Through image recognition and semantic analysis, it extracts information such as the terminal's page layout, function buttons, and text descriptions. Combined with the target service's business process (obtained from the target system, such as the "select department - verify information - payment" process for registration), it performs intelligent correlation analysis between the terminal page and the target service, generating a step-by-step operation guidance plan. Using AR technology, virtual operation guidance elements (such as button highlight boxes, operation sequence numbers, and text prompts) are overlaid on the corresponding positions on the terminal's real page. For example, a virtual text prompt "Click here to select the department" is displayed next to the real "Department Selection" button. When the user's operation deviates from the process, error correction guidance is provided through voice prompts and flashing virtual prompts until the user completes all operations related to the target service.

[0079] Users can also initiate expert assistance requests to connect to an expert terminal and obtain guidance from the expert on how to use the target self-service terminal.

[0080] The technical solution adopted in this application embodiment can realize terminal positioning and navigation through SLAM precise modeling and multi-source positioning fusion, and complete operation guidance by combining AR virtual and real overlay technology, which greatly reduces the threshold of user self-service and improves service processing efficiency. It is applicable to various complex building scenarios with self-service terminals, such as hospitals and government service halls.

[0081] To facilitate better implementation of the service bootstrapping method of this application, this application also provides a service bootstrapping device based on the above-described service bootstrapping method. The meanings of the terms used are the same as in the service bootstrapping method described above, and specific implementation details can be found in the descriptions of the method embodiments.

[0082] Please see Figure 5 , Figure 5 This is a schematic diagram of the service guidance device provided in an embodiment of this application, wherein the service guidance device is applied to an AR device, and the device includes: Service determination module 501 is used to determine a target service and obtain information on the preparation work required for the target service from the target system of the target service. The preparation guidance module 502 is used to intelligently guide the user to complete the preparation work based on AR technology, and to detect whether the preparation work is completed. The online queuing module 503 is used to send the user's online queuing request to the target system, obtain the call number information returned by the target system, and display the call number information in real time using the virtual screen of the AR device; The navigation display module 504 is used to display virtual navigation elements in the real environment through the virtual screen when the queuing information is about to call the user and the preparation work is completed, so as to guide the user to the location where the target service is provided.

[0083] In one embodiment, the target service is banking services, and the preparation work includes filling in information; the preparation guidance module 502 is specifically used to execute: The first image of the information to be filled in is captured using a camera; The characters in the first image are identified, and the identified characters are intelligently analyzed to automatically generate filling guidance for each item to be filled in; The virtual screen is used to display the filling instructions next to the actual content to be filled in; Real-time acquisition of a second image of the filled-in information; Obtain the standard template corresponding to the aforementioned data; By comparing the second image with the standard template, the target content in which the user entered an error can be determined. A virtual error message is displayed next to the actual target content of the data to guide the user in correcting the target content.

[0084] In one embodiment, the preparation boot module 502 is specifically used to perform: In response to the user's request for expert assistance, the system connects to the expert terminal and transmits the real-time image of the data captured by the camera to the expert terminal. Receive virtual guidance elements marked on the data displayed on the real-time screen by the expert terminal; The virtual guidance elements are overlaid on the real materials for display.

[0085] In one embodiment, the device further includes: The map modeling module is used to model the building map corresponding to the target service, wherein the building map includes the location distribution of one or more categories of self-service terminals; The terminal determination module is used to determine the target self-service terminal corresponding to the target service; The terminal navigation module is used to display virtual navigation elements leading to the target self-service terminal in a real environment through the virtual screen, so as to guide the user to the target self-service terminal; The terminal guidance module is used to scan the page of the target self-service terminal in real time, and to perform intelligent analysis on the target service and the page of the target self-service terminal, and guide the user to complete the target service on the target self-service terminal through AR technology.

[0086] In one embodiment, the target service is a physical examination service; the preparation information includes: the target physiological characteristics, contraindications, and special requirements corresponding to the physical examination service; the preparation guidance module 502 is specifically used to execute: Based on the sensors of the AR device, the user's physiological characteristics are collected; Detect whether the user's physiological characteristics match the target physiological characteristics; The system obtains the user's information and intelligently determines whether the user passes the contraindication screening of the physical examination service based on the user's information and the contraindication prompt. According to the specific requirements, virtual guide elements are displayed in the real environment through the virtual screen to guide the user to complete the preparation work corresponding to the specific requirements, and a prompt is issued to the user when the user is detected to have disrupted the preparation work.

[0087] In one embodiment, when the target service includes multiple health check services, the online queuing module 503 is specifically used to perform: The system obtains the real-time queue number and estimated waiting time for each of the physical examination services. Obtain the location distribution of the examination rooms corresponding to each of the aforementioned physical examination services; Detect the user's current location and movement speed; Based on the real-time number of people in the queue, the estimated waiting time, the location distribution of examination rooms, the location and movement speed of the users, the optimal triage process is calculated, and the target physical examination service for the current queue is determined. Send the user's online queuing request for the target physical examination service to the target system.

[0088] In one embodiment, the target service is a medical service; the device further includes: The drug identification module is used to acquire images of drug packaging and automatically identify the target drug based on the drug packaging images; The medication method display module is used to obtain the medication method of the target drug from the target system and display virtual elements of the medication method next to the actual target drug; The medication reminder module is used to determine the medication time according to the medication method and to issue a medication reminder to the user when the medication time arrives.

[0089] The technical solution of this application embodiment can identify the target service and obtain the information on the preparation work required for the target service from the target system of the target service. Because the information on the preparation work is obtained from the target system, it has the advantages of being professional, accurate, and effective. Based on AR technology and combined with the information on the preparation work, clear, straightforward, and visual guidance can be given to users, thereby guiding users to complete the preparation work in advance, improving the processing efficiency after arriving at the service site, and eliminating the need for staff to repeatedly explain the rules, thus reducing communication costs. Online queuing can be automatically performed on the target system, and the call number information can be displayed in real time on the virtual screen of the AR device, avoiding the time wasted by queuing after arriving at the site, and avoiding multiple users crowding together on site. When a user is about to be called and the preparation work is completed, virtual navigation elements are superimposed on the real environment to accurately guide the user to the location where the target service is provided, avoiding the problem of users having difficulty finding the location due to the complexity of the environment. In this way, both the invalid waiting time (including the time waiting for staff to inform about the preparation work and the queuing time) and the on-site inquiry and communication costs are reduced, which greatly improves the efficiency of offline service processing and user experience.

[0090] For specific limitations regarding the service boot device, please refer to the limitations on the service boot method above, which will not be repeated here. Each module in the aforementioned service boot device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in the computer device in hardware form, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0091] Furthermore, this application also provides an electronic device, which can be an AR device, specifically AR glasses. For example... Figure 6 As shown, it illustrates the structural diagram of the electronic device involved in this application, specifically: The electronic device may include components such as a processor 601 with one or more processing cores and a memory 602 with one or more computer-readable storage media. Those skilled in the art will understand that... Figure 6 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 601 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines, and performs various functions and processes data by running or executing software programs and / or modules stored in the memory 602, and by calling data stored in the memory 602, thereby providing overall monitoring of the electronic device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 601.

[0092] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0093] In one embodiment, the electronic device further includes a power supply 603 that supplies power to the various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 603 may also include one or more DC or AC power supplies, recharging systems, power equipment debugging circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0094] In one embodiment, the electronic device may further include an input unit 604, which can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0095] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the electronic device loads the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 601 runs the applications stored in the memory 602, thereby implementing the steps in any of the service booting methods provided in the embodiments of this application.

[0096] When the specific electronic device is AR glasses, in addition to the above structure, it also includes at least the glasses frame, optical display components, electronic circuit components, sensors, etc. The sensors built into the glasses include a heart rate monitor, a blood glucose meter, a microphone, a camera and / or an eye tracker.

[0097] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0098] In one embodiment, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the methods described in any embodiment of this application.

[0099] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method described in any embodiment of this application.

[0100] In some embodiments, a computer program product is also provided, including a computer program or instructions that, when executed by a processor, implement the methods described in any embodiment of this application.

[0101] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0102] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0103] To this end, this application provides a computer-readable storage medium storing a computer program that can be loaded by a processor to execute the steps of any of the service boot methods provided in this application.

[0104] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0105] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0106] Since the instructions stored in the computer-readable storage medium can execute the steps of any of the service booting methods provided in this application, the beneficial effects that any of the service booting methods provided in this application can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0107] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.

[0108] The above provides a detailed description of a service guidance method, apparatus, electronic device, and computer-readable storage medium provided in this application. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, those skilled in the art will recognize that there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A service guidance method, characterized in that, Applied to AR devices; the method includes: Identify the target service and obtain information on the preparatory work required for the target service from the target system of the target service; The system uses AR technology to intelligently guide users to complete the preparation work and detects whether the preparation work is completed. Send the user's online queuing request to the target system, obtain the call number information returned by the target system, and display the call number information in real time using the virtual screen of the AR device; When the call number is about to call the user and the preparation work is completed, virtual navigation elements are displayed in the real environment through the virtual screen to guide the user to the location where the target service is provided.

2. The method according to claim 1, characterized in that, The target service is banking business, and the preparatory work includes filling out forms; The AR-based intelligent guidance for users to complete the preparation work includes: The first image of the information to be filled in is captured using a camera; The characters in the first image are identified, and the identified characters are intelligently analyzed to automatically generate filling guidance for each item to be filled in; The virtual screen is used to display the filling instructions next to the actual content to be filled in; Real-time acquisition of a second image of the filled-in information; Obtain the standard template corresponding to the aforementioned data; By comparing the second image with the standard template, the target content in which the user entered an error can be determined. A virtual error message is displayed next to the actual target content of the data to guide the user in correcting the target content.

3. The method according to claim 2, characterized in that, The AR-based intelligent guidance for users to complete the preparation work includes: In response to the user's request for expert assistance, the system connects to the expert terminal and transmits the real-time image of the data captured by the camera to the expert terminal. Receive virtual guidance elements marked on the data displayed on the real-time screen by the expert terminal; The virtual guidance elements are overlaid on the real materials for display.

4. The method according to claim 1, characterized in that, The method further includes: Model a building map corresponding to the target service, wherein the building map includes the location distribution of one or more categories of self-service terminals; Identify the target self-service terminal corresponding to the target service; The virtual screen displays virtual navigation elements in the real environment to guide the user to the target self-service terminal. The system scans the target self-service terminal's page in real time and performs intelligent analysis on the target service and the target self-service terminal's page, using AR technology to guide the user to complete the target service on the target self-service terminal.

5. The method according to claim 1, characterized in that, The target service is a physical examination service; the information for the preparation work includes: the target physiological characteristics, contraindications, and special needs corresponding to the physical examination service; The AR-based intelligent guidance for users to complete the preparation work and the detection of whether the preparation work is completed include: Based on the sensors of the AR device, the user's physiological characteristics are collected; Detect whether the user's physiological characteristics match the target physiological characteristics; The system obtains the user's information and intelligently determines whether the user passes the contraindication screening of the physical examination service based on the user's information and the contraindication prompt. According to the specific requirements, virtual guide elements are displayed in the real environment through the virtual screen to guide the user to complete the preparation work corresponding to the specific requirements, and a prompt is issued to the user when the user is detected to have disrupted the preparation work.

6. The method according to claim 5, characterized in that, When the target service includes multiple health check services, sending the user's online queuing request to the target system includes: The system obtains the real-time queue number and estimated waiting time for each of the physical examination services. Obtain the location distribution of the examination rooms corresponding to each of the aforementioned physical examination services; Detect the user's current location and movement speed; Based on the real-time number of people in the queue, the estimated waiting time, the location distribution of examination rooms, the location and movement speed of the users, the optimal triage process is calculated, and the target physical examination service for the current queue is determined. Send the user's online queuing request for the target physical examination service to the target system.

7. The method according to claim 1, characterized in that, The target service is a medical service; the method further includes: Acquire images of drug packaging and automatically identify the target drug based on the drug packaging images; The method of administration of the target drug is obtained from the target system, and a virtual element of the method of administration is displayed next to the real target drug; The medication time is determined according to the medication method, and a medication reminder is issued to the user when the medication time arrives.

8. A service guidance device, characterized in that, Applied to AR devices; the device includes: The service determination module is used to determine the target service and obtain information on the preparatory work required for the target service from the target system of the target service. The preparation guidance module is used to intelligently guide the user to complete the preparation work based on AR technology, and to detect whether the preparation work is completed. The online queuing module is used to send the user's online queuing request to the target system, obtain the call number information returned by the target system, and display the call number information in real time using the virtual screen of the AR device; The navigation display module is used to display virtual navigation elements in the real environment through the virtual screen when the queuing information is about to call the user and the preparation work is completed, so as to guide the user to the location where the target service is provided.

9. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the service booting method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the service bootstrapping method as described in any one of claims 1 to 7.

Images