Multi-mode intelligent guiding method and system

Abstract

The invention discloses a multi-mode intelligent guiding method and system, and the method comprises the following steps: 1, binding intelligent terminal equipment with user identity information, and synchronizing the to-be-detected project process information of a user to the intelligent terminal equipment through a server; 2, communicating with the intelligent terminal equipment through at least one beacon equipment deployed in a guide area, automatically executing sign-in operation when judging that the intelligent terminal equipment enters a preset sign-in range according to a communication signal, and sending out a state prompt by the intelligent terminal equipment; 3, the intelligent terminal device obtains real-time state information related to the to-be-detected item and pushed by the server in real time; through the implementation of the invention, the systematic problems of low efficiency, split experience, insufficient reliability and the like in a traditional guide mode are solved, and unmanned, intelligent and high-reliability user guide experience in the whole process is realized.

Description

Technical Field

[0001] This invention relates to the field of intelligent guidance technology, and in particular to a multimodal intelligent guidance method and system. Background Technology

[0002] In everyday life, at places like health check centers, outpatient departments of large hospitals, and government service centers, users often need to complete multiple examinations or services sequentially. Traditional guidance methods mainly rely on paper guidance sheets, static signs, or manual inquiry. These traditional methods have some shortcomings, such as:

[0003] Users cannot know the queue status and location changes of each item in real time, and need to frequently go to the front desk or information kiosk to ask, or search blindly, which results in a poor experience and can easily cause congestion in the passage.

[0004] Traditional methods rely mainly on sight (looking at signs) and hearing (listening to the call of numbers). In noisy environments or when users have poor eyesight or hearing, it is easy to miss key prompts, resulting in missing the call or delays.

[0005] In most scenarios, users still need to manually sign in at the check-in machine or front desk, which is a cumbersome process and can easily create queuing bottlenecks when there is a large flow of users, reducing overall operational efficiency.

[0006] After completing all projects, users are often unclear about the subsequent processes (such as report collection and expense reimbursement), and need to find staff again, making it impossible to achieve a "one-stop" guidance service.

[0007] While some existing technologies attempt to guide users through smart terminals or mobile applications, most of them are single-function or only address information push issues, failing to fundamentally solve the core pain points of lacking multimodal perception, insufficient proactive check-in capabilities, and lack of closed-loop guidance throughout the entire process.

[0008] Therefore, there is an urgent need for a multimodal intelligent guidance method and system to address the shortcomings of existing technologies. Summary of the Invention

[0009] To address the shortcomings of existing technologies, this invention provides a multimodal intelligent guidance method and system, aiming to solve the problems of how to complete user check-in seamlessly, accurately, and efficiently, how to ensure that guidance information is reliably received by users under various environmental conditions, and how to achieve fully automated guidance from check-in to completion.

[0010] On the one hand, this application provides a multimodal intelligent guidance method, including the following steps:

[0011] Step 1: Bind the smart terminal device to the user's identity information, and the server synchronizes the user's inspection process information to the smart terminal device;

[0012] Step 2: Communicate with the smart terminal device through at least one beacon device deployed in the guidance area. When the smart terminal device enters the preset check-in range based on the communication signal, the check-in operation is automatically performed, and the smart terminal device issues a status prompt.

[0013] Step 3: The smart terminal device obtains real-time status information related to the item to be inspected, pushed by the server.

[0014] Step 4: Based on the real-time status information, issue guidance prompts to the user through at least two different sensory modal combinations;

[0015] Step 5: When the final check is detected as complete, a completion reminder is triggered, and the user is guided to the verification area or to call a volunteer with one click via the smart terminal device. This complete methodology, integrating automatic sensing, real-time communication, and multimodal interaction, solves the systemic problems of low efficiency, fragmented experience, and insufficient reliability inherent in traditional guidance methods, achieving a fully unmanned, intelligent, and highly reliable user guidance experience.

[0016] Furthermore, in step 2, the method for automatically performing the check-in operation when the smart terminal device enters the preset check-in range based on the communication signal includes:

[0017] Receive wireless signals from one or more beacon devices through a smart terminal device;

[0018] The collected wireless signals are filtered, denoised, and normalized.

[0019] Based on the processed signal data, the received signal strength indication positioning method is used to determine whether the smart terminal device has entered the preset check-in range.

[0020] If so, then automatic check-in will be triggered.

[0021] Furthermore, when the smart terminal device simultaneously receives signals from multiple beacon devices, the step of determining whether the smart terminal device has entered the preset check-in range includes:

[0022] Compare the strength information of multiple received beacon signals;

[0023] Based on the comparison of signal strength, the area corresponding to the beacon device with the strongest signal is selected as the candidate check-in area;

[0024] Verify whether the signal strength of the candidate check-in area exceeds its preset check-in threshold. If it does, it is determined to be within the preset check-in range of the area and check-in is triggered.

[0025] Furthermore, the step of determining whether the smart terminal device has entered the preset check-in range also includes:

[0026] If the strength difference of multiple beacon signals is less than a preset tolerance threshold, then the target beacon device is selected from the multiple beacon devices based on the user's order of the inspection items and / or the movement trend of the smart terminal device.

[0027] Verify whether the signal strength of the area corresponding to the target beacon device exceeds its preset check-in threshold. If it does, it is determined that the user has entered the preset check-in range of the area and the check-in is triggered.

[0028] Furthermore, the method for selecting the target beacon device from the plurality of beacon devices based on the motion trends of the smart terminal device includes the following steps:

[0029] Collect multiple signal strength values ​​from the same beacon device within a preset time window;

[0030] Calculate the rate of change of the plurality of signal intensity values, perform linear fitting on the plurality of signal intensity values, obtain the slope of the fitted line, and use the slope as the rate of change;

[0031] If the rate of change is greater than zero, it is determined that the user is approaching the beacon device.

[0032] Furthermore, after the step of acquiring multiple signal strength values, the method further includes:

[0033] The collected signal strength values ​​are smoothed using a filtering algorithm;

[0034] The step of calculating the rate of change is based on the smoothed signal strength value.

[0035] Furthermore, prior to step 2, the following is also included:

[0036] Resource allocation steps: The server allocates a specific check-in area to the user based on the real-time load of each check-in area, the type and priority of the user's pending items, and pushes the information of that area to the smart terminal device.

[0037] The smart terminal device guides the user to the designated area to complete the check-in based on the received allocation area information and the beacon device signal.

[0038] Furthermore, the resource allocation step includes:

[0039] The server monitors in real time at least one of the following in each region: current number of people in the queue, estimated waiting time, and equipment usage status.

[0040] The user's check-in area allocation is dynamically adjusted based on the urgency or preset priority of the user's pending inspection items.

[0041] If a certain area is overloaded, new users will be assigned to a less overloaded area, and the beacon device check-in threshold or guidance policy for that area will be updated.

[0042] If a user fails to check in within their assigned area, the system will automatically detect their current location and reassign them to the nearest or least overloaded available area, while also updating the guidance information.

[0043] On the other hand, this application provides a multimodal intelligent guidance system, including:

[0044] The device body is equipped with a display screen, a vibration motor, a speaker, and a buzzer.

[0045] The binding module is used to bind smart terminal devices to user identity information;

[0046] The location check-in module is used to detect the user's location through beacon devices and automatically complete the check-in process;

[0047] The status acquisition module is used to communicate with the server to obtain queuing status information in real time.

[0048] The multimodal prompt module is used to provide guidance prompts to users in various ways.

[0049] Furthermore, it also includes:

[0050] The signal processing module is used to filter and optimize beacon signals.

[0051] The completion guide module is used to prompt you when all projects are completed and provides functions for reimbursement or calling volunteers.

[0052] The resource allocation module is used to dynamically allocate appropriate check-in areas based on the real-time status of each area and user project information. It is also used to record historical load data of each area, predict the regional load trend in the future time period based on machine learning algorithms, and optimize user allocation in advance.

[0053] The resource allocation module is communicatively connected to the status acquisition module and the location check-in module, and is used to coordinate the area allocation and check-in triggering logic.

[0054] The substantial effects of this invention:

[0055] 1. In this invention, a complete method integrating automatic perception, real-time communication and multimodal interaction is used to solve the systemic problems of low efficiency, fragmented experience and insufficient reliability in traditional guidance methods, and realize a fully unmanned, intelligent and highly reliable user guidance experience.

[0056] 2. In this invention, by combining beacon equipment with RSSI positioning technology, users can automatically check in upon entering the area, completely eliminating the need for active user operation, greatly improving passage efficiency and user experience. Furthermore, by employing a combination of at least two of the following guidance modalities—tactile, auditory, and visual—it ensures that guidance information can be effectively and reliably perceived in different environments and under different physical conditions of users.

[0057] 3. In this invention, by filtering and smoothing the beacon signal and introducing motion judgment based on the trend of signal strength change, misjudgments caused by signal fluctuations or interference from multiple beacons are effectively avoided, making automatic check-in triggering more accurate and reliable. Furthermore, from automatic check-in to real-time multimodal guidance and finally completion guidance, a complete service loop is formed. Users do not need to ask multiple times in the middle, and the system automatically guides the next step of operation until the final process is completed, improving the overall service quality and efficiency. Attached Figure Description

[0058] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0059] Figure 1 This is a flowchart of Example 1.

[0060] Figure 2 This is a schematic diagram of the device body structure in Example 5.

[0061] Figure 3 This is a schematic diagram of the internal structure of the device body in Example 5.

[0062] Figure 4 This is a schematic diagram of the software functional modules in Example 5.

[0063] Figure 5 This is a schematic diagram of the smart terminal device in Example 5 displaying the identity information bound by scanning a QR code.

[0064] Figure 6 This is a schematic diagram of the precautions displayed on the smart terminal device in Example 5.

[0065] Figure 7 This is a schematic diagram showing the current queuing information displayed on the smart terminal device of Example 5.

[0066] Figure 8 This is a schematic diagram showing the current inspection item displayed on the smart terminal device of Example 5.

[0067] In the diagram: 100-device body, 101-display screen, 102-vibration motor, 103-speaker, 104-buzzer, 105-lanyard hole; 10-binding module, 20-positioning and check-in module, 30-status acquisition module, 40-multimodal prompt module, 50-signal processing module, 60-completion guidance module, 70-resource allocation module. Detailed Implementation

[0068] To facilitate understanding of the present invention, a more detailed description is provided below with reference to the accompanying drawings and specific embodiments. It should be noted that when an element is described as being "fixed to" another element, it can be directly on the other element, or one or more intermediate elements may exist between them. When an element is described as being "connected to" another element, it can be directly connected to the other element, or one or more intermediate elements may exist between them. The terms "vertical," "horizontal," "left," "right," and similar expressions used in this specification are for illustrative purposes only.

[0069] Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. The term "and / or" as used in this specification includes any and all combinations of one or more of the associated listed items.

[0070] Example 1:

[0071] like Figure 1 As shown, a multimodal intelligent guidance method includes the following steps:

[0072] Step 1: Bind the smart terminal device to the user's identity information, and the server synchronizes the user's inspection process information to the smart terminal device;

[0073] Step 2: Communicate with the smart terminal device through at least one beacon device deployed in the guidance area. When the smart terminal device enters the preset check-in range based on the communication signal, the check-in operation is automatically performed and the smart terminal device issues a status prompt.

[0074] Step 3: The smart terminal device obtains real-time status information related to the items to be inspected, pushed by the server.

[0075] Step 4: Based on real-time status information, provide guidance prompts to the user through at least two different sensory modal combinations;

[0076] Step 5: When the final check is detected to be completed, a completion reminder is triggered, and the user is guided to the verification area or to call a volunteer with one click via the smart terminal device.

[0077] As one implementation method, in step 2, the method for automatically performing the check-in operation when the smart terminal device enters the preset check-in range based on the communication signal includes:

[0078] Receive wireless signals from one or more beacon devices through a smart terminal device;

[0079] The collected wireless signals are filtered, denoised, and normalized to eliminate environmental interference.

[0080] Based on the processed signal data, the received signal strength indication positioning method is used to determine whether the smart terminal device has entered the preset check-in range.

[0081] If so, then automatic check-in will be triggered.

[0082] As one implementation method, when a smart terminal device simultaneously receives signals from multiple beacon devices, the steps for determining whether the smart terminal device has entered the preset check-in range include:

[0083] Compare the strength information of multiple received beacon signals;

[0084] Based on the comparison of signal strength, the area corresponding to the beacon device with the strongest signal is selected as the candidate check-in area;

[0085] Verify whether the signal strength of the candidate check-in area exceeds its preset check-in threshold. If it does, it is determined to be within the preset check-in range of the area and check-in is triggered.

[0086] As one implementation method, the step of determining whether a smart terminal device has entered the preset check-in range further includes:

[0087] If the strength difference of multiple beacon signals is less than the preset tolerance threshold, the target beacon device is selected from multiple beacon devices based on the user's inspection process sequence and / or the movement trend of the smart terminal device.

[0088] Verify whether the signal strength of the area corresponding to the target beacon device exceeds its preset check-in threshold. If it does, it is determined that the user has entered the preset check-in range of the area and the check-in is triggered.

[0089] As one implementation method, the method for selecting a target beacon device from multiple beacon devices based on the motion trends of smart terminal devices includes the following steps:

[0090] Collect multiple signal strength values ​​from the same beacon device within a preset time window;

[0091] Calculate the rate of change of multiple signal intensity values, perform linear fitting on the multiple signal intensity values, obtain the slope of the fitted line, and use the slope as the rate of change;

[0092] If the rate of change is greater than zero, it is determined that the user is approaching the beacon device.

[0093] As one implementation method, after the step of acquiring multiple signal strength values, the method further includes:

[0094] The collected signal strength values ​​are smoothed using a filtering algorithm;

[0095] The step of calculating the rate of change is based on the smoothed signal strength value.

[0096] As one implementation method, the deployment method of beacon equipment includes:

[0097] The zoning and beacon distribution are dynamically adjusted based on changes in pedestrian traffic to ensure effective coverage of each area;

[0098] The dynamic adjustment process includes three steps: data collection, data analysis, and adjustment decision-making. Data collection involves acquiring relevant data by monitoring beacon signals and pedestrian flow in real time. Data analysis involves analyzing the collected data to identify problems with area division and beacon distribution. Adjustment decision-making involves making dynamic adjustments based on the analysis results to ensure the rationality of area division and beacon distribution.

[0099] Based on the designated check-in area of ​​the project, and assuming the beacon location is fixed, adjust the range of beacon signal strength for that area.

[0100] As one implementation, the method further includes the following step before step 2:

[0101] Resource allocation steps: The server allocates a specific check-in area to the user based on the real-time load of each check-in area, the type and priority of the user's pending items, and pushes the information of that area to the smart terminal device.

[0102] Based on the received allocation area information and the beacon signal, the smart terminal device guides the user to the designated area to complete the check-in.

[0103] As one implementation method, the resource allocation step includes:

[0104] The server monitors the current number of people queuing and the estimated waiting time in each area in real time.

[0105] The check-in area allocation for users is dynamically adjusted based on the urgency of their pending inspection items. Specific steps include:

[0106] Data input and preprocessing, user project urgency labeling: During step 1, when binding identity information, the system automatically identifies or manually labels the urgency level of the user's pending examination items from their list (e.g., in a health checkup center, "myocardial enzyme spectrum" or "emergency CT scan" will be labeled as "high urgency"; "routine annual checkup" will be labeled as "low urgency"; the label levels are divided into "high", "medium", and "low"). Real-time regional status monitoring: The server continuously obtains real-time data from beacon devices or departmental systems in each region: current number of people in the queue, estimated average waiting time, current processing speed (number of people completed per unit time), and the status of available resources in the region (e.g., whether doctors are on duty, whether equipment is operating normally).

[0107] The dynamic allocation decision algorithm is triggered when the system detects that a user (smart terminal device) is approaching the target area.

[0108] Scenario A: Allocate dedicated resources or the optimal path to users with high urgency;

[0109] Strategy: The system will prioritize assigning high-urgency users to dedicated fast channels or the availability zone with the lowest current load, even if the zone is not physically the closest.

[0110] Specifically, the server compares the real-time load of all areas that can handle the project and selects the area with the "shortest expected waiting time" rather than the area with the "strongest signal". The target area ID is then pushed to the user's smart terminal device. The guide app on the terminal device will prioritize finding and matching beacon signals pointing to the target area based on the assigned area ID and guide the user there.

[0111] Scenario B: Dynamically adjust the check-in threshold to achieve "virtual queue jumping";

[0112] For high-priority users, the system can temporarily lower the "check-in threshold" for their target area (e.g., from -70dBm to -75dBm), which means they can successfully trigger automatic check-in from a distance from the entrance and enter the queue earlier.

[0113] Specifically, the server sends a new, more lenient check-in threshold parameter to the user's smart terminal device. The smart terminal device uses this new threshold to determine whether the check-in was successful, so the user can enter the queue earlier than ordinary users at the same distance.

[0114] If a region is overloaded, new users will be assigned to regions with lower load, and the beacon device check-in threshold or guidance policy for that region will be updated.

[0115] The specific steps for updating the beacon device check-in threshold include:

[0116] Based on real-time monitoring data, the server-side resource allocation module determines that a certain area (such as "blood drawing window B") has too high a load, while another area ("blood drawing window C") has too low a load.

[0117] The server calculates new, temporary check-in thresholds based on the degree of load imbalance using an internal algorithm (e.g., raising the threshold for region B from -70dBm to -65dBm and lowering the threshold for region C from -70dBm to -75dBm).

[0118] The server sends these new threshold parameters to the boot application on all users' smart terminal devices via Wi-Fi or cellular network. The application receives and updates the judgment logic in the background.

[0119] The terminal executes the new rules, and when a user approaches these areas, the smart terminal device uses the latest threshold issued by the server to determine whether to trigger a check-in.

[0120] User A walks towards the "overloaded area B". At -68dBm (old rule has been met, new rule has not been met), the check-in will not be triggered, and he will continue to walk forward. At the same time, User A's smart terminal device scans the "idle area C" with a signal strength of -73dBm (old rule not met, new rule has been met). Therefore, the smart terminal device successfully checks in in area C and reminds the user: "Please go to area C".

[0121] The updated boot strategy specifically includes:

[0122] The server decision-making and instruction generation are also made by the server resource allocation module. When the system decides to guide the user to a low-load area, it generates a clear boot instruction.

[0123] Push guidance information: The server sends guidance information to the user's smart terminal device through push notifications or real-time interfaces;

[0124] After receiving the instruction, the user's smart terminal device will issue a strong guidance through a combination of multiple sensory modalities:

[0125] The path line on the screen map interface points directly to the assigned low-load area (such as "Blood Drawing Window C"); a prominent notification pops up on the screen: "Tip: There are fewer people in the queue at Window C, with an estimated wait time of 5 minutes. We recommend you go there!" and the "Go" button is highlighted; a flashing green arrow points in the direction; the speaker plays a voice message: "We recommend an available window. Please follow the on-screen instructions to area C.", accompanied by a vibration to remind the user to check important guidance information;

[0126] By proactively and clearly informing users and providing strong multi-sensory cues, the probability of users complying with traffic diversion is greatly increased, thereby quickly balancing the load in different areas.

[0127] If a user fails to check in within their assigned area, the system automatically detects their current location and reassigns them to the nearest or least overloaded available area. Simultaneously, it updates the guidance information, including:

[0128] Step A1: Trigger the condition of "not signing in in the assigned area";

[0129] The system triggers the reallocation process under any of the following conditions:

[0130] Failure to check in within time limit: The user is assigned to area A and fails to check in within area A within the preset time window (e.g., 90 seconds).

[0131] Check-in in a non-assigned area: The user successfully triggered the check-in in another area outside the assigned area (such as area B);

[0132] Location deviation warning: Based on signal strength triangulation or inertial navigation data from multiple beacons (if the terminal supports it), it determines that the user's travel trajectory has significantly deviated from the optimal path to the assigned area.

[0133] Step A2: Automatically detect the current location;

[0134] Once the triggering condition is met, the system immediately starts the current location detection program:

[0135] Beacon signal scanning: The terminal device (mobile phone / wristband) rapidly scans all receivable beacon signals in the vicinity to obtain their device ID and signal strength (RSSI).

[0136] Data reporting: The terminal device reports the scanned beacon data list (including beacon ID and corresponding RSSI value) to the central server in real time;

[0137] Server-side location calculation: After receiving the reported data, the server compares it with the beacon database; the database stores the mapping relationship between each beacon ID and its physical deployment location; the server uses the fingerprint positioning method: it matches the currently received beacon strength combination with the pre-collected "location-signal strength" database to find the most similar location point, which is the user's estimated current location.

[0138] Step A3: Reassign to a new region;

[0139] Based on the calculated current user location, the system runs a new decision-making algorithm to select the optimal new target area. The decision priority is as follows:

[0140] Priority 1: Select the availability zone with the lowest load to maximize overall efficiency and minimize overall wait time. The system ignores distance factors and selects the zone with the lowest current real-time load and shortest expected wait time (e.g., Zone C) from all available zones capable of handling user projects. This is the optimal load balancing strategy.

[0141] Priority 2: The closest available area minimizes user walking distance and provides maximum convenience. Based on the user's current location, the system calculates the path distance to all available areas that can process their project and selects the one with the closest spatial distance (e.g., area D). This is a suboptimal choice when the load is roughly the same.

[0142] The system can dynamically adjust priorities based on the overall load. For example, when the load in all areas is low, the "closest to" principle is prioritized; when there is a significant load imbalance, the "lowest load" principle is prioritized.

[0143] Step A4: Update the onboarding information and push it out;

[0144] After the system completes the reallocation, it immediately sends an update command to the user terminal:

[0145] Generate new guidance instructions: The instructions include enhanced information such as a new target area ID (e.g., area C or area D), optimal path planning, and estimated waiting time;

[0146] Multimodal strong warning: Upon receiving a new instruction, the user terminal will explicitly interrupt its current state to notify the user of the plan change.

[0147] Visually: A prominent pop-up notification appears on the screen, displaying: "Plan changed! You have been rerouted to [Area C], with a shorter estimated wait time (only 5 minutes). Please click to view the new route." Simultaneously, the path lines on the map interface update in real time.

[0148] Auditory: Play a unique notification sound (distinguishing it from ordinary notifications), such as "Ding-dong, route updated";

[0149] Haptic: Produce long vibrations or vibrations in a specific pattern (such as two long and one short) to ensure user perception.

[0150] Continuous guidance: After the prompt ends, the terminal interface will continue to display guidance information to the new target area until the user successfully checks in to the new area or changes again.

[0151] As one implementation method, the Kalman filter algorithm is used to filter and denoise the received wireless signal.

[0152] In one implementation, in step 4, the sensory modalities used to provide guidance prompts to the user through at least two different combinations of sensory modalities include tactile, auditory, and visual.

[0153] The guidance prompts include a combination of at least two of the following:

[0154] Tactile cues are generated via a vibration module;

[0155] Aural cues are generated using a buzzer or speaker;

[0156] Visual cues are generated by changing the colors of the screen interface, text, or icons.

[0157] The screen interface uses color changes to represent different queue statuses, with light colors indicating that you can proceed and dark colors indicating that you need to wait.

[0158] As one implementation method, in step 1, the way to bind the smart terminal device with the user's identity information includes at least one of the following:

[0159] Scan the device identification code of the smart terminal device;

[0160] Scan the user's medical examination report number;

[0161] Manually enter the user's identification information.

[0162] Example 2:

[0163] This embodiment is basically the same as embodiment 1, except that it provides an intelligent guidance method for a health checkup center (the health checkup center uses this method to provide users with smart bracelets as smart terminal devices and deploys Bluetooth beacon devices at the entrance of each examination department):

[0164] Step 1: Binding and Information Synchronization. After registering at the front desk, staff will provide a smart bracelet. Users can use their mobile app to scan the QR code (device identification code) displayed on the bracelet screen to bind the bracelet to their identity information and health check package items. After successful binding, the user's list of pending examination items (such as blood routine, electrocardiogram, B-ultrasound, etc.) and recommended procedures will be synchronized to the smart bracelet through the server.

[0165] Step 2: Automatic check-in. Users follow the guidance to the ECG room. As the user approaches, the wristband begins to receive Bluetooth signals from multiple beacon devices deployed at the entrance.

[0166] The signal processing module inside the bracelet first performs Kalman filtering on the received signal strength index (RSSI) to smooth it out and eliminate transient fluctuations.

[0167] After processing, it was found that the signal strength from the "ECG Room B" beacon was the strongest (-65dBm), and significantly stronger than the neighboring "ECG Room A" beacon (-72dBm). The system initially determined "ECG Room B" as a candidate check-in area.

[0168] To further confirm this, the system analyzed the signal strength change trend of the "ECG Room B" beacon over the past 3 seconds. Calculations showed that the slope of the signal strength change was positive (greater than zero), indicating that the user was continuously approaching the beacon.

[0169] Ultimately, the system verified that the signal strength (-65dBm) of "ECG Room B" exceeded its preset check-in threshold (-70dBm). The wristband automatically triggered the check-in and emitted a short vibration, while the screen displayed "ECG check-in successful".

[0170] Step 3: Status Acquisition and Multimodal Guidance. After check-in, the wristband obtains the queuing status of the department from the server in real time. The current status is "Queuing, there are 2 people ahead of you";

[0171] The LED strip on the wristband is blue (a dark color, indicating that you need to wait), and the screen also displays the same waiting text message and icon;

[0172] When the server pushes a message that says "Please get ready, next one is you", the bracelet immediately activates a multimodal combination prompt: it emits a rapid vibration (tactile), the screen flashes green and displays "Please get ready" (visual), and the speaker plays a gentle prompt tone (auditory), ensuring that the user will not miss the prompt under any circumstances;

[0173] Step 4: After completing all the health check items, the wristband receives a completion notification from the server. The screen displays: "All items have been completed. Please present your wristband at the front desk on the first floor to verify your identity and collect your breakfast voucher."

[0174] Meanwhile, the interface provides a "one-click call for volunteers" button. If users are unsure of the location of the front desk, they can press the button, and nearby volunteers' handheld devices will receive a notification to come and assist.

[0175] Example 3:

[0176] This embodiment is basically the same as Embodiment 1, except that the user uses their own smartphone as a smart terminal device to implement all the guidance functions through the pre-installed official application or mini-program, which aims to further reduce the system deployment cost and improve the user's ease of use.

[0177] Step 1: Binding and Information Synchronization. Upon arrival at the venue, users scan the designated service QR code at the reception desk or through promotional posters. This QR code is linked to the user's pending inspection item or service process. After scanning, the phone automatically redirects to a guiding application or mini-program interface. The application first requests the user's location and Bluetooth permissions. After authorization, the application prompts the user to confirm their identity information (the system can pre-fill some information based on the scanned content, or allow the user to manually complete the confirmation). Once confirmed, the user's identity information is uniquely bound to the mobile device, and the server simultaneously synchronizes the user's pending inspection item process information to the mobile application.

[0178] Step 2: Automatic check-in. Users proceed to the first inspection area based on the map or initial directions displayed on the mobile application. Bluetooth beacon devices deployed at the department entrance continuously broadcast signals. The application on the user's mobile phone continuously scans and receives these beacon signals in the background.

[0179] The signal processing algorithm within the application performs Kalman filtering to smooth the received RSSI values;

[0180] When the application determines that the phone has entered the preset check-in range of a certain beacon (for example, the signal strength continuously exceeds the threshold of -75dBm), it automatically sends a check-in request to the server. Upon successful check-in, the phone immediately emits a short vibration accompanied by a crisp notification sound, and a notification pops up at the top of the screen: "ECG Room Check-in Successful";

[0181] Step 3: Status Acquisition and Multimodal Guidance. After check-in, the application obtains the queuing status of the department from the server in real time and clearly displays "You are currently in 3rd place" or "Estimated waiting time: about 15 minutes" on the homepage.

[0182] During the waiting period, the application interface is displayed in blue (waiting time required). When the server notifies the user that it is almost their turn, the application triggers a multimodal alert with a strong vibration, a green screen flash, and a notification sound, ensuring that the user can reliably receive the alert through at least two sensory channels, even if the phone is in their pocket or held in their hand.

[0183] Step 4: After the user completes all the procedures, the server sends a command to the mobile application. The application interface updates, displaying: "All examinations are complete. Please proceed to the information desk on the first floor to print your report." Simultaneously, a prominent "One-Click Navigation" button is provided, which, when clicked, directly redirects to the mobile map application and plans the route to the information desk. Furthermore, virtual buttons for "Online Customer Service" or "One-Click Volunteer Call" are retained to provide additional assistance to the user.

[0184] The beneficial effects of this embodiment are as follows:

[0185] Cost reduction and process simplification: By making full use of users' own equipment, the procurement, maintenance, disinfection, distribution and recycling processes of dedicated smart terminal equipment are eliminated, which significantly reduces the operator's hardware costs and management complexity.

[0186] Improve user acceptance and convenience: Users do not need to learn how to use new devices and can directly operate using their familiar mobile phones. The binding and interaction process conforms to daily habits (such as scanning codes, authorizing, and receiving notifications), reducing the learning cost and making the experience more natural and smooth.

[0187] Functionality remains unaffected: Smartphones generally possess the necessary hardware such as Bluetooth, vibration motors, speakers, and high-definition screens, which fully support the signal reception, positioning judgment, and multimodal prompting functions described in this invention, ensuring the complete realization of the guidance effect.

[0188] Easy to promote and popularize: The implementation threshold of this solution is low, and it is especially suitable for institutions with existing online service platforms (such as hospital WeChat official accounts and government affairs apps) to integrate and upgrade, and can be quickly and widely promoted and applied.

[0189] Example 4:

[0190] This embodiment is basically the same as Embodiment 1, except that it provides a precise guidance and anti-interference check-in method for government service halls (government service halls are crowded and have complex beacon signals; users use the smart terminal devices provided in the hall to handle "enterprise change" business, which requires passing through three windows in sequence: "consultation, material submission, and payment").

[0191] Step 1: Binding and Information Synchronization. The user obtains a business ticket from the ticket dispenser. The ticket has a QR code printed on it. The user scans the QR code on the ticket at the self-service terminal. The terminal then assigns the user a smart handheld device (smart terminal). The user's identity and business process sequence are automatically bound to the handheld device.

[0192] Step 2: Accurate check-in and conflict resolution. Users follow the instructions to the service area. Due to the narrow hall passage and dense beacon deployment, the handheld device simultaneously receives signals from two beacons: the "inquiry window" and the adjacent "complaint window". The signal strengths of the two are very close (the difference is less than the preset tolerance threshold of 3dB). The system cannot immediately determine the target area by comparing the signal strength.

[0193] The system initiates a conflict resolution mechanism. First, it queries the user's pending business process. The next process is "consultation," so the "consultation window" beacon is prioritized as a suspicious target. At the same time, the system analyzes the signal change trends of the two beacons and finds that in the past 2 seconds, the signal strength of the "consultation window" beacon has been continuously increasing (with a positive slope), while the signal strength of the "complaint window" has changed slowly. This indicates that the user is heading towards the "consultation window" rather than the "complaint window."

[0194] Based on the analysis of business process sequence and movement trends, the system ultimately determined that the "consultation window" was the target beacon device. After verifying that its signal strength exceeded the threshold, the system automatically completed the check-in, and the handheld device screen displayed a message that "consultation check-in successful".

[0195] Step 3: Status acquisition and multimodal guidance. While the user is waiting in the waiting area, the handheld device displays the queuing status of each window in real time. When it is the user's turn, the system plays a clear voice call through the handheld device's speaker, "Please go to consultation window number 3 if you are number A001". At the same time, the handheld device screen highlights the window number and the words "Please go there".

[0196] This combination of auditory and visual cues ensures that guidance information is effectively delivered even when users are looking down at their phones or in noisy environments.

[0197] Step 4: Complete the guidance. After the user completes the last step in the "Payment" window, the handheld device will receive a completion instruction, and the screen will display: "Business completed. If you need an invoice, please turn left to the self-service invoice machine; if you need mail, please turn right to the post office service counter."

[0198] This embodiment provides clear next-step instructions, forming a perfect service loop without requiring users to ask again.

[0199] Example 5:

[0200] like Figures 2-8 As shown, this embodiment is basically the same as embodiment 1, except that it provides a multimodal intelligent guidance system, including:

[0201] The processor is used to execute the control logic of each module;

[0202] Memory is used to store user information, program instructions, and status data;

[0203] Communication modules (Bluetooth, Wi-Fi, 4G / 5G modules) are used for data interaction with beacon equipment and servers;

[0204] The device body 100 is equipped with a display screen 101, a vibration motor 102, a speaker 103 and a buzzer 104. In the initial state, the display screen 101 displays a QR code and a digital code for binding user identity information. After binding is completed, the display screen 101 is used to display information and sensory feedback during the guidance process.

[0205] Binding module 10 is used to bind the smart terminal device with the user's identity information. Binding module 10 is implemented by the processor of the device body 100 calling the binding program stored in the memory, specifically including:

[0206] Scan the user's medical examination form or identity QR code using a camera or barcode scanner;

[0207] Alternatively, the system may receive user-inputted identity information via a touchscreen.

[0208] The processor associates the acquired identity information with the device identification code and uploads it to the server via the communication module to complete the binding.

[0209] Location check-in module 20 is used to detect the user's location through beacon equipment and automatically complete the check-in. Location check-in module 20 includes:

[0210] Signal receiving unit: Acquires wireless signals emitted by the beacon device via a Bluetooth receiving module;

[0211] Signal processing unit: The processor performs filtering and normalization processing on the received signals;

[0212] Location determination unit: The processor determines whether the check-in area has been entered based on the RSSI location algorithm;

[0213] Check-in execution unit: If the conditions are met, the processor automatically sends a check-in request to the server and triggers the output device to display a status prompt;

[0214] Status acquisition module 30 is used to communicate with the server to obtain queuing status information in real time;

[0215] The multimodal prompting module 40 is used to provide guidance prompts to the user in various ways. The multimodal prompting module 40 is implemented through the following hardware combination:

[0216] Vibration motor 103 is used for tactile cues;

[0217] A speaker 104 or a buzzer 105 is used for auditory cues;

[0218] Display screen 101 is used for visual cues;

[0219] The processor controls the above hardware to output corresponding combinations of prompts based on the status information pushed by the server.

[0220] As one implementation method, the intelligent guidance system also includes:

[0221] The signal processing module 50 is used to filter and optimize the beacon signal. The signal processing module 50 is implemented by the processor executing the signal filtering algorithm (such as Kalman filtering or moving average filtering) to smooth the received signal strength value and improve the positioning accuracy.

[0222] The completion guidance module 60 is used to issue prompts and provide verification or volunteer call functions after all items are completed. The completion guidance module 60 detects the completion status of the last item through the processor, obtains the location information of the verification area or initiates a volunteer call request through the communication module, and prompts the user with the result through the output device.

[0223] Each functional module of this system is implemented based on the hardware resources of the device body 100. Specifically, the computer program stored in the memory is executed by the central processing unit, and together with hardware components such as communication modules, sensors, and output devices, the functions of each step in the intelligent guidance method are completed.

[0224] The resource allocation module 70 is used to dynamically allocate appropriate check-in areas based on the real-time status of each area and user project information. It is also used to record historical load data of each area, predict the regional load trend in the future time period based on machine learning algorithms, and optimize user allocation in advance.

[0225] The resource allocation module 70 is communicatively connected to the status acquisition module 30 and the location check-in module 20, and is used to coordinate the area allocation and check-in triggering logic.

[0226] Example 6:

[0227] like Figure 2 As shown, this embodiment is basically the same as embodiment 4, except that a multimodal intelligent guidance system is provided. The device body 100 is a handheld device, and a lanyard hole 105 is provided on the handheld device. A lanyard hole is used to attach a lanyard, which makes it convenient for the user to wear the handheld device and use it in the whole guidance process.

[0228] It should be noted that while the preferred embodiments of the present invention are provided in the specification and accompanying drawings, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. These embodiments are not intended to impose additional limitations on the content of the present invention; their purpose is to provide a more thorough and comprehensive understanding of the disclosure of the present invention. Furthermore, the above-described technical features can be combined with each other to form various embodiments not listed above, all of which are considered to be within the scope of the present invention specification. Moreover, those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims.

Claims

1. A multimodal intelligent guidance method, characterized in that, Includes the following steps: Step 1: Bind the smart terminal device to the user's identity information, and the server synchronizes the user's inspection process information to the smart terminal device; Step 2: Communicate with the smart terminal device through at least one beacon device deployed in the guidance area. When the smart terminal device enters the preset check-in range based on the communication signal, the check-in operation is automatically performed, and the smart terminal device issues a status prompt. Step 3: The smart terminal device obtains real-time status information related to the item to be inspected, pushed by the server. Step 4: Based on the real-time status information, issue guidance prompts to the user through at least two different sensory modal combinations; Step 5: When the final check is detected to be completed, a completion reminder is triggered, and the user is guided to the verification area or to call a volunteer with one click through the smart terminal device.

2. The multimodal intelligent guidance method according to claim 1, characterized in that, In step 2, the method for automatically performing the check-in operation when the smart terminal device enters the preset check-in range based on the communication signal includes: Receive wireless signals from one or more beacon devices through a smart terminal device; The collected wireless signals are filtered, denoised, and normalized. Based on the processed signal data, the received signal strength indication positioning method is used to determine whether the smart terminal device has entered the preset check-in range. If so, then automatic check-in will be triggered.

3. The multimodal intelligent guidance method according to claim 2, characterized in that, When the smart terminal device receives signals from multiple beacon devices simultaneously, the steps for determining whether the smart terminal device has entered the preset check-in range include: Compare the strength information of multiple received beacon signals; Based on the comparison of signal strength, the area corresponding to the beacon device with the strongest signal is selected as the candidate check-in area; Verify whether the signal strength of the candidate check-in area exceeds its preset check-in threshold. If it does, it is determined to be within the preset check-in range of the area and check-in is triggered.

4. The multimodal intelligent guidance method according to claim 3, characterized in that, Also includes: If the strength difference of multiple beacon signals is less than a preset tolerance threshold, then the target beacon device is selected from the multiple beacon devices based on the user's order of the inspection items and / or the movement trend of the smart terminal device. Verify whether the signal strength of the area corresponding to the target beacon device exceeds its preset check-in threshold. If it does, it is determined that the user has entered the preset check-in range of the area and the check-in is triggered.

5. The multimodal intelligent guidance method according to claim 4, characterized in that, The method for selecting a target beacon device from multiple beacon devices based on the motion trends of smart terminal devices includes the following steps: Collect multiple signal strength values ​​from the same beacon device within a preset time window; Calculate the rate of change of the plurality of signal intensity values, perform linear fitting on the plurality of signal intensity values, obtain the slope of the fitted line, and use the slope as the rate of change; If the rate of change is greater than zero, it is determined that the user is approaching the beacon device.

6. The multimodal intelligent guidance method according to claim 5, characterized in that, After the step of acquiring multiple signal strength values, the method further includes: The collected signal strength values ​​are smoothed using a filtering algorithm; The step of calculating the rate of change is based on the smoothed signal strength value.

7. The multimodal intelligent guidance method according to claim 1, characterized in that, Before step 2, the following also applies: Resource allocation steps: The server allocates a specific check-in area to the user based on the real-time load of each check-in area, the type and priority of the user's pending items, and pushes the information of that area to the smart terminal device. The smart terminal device guides the user to the designated area to complete the check-in based on the received allocation area information and the beacon device signal.

8. The multimodal intelligent guidance method according to claim 7, characterized in that, The resource allocation steps include: The server monitors in real time at least one of the following in each region: current number of people in the queue, estimated waiting time, and equipment usage status. The user's check-in area allocation is dynamically adjusted based on the urgency or preset priority of the user's pending inspection items. If a certain area is overloaded, new users will be assigned to a less overloaded area, and the beacon device check-in threshold or guidance policy for that area will be updated. If a user fails to check in within their assigned area, the system will automatically detect their current location and reassign them to the nearest or least overloaded available area, while also updating the guidance information.

9. A multimodal intelligent guidance system for implementing the intelligent guidance method as described in any one of claims 1-8, characterized in that, include: The device body (100) is equipped with a display screen (101), a vibration motor (102), a speaker (103) and a buzzer (104). The binding module (10) is used to bind the smart terminal device with the user's identity information; The location check-in module (20) is used to detect the user's location through the beacon device and automatically complete the check-in; The status acquisition module (30) is used to communicate with the server to obtain queuing status information in real time; The multimodal prompting module (40) is used to provide guidance prompts to the user in a variety of ways.

10. The multimodal intelligent guidance system according to claim 9, characterized in that, Also includes: The signal processing module (50) is used to filter and optimize the beacon signal; The completion guide module (60) is used to issue prompts and provide reimbursement or call-to-volunteer functions after all projects are completed; The resource allocation module (70) is used to dynamically allocate suitable check-in areas based on the real-time status of each area and user project information. It is also used to record the historical load data of each area, predict the regional load trend in the future time period based on machine learning algorithms, and optimize user allocation in advance. The resource allocation module (70) is communicatively connected to the status acquisition module (30) and the location check-in module (20) to coordinate the area allocation and check-in triggering logic.

Images