A method, device and equipment for returning goods based on misplacement

By combining smart glasses with radio frequency identification (RFID) technology, the system proactively identifies misplaced goods and generates intuitive guidance paths, solving inventory problems caused by misplaced goods and achieving efficient and accurate goods placement and inventory management.

CN120996067BActive Publication Date: 2026-03-27HANGZHOU QIUGUOJIHUA TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-10-23
Publication Date
2026-03-27

AI Technical Summary

Technical Problem

In existing technologies, misplacement of goods leads to distorted inventory data, increases difficulties for customers and economic losses, and relies on manual inspection, which is inefficient and costly.

Method used

By using smart glasses combined with radio frequency identification (RFID) technology, the system obtains real-time location information of goods through area scanning, compares it with preset locations, generates intuitive visual guidance paths, dynamically plans return paths, and monitors user deviations in real time. The system also improves recognition accuracy by comparing product images.

Benefits of technology

It enables efficient and accurate product placement, reduces labor costs, improves inventory management accuracy and user experience, and avoids blind searching and misoperation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120996067B_ABST
    Figure CN120996067B_ABST
Patent Text Reader

Abstract

The application discloses a method and device for returning misplaced goods based on the position of the goods, and a first radio frequency identification reader is arranged on a goods shelf. The method is applied to an intelligent glasses end, and comprises the following steps: in response to a user wearing intelligent glasses to return misplaced goods, performing area scanning through the first radio frequency identification reader, so as to read radio frequency identification tag information of all goods in a specified range through the first radio frequency identification reader; if current radio frequency identification positioning information of a specified good is inconsistent with initial radio frequency identification positioning information of the specified good, it is determined that the type of the misplaced goods is goods placement misplacement; based on the current radio frequency identification positioning information of the specified good and the initial radio frequency identification positioning information of the specified good, a returning path is determined, so that the user moves the specified good to a goods shelf position corresponding to the initial radio frequency identification positioning information of the specified good according to the returning path.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the warehouse management technical field, and particularly relates to a homing method, device and equipment based on misplaced goods. BACKGROUND

[0002] In the fields of retail, warehousing and logistics, standardized placement of goods is a key link to guarantee operational efficiency, improve inventory management accuracy and optimize customer shopping experience. However, in actual operation, due to customer selection, employee restocking errors or daily inventory negligence, goods are often placed in the wrong shelf location, i.e. "misplaced goods". This misplacement not only distorts inventory data and causes inventory discrepancies, but also increases the difficulty for customers to find the desired goods, and even causes direct economic losses due to long-term storage of goods in the wrong location.

[0003] Currently, the traditional solution to the problem of misplaced goods mainly relies on periodic manual inspection and arrangement. This method highly depends on the experience, memory and responsibility of the inventory clerk, and has the significant disadvantages of low efficiency, easy omission and high labor cost. Especially in large supermarkets or warehouse centers, the number of goods is huge and the types are various, and simply relying on manual search for misplaced goods and homing is an extremely tedious and time-consuming work. SUMMARY

[0004] One or more embodiments of the present specification provide a homing method, device and equipment based on misplaced goods, to solve the technical problems proposed in the background.

[0005] One or more embodiments of the present specification adopt the following technical solutions:

[0006] The homing method based on misplaced goods provided by one or more embodiments of the present specification is applied to the smart glasses end, and comprises the following steps:

[0007] In response to the user wearing the smart glasses homing the misplaced goods, the first radio frequency identification reader is scanned to read the radio frequency identification tag information of all goods in the specified range, and the radio frequency identification tag information is transmitted to the smart glasses, wherein the radio frequency identification tag information comprises the identification code of the corresponding goods and the current radio frequency identification positioning information of the corresponding goods.

[0008] The current radio frequency identification positioning information corresponding to each identification code received is compared with the initial radio frequency identification positioning information corresponding to each identification code stored in advance.

[0009] If the current radio frequency identification positioning information of the specified goods is inconsistent with the initial radio frequency identification positioning information of the specified goods, it is determined that the misplacement type of the specified goods is goods placement misplacement.

[0010] Based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, a homing path is determined, so that the user moves the specified goods to the shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the homing path.

[0011] It should be noted that the present application constructs a set of active discovery and intelligent guidance combined goods homing system through the cooperative application of smart glasses and radio frequency identification technology, and changes the traditional passive and inefficient work mode relying on artificial memory and inspection into an active discovery, accurate positioning and intelligent guidance efficient operation process driven by technology. Specifically, the system triggers the shelf reader / writer to perform area scanning through smart glasses, automatically obtains the real-time position information of all goods, and compares with the preset correct position, so as to actively and quickly identify misplacement goods, overcoming the inherent defects of easy omission and low efficiency of artificial inspection; after discovering misplacement, the system further integrates goods position information and user real-time position, generates an intuitive visual guidance path through extended reality technology, directly guides the user to the misplacement goods and indicates the correct homing position, greatly reduces the dependence on the experience and memory of the goods organizer, avoids blind search, so that even novice employees can quickly and accurately complete complex homing tasks, thereby significantly improving the arrangement efficiency, reducing the labor cost, and fundamentally improving the accuracy of inventory management.

[0012] Further, the smart glasses are built-in with a second radio frequency identification reader / writer, which triggers the first radio frequency identification reader / writer to perform area scanning, so as to read the radio frequency identification tag information of all goods in the specified range through the first radio frequency identification reader / writer, including:

[0013] The first radio frequency identification reader / writer is triggered by the second radio frequency identification reader / writer to perform area scanning, so as to read the radio frequency identification tag information of all goods in the specified range through the first radio frequency identification reader / writer.

[0014] It should be noted that the application constructs a precise data acquisition mode of on-demand starting and cooperative operation, effectively avoids the energy waste and signal interference caused by the continuous scanning of the radio frequency identification system, and at the same time ensures the immediacy and integrity of the acquisition of goods information. Specifically, the system does not make the first radio frequency identification read-write ware on the shelf always in the energy consumption state of full-time work, but through the second radio frequency identification read-write ware built in the smart glasses, only when the user needs to perform the homing operation, the first radio frequency identification read-write ware in the specific area is sent a precise scanning instruction; This mechanism triggered by user operation intention makes the radio frequency scanning activity have clear target and timeliness, and the first read-write ware only starts the reading operation of all goods tags in its jurisdiction range after receiving the instruction, and returns the complete radio frequency identification tag information obtained to the smart glasses, which not only significantly reduces the standby power consumption of the whole radio frequency identification system and prolongs the service life of the equipment, but more importantly, ensures that the goods position data obtained at the moment when the user starts to operate is the latest and complete, provides a solid and reliable data foundation for subsequent comparison, judgment and path planning, so as to realize the double improvement of energy efficiency and efficiency at the system level.

[0015] Further, the homing path is determined based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, comprising:

[0016] Obtaining real-time location information of the user;

[0017] Obtaining environment information of the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods;

[0018] Determine the homing path based on the real-time location information, the environment information, the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods.

[0019] It should be noted that the application upgrades the traditional one-way and static goods location guide to a personalized and executable dynamic navigation scheme based on multi-dimensional space perception and real-time calculation by fusing user real-time location, goods location and environmental information. Specifically, the system does not simply inform the user of the target location, but continuously acquires the accurate location of the user through the smart glasses, thereby taking the user as the starting point of path planning, ensuring the real-time and personalization of navigation; at the same time, the system comprehensively considers the current mispositioned location of the goods, the correct location thereof, and the surrounding shelf layout, passageway and other environmental information, so that the finally generated homing path is not an ideal straight line, but a practical and feasible route that integrates space structure, obstacle avoidance and optimal sequence (such as picking up first and then placing); this not only greatly reduces the cognitive load and operation time of the user in the complex shelf environment due to blind searching, but also ensures seamless connection of the entire process from discovering mispositioning, planning path to executing homing, guides the user to complete the operation in the most efficient and direct way, thereby significantly improving the execution efficiency and user experience of the homing task.

[0020] Further, after determining the homing path based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, the method further comprises:

[0021] The indication information of the homing path is generated through the extended reality technology of the smart glasses, and the corresponding indication information is displayed in real time through the display screen of the smart glasses.

[0022] It should be noted that the application intuitively superimposes the homing path information in the user's real field of view through the extended reality (XR) technology to guide, converts the abstract path information into immersive and visual space guidance, greatly reduces the cognitive and operational burden of the user, and realizes seamless conversion from searching to execution. Specifically, the system does not use the traditional two-dimensional map or voice instruction, which requires the user to perform in-head conversion, but uses the XR technology of the smart glasses to directly render direction arrows, distance markers, highlight identifiers and other visual elements in the user's field of view, accurately aligns the correct movement path and operation steps with the real physical environment, so that the user does not need to interrupt the current task to understand the instructions or remember the location, can keep the attention focused on the operation itself, thereby forming an intuitive operation experience of seeing is believing. This not only significantly shortens the decision-making and searching time, avoids misoperation due to understanding deviation, but also makes the entire homing process smooth and efficient, greatly improves the execution accuracy of the task and the user experience.

[0023] Further, the method further comprises:

[0024] The homing path is monitored in real time through the smart glasses;

[0025] If the user deviates from the homing path during movement, an off-path warning is issued to the user through the smart glasses, and the latest homing path is re-determined.

[0026] It should be noted that the present application upgrades the traditional one-way, static navigation guide to a continuous closed-loop collaborative guidance system by introducing a real-time monitoring and dynamic re-planning mechanism for the user's movement path, effectively ensuring the robustness of the guidance process and the reliability of the final task execution. Specifically, the system does not simply generate a path and leave the user to move on their own, but continuously monitors the user's actual movement trajectory through the smart glasses and compares it with the preset optimal path. This real-time feedback mechanism can quickly detect deviations caused by environmental interference, understanding bias or temporary decisions. Once a deviation is detected, the system immediately provides immediate feedback to the user through visual or tactile warnings, allowing them to quickly detect abnormalities and stop incorrect movements, effectively avoiding wasting time and effort in the wrong direction. More importantly, the system does not mechanically require the user to return to the original path, but intelligently recalculates an optimal path from the current location to the target based on the user's latest location, product location and environmental information. This dynamic adaptive capability ensures that the guidance path is always consistent with the user's real-time state and environment, minimizing the interruption of the task flow caused by unexpected deviations, thereby ensuring that the entire guidance process from start to finish is coherent, efficient and fault-tolerant, greatly improving the operation success rate and user experience in complex real-world environments.

[0027] Further, the radio frequency identification tag information further includes pictures of each product;

[0028] If the current radio frequency identification positioning information of the specified product is consistent with the initial radio frequency identification positioning information of the specified product, the smart glasses compare the current product pictures corresponding to each identification code with the pre-stored initial product pictures corresponding to each identification code.

[0029] If the current product picture of a specific product is inconsistent with the initial product picture of the specific product, it is determined that the misplacement type of the specific product is product misplacement.

[0030] It should be noted that the present application introduces the comparison of goods pictures as a supplementary verification means of radio frequency identification positioning detection, constructs a double verification mechanism composed of radio frequency positioning and visual information, greatly improves the accuracy and comprehensiveness of the identification of mispositioned goods, and effectively solves the detection blind area that may exist in single dependence on position data. Specifically, when the radio frequency identification detects that a certain goods is located at the correct position of its initial registration, the traditional method will determine that the goods is placed correctly, but in the actual situation, there may be a misposition type of "the position is correct but the goods itself is replaced" (for example, different goods are placed in the same shelf position); the present application can sensitively find this abnormal situation of inconsistent appearance and registration information by further calling and comparing the current goods image with the initial image stored in the system, so that this kind of hidden misposition problem is also included in the detection range of the system; this double verification mechanism makes the system not only pay attention to "whether the goods is in the correct position", but also further confirm "whether the goods in the correct position is the correct goods", so as to realize more in-depth and more fine monitoring of the goods placement state, greatly reduce the risk of misjudgment or omission caused by single information, and improve the authenticity and reliability of inventory management.

[0031] Further, the misposition type further includes goods missing; the method further includes:

[0032] In the guiding process of the homing path by the extended reality technology of the intelligent glasses, the goods images in the preset range are collected, and the goods images are identified to obtain a plurality of to-be-detected identification codes;

[0033] The plurality of to-be-detected identification codes are compared with an identification code list of the misposition type of goods missing pre-written;

[0034] If it is determined that the misposition type of the goods corresponding to the specified to-be-detected identification code is goods missing, the radio frequency identification positioning information corresponding to the goods of the specified to-be-detected identification code is recorded, so as to homing the goods of the specified to-be-detected identification code based on the radio frequency identification positioning information.

[0035] It should be noted that this invention creatively integrates the missing goods detection task seamlessly into the existing return path guidance process, utilizing the existing navigation route to achieve parallel inspection and recording of missing goods. This transforms the originally independent and additional inventory shortage work into a background process that automatically completes alongside the main task, resulting in a significant increase in work efficiency. Specifically, the system does not initiate a dedicated inventory shortage task after all misplaced goods have been returned to their original positions. Instead, it intelligently and continuously utilizes the visual capabilities of the user's smart glasses to automatically scan shelves along the route, collect images, and identify goods while the user moves along the preset path and performs the main return operation. It automatically compares the identified goods with the known list of missing goods in real time. Once a missing item on the list reappears (i.e., it has been replenished but not updated in the system), the system automatically records its precise location. Thus, without the user noticing and without adding any additional operational burden, the system silently completes the verification and update of the inventory shortage status, achieving both misplacement return and shortage verification without error. This greatly optimizes the workflow and comprehensively improves the automation level and overall efficiency of dynamic, real-time inventory status management.

[0036] Furthermore, if the designated goods are multiple misplaced goods, determining the relocation path based on the current RFID positioning information and the initial RFID positioning information of the designated goods includes:

[0037] Obtain a list of all misplaced goods, the list including the identification code, current RFID positioning information and initial RFID positioning information for each misplaced goods;

[0038] Based on the user's real-time location information and the current RFID positioning information of each misplaced item, the real-time distance from the user to the current location of each misplaced item is calculated, and the initial item processing order is generated according to the real-time distance.

[0039] By combining the shelf layout information with the initial product processing sequence, a return path is generated for each misplaced product.

[0040] The application introduces an intelligent sorting and path planning mechanism based on real-time distance and spatial layout for multiple misaligned goods, converts complex manual task scheduling decisions into an automatic and intelligent global optimization process, thereby significantly improving work efficiency in a multi-task scenario and greatly reducing the cognitive load of operators. Specifically, when facing multiple misaligned goods, the system does not simply list the problem list or rely on the operator to decide the processing order, but actively obtains the real-time location of the user and dynamically calculates the real-time spatial distance between the user and each misaligned good, to generate an initial processing order based on the basic principle of from near to far. This mechanism ensures that every move of the user in the initial stage is the most efficient and economical; further, the system does not stop at this simple distance sorting, but further integrates spatial structure information such as shelf environment and channel layout to optimize and adjust the initial order, generating a globally optimal homing path with the shortest overall movement distance, avoiding repeated paths and back-and-forth returns. This makes the user not need to make time-consuming and laborious task priority judgments and route planning, but only need to follow the system's guidance to complete all goods homing operations efficiently, thereby realizing the mode upgrade from single good processing to multi-good batch processing, and still ensuring the orderliness and high efficiency of the operation in a complex scenario.

[0041] The one or more embodiments of the present specification provide a homing device based on misaligned goods placement, a first radio frequency identification reader is arranged on a shelf, the device is applied to an intelligent glasses end, and comprises:

[0042] A scanning unit, in response to the user wearing the intelligent glasses to homing misaligned goods, performs area scanning through the first radio frequency identification reader, so as to read the radio frequency identification tag information of all goods in the specified range through the first radio frequency identification reader, the radio frequency identification tag information comprising an identification code of the corresponding goods and current radio frequency identification positioning information of the corresponding goods, and the radio frequency identification tag information of all goods is transmitted to the intelligent glasses;

[0043] A comparison unit compares the current radio frequency identification positioning information corresponding to each identification code received with the initial radio frequency identification positioning information corresponding to each identification code stored in advance;

[0044] A determination unit determines that the misalignment type of the specified goods is the misaligned goods placement if the current radio frequency identification positioning information of the specified goods is inconsistent with the initial radio frequency identification positioning information of the specified goods;

[0045] The homing unit determines a homing path based on the current RFID positioning information of the specified goods and the initial RFID positioning information of the specified goods, so that the user moves the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0046] The one or more embodiments of the present specification provide a homing device based on goods misplacement, a first RFID reader-writer is arranged on a shelf, the device is applied to an intelligent glasses end, and the device comprises:

[0047] at least one processor and a bus; and

[0048] a memory in communication connection with the at least one processor; wherein

[0049] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to:

[0050] In response to the user wearing the intelligent glasses to homing the misplaced goods, the first RFID reader-writer is used for area scanning, so as to read the RFID tag information of all goods in a specified range through the first RFID reader-writer, the RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods, and the RFID tag information of all goods is transmitted to the intelligent glasses;

[0051] The current RFID positioning information corresponding to each identification code received is compared with the initial RFID positioning information corresponding to each identification code stored in advance;

[0052] If the current RFID positioning information of the specified goods is inconsistent with the initial RFID positioning information of the specified goods, it is determined that the misplacement type of the specified goods is goods misplacement;

[0053] Based on the current RFID positioning information of the specified goods and the initial RFID positioning information of the specified goods, a homing path is determined, so that the user moves the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0054] The above at least one technical scheme adopted by the embodiments of the present specification can achieve the following beneficial effects:

[0055] The application constructs a set of goods homing system combining active discovery and intelligent guidance by the synergistic application of intelligent glasses and radio frequency identification technology, and changes the passive and inefficient work mode of traditional manual memory and inspection into the efficient work flow of active discovery, accurate positioning and intelligent guidance driven by technology. Specifically, the system triggers the shelf reader to perform area scanning through the intelligent glasses, automatically obtains the real-time position information of all goods, and compares with the preset correct position, thereby actively and quickly identifying the mispositioned goods, overcoming the inherent defects of manual inspection such as easy omission and low efficiency; after discovering the misposition, the system further fuses the goods position information and the real-time position of the user, generates an intuitive visual guidance path through the extended reality technology, directly guides the user to the mispositioned goods and indicates the correct homing position, greatly reduces the dependence on the experience and memory of the goods organizer, avoids blind search, so that even novice employees can quickly and accurately complete the complex homing task, thereby significantly improving the arrangement efficiency, reducing the labor cost, and fundamentally improving the accuracy of inventory management. BRIEF DESCRIPTION OF DRAWINGS

[0056] In order to more clearly illustrate the technical solutions in the embodiments of the present specification or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the present specification, and other drawings can be obtained by those skilled in the art without creative labor. In the drawings:

[0057] Figure 1 An application environment diagram of a goods homing method based on goods misplacement provided by one or more embodiments of the present specification;

[0058] Figure 2 A flowchart of a goods homing method based on goods misplacement provided by one or more embodiments of the present specification;

[0059] Figure 3 A flowchart of a homing path determination method provided by one or more embodiments of the present specification;

[0060] Figure 4 A structural diagram of a homing device based on goods misplacement provided by one or more embodiments of the present specification;

[0061] Figure 5 A structural diagram of a homing device based on goods misplacement provided by one or more embodiments of the present specification. DETAILED DESCRIPTION

[0062] The embodiments of the present specification provide a goods homing method, device and equipment based on goods misplacement.

[0063] In order to enable a person skilled in the art to better understand the technical solutions in the specification, the technical solutions in the specification will be clearly and completely described below in combination with the drawings in the specification. Obviously, the described embodiments are only some of the embodiments of the specification, not all. Based on the embodiments of the specification, all other embodiments obtained by a person skilled in the art without creative labor should be within the protection scope of the specification.

[0064] The scheme of the present application can be applied in the goods homing scene of the goods homing terminal. Figure 1 An application environment diagram of a goods homing method based on goods misplacement provided by an embodiment of the specification is shown in FIG. 1. Figure 1 As shown, the terminal 102 communicates with the server 103 through a network. The data storage system 101 can store data required to be processed by the server 103. The data storage system 101 can be integrated on the server 103, or placed on a cloud or other network server. The terminal 102 can obtain historical behavior data of a user in different operation scenes and running states of an XR glasses; extract behavior common information of the user from the historical behavior data of the user in each operation scene; extract state common information of the XR glasses from the running states of the XR glasses in each operation scene; combine the behavior common information and the state common information to generate glasses habit states of the XR glasses in the operation scene; and associate the operation scene with the glasses habit states to obtain a behavior habit label. Or the above process of constructing the label is executed in the server 103, that is, the server obtains historical behavior data of a user in different operation scenes and running states of an XR glasses; extracts behavior common information of the user from the historical behavior data of the user in each operation scene; extracts state common information of the XR glasses from the running states of the XR glasses in each operation scene; combines the behavior common information and the state common information to generate glasses habit states of the XR glasses in the operation scene; and associates the operation scene with the glasses habit states to obtain a behavior habit label.

[0065] The goods homing terminal can specifically include a smart phone, a smart home appliance, a tablet computer, a virtual reality headset (VR headset), an augmented reality glasses (AR glasses), an electronic display screen, a mixed reality (MR) device, and the like. The MR device can be MR glasses, an MR helmet, an MR camera, and the like. The vehicle-mounted system can be a vehicle-mounted chip, a vehicle-mounted device (for example, an in-vehicle infotainment, a vehicle-mounted computer, a sensor with voice recognition function, and the like), and the like.

[0066] Figure 2 A flowchart of a method for repositioning based on misplacement of goods is provided for one or more embodiments of the present specification. A first radio frequency identification reader / writer is arranged on a shelf. The method is applied to a smart glasses end. Some input parameters or intermediate results in the flow allow manual intervention to adjust to help improve accuracy.

[0067] The method flow steps of the embodiments of the present specification are as follows:

[0068] S201, in response to a user wearing smart glasses to reposition mislocated goods, scanning the area through the first radio frequency identification reader / writer to read the radio frequency identification tag information of all goods within the specified range through the first radio frequency identification reader / writer, the radio frequency identification tag information includes the identification code of the corresponding goods and the current radio frequency identification positioning information of the corresponding goods, and the radio frequency identification tag information of all goods is transmitted to the smart glasses.

[0069] In the embodiments of the present specification, the smart glasses are built-in with a second radio frequency identification reader / writer. The user wears the smart glasses to start the repositioning mode. The smart glasses establish a connection with the first radio frequency identification reader / writer deployed at the shelf end through near field communication or wireless local area network. The scanning instruction can be sent to the first radio frequency identification reader / writer through the second radio frequency identification reader / writer to trigger the first radio frequency identification reader / writer to perform radio frequency scanning on all goods within its coverage range. The first radio frequency identification reader / writer reads the identification code and the current radio frequency identification positioning information contained in the electronic tag of all goods within the range, and sends these radio frequency identification tag information to the smart glasses through wireless transmission.

[0070] S202, compare the current radio frequency identification positioning information corresponding to each identification code received respectively with the initial radio frequency identification positioning information corresponding to each identification code stored in advance respectively.

[0071] In the embodiments of the present specification, after the smart glasses receive the radio frequency identification tag information sent by the first radio frequency identification reader / writer, the locally stored goods information database is called. The database has pre-recorded identification codes of each goods and the initial radio frequency identification positioning information corresponding thereto. The smart glasses compare the current radio frequency identification positioning information corresponding to each identification code received with the initial radio frequency identification positioning information of the corresponding identification code stored in the database one by one.

[0072] S203, if the current radio frequency identification positioning information of the specified goods is inconsistent with the initial radio frequency identification positioning information of the specified goods, it is determined that the mislocation type of the specified goods is goods misplacement.

[0073] In the embodiments described in this specification, the smart glasses determine the location status of each item by comparing the current RFID positioning information with the initial RFID positioning information. When a discrepancy is found between the current RFID positioning information of an item and the initial RFID positioning information of that item in the database, the smart glasses mark the item as a misplaced item and record its misplacement type as "item placement misalignment".

[0074] S204, based on the current RFID positioning information and the initial RFID positioning information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the return path.

[0075] In the embodiments described in this specification, for identified misplaced goods, the smart glasses calculate the optimal return path using a path planning algorithm based on the goods' current and initial RFID positioning information. The smart glasses utilize extended reality technology to overlay virtual path guidance onto the user's field of vision, including directional arrows, distance indicators, and target location markers, guiding the user to the misplaced goods' current location to retrieve them and transport them to the correct shelf position. During the movement, the smart glasses continuously update the displayed path guidance to ensure the user can accurately complete the return operation.

[0076] It should be noted that this invention, through the synergistic application of smart glasses and radio frequency identification (RFID) technology, constructs a goods placement system that combines proactive discovery and intelligent guidance. This transforms the traditional passive and inefficient work mode, reliant on manual memory and inspection, into a highly efficient workflow driven by technology: proactive discovery, precise positioning, and intelligent guidance. Specifically, the system triggers a shelf reader via smart glasses to scan the area, automatically acquiring the real-time location information of all goods and comparing it with preset correct locations. This proactively and quickly identifies misplaced goods, overcoming the inherent shortcomings of manual inspection, such as easy omissions and low efficiency. After detecting a misplacement, the system further integrates the goods' location information with the user's real-time location, generating an intuitive visual guidance path through extended reality technology. This directly guides the user to the misplaced goods and instructs them on their correct placement, greatly reducing reliance on the experience and memory of stock clerks, avoiding blind searching, and enabling even novice employees to quickly and accurately complete complex placement tasks. This significantly improves organization efficiency, reduces labor costs, and fundamentally enhances the accuracy of inventory management.

[0077] Furthermore, when determining the homing path based on the current RFID location information and the initial RFID location information of the specified goods in the embodiments of this specification, please refer to... Figure 3A flowchart of a homing path determination method is shown, which can be executed by the smart glasses. Some input parameters or intermediate results in the flow allow manual intervention adjustment to help improve accuracy.

[0078] S301, obtaining real-time location information of the user.

[0079] In the embodiments of the present specification, the smart glasses can continuously track and obtain the real-time location coordinates and orientation angle of the user in the shelf environment through its built-in positioning module, such as a visual-inertial odometry module or an ultra-wideband positioning module.

[0080] S302, obtaining environment information of the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods.

[0081] In the embodiments of the present specification, the smart glasses retrieve the environment information related to the specified goods from a local or cloud database. The environment information includes a shelf layout three-dimensional map, channel information, and obstacle distribution data, which are associated with the current radio frequency identification positioning information and the initial radio frequency identification positioning information of the specified goods.

[0082] S303, determining a homing path based on the real-time location information, the environment information, the current radio frequency identification positioning information of the specified goods, and the initial radio frequency identification positioning information of the specified goods.

[0083] In the embodiments of the present specification, the path planning engine of the smart glasses receives the real-time location information of the user, the environment information, the current radio frequency identification positioning information of the specified goods, and the initial radio frequency identification positioning information thereof. The planning engine integrates these information to calculate an optimal path in the three-dimensional environment map, which starts from the current location of the user, first goes to the location of the misplaced goods, and then goes to the correct shelf location of the goods, while avoiding known obstacles in the environment.

[0084] It should be noted that the application upgrades the traditional one-way and static goods location guide to a personalized and executable dynamic navigation scheme based on multi-dimensional space perception and real-time calculation by fusing user real-time location, goods location and environmental information. Specifically, the system does not simply inform the user of the target location, but continuously acquires the accurate position of the user through intelligent glasses, so as to take the user as the starting point of path planning, ensuring the real-time and personalization of navigation; at the same time, the system comprehensively considers the current dislocation position of the goods, the correct position thereof, and the surrounding shelf layout, channel and other environmental information, so that the finally generated homing path is not an ideal straight line, but a practical feasible route that integrates space structure, obstacle avoidance and optimal sequence (such as picking up first and then placing); this not only greatly reduces the cognitive load and operation time of the user in the complex shelf environment due to blind searching, but also ensures seamless connection of the whole process from discovering dislocation, planning path to executing homing, guides the user to complete the operation in the most efficient and direct way, thereby significantly improving the execution efficiency of the homing task and user experience.

[0085] Further, after determining the homing path based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, the indication information of the homing path can be generated through the extended reality technology of the intelligent glasses, and the corresponding indication information can be displayed in real time through the display screen of the intelligent glasses.

[0086] It should be noted that the extended reality rendering engine of the intelligent glasses receives the homing path data provided by the path planning module, and the data contains the spatial coordinate sequence of the path and the action guide. The extended reality rendering engine generates corresponding visual guide elements according to the received path data, including a direction arrow pointing to the next target point, a highlighted identification displayed at the target shelf position, and distance prompt information displayed at the key points of the path. The display screen of the intelligent glasses superimposes the generated visual guide elements and the real environment picture in real time, and continuously presents them to the user in an augmented reality manner, realizing the whole visual guidance of the homing operation.

[0087] It should be noted that the application directly superimposes the homing path information in the real field of view of the user through extended reality (XR) technology for guidance, converts the abstract path information into immersive and visual spatial guidance, greatly reduces the cognitive and operation burden of the user, and realizes seamless conversion from searching to execution. Specifically, the system does not use the indirect method of traditional two-dimensional maps or voice instructions that require the user to convert in the brain, but uses the XR technology of smart glasses to directly render direction arrows, distance markers, highlight identifiers and other visual elements in the user's field of view, accurately aligns the correct moving path and operation steps with the real physical environment, so that the user does not need to interrupt the current task to understand the instructions or remember the position, can keep the attention focused on the operation itself, thereby forming a visual operation experience of seeing is believing. This not only significantly shortens the decision and searching time, avoids misoperation caused by understanding deviation, but also makes the entire homing process smooth and efficient, greatly improves the execution accuracy of the task and the user experience.

[0088] Further, the embodiments of the present application can monitor the homing path in real time through the smart glasses; if the user deviates from the homing path during movement, the smart glasses issue a deviation warning to the user and re-determine the latest homing path.

[0089] It should be noted that the smart glasses continuously obtain the real-time spatial position and movement trajectory of the user through the built-in positioning and attitude perception system. The path monitoring module of the smart glasses compares the obtained real-time position of the user with the pre-generated homing path, and determines that the path deviates when the user position deviates from the preset path by more than the allowed threshold. After determining that the deviation occurs, the path monitoring module of the smart glasses immediately triggers the feedback system of the smart glasses, and issues a deviation warning to the user through visual prompts (such as warning icons on the display screen) or tactile feedback (such as vibration). The path planning module of the smart glasses re-computes and generates a latest homing path from the current position to the target position based on the latest position of the user, the positioning information of the target goods and the environmental information, and updates the extended reality guidance information.

[0090] It should be noted that the application upgrades the traditional one-way and static navigation guide to a continuous closed-loop collaborative guidance system by introducing a real-time monitoring and dynamic re-planning mechanism for the user's moving path, effectively ensuring the robustness of the guidance process and the reliability of the final task execution. Specifically, the system does not abandon the user to move on his own after generating the path, but continuously monitors the actual moving trajectory of the user through the intelligent glasses, and compares it with the preset optimal path. This real-time feedback mechanism can discover the deviation caused by environmental interference, understanding deviation or temporary decision of the user at the first time; once the deviation is found, the system immediately provides immediate feedback to the user through visual or tactile warning, so that the user can quickly perceive the abnormality and stop the wrong movement, effectively avoiding wasting time and effort in the wrong direction; more importantly, the system does not mechanically require the user to return to the original path, but intelligently recalculates an optimal path from the current position to the target based on the user's current latest position, goods position and environmental information. This dynamic adaptive capability ensures that the guidance path is always consistent with the real-time state of the user and the environment, minimizes the interruption of the task process caused by unexpected deviation, and ensures that the entire guidance process from the beginning to the completion is coherent, efficient and fault-tolerant, greatly improving the operation success rate and user experience in complex real environment.

[0091] Further, the radio frequency identification tag information further includes pictures of each goods, and if the current radio frequency identification positioning information of the specified goods is consistent with the initial radio frequency identification positioning information of the specified goods, the current goods picture corresponding to each identification code is compared with the initial goods picture corresponding to each identification code pre-stored through the intelligent glasses; if the current goods picture of a specific goods is inconsistent with the initial goods picture of the specific goods, it is determined that the misplacement type of the specific goods is goods placement misplacement.

[0092] It should be noted that the intelligent glasses acquire the current goods picture of the specified goods through the built-in camera, and the picture is corresponded to the identification code in the radio frequency identification tag. The intelligent glasses call the pre-stored goods information database to acquire the initial goods picture corresponding to each identification code, and compare the current acquired goods picture with the initial goods picture of the corresponding identification code in the database. When the intelligent glasses detect that the current goods picture of a specific goods is inconsistent with the initial goods picture in visual features, it is determined that the goods is of goods placement misplacement type, and the abnormal state is recorded.

[0093] It should be noted that the present application introduces the comparison of product pictures as a supplementary verification means of radio frequency identification positioning detection, constructs a double verification mechanism composed of radio frequency positioning and visual information, greatly improves the accuracy and comprehensiveness of the identification of mispositioned products, and effectively solves the detection blind area that may exist in single dependence on position data. Specifically, when the radio frequency identification detects that a certain product is located at the correct position initially registered, the traditional method will determine that the product is placed correctly, but in the actual situation, there may be a mispositioning type that the position is correct but the product itself is replaced (for example, different goods are placed in the same shelf position); the present application can sensitively find this abnormal situation that the appearance does not match the registered information by further calling and comparing the current product image with the initially stored image, so that such hidden mispositioning problem is also included in the detection range of the system; this double verification mechanism makes the system not only pay attention to whether the product is in the correct position, but also further confirm whether the product in the correct position is the correct product, so as to realize more in-depth and more precise monitoring of the product placement state, greatly reduce the risk of misjudgment or omission caused by single information, and comprehensively improve the authenticity and reliability of inventory management.

[0094] Further, the mispositioning type also includes product loss; during the guiding process of the homing path by the extended reality technology of the intelligent glasses, the product images in the preset range are collected, and the product images are identified to obtain a plurality of to-be-detected identification codes; the plurality of to-be-detected identification codes are compared with the identification code list of the mispositioning type of product loss written in advance; if it is determined that the mispositioning type of the product corresponding to a specified to-be-detected identification code is product loss, the radio frequency identification positioning information corresponding to the product of the specified to-be-detected identification code is recorded, so as to homing the product of the specified to-be-detected identification code based on the radio frequency identification positioning information.

[0095] It should be noted that in the process of guiding the homing path by the extended reality technology of the intelligent glasses, the image acquisition function of the intelligent glasses is started synchronously, and the product display area in the preset range in the user's field of view is continuously imaged. The intelligent glasses perform real-time identification processing on the collected product images, extract the visual features of the visible products in the images through image recognition algorithms, and convert them into corresponding to-be-detected identification codes. The intelligent glasses match and compare the plurality of to-be-detected identification codes obtained by identification with the locally stored product loss identification code list, which contains the product identification codes that have been recorded as missing. When it is found that a certain to-be-detected identification code matches an entry in the product loss identification code list, the intelligent glasses record the current radio frequency identification positioning information of the product, and update the information to the system database to provide a position basis for subsequent homing operation.

[0096] It should be noted that the present application seamlessly integrates the missing goods detection task into the existing homing path guiding process, creatively utilizes the existing navigation flow to realize parallel inspection and recording of missing goods, and converts the original independent and additional missing work into a background process automatically completed with the main task, thereby achieving the multiplication of work efficiency. Specifically, the system does not initiate a special missing task after completing the homing of all misplaced goods, but intelligently uses the visual ability of the smart glasses to automatically scan the racks along the way, collect images and identify goods while the user moves along the preset path to perform the main homing operation, automatically compares the identified goods with the known missing goods list in real time; once the missing goods on the list reappear (i.e. have been restocked but not updated in the system), the system automatically records the accurate position, thereby completing the verification and update of the inventory missing state without the user's awareness and without any additional operation burden, achieving the coincidence of misplaced homing and missing recheck, greatly optimizing the work flow and comprehensively improving the automation level and overall efficiency of dynamic and real-time management of inventory status.

[0097] Further, if the specified goods are a plurality of misplaced goods, the homing path can be determined based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods. A list of all misplaced goods can be obtained, including the identification code, current radio frequency identification positioning information and initial radio frequency identification positioning information of each misplaced good. Based on the real-time position information of the user and the current radio frequency identification positioning information of each misplaced good, the real-time distance from the user to the current position of each misplaced good is calculated, and an initial goods processing order is generated according to the real-time distance. The homing path of each misplaced good is generated by combining the shelf environment layout information and the initial goods processing order.

[0098] It should be noted that the smart glasses system first obtains a list of all misplaced goods that have been identified, which includes the unique identification code of each misplaced good, the current location information obtained by radio frequency identification technology, and the initial correct position information recorded in the system. The smart glasses obtain the real-time position coordinates of the user through its positioning system, and calculate the spatial distance between the current position of the user and the current position of each misplaced good, and generate a preliminary goods processing order based on the principle of "from near to far". The smart glasses call the stored shelf environment layout information, including the arrangement of shelves, the direction of channels and the position of obstacles, optimize and adjust the preliminary processing order, and finally generate an optimal homing path that considers the distance efficiency and environmental structure.

[0099] The application introduces an intelligent sorting and path planning mechanism based on real-time distance and spatial layout for multiple misaligned goods, converting complex manual task scheduling decisions into an automatic and intelligent global optimization process, thereby significantly improving work efficiency in multi-task scenarios and greatly reducing the cognitive load of operators. Specifically, when facing multiple misaligned goods, the system does not simply list the problem list or rely on the operator to decide the processing order, but actively obtains the real-time location of the user and dynamically calculates the real-time spatial distance between the user and each misaligned good, to generate an initial processing order based on the basic principle of near and far. This mechanism ensures that every move of the user in the initial stage is the most efficient and economical; further, the system does not stop at this simple distance sorting, but further integrates spatial structure information such as shelf environment and channel layout to optimize and adjust the initial order, generating a globally optimal homing path with the shortest overall movement distance, avoiding repeated paths and back-and-forth turns. This allows the user to follow the system's guidance without having to make time-consuming and laborious task priority judgments and route planning, and to efficiently complete all goods homing operations in a seamless pipeline, thereby realizing the upgrade from single good processing to multi-good batch processing, ensuring the orderliness and high efficiency of operations in complex scenarios.

[0100] Definitions of key terms:

[0101] RFID (Radio Frequency Identification): a non-contact automatic identification technology that automatically identifies target objects and obtains related data through radio frequency signals.

[0102] Smart glasses: a wearable device that usually has display, camera, sensor and communication functions, and can provide users with extended reality (XR) experience.

[0103] First misaligned goods: goods that can be located by an RFID reader, but whose current location is different from the initial correct placement position.

[0104] Second misaligned goods: goods that cannot be located by the RFID reader on the shelf (for example, due to reasons such as exceeding the reading distance, RFID tag failure or falling off), which need to be actively found by the user.

[0105] In the modern warehousing, retail and other industries, the accurate placement and quick homing of goods is the key to improve operational efficiency and reduce management costs. However, due to human operation errors, customers' random placement and other reasons, the misplacement of goods is widespread. The traditional way of goods homing mainly relies on manual searching and memory, which is inefficient and prone to errors, especially in the case of a large number of goods, the workload of searching and homing is huge, which seriously affects the work efficiency and user experience. Although there are some automated or semi-automated warehouse management systems, there is still a lack of a perfect and intelligent solution for accurate positioning and efficient homing of mislocated goods, especially for "missing" goods that RFID cannot directly locate.

[0106] The present application provides an intelligent goods homing system and method, which is characterized by personnel wearing smart glasses, combining RFID technology and image recognition technology, to realize accurate positioning of goods, intelligent path planning and effective recovery of "missing" goods, thereby greatly improving the efficiency of goods homing and reducing labor costs. The technical solution is as follows:

[0107] 1. Personnel wear smart glasses and start the goods homing application.

[0108] 2. The smart glasses obtain the current location information of the goods through the RFID reader on the shelf, and compare it with the pre-stored initial location information to distinguish the first mislocated goods and the second mislocated goods.

[0109] (1) Smart glasses hardware configuration and data preloading: the smart glasses worn by personnel are equipped with an RFID reader, and pre-stored with the initial placement picture and RFID positioning information of the goods. The shelf is also equipped with an RFID reader, forming a cooperative positioning network.

[0110] (2) Smart glasses assist personnel to identify mislocated goods: when personnel need to homing goods, the smart glasses will actively scan the goods through the RFID reader on the shelf, and according to the scanning result, intelligently identify two types of mislocated goods, and prompt the personnel through the display screen of the smart glasses:

[0111] (3) First mislocated goods: refers to the goods that the smart glasses can locate, but the current location is different from the initial correct placement position.

[0112] (4) Second mislocated goods: refers to the goods that the smart glasses cannot locate through the RFID reader on the shelf (such as exceeding the reading distance, RFID tag failure or falling off, etc.), which need to be actively searched by personnel.

[0113] 3. The smart glasses plan and guide the homing path of the first mislocated goods in AR mode for personnel.

[0114] (1) Guiding the first misplaced product to its correct position: The smart glasses will intelligently plan the optimal path for the first misplaced product to its correct position based on the current location of the staff, the initial and current location of the first misplaced product. The staff will intuitively move the product to the correct position guided by the augmented reality (AR) on the display screen of the smart glasses.

[0115] 4. The smart glasses guide the staff to find the second misplaced product by fusing RFID signals and image recognition, and plan and guide the path for the staff to return the product to its correct position after finding it.

[0116] (1) Guiding the second misplaced product to find and return to its correct position: During the staff's search for the second misplaced product, the smart glasses will continuously collect and identify images within the staff's field of view, and combine the signal strength received by the built-in RFID reader to continuously guide the staff in the direction of the second misplaced product. Once the smart glasses identify the second misplaced product, they will immediately guide the staff to return the product to its correct position through the display screen or voice prompt.

[0117] 5. The smart glasses dynamically detect and optimize the staff's return path: During the staff's return of the first misplaced product, the smart glasses will continuously collect and identify images within the staff's field of view to detect whether there is a second misplaced product in the staff's field of view. Once the smart glasses find a new second misplaced product, the system will dynamically adjust and re-plan the overall return path based on the location of the new product and the situation of the first misplaced product that has not been returned, to maximize the efficiency of the staff's return.

[0118] Corresponding to the above embodiments, the specific detailed implementation is as follows:

[0119] The specific implementation of the multi-modal target positioning technology will be described in detail in the specific implementation of the present application, which will describe how the staff wears and operates the smart glasses and completes the product return in combination with the system functions.

[0120] 1. System initialization and data preparation:

[0121] (1) RFID tags and data entry: Paste ultra-high frequency (UHF) RFID tags on each product to be managed. These tags have a unique global identification code (EPC). In the system background database, the administrator will enter the EPC code, the accurate initial placement position (for example, shelf number, layer number, specific coordinates, etc., which will be associated with the RFID positioning coordinates), and a clear product picture for each product. These product pictures will be used for subsequent image recognition comparison by the smart glasses.

[0122] (2) Shelf RFID Reader Network Deployment: Multiple fixed RFID readers are strategically installed on each shelf in the warehouse or retail area. These readers should be able to cover the entire area of the shelf, forming a high-precision RFID positioning network. The readers are connected to the central server through wired or wireless means to upload scan data in real time. The installation position of the readers is optimized to minimize blind spots and signal interference.

[0123] (3) Smart Glasses Configuration and Personnel Training: The smart glasses worn by personnel are the core interactive device of the entire system. It is built-in with a high-resolution camera, a high-performance RFID reader (usually handheld or integrated), a powerful processor, a high-brightness display screen (supporting augmented reality display), and multiple communication modules. Before personnel start work, the smart glasses will be pre-installed with a goods management application and synchronized with the central server to synchronize all initial placement pictures and RFID positioning information of goods, ensuring that partial operations can be performed even in poor network conditions. Personnel will receive brief training on how to wear smart glasses, start the application, understand the AR guide interface, and voice prompts.

[0124] 2. Personnel detect and classify misplaced goods through smart glasses:

[0125] (1) Start the homing operation: When warehouse administrators or store clerks find that goods are misplaced and need to be homed, they only need to wear smart glasses and start the pre-installed "goods homing" application through simple voice commands or gesture operations. The display screen of the smart glasses will immediately display the current task status and prompt the personnel to enter the area to be homed.

[0126] (2) Smart glasses assisted RFID scanning and data comparison: After personnel enter the designated area, the smart glasses will trigger the fixed RFID readers on the shelves to perform area scanning through its built-in RFID reader. The shelf reader will read the EPC code of all goods RFID tags within its coverage range and transmit these data to the personnel's smart glasses in real time. The application of the smart glasses will cross-compare the received current goods EPC code and its corresponding RFID positioning information with the locally stored initial RFID positioning information of the goods.

[0127] (3) Smart glasses identify and prompt the first misplaced goods: During the comparison process, if the smart glasses find that the EPC code of a certain good is read in the current scan data, but its current RFID positioning is inconsistent with the initial positioning recorded by the system, the smart glasses will immediately mark it as the "first misplaced goods". The display screen of the smart glasses will display the picture, current position and correct initial position of the goods in a prominent way (such as red frame, text prompt), and record its detailed information.

[0128] (4) Smart glasses recognize and prompt the second misplaced product: If the smart glasses find that the EPC code of a product exists in the initial product list but is not read in the current shelf RFID reader scan, the smart glasses will prompt the person with the picture and initial location of the "missing" product and list it in the to-be-searched list, ready to guide the person to actively search.

[0129] 3. Personnel return the first misplaced product to the correct location under the guidance of smart glasses:

[0130] (1) Smart glasses plan the optimal path: For the first misplaced product recognized by the smart glasses, the smart glasses will use its built-in positioning module (such as GPS, Wi-Fi fingerprint positioning, or visual SLAM) to obtain the current location of the person in real time. Combined with the current location of the first misplaced product and its correct initial location, the smart glasses will call the optimized path planning algorithm to calculate a shortest or optimal return path from the current location of the product to its initial location. This path will take into account the actual environmental factors such as the passage between shelves, obstacles, etc., to ensure efficient movement of the person.

[0131] (2) Smart glasses provide augmented reality (AR) guidance: The planned return path will be presented to the person's field of view through the display screen of the smart glasses in an intuitive augmented reality (AR) way. For example, the smart glasses can superimpose virtual arrows, highlight the current and target locations of the product, or display a virtual product model above the product, indicating that the person should move it to the correct location. The person only needs to follow the AR instructions provided by the smart glasses, without needing to look down at paper lists or handheld devices, to free up both hands and efficiently move the product to the correct location.

[0132] (3) Smart glasses provide real-time feedback and error correction: During the return process, the smart glasses will continuously monitor the location changes of the product. If the person deviates from the planned path, the smart glasses will immediately issue a visual (such as a red warning box) and auditory (such as a voice prompt "Please pay attention to direction") warning and automatically recalculate the path. When the product is successfully placed in the initial location by the person, the smart glasses will provide visual (such as green highlighting, "Return successful" text prompt) and auditory (such as a prompt sound) feedback to confirm the successful return and automatically remove the product from the to-be-returned list, while updating the system inventory information.

[0133] 4. Personnel search for and return the second misplaced product under the guidance of smart glasses:

[0134] (1) Smart glasses start the search mode: When there is a second misplaced product, the smart glasses will preferentially guide the person into the search mode. The display screen of the smart glasses will display the picture and initial location information of the second misplaced product to be searched and prompt the person to start searching. The person can start moving within the area according to the instructions of the smart glasses.

[0135] (2) Smart glasses assist image recognition and RFID signal tracking: During the personnel search process, the camera of the smart glasses will collect image streams in the personnel's field of view in real time. The image recognition module built-in the smart glasses will analyze the images in real time to identify possible products in the personnel's field of view. At the same time, the RFID reader built-in the smart glasses will continuously and actively emit signals and receive weak signals from the second misplaced product (if its RFID tag is still valid). The smart glasses will determine the relative distance and direction of the personnel and the second misplaced product according to the received RFID signal strength changes (the stronger the signal, the closer the distance), combined with the image recognition results.

[0136] (3) Smart glasses provide search direction hints: The smart glasses will guide the personnel to move towards the direction of the second misplaced product through dynamic indicators on the display screen (such as signal strength bars, arrows pointing to the target direction, distance display) or voice prompts (such as "a little to the left", "signal strength increases"). The personnel can gradually approach the target product according to these intuitive hints. When the image recognition module of the smart glasses successfully identifies the target product and the RFID signal strength reaches the preset threshold, the smart glasses will immediately issue a "found" prompt and highlight the product in the field of view.

[0137] (4) Smart glasses dynamic detection and path optimization: This is a key innovation. During the process of personnel searching for the second misplaced product or returning the first misplaced product, the smart glasses will continuously collect images in the personnel's field of view and perform image recognition. The purpose is to inadvertently discover other second misplaced products that are not located by RFID. Once the smart glasses detect a new second misplaced product, the system will immediately record its current location (through image recognition or close-range RFID reading by the smart glasses' own RFID reader) and add it to the to-do list, while issuing a prompt to the personnel.

[0138] (5) Smart glasses guide single second misplaced product processing: If there is only one second misplaced product, once its current location is successfully found and identified through image recognition or close-range RFID reading, the smart glasses will immediately plan a shortest return path according to its current location and initial location, and guide the personnel to complete the return in AR mode.

[0139] (6) Smart glasses guide multiple second mislocated items: If there are multiple second mislocated items, the smart glasses will not guide the first one immediately after finding it. Instead, it will record the current locations of all second mislocated items identified during the staff's search process. When all (or a preset number of) second mislocated items are identified and located, the smart glasses will plan an optimal sequential homing path based on the current and initial locations of these items and their relative positions, guiding the staff to efficiently complete the homing of all second mislocated items.

[0140] (7) Smart glasses comprehensive path planning: The most intelligent aspect of the invention is its comprehensive path planning capability. During the staff's homing of the first mislocated item, if the smart glasses dynamically detect a new second mislocated item, the system will not simply interrupt the current task. It will immediately re-plan a comprehensive path based on the staff's current location, the initial and current locations of the newly discovered second mislocated item, and the current and initial locations of all first mislocated items that have not yet been homed. This new path will consider the priorities, distances, and types of all items to be homed, achieving the most efficient and time-saving homing strategy overall, avoiding repeated routes or omissions, and maximizing staff efficiency.

[0141] 5. System architecture and data flow:

[0142] (1) Data acquisition layer: including shelf RFID readers and staff-worn smart glasses (with built-in RFID readers, cameras, and positioning modules). Responsible for real-time acquisition of product RFID information, image data, and staff location data.

[0143] (2) Data processing layer: located in the smart glasses locally or on a cloud server. Responsible for pre-processing collected data, RFID positioning comparison, image recognition (product identification, pose estimation), path planning algorithm calculation (A*, Dijkstra, genetic algorithm, etc.), and dynamic task scheduling and optimization.

[0144] (3) Data storage layer: central database, storing product basic information (EPC, initial location, picture), historical homing records, shelf layout, RFID reader network topology, etc.

[0145] (4) Staff interaction layer: smart glasses display screen and voice module. Through augmented reality (AR) interface, text prompts, graphical indications, and voice instructions, providing intuitive homing guidance and real-time feedback for staff.

[0146] (5) Communication module: responsible for data transmission between smart glasses and shelf RFID reader, central server, supports Wi-Fi, Bluetooth, 5G and other communication methods, ensures real-time and stability of data transmission.

[0147] 6. Security and reliability considerations:

[0148] (1) Data encryption: all data transmitted between devices and servers should be encrypted to prevent information leakage.

[0149] (2) Permission management: the system should have a strict user permission management mechanism to ensure that only authorized personnel can perform homing operations and data access.

[0150] (3) Fault tolerance: when RFID tags are damaged or readers fail, the system can automatically switch to image recognition-based search mode to ensure continuous operation.

[0151] (4) Tag anti-collision: advanced RFID anti-collision algorithm is used to ensure accurate reading of all tags in dense product areas.

[0152] (5) Image recognition robustness: image recognition models should be trained for different lighting, angles, and occlusions in complex environments to improve recognition accuracy and robustness.

[0153] 7. Future scalability:

[0154] (1) Multi-user collaboration: supports multiple people to perform homing operations simultaneously, the system can coordinate different personnel tasks to avoid conflicts and optimize overall efficiency.

[0155] (2) Robot integration: future integration with AGV (Automatic Guided Vehicle) or drone to achieve automatic homing or large-scale search of some products, further reducing personnel burden.

[0156] (3) Data analysis and optimization: through deep analysis of homing process data, continuously optimize path planning algorithm, recognition model and shelf layout to further improve system performance.

[0157] (4) Inventory counting function: during the homing process, inventory counting can be done to improve efficiency and accuracy, providing more comprehensive assistance to personnel.

[0158] Figure 4 A structural diagram of a homing device based on product misplacement is provided for one or more embodiments of the present specification. A first radio frequency identification reader is provided on the shelf. The device is applied to the smart glasses end, including a scanning unit 401, a comparison unit 402, a determination unit 403, and a homing unit 404.

[0159] The scanning unit 401, in response to the user wearing the smart glasses to reposition the mispositioned goods, performs area scanning through the first radio frequency identification reader, so as to read the radio frequency identification tag information of all goods within a specified range through the first radio frequency identification reader, the radio frequency identification tag information including the identification code of the corresponding goods and the current radio frequency identification positioning information of the corresponding goods, and transmit the radio frequency identification tag information of all goods to the smart glasses;

[0160] The comparison unit 402 compares the current radio frequency identification positioning information corresponding to each received identification code with the initial radio frequency identification positioning information corresponding to each identification code stored in advance.

[0161] The determination unit 403 determines that the mispositioned goods are goods misplacement if the current radio frequency identification positioning information of the specified goods is inconsistent with the initial radio frequency identification positioning information of the specified goods.

[0162] The repositioning unit 404 determines a repositioning path based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, so that the user moves the specified goods to the shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the repositioning path.

[0163] Figure 5 A structure schematic diagram of a repositioning device based on goods misplacement is provided for one or more embodiments of the present specification, a first radio frequency identification reader is arranged on a shelf, the device is applied to the smart glasses end, and includes:

[0164] At least one processor and a bus; and,

[0165] A memory in communication connection with the at least one processor; wherein,

[0166] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to:

[0167] In response to the user wearing the smart glasses to reposition the mispositioned goods, the first radio frequency identification reader performs area scanning, so as to read the radio frequency identification tag information of all goods within a specified range through the first radio frequency identification reader, the radio frequency identification tag information including the identification code of the corresponding goods and the current radio frequency identification positioning information of the corresponding goods, and transmit the radio frequency identification tag information of all goods to the smart glasses;

[0168] The comparison unit 402 compares the current radio frequency identification positioning information corresponding to each received identification code with the initial radio frequency identification positioning information corresponding to each identification code stored in advance.

[0169] If the current RFID positioning information of the specified goods is inconsistent with the initial RFID positioning information of the specified goods, it is determined that the misplacement type of the specified goods is goods placement misplacement.

[0170] Based on the current RFID positioning information of the specified goods and the initial RFID positioning information of the specified goods, a homing path is determined, so that the user moves the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0171] Each of the embodiments in the specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other. Each embodiment mainly describes the difference from other embodiments. Especially, the device, equipment, and nonvolatile computer storage medium embodiments are basically similar to the method embodiments, and thus the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0172] Each of the embodiments in the specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other. Each embodiment mainly describes the difference from other embodiments. Especially, the device, equipment, and nonvolatile computer storage medium embodiments are basically similar to the method embodiments, and thus the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0173] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0174] In the embodiments provided in the present application, it should be understood that the disclosed apparatus / network device and method can be implemented in other ways. For example, the apparatus / network device embodiments described above are only schematic. The division of the modules or units is only a logical function division, and there can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection between the units can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0175] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, i.e. may be located in one place, or may be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0176] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present alone, or two or more units can be integrated in one unit. The above-mentioned units can be realized in the form of hardware or in the form of software.

[0177] The integrated module / unit, if realized in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the above-mentioned embodiment methods can also be completed by a computer program instructing related hardware, and the computer program can be stored in a computer readable storage medium. The computer program can implement the steps of each method embodiment when executed by a processor. The computer program includes computer program code, which can be in the form of source code, object code, executable file or some intermediate form. The computer readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the contents included in the computer readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.

[0178] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. A method for repositioning misplaced goods, characterized in that, A first radio frequency identification (RFID) reader / writer is installed on the shelf, and the method is applied to smart glasses, including: In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods. The system then transmits the RFID tag information of all goods to the smart glasses. The current RFID positioning information corresponding to each received identification code is compared with the initial RFID positioning information corresponding to each pre-stored identification code. If the current RFID positioning information of a specified item is inconsistent with the initial RFID positioning information of the specified item, then the misalignment type of the specified item is determined to be misplacement of the item. Based on the current RFID location information and the initial RFID location information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID location information of the specified goods according to the return path. The smart glasses have a built-in second RFID reader / writer. The first RFID reader / writer is used to scan an area, allowing the reader / writer to read the RFID tag information of all goods within a specified range. This includes: The second RFID reader triggers the first RFID reader to perform an area scan, so as to read the RFID tag information of all goods within the specified range through the first RFID reader; The step of determining the homing path based on the current RFID location information and the initial RFID location information of the specified goods includes: Obtain the user's real-time location information; Obtain the current RFID location information and the environmental information of the initial RFID location information of the specified goods; Based on the real-time location information, the environmental information, the current RFID positioning information of the specified goods, and the initial RFID positioning information of the specified goods, a return path is determined.

2. The method according to claim 1, characterized in that, After determining the homing path based on the current RFID location information and the initial RFID location information of the specified goods, the method further includes: The return path indication information is generated using the extended reality technology of the smart glasses, and the corresponding indication information is displayed in real time on the display screen of the smart glasses.

3. The method according to claim 1, characterized in that, The method further includes: The return path is monitored in real time through the smart glasses; If the user deviates from the return path during movement, a deviation warning is issued to the user through the smart glasses, and a new return path is determined.

4. The method according to claim 1, characterized in that, The RFID tag information also includes images of each product; If the current RFID location information of the specified product is consistent with the initial RFID location information of the specified product, the smart glasses will compare the current product image corresponding to each identification code with the pre-stored initial product image corresponding to each identification code. If the current product image of a specific product is inconsistent with the initial product image of that specific product, then the misalignment type of that specific product is determined to be product placement misalignment.

5. The method according to claim 1, characterized in that, The misalignment type also includes missing goods; the method further includes: During the process of guiding the return path using the extended reality technology of the smart glasses, images of goods within a preset range are collected and the images of goods are identified to obtain multiple identification codes to be inspected. The multiple identification codes to be inspected are compared with a pre-written list of identification codes whose misalignment type is missing goods. If the misalignment type of the goods corresponding to the specified inspection identification code is determined to be goods missing, the radio frequency identification (RFID) positioning information corresponding to the goods with the specified inspection identification code is recorded so that the goods with the specified inspection identification code can be repositioned based on the RFID positioning information.

6. The method according to claim 1, characterized in that, If the designated goods consist of multiple misplaced goods, determining the relocation path based on the current RFID positioning information and the initial RFID positioning information of the designated goods includes: Obtain a list of all misplaced goods, the list including the identification code, current RFID positioning information and initial RFID positioning information for each misplaced goods; Based on the user's real-time location information and the current RFID positioning information of each misplaced item, the real-time distance from the user to the current location of each misplaced item is calculated, and the initial item processing order is generated according to the real-time distance. By combining the shelf layout information with the initial product processing sequence, a return path is generated for each misplaced product.

7. A device for repositioning misplaced goods, characterized in that, A first radio frequency identification (RFID) reader / writer is installed on the shelf. The device is used in smart glasses and includes: The scanning unit, in response to the user wearing smart glasses to reposition misplaced goods, performs area scanning through the first RFID reader / writer to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods, and transmits the RFID tag information of all goods to the smart glasses. The comparison unit compares the current RFID positioning information corresponding to each received identification code with the pre-stored initial RFID positioning information corresponding to each identification code. If the current RFID positioning information of a specified item is inconsistent with the initial RFID positioning information of the specified item, the determination unit determines that the misalignment type of the specified item is misplacement of the item. The homing unit determines a homing path based on the current RFID positioning information and the initial RFID positioning information of the specified goods, so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path. The smart glasses have a built-in second RFID reader / writer. The first RFID reader / writer is used to scan an area, allowing the reader / writer to read the RFID tag information of all goods within a specified range. This includes: The second RFID reader triggers the first RFID reader to perform an area scan, so as to read the RFID tag information of all goods within the specified range through the first RFID reader; The step of determining the homing path based on the current RFID location information and the initial RFID location information of the specified goods includes: Obtain the user's real-time location information; Obtain the current RFID location information and the environmental information of the initial RFID location information of the specified goods; Based on the real-time location information, the environmental information, the current RFID positioning information of the specified goods, and the initial RFID positioning information of the specified goods, a return path is determined.

8. A device for repositioning misplaced goods, characterized in that, A first radio frequency identification (RFID) reader / writer is installed on the shelf. The device is used in smart glasses and includes: At least one processor and bus; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to: In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods. The system then transmits the RFID tag information of all goods to the smart glasses. The current RFID positioning information corresponding to each received identification code is compared with the initial RFID positioning information corresponding to each pre-stored identification code. If the current RFID positioning information of a specified item is inconsistent with the initial RFID positioning information of the specified item, then the misalignment type of the specified item is determined to be misplacement of the item. Based on the current RFID location information and the initial RFID location information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID location information of the specified goods according to the return path. The smart glasses have a built-in second RFID reader / writer. The first RFID reader / writer is used to scan an area, allowing the reader / writer to read the RFID tag information of all goods within a specified range. This includes: The second RFID reader triggers the first RFID reader to perform an area scan, so as to read the RFID tag information of all goods within the specified range through the first RFID reader; The step of determining the homing path based on the current RFID location information and the initial RFID location information of the specified goods includes: Obtain the user's real-time location information; Obtain the current RFID location information and the environmental information of the initial RFID location information of the specified goods; Based on the real-time location information, the environmental information, the current RFID positioning information of the specified goods, and the initial RFID positioning information of the specified goods, a return path is determined.

Citation Information

Patent Citations

  • Device and method for positioning goods shelf where goods are located

    CN113988229A

  • Resolving misplaced items in physical retail stores

    US20240070608A1