A goods homing method, device and equipment based on goods loss

Abstract

The application discloses a kind of based on goods missing goods homing method, device and equipment, comprising: in response to user wearing smart glasses, mislocation goods is homed, is scanned by first radio frequency identification read-write device, and the radio frequency identification tag information of all goods in specified range is read by first radio frequency identification;Received all goods identification code is compared with the identification code list of pre-stored specified range whether consistent;If the identification code of specified goods is not in identification code list, then determine the mislocation type of specified goods as goods missing;The actual radio frequency identification position information of specified goods is determined in preset range;Based on the actual radio frequency identification position information of specified goods and the initial radio frequency identification position information of pre-stored specified goods, determine homing path, so that user moves specified goods to the initial radio frequency identification position information of specified goods corresponding shelf position according to homing path.

Description

A method, apparatus and equipment for relocating missing goods. Technical Field

[0001] This application relates to the field of warehouse management technology, and in particular to a method, apparatus and equipment for returning missing goods to their proper place. Background Technology

[0002] In the modern retail, warehousing, and logistics industries, precise product management is key to improving operational efficiency and optimizing customer experience. In large supermarkets, warehouses, and other similar locations, products often become misplaced, missing, or mis-located due to customer selection or employee oversight during restocking—a problem known as "product misplacement." "Missing products" is a common but particularly challenging type of misplacement, specifically referring to products not being placed in their designated shelf locations but potentially being left in shopping carts, other shelf areas, or some corner of the store.

[0003] Currently, the management of misplaced goods largely relies on staff conducting regular visual inspections and inventory checks of the shelves. This method is not only inefficient and time-consuming, but also prone to missed inspections due to fatigue and negligence, making it impossible to achieve real-time detection and handling of misplacements. Summary of the Invention

[0004] This specification provides one or more embodiments of a method, apparatus, and device for returning missing goods to their original location, in order to solve the technical problems raised in the background art.

[0005] One or more embodiments of this specification employ the following technical solutions:

[0006] This specification provides one or more embodiments of a method for returning missing goods to their place, wherein a first radio frequency identification (RFID) reader is installed on the shelf, and the method is applied to smart glasses, including:

[0007] In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the smart glasses.

[0008] Compare the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match;

[0009] If the identification code of the specified product is not in the identification code list, the misalignment type of the specified product is determined to be product missing.

[0010] Determine the actual radio frequency identification location information of the specified goods within a preset range;

[0011] Based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the return path.

[0012] It should be noted that this application, through the combination of smart glasses and radio frequency identification (RFID) technology, achieves real-time detection and precise guidance for the return of missing goods, effectively solving the inherent problems of low efficiency, high missed detection rate, and delayed processing in traditional manual visual inspection and inventory. Specifically, when the user operates the smart glasses, the first RFID reader scans the area, automatically collecting the tag information of all goods and comparing it in real time with the locally stored correct list. Once a missing item is identified, the system can dynamically determine the actual location of the item using extended reality technology and generate the optimal return path, providing intuitive visual guidance for the user to quickly and accurately place the item back in the correct position. This process not only significantly reduces the time and effort spent on manual inspection but also significantly improves the real-time performance and accuracy of goods management, thereby optimizing overall operational efficiency and customer experience, and avoiding sales losses or inventory chaos caused by misplaced goods.

[0013] Furthermore, the smart glasses have a built-in second RFID reader / writer. The first RFID reader / writer is used to scan an area to read the RFID tag information of all goods within a specified range, including:

[0014] The second RFID reader triggers the first RFID reader to perform an area scan, so as to read the RFID tag information of all goods within the specified range through the first RFID reader.

[0015] Furthermore, the RFID tag information also includes images of each product;

[0016] Determining the actual RFID location information of the designated goods within a preset range includes:

[0017] Issue a search instruction so that the user can move based on the search instruction, the search instruction including the direction of movement;

[0018] The smart glasses' camera captures a stream of images within a preset range in real time and performs real-time recognition on the image stream.

[0019] If the image of the specified goods is identified, the actual radio frequency identification (RFID) location information of the specified goods is determined.

[0020] It should be noted that this application, based on the introduction of product image information and the visual recognition capabilities of smart glasses in the aforementioned method, enables the system to achieve accurate visual search and location of missing products, thereby greatly improving the efficiency and accuracy of searching in complex environments. Specifically, when the system determines that a product is missing through radio frequency identification (RFID) technology, the smart glasses will issue dynamic movement direction instructions to the user, guiding the user to move purposefully within a preset range. Simultaneously, the glasses' camera continuously collects environmental image streams and matches them with images of the missing product using real-time image recognition technology. Once recognition is successful, the actual location of the product can be immediately locked. This process combines the wide-range monitoring capabilities of RFID technology with the precise recognition capabilities of computer vision, eliminating the need for blind searching and avoiding the location ambiguity that may result from relying solely on RFID signal strength for positioning. This significantly shortens search time, reduces operational difficulty, and ensures that products can be quickly and reliably returned to their original locations, further enhancing the intelligence and user-friendliness of the overall product management process.

[0021] Furthermore, issuing a search instruction so that the user can move based on the search instruction includes:

[0022] The second radio frequency identification reader continuously and actively transmits signals to the designated goods and receives feedback signals from the designated goods.

[0023] The orientation information of the designated goods is determined based on the feedback signal;

[0024] Based on the directional information, a search instruction is issued so that the user can move according to the search instruction.

[0025] It should be noted that this application, based on the method described above, uses smart glasses to actively transmit and receive radio frequency signals to determine the direction of missing goods. This system provides real-time, dynamic guidance for the user's search process, significantly improving the intuitiveness and operational efficiency of goods location. Specifically, when a missing item is determined, the reader built into the smart glasses continuously transmits signals to the target item and receives its feedback. By analyzing signal characteristics (such as signal strength or phase difference), it calculates the precise direction of the item relative to the user in real time. Subsequently, the glasses immediately convert this directional information into intuitive visual or auditory instructions (such as arrows or pointing light spots), guiding the user to move in the correct direction. This process seamlessly combines the non-contact direction-finding capability of radio frequency technology with the interactive capability of smart glasses, allowing users to quickly approach the target without relying on their own sense of direction or blindly searching. This effectively avoids the difficulties in finding items in complex environments due to obstructed vision or hidden items, significantly shortening search time, reducing operational burden, and further ensuring the smoothness and reliability of the entire relocation process.

[0026] Furthermore, the RFID tag information also includes images of each product;

[0027] Determining the actual RFID location information of the designated goods within a preset range includes:

[0028] The second radio frequency identification reader continuously and actively transmits signals to the designated goods and receives feedback signals from the designated goods.

[0029] The orientation information of the designated goods is determined based on the feedback signal;

[0030] Based on the directional information, a search instruction is issued so that the user can move according to the search instruction, and the strength value of the feedback signal is detected in real time;

[0031] If the intensity value of the feedback signal reaches a preset threshold, an image stream within a preset range is acquired, and the image stream is identified in real time.

[0032] If the image of the specified goods is identified, the actual radio frequency identification (RFID) location information of the specified goods is determined.

[0033] It should be noted that, based on the collaborative mechanism of triggering image recognition through a radio frequency signal strength threshold in the method described above, this application enables intelligent switching between coarse and fine positioning during the search for missing goods, thereby significantly improving the efficiency and accuracy of the search operation. Specifically, when the user moves according to the directional instructions provided by the smart glasses, the system continuously monitors the strength of the radio frequency feedback signal. Only when the signal strength reaches a preset threshold (indicating that the user has approached the target goods) is the camera automatically activated for image acquisition and real-time recognition. This design allows the system to avoid relying on high-energy-consuming image processing throughout the process, instead initiating visual matching within a key distance to ultimately confirm the identity and lock the location using the goods image. This phased positioning strategy effectively integrates the wide-range directional advantages of radio frequency technology and the precise recognition capabilities of visual technology. It avoids the instability and resource consumption of image recognition at long distances and prevents proximity misjudgments that may result from relying solely on radio frequency signals. This allows the user to quickly approach the target under efficient guidance, and ensures absolute accuracy of the operation through visual verification in the final stage, thereby significantly reducing the complexity and uncertainty of the search process and improving the intelligence and reliability of the overall relocation process.

[0034] Furthermore, the method also includes:

[0035] During the process of guiding the return path using the extended reality technology of the smart glasses, images of goods within a preset range are collected and the images of goods are identified to obtain multiple identification codes to be inspected.

[0036] The multiple identification codes to be inspected are compared with a pre-written list of identification codes whose misalignment type is missing goods.

[0037] If the misalignment type of the goods corresponding to the specified inspection identification code is determined to be goods missing, the radio frequency identification (RFID) positioning information corresponding to the goods with the specified inspection identification code is recorded so that the goods with the specified inspection identification code can be repositioned based on the RFID positioning information.

[0038] It should be noted that this application, based on the method described above, simultaneously performs product image recognition and misalignment detection during path guidance. This system achieves intelligent integration of repositioning operations and dynamic inspection, significantly improving the comprehensiveness and efficiency of product management. Specifically, as the user moves along the extended reality-guided path, the smart glasses continuously collect images of surrounding products and identify multiple identification codes in real time. By comparing these codes with a pre-stored list of missing products, the system can automatically detect and record the current location information of other potentially missing products. This process transforms a single repositioning task into a continuous dynamic inspection, allowing the user to simultaneously detect and record other misaligned products without additional time or resources while completing the main objective. This not only avoids the need for subsequent repeated inspections but also significantly enhances the system's overall responsiveness to complex misalignment situations. Therefore, while optimizing the efficiency of a single operation, it further improves the coherence and intelligence of the product management process.

[0039] Furthermore, determining the homing path based on the actual RFID positioning information of the designated goods and the pre-stored initial RFID positioning information of the designated goods includes:

[0040] Determine whether there are multiple items with the misalignment type of missing goods;

[0041] If not, after determining the actual RFID location information of the specified goods, a homing path is determined based on the actual RFID location information of the specified goods and the pre-stored initial RFID location information of the specified goods.

[0042] It should be noted that, based on the method described above, this application determines whether the missing item is a single item, and directly generates a dedicated return path for it upon confirmation. This system achieves rapid response and accurate handling of single misplacement cases, thereby significantly improving operational efficiency and resource utilization in simple scenarios. Specifically, when the system detects that only one item is missing, it does not need to initiate a complex multi-objective path planning algorithm. Instead, it directly calculates the optimal path based on the item's actual and original location information, and provides clear and direct guidance to the user through extended reality technology. This simplified processing mode for a single task avoids computational redundancy and operational delays that may result from multi-objective scheduling, enabling the user to quickly locate the target and complete the return, reducing unnecessary intermediate steps and decision interference. This further optimizes the task execution speed and the overall process smoothness while ensuring accuracy.

[0043] Furthermore, if the misalignment type involves multiple items that are missing, the method further includes:

[0044] The misalignment type is determined to be the remaining goods where the goods are missing;

[0045] Determine the actual radio frequency identification (RFID) location information corresponding to the remaining goods;

[0046] Based on the actual RFID positioning information of the specified goods, the pre-stored initial RFID positioning information of the specified goods, the actual RFID positioning information of the remaining goods, and the pre-stored initial RFID positioning information of the remaining goods, a homing path is determined.

[0047] It should be noted that, based on the method described in this application, when multiple missing items are detected, the system can simultaneously acquire the actual and initial location information of all missing items and perform unified path planning. This method achieves efficient collaborative processing of complex misalignment scenarios, thereby significantly improving the overall efficiency and resource utilization of multi-task repositioning. Specifically, when the system identifies multiple missing items, it does not process individual targets in isolation, but actively collects the real-time location and original shelf location of all relevant items, and calculates an optimal path that can connect multiple repositioning tasks based on this comprehensive information. This global path planning eliminates the need for users to repeatedly travel between different items or handle each task individually. Instead, it allows users to complete the repositioning of all items sequentially through a coherent and reasonable movement route, greatly reducing unnecessary walking distance and operation time. It also reduces human error or omissions that may be caused by multiple target switching, thereby further optimizing the allocation of human resources and time costs while ensuring accuracy, and enhancing the system's ability to cope with batch misalignment problems and the overall level of intelligent operation.

[0048] This specification provides one or more embodiments of a goods return device based on missing goods, wherein a first radio frequency identification reader is installed on the shelf, and the device is applied to smart glasses, comprising:

[0049] The scanning unit, in response to the user wearing smart glasses to reposition misplaced goods, performs area scanning through the first RFID reader / writer to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the smart glasses.

[0050] The comparison unit compares the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match.

[0051] If the identification code of the specified product is not in the identification code list, the determination unit determines that the misalignment type of the specified product is product missing.

[0052] The determining unit determines the actual radio frequency identification location information of the designated goods within a preset range;

[0053] The homing unit determines a homing path based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0054] This specification provides one or more embodiments of a goods return device based on missing goods, wherein a first radio frequency identification reader is installed on the shelf, and the device is applied to smart glasses, comprising:

[0055] At least one processor and bus; and,

[0056] A memory communicatively connected to the at least one processor; wherein,

[0057] The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to:

[0058] In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the smart glasses.

[0059] Compare the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match;

[0060] If the identification code of the specified product is not in the identification code list, the misalignment type of the specified product is determined to be product missing.

[0061] Determine the actual radio frequency identification location information of the specified goods within a preset range;

[0062] Based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the return path.

[0063] The above-described at least one technical solution used in the embodiments of this specification can achieve the following beneficial effects:

[0064] This application combines smart glasses with radio frequency identification (RFID) technology to achieve real-time detection and precise repositioning of missing goods, effectively solving the inherent problems of low efficiency, high missed detection rate, and delayed processing in traditional manual visual inspection and inventory. Specifically, when a user operates the smart glasses, a first RFID reader scans the area, automatically collecting the tag information of all goods and comparing it instantly with a locally stored correct list. Once a missing item is identified, the system dynamically determines its actual location using extended reality technology and generates the optimal repositioning path, providing intuitive visual guidance for the user to quickly and accurately place the item back in its correct position. This process not only significantly reduces the time and effort required for manual inspection but also significantly improves the real-time nature and accuracy of goods management, thereby optimizing overall operational efficiency and customer experience, and preventing sales losses or inventory chaos caused by misplaced goods. Attached Figure Description

[0065] To more clearly illustrate the technical solutions in the embodiments or prior art of this specification, the drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. In the drawings:

[0066] Figure 1 is an application environment diagram of a goods placement method based on missing goods provided by one or more embodiments of this specification;

[0067] Figure 2 is a flowchart illustrating a method for returning missing goods to its proper place, provided by one or more embodiments of this specification.

[0068] Figure 3 is a flowchart illustrating the method for determining the actual radio frequency identification location information of goods provided in one or more embodiments of this specification;

[0069] Figure 4 is a schematic diagram of a goods return device based on missing goods provided in one or more embodiments of this specification;

[0070] Figure 5 is a structural schematic diagram of a goods return device based on missing goods provided in one or more embodiments of this specification. Detailed Implementation

[0071] This specification provides a method, apparatus, and equipment for returning missing goods to their proper place.

[0072] To enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this specification, and not all embodiments. Based on the embodiments of this specification, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this specification.

[0073] The solution proposed in this application can be applied to the goods placement scenario of a goods placement terminal. Figure 1 shows an application environment diagram of a goods placement method based on missing goods provided in an embodiment of this specification. As shown in Figure 1, the terminal 102 communicates with the server 103 via a network. The data storage system 101 can store the data that the server 103 needs to process. The data storage system 101 can be integrated on the server 103 or placed on the cloud or other network servers. The terminal 102 can obtain the user's historical behavior data in different operating scenarios and the operating status of the XR glasses; extract the user's common behavior information from the user's historical behavior data in each operating scenario; extract the common status information of the XR glasses from the operating status of the XR glasses in each operating scenario; combine the common behavior information and the common status information to generate the glasses habit status of the XR glasses in the operating scenario; associate the operating scenario with the glasses habit status to obtain behavior habit tags. Alternatively, the process of constructing the tags described above can be executed on server 103. That is, the server obtains the user's historical behavior data in different operating scenarios and the operating status of the XR glasses; extracts common behavioral information from the user's historical behavior data in each operating scenario; extracts common status information of the XR glasses from the operating status of the XR glasses in each operating scenario; combines the common behavioral information and the common status information to generate the glasses habit status of the XR glasses in the operating scenario; and associates the operating scenario with the glasses habit status to obtain behavioral habit tags.

[0074] Specifically, the goods return terminal can include smartphones, smart home appliances, tablets, virtual reality headsets (VR headsets), augmented reality glasses (AR glasses), electronic displays, and mixed reality (MR) devices, etc. MR devices can include MR glasses, MR helmets, MR cameras, etc. In-vehicle systems can include in-vehicle chips, in-vehicle devices (such as in-vehicle infotainment systems, in-vehicle computers, sensors with voice recognition capabilities, etc.).

[0075] Figure 2 is a flowchart illustrating a method for returning missing goods based on one or more embodiments of this specification. A first RFID reader is installed on the shelf, and the process is executed by smart glasses. Certain input parameters or intermediate results in the process can be manually adjusted to help improve accuracy.

[0076] The method flow steps of the embodiments in this specification are as follows:

[0077] S201, in response to the user wearing smart glasses to reposition misplaced goods, the first RFID reader scans the area to read the RFID tag information of all goods within a specified range, the RFID tag information including the identification code of the corresponding goods, and transmits the RFID tag information of all goods to the smart glasses.

[0078] In the embodiments described in this specification, the user wears smart glasses to begin performing the task of returning goods to their designated locations. The smart glasses have a built-in second RFID reader / writer. When activated, the second RFID reader / writer sends a trigger command to a first RFID reader / writer on the target shelf area. This command wakes up the first RFID reader / writer, causing it to perform a radio frequency scan of the designated shelf area covered by its antenna. The first RFID reader / writer reads the RFID tags attached to all goods in the area, obtaining tag information including the unique identifier for each item, and then sends all the read tag information data packets back to the smart glasses.

[0079] S202, compare the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match.

[0080] In the embodiments described in this specification, after receiving all the product identification codes from the first RFID reader, the smart glasses access its locally stored database. This database contains a list of product identification codes that should theoretically exist for each shelf area. The system compares the newly received real-time identification code list with the locally stored standard identification code list for that area one by one to verify whether the two are completely consistent.

[0081] S203, if the identification code of the specified product is not in the identification code list, then the misalignment type of the specified product is determined to be product missing.

[0082] In the embodiments described in this specification, after the comparison is completed, the system performs analysis. If it finds that a certain identification code existing in the locally stored standard list does not appear in the real-time identification code list just scanned, the system determines that the product has been misplaced. Since the product is not in its proper shelf area, its misplacement type is determined to be "product missing".

[0083] S204, determine the actual RFID location information of the specified goods within a preset range.

[0084] In the embodiments described in this specification, after determining that an item is missing, the system initiates a search procedure. The smart glasses utilize their integrated second RFID reader to continuously search for the RFID tag signal of the missing item within a certain signal reception range (preset range). By analyzing the characteristics of the received RFID signal, the smart glasses calculate and determine the actual location coordinates of the missing item in physical space.

[0085] S205, based on the actual RFID positioning information of the designated goods and the pre-stored initial RFID positioning information of the designated goods, a return path is determined so that the user can move the designated goods to the shelf position corresponding to the initial RFID positioning information of the designated goods according to the return path.

[0086] In the embodiments described in this specification, the system calls the local database to obtain the coordinates of the correct shelf location (initial RFID positioning information) where the missing item originally belonged. Subsequently, the system's path planning module calculates an optimal physical movement path based on the real-time location of the missing item and its target location. This planned path is then displayed overlaid in the user's real-world field of vision using the extended reality technology of smart glasses, appearing as virtual arrows, highlighted paths, or similar navigation indicators. Following the visual guidance in their field of vision, the user moves along this path with the missing item, ultimately placing it back in its correct shelf location, thus completing the return to its original place.

[0087] It should be noted that this application, through the combination of smart glasses and radio frequency identification (RFID) technology, achieves real-time detection and precise guidance for the return of missing goods, effectively solving the inherent problems of low efficiency, high missed detection rate, and delayed processing in traditional manual visual inspection and inventory. Specifically, when the user operates the smart glasses, the first RFID reader scans the area, automatically collecting the tag information of all goods and comparing it in real time with the locally stored correct list. Once a missing item is identified, the system can dynamically determine the actual location of the item using extended reality technology and generate the optimal return path, providing intuitive visual guidance for the user to quickly and accurately place the item back in the correct position. This process not only significantly reduces the time and effort spent on manual inspection but also significantly improves the real-time performance and accuracy of goods management, thereby optimizing overall operational efficiency and customer experience, and avoiding sales losses or inventory chaos caused by misplaced goods.

[0088] Furthermore, the RFID tag information also includes images of each product. When determining the actual RFID location information of the specified product within a preset range, refer to Figure 3 for a flowchart illustrating the method for determining the actual RFID location information of the product. This process can be executed by the smart glasses. Certain input parameters or intermediate results in the process can be manually adjusted to help improve accuracy.

[0089] The method flow steps of the embodiments in this specification are as follows:

[0090] S301, issue a search instruction so that the user can move based on the search instruction, the search instruction including the direction of movement.

[0091] The S302 uses the camera of smart glasses to capture image streams within a preset range in real time and performs real-time recognition of the image streams.

[0092] S303, if a product image of the designated product is identified, determine the actual radio frequency identification (RFID) location information of the designated product.

[0093] It should be noted that, regarding the above process, when determining the actual RFID location information of a specified item using smart glasses, the system initiates a collaborative search process. First, the smart glasses issue a search instruction to the user. This instruction, based on the analysis of the RFID signal, is presented as a clear directional movement indicator (e.g., displaying an arrow or light spot in the extended reality interface), guiding the user to move towards an area with stronger signal. During this process, the smart glasses' camera is activated, continuously capturing an image stream within the user's current field of view. The system performs real-time analysis on the captured image stream, using image recognition algorithms to compare the images of objects in the scene with the target item. When the image recognition algorithm successfully identifies visual features in the image stream that match the image of the target item, the system determines that the target has been found and then, combined with the RFID signal data at that moment, calculates the precise actual RFID location information (such as coordinates) of the item, completing the location.

[0094] It should be noted that this application, based on the introduction of product image information and the visual recognition capabilities of smart glasses in the aforementioned method, enables the system to achieve accurate visual search and location of missing products, thereby greatly improving the efficiency and accuracy of searching in complex environments. Specifically, when the system determines that a product is missing through radio frequency identification (RFID) technology, the smart glasses will issue dynamic movement direction instructions to the user, guiding the user to move purposefully within a preset range. Simultaneously, the glasses' camera continuously collects environmental image streams and matches them with images of the missing product using real-time image recognition technology. Once recognition is successful, the actual location of the product can be immediately locked. This process combines the wide-range monitoring capabilities of RFID technology with the precise recognition capabilities of computer vision, eliminating the need for blind searching and avoiding the location ambiguity that may result from relying solely on RFID signal strength for positioning. This significantly shortens search time, reduces operational difficulty, and ensures that products can be quickly and reliably returned to their original locations, further enhancing the intelligence and user-friendliness of the overall product management process.

[0095] Furthermore, when the user moves based on the search instruction, the second RFID reader can continuously and actively transmit signals to the designated goods and receive feedback signals from the designated goods; determine the direction information of the designated goods based on the feedback signals; and issue a search instruction based on the direction information so that the user can move based on the search instruction.

[0096] It's important to note that when the system needs to issue a search instruction to the user via the smart glasses, it initiates an active radio frequency (RF) detection process. The RF reader built into the smart glasses continuously transmits RF signals to the RF tag of the target item (i.e., the designated item that has been determined to be missing). Once activated, the tag returns a feedback signal. The smart glasses' RF reader continuously receives and analyzes this feedback signal. Based on the characteristics of the received feedback signal, the system calculates the direction information of the target item relative to the user's current location in real time. The smart glasses then use this direction information to issue a clear search instruction to the user through its display interface (such as an extended reality overlaid arrow) or audio prompts, guiding the user to move in the calculated direction to approach the target item.

[0097] It should be noted that this application, based on the method described above, uses smart glasses to actively transmit and receive radio frequency signals to determine the direction of missing goods. This system provides real-time, dynamic guidance for the user's search process, significantly improving the intuitiveness and operational efficiency of goods location. Specifically, when a missing item is determined, the reader built into the smart glasses continuously transmits signals to the target item and receives its feedback. By analyzing signal characteristics (such as signal strength or phase difference), it calculates the precise direction of the item relative to the user in real time. Subsequently, the glasses immediately convert this directional information into intuitive visual or auditory instructions (such as arrows or pointing light spots), guiding the user to move in the correct direction. This process seamlessly combines the non-contact direction-finding capability of radio frequency technology with the interactive capability of smart glasses, allowing users to quickly approach the target without relying on their own sense of direction or blindly searching. This effectively avoids the difficulties in finding items in complex environments due to obstructed vision or hidden items, significantly shortening search time, reducing operational burden, and further ensuring the smoothness and reliability of the entire relocation process.

[0098] Furthermore, the RFID tag information also includes images of each product; when determining the actual RFID location information of the designated product within a preset range, the second RFID reader can continuously and actively transmit signals to the designated product and receive feedback signals from the designated product; the direction information of the designated product is determined based on the feedback signals; a search instruction is issued based on the direction information so that the user can move according to the search instruction, and the strength value of the feedback signal is detected in real time; if the strength value of the feedback signal reaches a preset threshold, an image stream within a preset range is collected, and the image stream is identified in real time; if the product image of the designated product is identified, the actual RFID location information of the designated product is determined.

[0099] It should be noted that when determining the actual RFID location of a designated item using smart glasses, the system can initiate a phased collaborative positioning process. First, the RFID reader built into the smart glasses continuously transmits signals to the RFID tag of the target item and receives feedback signals from the tag. Based on the received feedback signals, the system calculates the direction of the target item relative to the user's current location in real time. The smart glasses then use this direction information to issue search instructions (such as a directional visual arrow) to the user through its display interface, guiding the user to move in that direction to gradually approach the target item. During this movement, the system simultaneously monitors and analyzes the strength of the received feedback signals in real time. When the system detects that the strength of the feedback signal has increased and reached a preset threshold (indicating that the user is close enough to the target item), it automatically triggers the next step.

[0100] Once triggered, the smart glasses immediately activate their cameras, capturing an image stream within the user's current preset field of view. The system instantly analyzes the captured real-time image stream, using image recognition algorithms to compare the objects in the image with the target product's image. If the image recognition algorithm successfully identifies a visual object in the image stream that matches the target product's image, the system finally confirms that the target has been found. It then combines this with the current radio frequency signal data to calculate the precise actual RFID location information of the product, completing the entire positioning process.

[0101] It should be noted that, based on the collaborative mechanism of triggering image recognition through a radio frequency signal strength threshold in the method described above, this application enables intelligent switching between coarse and fine positioning during the search for missing goods, thereby significantly improving the efficiency and accuracy of the search operation. Specifically, when the user moves according to the directional instructions provided by the smart glasses, the system continuously monitors the strength of the radio frequency feedback signal. Only when the signal strength reaches a preset threshold (indicating that the user has approached the target goods) is the camera automatically activated for image acquisition and real-time recognition. This design allows the system to avoid relying on high-energy-consuming image processing throughout the process, instead initiating visual matching within a key distance to ultimately confirm the identity and lock the location using the goods image. This phased positioning strategy effectively integrates the wide-range directional advantages of radio frequency technology and the precise recognition capabilities of visual technology. It avoids the instability and resource consumption of image recognition at long distances and prevents proximity misjudgments that may result from relying solely on radio frequency signals. This allows the user to quickly approach the target under efficient guidance, and ensures absolute accuracy of the operation through visual verification in the final stage, thereby significantly reducing the complexity and uncertainty of the search process and improving the intelligence and reliability of the overall relocation process.

[0102] Furthermore, in the process of guiding the relocation path using the extended reality technology of the smart glasses, the embodiments of this specification can collect product images within a preset range and identify the product images to obtain multiple identification codes to be inspected; compare the multiple identification codes to be inspected with a pre-written list of identification codes whose misalignment type is missing products; if it is determined that the misalignment type of the product corresponding to the specified identification code to be inspected is missing products, record the radio frequency identification (RFID) positioning information corresponding to the product of the specified identification code to be inspected, so as to relocate the product of the specified identification code to be inspected based on the RFID positioning information.

[0103] It should be noted that, in the embodiments of this specification, during the process of guiding the user back to their location using the extended reality technology of smart glasses, the system simultaneously initiates an auxiliary inspection process. The smart glasses utilize their cameras to continuously collect images of goods within the user's current field of vision (a preset range). The system performs real-time analysis on these collected images, using image recognition technology to identify the identification codes corresponding to one or more goods in the images, thus obtaining multiple identification codes to be inspected.

[0104] The system then compares these identified identification codes with a specific list pre-written and stored locally. This list contains the identification codes of all items that have been determined to be of the "missing item" misalignment type.

[0105] During the comparison process, if the system finds a specific identification code to be inspected in the aforementioned "Missing Goods" identification code list, it indicates that the goods are a recorded missing goods. The system will immediately record the current location information (i.e., its actual RFID positioning information) of the goods corresponding to this specified identification code to be inspected, obtained through RFID technology.

[0106] The recorded location information will be saved so that the system can use this information to plan a route for the goods and guide the user or others to return them to their original location, just like handling the main return task.

[0107] It should be noted that the embodiments in this specification are based on the method of simultaneously performing product image recognition and misalignment detection during path guidance. This system achieves intelligent integration of repositioning operations and dynamic inspections, thereby significantly improving the comprehensiveness and efficiency of product management. Specifically, when the user moves along the guided path using extended reality technology, the smart glasses continuously collect images of surrounding products and identify multiple identification codes to be inspected in real time. By comparing these codes with a pre-stored list of missing products, the system can automatically discover and record the current location information of other potentially missing products. This process transforms a single repositioning task into a continuous dynamic inspection, allowing the user to simultaneously detect and record other misaligned products without investing additional time or resources while completing the main objective. This not only avoids the necessity of subsequent repeated inspections but also significantly enhances the system's overall responsiveness to complex misalignment situations. Thus, while optimizing the efficiency of a single operation, it further improves the coherence and intelligence level of the product management process.

[0108] Furthermore, when determining the relocation path based on the actual RFID location information of the specified goods and the pre-stored initial RFID location information of the specified goods, it can be determined whether there are multiple goods with the misalignment type of missing goods; if not, after determining the actual RFID location information of the specified goods, the relocation path is determined based on the actual RFID location information of the specified goods and the pre-stored initial RFID location information of the specified goods.

[0109] It should be noted that, in the embodiments of this specification, when determining the homing path based on the actual RFID positioning information of the specified goods and the initial RFID positioning information stored locally, the system first performs a judgment step: analyzing whether there are multiple goods that are currently judged as misaligned as "goods missing".

[0110] If not, meaning the system determines that only one item is currently confirmed as missing, the system will directly enter the path planning stage after successfully determining the actual RFID location information of the specified item. At this time, the path planning module will calculate and generate an optimal path from the item's current location back to its target location based solely on two key pieces of information for the specified item: its newly acquired actual RFID location information and its initial RFID location information retrieved from the local database.

[0111] If so, meaning the system determines that multiple items are missing, it can initiate a different processing logic. First, it will sequentially determine the actual RFID location information of all items identified as missing. Then, the path planning module will integrate the actual location information of all missing items with their respective initial RFID positioning information to perform global path optimization calculations, ultimately generating a comprehensive optimal path that efficiently completes the task of returning all items to their original locations.

[0112] It should be noted that, based on the method described above, this application determines whether the missing item is a single item, and directly generates a dedicated return path for it upon confirmation. This system achieves rapid response and accurate handling of single misplacement cases, thereby significantly improving operational efficiency and resource utilization in simple scenarios. Specifically, when the system detects that only one item is missing, it does not need to initiate a complex multi-objective path planning algorithm. Instead, it directly calculates the optimal path based on the item's actual and original location information, and provides clear and direct guidance to the user through extended reality technology. This simplified processing mode for a single task avoids computational redundancy and operational delays that may result from multi-objective scheduling, enabling the user to quickly locate the target and complete the return, reducing unnecessary intermediate steps and decision interference. This further optimizes the task execution speed and the overall process smoothness while ensuring accuracy.

[0113] Furthermore, if there are multiple instances of the misalignment type where goods are missing, the remaining goods with the misalignment type of missing goods are identified; the actual RFID positioning information corresponding to each of the remaining goods is determined; and based on the actual RFID positioning information of the specified goods, the pre-stored initial RFID positioning information of the specified goods, the actual RFID positioning information corresponding to each of the remaining goods, and the pre-stored initial RFID positioning information corresponding to each of the remaining goods, a relocation path is determined.

[0114] It should be noted that, in the embodiments of this specification, when the system determines that there are multiple misalignment types of goods that are missing, the operation of determining the return path can be implemented according to the following steps:

[0115] First, the system needs to acquire the actual RFID location information of the primary target item. Then, the system will sequentially initiate the search and location process for all other items identified as missing, determining the actual RFID location information for each of the remaining items.

[0116] After obtaining the actual location of all missing items (including the specified item and all other items), the system will retrieve the initial RFID location information corresponding to each item from the local storage database.

[0117] The path planning module integrates all this information—the actual RFID location information of all missing items and their respective initial RFID location information—for global calculation. The module analyzes the spatial relationship between the current location and the target location of all items, ultimately planning and generating an optimal movement path that efficiently connects multiple relocation tasks and guides the user to return all missing items to their original positions sequentially.

[0118] It should be noted that, based on the method described in this application, when multiple missing items are detected, the system can simultaneously acquire the actual and initial location information of all missing items and perform unified path planning. This method achieves efficient collaborative processing of complex misalignment scenarios, thereby significantly improving the overall efficiency and resource utilization of multi-task repositioning. Specifically, when the system identifies multiple missing items, it does not process individual targets in isolation, but actively collects the real-time location and original shelf location of all relevant items, and calculates an optimal path that can connect multiple repositioning tasks based on this comprehensive information. This global path planning eliminates the need for users to repeatedly travel between different items or handle each task individually. Instead, it allows users to complete the repositioning of all items sequentially through a coherent and reasonable movement route, greatly reducing unnecessary walking distance and operation time. It also reduces human error or omissions that may be caused by multiple target switching, thereby further optimizing the allocation of human resources and time costs while ensuring accuracy, and enhancing the system's ability to cope with batch misalignment problems and the overall level of intelligent operation.

[0119] Definitions of key terms:

[0120] RFID (Radio Frequency Identification): A non-contact automatic identification technology that uses radio frequency signals to automatically identify target objects and obtain relevant data.

[0121] Smart glasses: A type of wearable device that typically features a display, camera, sensors, and communication capabilities to provide users with an extended reality (XR) experience.

[0122] The first misplaced item refers to an item that can be located using an RFID reader, but whose current position is inconsistent with its initial correct placement position.

[0123] The second type of misplaced goods refers to goods that cannot be located by the RFID reader on the shelf (e.g., due to being outside the reading range, the RFID tag being invalid or falling off, etc.) and require the user to actively search for them.

[0124] In modern warehousing and retail industries, accurate placement and rapid return of goods are crucial for improving operational efficiency and reducing management costs. However, misplacement of goods is common due to human error and customers' careless placement. Traditional methods of goods return rely mainly on manual searching and memorization, which is inefficient and prone to errors, especially when dealing with a wide variety and large quantity of goods. The workload for searching and returning goods is enormous, severely impacting work efficiency and user experience. While some automated or semi-automated warehouse management systems exist, a comprehensive and intelligent solution is still lacking for the accurate location and efficient return of misplaced goods, particularly for "missing" goods that cannot be directly located by RFID.

[0125] This invention provides an intelligent goods return system and method. Its core lies in using smart glasses worn by personnel, combined with RFID and image recognition technologies, to achieve precise positioning of goods, intelligent path planning, and effective retrieval of "missing" goods. This significantly improves goods return efficiency and reduces labor costs. Technical solution summary:

[0126] 1. Personnel wear smart glasses and activate the goods return application;

[0127] 2. The smart glasses obtain the current location information of the goods through the RFID reader on the shelf and compare it with the pre-stored initial location information to distinguish the first misplaced goods and the second misplaced goods.

[0128] (1) Smart Glasses Hardware Configuration and Data Preloading: The smart glasses worn by personnel have built-in RFID readers and pre-store initial placement images and RFID positioning information of the goods. RFID readers are also installed on the shelves to form a collaborative positioning network.

[0129] (2) Smart glasses assist personnel in identifying misplaced goods: When personnel need to return goods to their proper place, the smart glasses will actively scan the goods using the RFID reader on the shelf, and based on the scanning results, intelligently identify two types of misplaced goods, and provide prompts to personnel through the smart glasses' display screen:

[0130] (3) First misplaced goods: refers to goods that can be located by smart glasses, but whose current position is inconsistent with the initial correct placement position.

[0131] (4) Second misplaced goods: refers to goods that cannot be located by the RFID reader on the shelf (e.g., due to reasons such as exceeding the reading distance, RFID tag failure or falling off), and require personnel to actively search for them.

[0132] 3. Smart glasses plan and guide personnel through the return path of the first misplaced item using AR technology;

[0133] (1) Guiding the first misplaced item back to its correct position: The smart glasses will intelligently plan the optimal return path based on the person's current location, the initial position of the first misplaced item, and its current position. The person can intuitively move the item to the correct position through the augmented reality (AR) guidance on the smart glasses' display screen.

[0134] 4. By integrating RFID signals and image recognition, smart glasses guide people to find the second misplaced item and, once found, plan and guide it back to its original location.

[0135] (1) Guiding the search and return of the second misplaced item: During the process of searching for the second misplaced item, the smart glasses will collect images within the person's field of vision in real time for identification, and combine the signal strength received by the built-in RFID reader of the smart glasses to continuously prompt the person in the direction of finding the item. Once the smart glasses identify the second misplaced item, they will immediately prompt the person through the display screen or voice, and plan the return path to guide the person to complete the return.

[0136] 5. Smart Glasses Dynamically Detect and Optimize Personnel Return Path: During the process of personnel returning to their original positions for the first misplaced item, the smart glasses continuously collect images within the personnel's field of vision in real time and perform image recognition to detect the presence of a second misplaced item. Once the smart glasses detect a new second misplaced item, the system dynamically adjusts and replans the overall return path based on the location of the newly discovered item and the status of the first misplaced item, ensuring maximum efficiency in personnel return.

[0137] Corresponding to the above embodiments, the specific implementation details are as follows:

[0138] The specific implementation of the multimodal target positioning technology and the specific embodiments of the present invention will describe in detail how personnel wear and operate smart glasses, and how to complete the return of goods to their proper place in conjunction with system functions.

[0139] 1. System initialization and data preparation:

[0140] (1) RFID Tagging and Data Entry: A UHF RFID tag is affixed to each item to be managed. These tags have a unique Globally Registered Identifier (EPC). In the system's backend database, the administrator enters the EPC code, the precise initial placement location (e.g., shelf number, shelf panel number, specific coordinates, etc., which will be associated with the RFID positioning coordinates), and a clear image of the item for each item. These images will be used for subsequent image recognition and comparison with the smart glasses.

[0141] (2) Deployment of RFID Reader Network on Shelves: Strategically install multiple fixed RFID readers on each shelf in the warehouse or retail area. These readers should cover the entire shelf area, forming a high-precision RFID positioning network. The readers are connected to a central server via wired or wireless means to upload scan data in real time. The installation locations of the readers are optimized to minimize blind spots and signal interference.

[0142] (3) Smart Glasses Configuration and Personnel Training: The smart glasses worn by personnel are the core interactive device of the entire system. They are equipped with a high-resolution camera, a high-performance RFID reader (usually handheld or integrated), a powerful processor, a high-brightness display (supporting augmented reality), and multiple communication modules. Before personnel begin work, the smart glasses are pre-installed with an inventory management application and synchronize initial placement images and RFID location information of all goods from a central server, ensuring some operations can be performed even with poor network conditions. Personnel will receive brief training on how to wear the smart glasses, launch the application, understand the AR guided interface, and hear voice prompts.

[0143] 2. Personnel use smart glasses to detect and classify misplaced goods:

[0144] (1) Initiating the repositioning operation: When warehouse managers or store staff find that goods are misplaced and need to be repositioned, they only need to wear smart glasses and activate the pre-installed "Goods Repositioning" application through simple voice commands or gestures. The smart glasses' display screen will immediately show the current task status and prompt the personnel to enter the repositioning area.

[0145] (2) Smart Glasses-Assisted RFID Scanning and Data Comparison: After a person enters the designated area, the smart glasses will actively trigger the fixed RFID readers on the shelves to scan the area via their built-in RFID reader. The shelf reader will read the EPC codes of all goods' RFID tags within its coverage area and transmit this data to the person's smart glasses in real time. The smart glasses will then cross-compare the received current goods' EPC codes and their corresponding RFID positioning information with the locally stored initial RFID positioning information of the goods.

[0146] (3) Smart glasses identify and alert the first misplaced item: During the comparison process, if the smart glasses find that the EPC code of an item is read in the current scan data, but its current RFID location is inconsistent with the initial location recorded by the system, the smart glasses will immediately mark it as the "first misplaced item". The smart glasses' display screen will show the person the picture of the item, its current location and the correct initial location in a conspicuous manner (such as a red border and text prompts), and record its detailed information.

[0147] (4) Smart glasses identify and prompt the second misplaced item: If the smart glasses find that the EPC code of an item exists in the initial item list, but cannot be read by the RFID reader on the current shelf, the smart glasses will prompt the personnel with the picture and initial location of the "missing" item, and add it to the list of items to be found, in order to guide the personnel to actively search for it.

[0148] 3. Guided by smart glasses, personnel reposition the first misplaced item:

[0149] (1) Smart Glasses Optimal Path Planning: For the first misplaced item identified by the smart glasses, the glasses utilize their built-in positioning module (such as GPS, Wi-Fi fingerprint positioning, or visual SLAM) to obtain the current location of the person in real time. Combining the current location of the first misplaced item with its correct initial location, the smart glasses invoke an optimized path planning algorithm to calculate the shortest or optimal return path from the item's current location to its initial location. This path takes into account actual environmental factors such as aisles between shelves and obstacles to ensure efficient movement of personnel.

[0150] (2) Smart glasses provide augmented reality (AR) guidance: The planned return path is presented in an intuitive augmented reality (AR) manner on the smart glasses' display screen. For example, the smart glasses can overlay virtual arrows in the user's field of vision, highlight the current and target locations of goods, or display a virtual model of the goods above them, instructing the user to move them to the correct location. Users can simply follow the AR instructions provided by the smart glasses, freeing their hands and efficiently moving goods to the correct location without having to look down at paper lists or handheld devices.

[0151] (3) Real-time feedback and error correction from smart glasses: During the personnel's return to their designated positions, the smart glasses continuously monitor the changes in the position of the goods. If the personnel deviate from the planned path, the smart glasses will immediately issue visual (e.g., a red warning box) and auditory (e.g., a voice prompt "Please pay attention to the direction") warnings and automatically recalculate the path. Once the goods are successfully placed in their initial positions, the smart glasses will confirm successful return through visual (e.g., a green highlight, and a "Return successful" text prompt) and auditory (e.g., a prompt sound) feedback, automatically remove the goods from the list of items to be returned, and update the system's inventory information.

[0152] 4. Guided by smart glasses, personnel locate and reposition misplaced items:

[0153] (1) Smart glasses activate item-finding mode: When a second misplaced item is found, the smart glasses will guide the user into item-finding mode. The smart glasses' display screen will show an image of the second misplaced item and its initial location information, and prompt the user to begin the search. The user can then move within the area according to the instructions from the smart glasses.

[0154] (2) Smart Glasses-Assisted Image Recognition and RFID Signal Tracking: During the search process, the smart glasses' camera captures a real-time image stream within the person's field of vision. The built-in image recognition module of the smart glasses analyzes the images in real time to identify potential items within the person's field of vision. Simultaneously, the built-in RFID reader continuously and actively transmits signals and receives weak signals from the second misplaced item (if its RFID tag is still valid). Based on the changes in the received RFID signal strength (a stronger signal indicates a closer distance) and the image recognition results, the smart glasses determine the relative distance and direction between the person and the second misplaced item.

[0155] (3) Smart glasses provide directional guidance: The smart glasses will guide people to move towards the second misaligned item through dynamic indicators on the display screen (such as signal strength bars, arrows pointing in the direction of the target, and distance display) or voice prompts (such as "a little to the left" or "signal strengthening"). People can gradually approach the target item based on these intuitive prompts. When the image recognition module of the smart glasses successfully identifies the target item and the RFID signal strength reaches the preset threshold, the smart glasses will immediately issue a "found" prompt and highlight the item in the field of vision.

[0156] (4) Dynamic Detection and Path Optimization of Smart Glasses: This is a key innovation. While personnel are searching for a second misplaced item or repositioning a first misplaced item, the smart glasses continuously collect images within the personnel's field of vision in real time and perform image recognition. The purpose is to detect other second misplaced items that have not been located by RFID without the personnel's notice. Once the smart glasses detect a new second misplaced item, the system immediately records its current location (through image recognition or close-range reading by the smart glasses' own RFID reader), adds it to the pending list, and simultaneously alerts the personnel.

[0157] (5) Smart glasses guide the handling of a single misplaced item: If there is only one misplaced item, once its current location is successfully found and identified through image recognition or near-field RFID reading, the smart glasses will immediately plan the shortest return path based on its current location and initial location, and guide the person to return the item in AR mode.

[0158] (6) Smart glasses guide the handling of multiple misplaced items: If there are multiple misplaced items, the smart glasses will not immediately guide the items back to their original positions after finding the first one. Instead, it will record the current positions of all misplaced items identified during the search process. Once all (or a preset number) misplaced items have been identified and located, the smart glasses will plan an optimal sequential repositioning path (e.g., considering the shortest total path or the fewest moves) based on the current and initial positions of these items, as well as their relative positions, guiding the person to efficiently reposition all the misplaced items.

[0159] (7) Smart Glasses Integrated Path Planning: The most intelligent aspect of this invention lies in its integrated path planning capability. During the process of personnel returning the first misplaced item, if the smart glasses dynamically detect a new second misplaced item, the system will not simply interrupt the current task. It will immediately perform a global integrated path planning based on the personnel's current location, the initial and current locations of the newly discovered second misplaced item, and the current and initial locations of all unplaced first misplaced items. This new path will consider the priority, distance, and type of all items to be returned, to achieve the most efficient and time-saving return strategy overall, avoiding repeated routes or omissions, and maximizing personnel work efficiency.

[0160] 5. System Architecture and Data Flow:

[0161] (1) Data Acquisition Layer: This includes shelf RFID readers and smart glasses worn by personnel (with built-in RFID readers, cameras, and positioning modules). It is responsible for real-time acquisition of RFID information of goods, image data, and personnel location data.

[0162] (2) Data Processing Layer: Located on the local or cloud server of the smart glasses. It is responsible for preprocessing the collected data, RFID positioning comparison, image recognition (goods recognition, posture estimation), path planning algorithm calculation (A*, Dijkstra, genetic algorithm, etc.), and dynamic task scheduling and optimization.

[0163] (3) Data storage layer: Central database, which stores basic information of goods (EPC, initial location, pictures), historical return records, shelf layout diagram, RFID reader network topology, etc.

[0164] (4) Human interaction layer: The display screen and voice module of the smart glasses. Through augmented reality (AR) interface, text prompts, graphic indicators and voice commands, intuitive return guidance and real-time feedback are provided to the human body.

[0165] (5) Communication module: responsible for data transmission between smart glasses, shelf RFID readers, and central server, supporting multiple communication methods such as Wi-Fi, Bluetooth, and 5G to ensure the real-time performance and stability of data transmission.

[0166] 6. Safety and reliability considerations:

[0167] (1) Data encryption: All data transmitted between devices and servers should be encrypted to prevent information leakage.

[0168] (2) Access control: The system should have a strict user access control mechanism to ensure that only authorized personnel can perform the return operation and access the data.

[0169] (3) Fault tolerance: When the RFID tag is damaged or the reader fails, the system can automatically switch to the image recognition-based item finding mode to ensure continuous operation of the system.

[0170] (4) Tag anti-collision: Advanced RFID anti-collision algorithm is adopted to ensure that all tags can be read accurately in dense goods areas.

[0171] (5) Image recognition robustness: The image recognition model should be trained for complex environments such as different lighting, angles, and occlusions to improve recognition accuracy and robustness.

[0172] 7. Future scalability:

[0173] (1) Multi-user collaboration: Supports multiple people to perform the return operation at the same time. The system can coordinate the tasks of different people, avoid conflicts and optimize overall efficiency.

[0174] (2) Robot integration: In the future, it can be integrated with AGV (Automated Guided Vehicle) or drone to realize the automated placement of some goods or large-scale item retrieval, further reducing the burden on personnel.

[0175] (3) Data analysis and optimization: Through in-depth analysis of the data of the return process, the path planning algorithm, recognition model and shelf layout are continuously optimized to further improve the system performance.

[0176] (4) Inventory counting function: During the return process, inventory counting can be carried out at the same time, improving the efficiency and accuracy of inventory counting and providing more comprehensive assistance to personnel.

[0177] Figure 4 is a schematic diagram of a goods return device based on missing goods provided in one or more embodiments of this specification. A first radio frequency identification reader is provided on the shelf. The device is applied to smart glasses and includes: a scanning unit 401, a comparison unit 402, a judgment unit 403, a determination unit 404 and a return unit 405.

[0178] The scanning unit 401, in response to a user wearing smart glasses to reposition misplaced goods, performs area scanning through the first RFID reader / writer to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the smart glasses.

[0179] The comparison unit 402 compares the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match.

[0180] If the identification code of the specified product is not in the identification code list, the determination unit 403 determines that the misalignment type of the specified product is product missing.

[0181] The determining unit 404 determines the actual radio frequency identification location information of the designated goods within a preset range;

[0182] The homing unit 405 determines a homing path based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0183] Figure 5 is a structural schematic diagram of a goods return device based on missing goods provided in one or more embodiments of this specification. A first radio frequency identification reader is installed on the shelf. The device is applied to smart glasses and includes:

[0184] At least one processor and bus; and,

[0185] A memory communicatively connected to the at least one processor; wherein,

[0186] The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to:

[0187] In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the smart glasses.

[0188] Compare the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match;

[0189] If the identification code of the specified product is not in the identification code list, the misalignment type of the specified product is determined to be product missing.

[0190] Determine the actual radio frequency identification location information of the specified goods within a preset range;

[0191] Based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the return path.

[0192] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the embodiments of apparatus, devices, and non-volatile computer storage media are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0193] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0194] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0195] In the embodiments provided in this application, it should be understood that the disclosed apparatus / network devices and methods can be implemented in other ways. For example, the apparatus / network device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0196] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0197] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The aforementioned units can be implemented in hardware or software.

[0198] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electrical carrier signals and telecommunication signals.

[0199] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for relocating missing goods, characterized in that, A first RFID reader is installed on the shelf. The method is applied to smart glasses and includes: responding to a user wearing smart glasses to reposition misplaced goods, scanning an area using the first RFID reader to read the RFID tag information of all goods within a specified range, the RFID tag information including the identification code of the corresponding goods, and transmitting the RFID tag information of all goods to the smart glasses; comparing the received identification codes of all goods with a pre-stored list of identification codes within the specified range; if the identification code of a specified goods is not in the identification code list, determining that the misplacement type of the specified goods is goods missing; determining the actual RFID location information of the specified goods within a preset range; and determining a repositioning path based on the actual RFID location information of the specified goods and the pre-stored initial RFID location information of the specified goods, so that the user can reposition the specified goods according to the repositioning path. The product is moved to the shelf position corresponding to the initial RFID positioning information of the designated product; the smart glasses have a built-in second RFID reader / writer. The step of scanning the area through the first RFID reader / writer to read the RFID tag information of all products within the designated range includes: triggering the first RFID reader / writer to perform an area scan through the second RFID reader / writer to read the RFID tag information of all products within the designated range; the RFID tag information also includes images of each product; the step of determining the actual RFID location information of the designated product within a preset range includes: issuing a search instruction so that the user can move based on the search instruction, the search instruction including the direction of the movement instruction; real-time acquisition of an image stream within a preset range through the smart glasses' camera, and real-time recognition of the image stream; if an image of the designated product is recognized, the actual RFID positioning information of the designated product is determined.

2. The method according to claim 1, characterized in that, The step of issuing a search instruction so that the user can move based on the search instruction includes: continuously and actively transmitting a signal to the designated goods through the second radio frequency identification reader and receiving a feedback signal from the designated goods; determining the direction information of the designated goods based on the feedback signal; and issuing a search instruction based on the direction information so that the user can move based on the search instruction.

3. The method according to claim 1, characterized in that, The RFID tag information also includes images of each product; determining the actual RFID location information of the designated product within a preset range includes: continuously and actively transmitting signals to the designated product through the second RFID reader and receiving feedback signals from the designated product; determining the direction information of the designated product based on the feedback signals; issuing a search instruction based on the direction information so that the user can move according to the search instruction, and detecting the strength value of the feedback signal in real time; if the strength value of the feedback signal reaches a preset threshold, acquiring an image stream within a preset range and performing real-time recognition on the image stream; if an image of the designated product is recognized, determining the actual RFID location information of the designated product.

4. The method according to claim 1, characterized in that, The method further includes: during the process of guiding the relocation path using the extended reality technology of the smart glasses, acquiring product images within a preset range and recognizing the product images to obtain multiple inspection codes; comparing the multiple inspection codes with a pre-written list of inspection codes whose misalignment type is missing products; if it is determined that the misalignment type of the product corresponding to the specified inspection code is missing products, recording the radio frequency identification (RFID) positioning information corresponding to the product with the specified inspection code, so as to relocate the product with the specified inspection code based on the RFID positioning information.

5. The method according to claim 1, characterized in that, The step of determining the relocation path based on the actual RFID location information of the specified goods and the pre-stored initial RFID location information of the specified goods includes: determining whether there are multiple goods with the misalignment type of missing goods; if not, after determining the actual RFID location information of the specified goods, determining the relocation path based on the actual RFID location information of the specified goods and the pre-stored initial RFID location information of the specified goods.

6. The method according to claim 5, characterized in that, If there are multiple items with the misalignment type of missing goods, the method further includes: determining the remaining items with the misalignment type of missing goods; determining the actual RFID positioning information corresponding to the remaining items; and determining the relocation path based on the actual RFID positioning information of the specified item, the pre-stored initial RFID positioning information of the specified item, the actual RFID positioning information corresponding to the remaining items, and the pre-stored initial RFID positioning information corresponding to the remaining items.

7. A goods return device based on missing goods, characterized in that, A first RFID reader / writer is installed on the shelf. The device is applied to smart glasses and includes: a scanning unit that, in response to a user wearing the smart glasses to reposition misplaced goods, performs an area scan using the first RFID reader / writer to read the RFID tag information of all goods within a specified range. The RFID tag information includes the corresponding product's identification code, and the RFID tag information of all goods is transmitted to the smart glasses; a comparison unit that compares the received identification codes of all goods with a pre-stored list of identification codes within the specified range; a determination unit that, if the identification code of a specified product is not in the identification code list, determines that the misplacement type of the specified product is product missing; a determination unit that determines the actual RFID location information of the specified product within a preset range; and a repositioning unit that, based on the actual RFID location information of the specified product and the pre-stored initial RFID location information of the specified product, determines a repositioning path so that the user can reposition the product accordingly. The relocation path moves the designated goods to the shelf position corresponding to the initial RFID positioning information of the designated goods. The smart glasses have a built-in second RFID reader. The step of scanning the area through the first RFID reader to read the RFID tag information of all goods within the designated range includes: triggering the first RFID reader to scan the area through the second RFID reader to read the RFID tag information of all goods within the designated range; the RFID tag information also includes images of each goods; determining the actual RFID location information of the designated goods within a preset range includes: issuing a search instruction so that the user can move based on the search instruction, the search instruction including the direction of the movement instruction; capturing an image stream within a preset range in real time through the smart glasses' camera and performing real-time recognition of the image stream; if an image of the designated goods is recognized, determining the actual RFID positioning information of the designated goods.

8. A goods return device based on missing goods, characterized in that, A first RFID reader / writer is installed on the shelf. The device is used in smart glasses and includes: at least one processor and a bus; and a memory communicatively connected to the at least one processor. The memory stores instructions executable by the at least one processor, which, when executed, enable the at least one processor to: respond to a user wearing the smart glasses to reposition misplaced goods; perform an area scan using the first RFID reader / writer to read RFID tag information of all goods within a specified range, the RFID tag information including the corresponding product's identification code; and transmit the RFID tag information of all goods to the smart glasses; compare the received identification codes of all goods with a pre-stored list of identification codes within the specified range; if the identification code of a specified product is not in the identification code list, determine that the misplacement type of the specified product is product missing; determine the actual RFID location information of the specified product within a preset range; and, based on the actual RFID location information of the specified product and the pre-stored... The system uses the initial RFID positioning information of the specified goods to determine a return path, enabling the user to move the specified goods to the shelf location corresponding to the initial RFID positioning information of the specified goods according to the return path. The smart glasses have a built-in second RFID reader. The process of scanning an area using the first RFID reader to read the RFID tag information of all goods within a specified range includes: triggering the first RFID reader to perform an area scan using the second RFID reader; the RFID tag information also includes images of each goods; determining the actual RFID location information of the specified goods within a preset range includes: issuing a search instruction so that the user can move based on the search instruction, the search instruction including the direction of movement; real-time acquisition of an image stream within a preset range using the smart glasses' camera, and real-time recognition of the image stream; if an image of the specified goods is recognized, the actual RFID positioning information of the specified goods is determined.

Images