Homing method, device and equipment based on misaligned placement of goods

Abstract

The invention discloses a homing method, device and equipment based on goods placement dislocation, a first radio frequency identification reader-writer is arranged on a goods shelf, the method is applied to an intelligent glasses end, and the method comprises the following steps: in response to a situation that a user wears intelligent glasses to homing staggered goods, carrying out area scanning through the first radio frequency identification reader-writer, and carrying out area scanning through the first radio frequency identification reader-writer; the first radio frequency identification reader-writer is used for reading the radio frequency identification tag information of all goods in a specified range; if the current radio frequency identification positioning information of the specified goods is inconsistent with the initial radio frequency identification positioning information of the specified goods, judging that the dislocation type of the specified goods is goods placement dislocation; and determining a homing path based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, so that the user moves the specified goods to a shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the homing path.

Description

Technical Field

[0001] This application relates to the field of warehouse management technology, and in particular to a method, apparatus and equipment for repositioning misplaced goods. Background Technology

[0002] In retail, warehousing, and logistics, standardized product placement is crucial for ensuring operational efficiency, improving inventory management accuracy, and optimizing the customer shopping experience. However, in practice, due to customer selection errors, employee restocking mistakes, or routine oversights, products often end up in the wrong shelf locations—a situation known as "misplaced merchandise." This misplacement not only distorts inventory data and causes discrepancies in inventory counts, but also makes it more difficult for customers to find the items they need. Furthermore, products left in the wrong location for extended periods can expire and spoil, resulting in direct economic losses.

[0003] Currently, traditional solutions to the problem of misplaced goods mainly rely on regular manual inspections and reorganization. This method is highly dependent on the experience, memory, and sense of responsibility of the stock clerks, and has significant drawbacks such as low efficiency, easy omissions, and high labor costs. Especially in large supermarkets or warehouses, where the number and variety of goods are enormous, relying solely on manual methods to find and return misplaced goods is an extremely tedious, time-consuming, and labor-intensive task. Summary of the Invention

[0004] This specification provides one or more embodiments of a method, apparatus, and device for repositioning misplaced goods, which is used to solve the technical problems mentioned in the background art.

[0005] One or more embodiments of this specification employ the following technical solutions: This specification provides one or more embodiments of a method for repositioning misplaced goods, wherein a first radio frequency identification (RFID) reader is installed on the shelf, and the method is applied to smart glasses, including: In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods. The system then transmits the RFID tag information of all goods to the smart glasses. The current RFID positioning information corresponding to each received identification code is compared with the initial RFID positioning information corresponding to each pre-stored identification code. If the current RFID positioning information of a specified item is inconsistent with the initial RFID positioning information of the specified item, then the misalignment type of the specified item is determined to be misplacement of the item. Based on the current RFID location information and the initial RFID location information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf location corresponding to the initial RFID location information of the specified goods according to the return path.

[0006] It should be noted that this invention, through the synergistic application of smart glasses and radio frequency identification (RFID) technology, constructs a goods placement system that combines proactive discovery and intelligent guidance. This transforms the traditional passive and inefficient work mode, reliant on manual memory and inspection, into a highly efficient workflow driven by technology: proactive discovery, precise positioning, and intelligent guidance. Specifically, the system triggers a shelf reader via smart glasses to scan the area, automatically acquiring the real-time location information of all goods and comparing it with preset correct locations. This proactively and quickly identifies misplaced goods, overcoming the inherent shortcomings of manual inspection, such as easy omissions and low efficiency. After detecting a misplacement, the system further integrates the goods' location information with the user's real-time location, generating an intuitive visual guidance path through extended reality technology. This directly guides the user to the misplaced goods and instructs them on their correct placement, greatly reducing reliance on the experience and memory of stock clerks, avoiding blind searching, and enabling even novice employees to quickly and accurately complete complex placement tasks. This significantly improves organization efficiency, reduces labor costs, and fundamentally enhances the accuracy of inventory management.

[0007] Furthermore, the smart glasses have a built-in second RFID reader / writer. The first RFID reader / writer is used to scan an area to read the RFID tag information of all goods within a specified range, including: The second RFID reader triggers the first RFID reader to perform an area scan, so as to read the RFID tag information of all goods within the specified range through the first RFID reader.

[0008] It should be noted that this invention constructs a precise data acquisition mode that starts on demand and operates collaboratively, effectively avoiding energy waste and signal interference caused by continuous scanning of the RFID system, while ensuring the timeliness and completeness of the acquired product information. Specifically, the system does not keep the first RFID reader on the shelf in a constantly consuming energy-intensive state. Instead, the second RFID reader built into the smart glasses sends a precise scanning command to the first RFID reader in a specific area only when the user needs to perform a repositioning operation. This mechanism, triggered by the user's operation intention, makes the RFID scanning activity clearly targeted and timely. The first reader only starts reading all product tags within its jurisdiction after receiving the command and sends the complete RFID tag information back to the smart glasses. This not only significantly reduces the standby power consumption of the entire RFID system and extends the equipment life, but more importantly, it ensures that the acquired product location data is up-to-date and comprehensive at the moment the user starts operating, providing a solid and reliable data foundation for subsequent comparison, judgment, and path planning, thereby achieving a dual improvement in energy efficiency and performance at the system level.

[0009] Furthermore, determining the homing path based on the current RFID positioning information and the initial RFID positioning information of the specified goods includes: Obtain the user's real-time location information; Obtain the current RFID location information and the environmental information of the initial RFID location information of the specified goods; Based on the real-time location information, the environmental information, the current RFID positioning information of the specified goods, and the initial RFID positioning information of the specified goods, a return path is determined.

[0010] It should be noted that this invention upgrades traditional one-way, static product location guidance into a personalized and executable dynamic navigation solution based on multi-dimensional spatial perception and real-time calculation by integrating real-time user location, product location, and environmental information for dynamic path planning. Specifically, the system does not simply tell the user the target location, but continuously acquires the user's precise location through smart glasses, using the user as the starting point for path planning, ensuring real-time and personalized navigation. Simultaneously, the system comprehensively considers the current misplaced position of the product, its correct position, and surrounding shelf layout, aisle, and other environmental information, ensuring that the final generated return path is not an ideal straight line, but a practically feasible route that integrates spatial structure, obstacle avoidance, and optimal order (e.g., picking up before placing). This not only significantly reduces the cognitive load and operational time of users blindly searching in complex shelf environments, but also ensures a seamless connection between the entire process from discovering misplacement, planning the path, to executing the return, guiding users to complete the operation in the most efficient and direct way, thereby significantly improving the execution efficiency of the return task and the user experience.

[0011] Furthermore, after determining the homing path based on the current RFID positioning information and the initial RFID positioning information of the specified goods, the method further includes: The return path indication information is generated using the extended reality technology of the smart glasses, and the corresponding indication information is displayed in real time on the display screen of the smart glasses.

[0012] It should be noted that this invention uses Extended Reality (XR) technology to intuitively overlay the relocation path information onto the user's real field of vision for guidance. This transforms abstract path information into immersive, visual spatial guidance, significantly reducing the user's cognitive and operational burden and achieving a seamless transition from searching to execution. Specifically, instead of using indirect methods like traditional 2D maps or voice commands that require mental processing, the system utilizes the XR technology of smart glasses to directly render visual elements such as directional arrows, distance markers, and highlighted indicators within the user's field of vision. This precisely aligns the correct movement path and operational steps with the real physical environment, allowing the user to focus on the operation itself without interrupting the current task to understand instructions or memorize locations. This creates a direct, intuitive operational experience where what you see is what you do. This not only significantly shortens decision-making and searching time and avoids misoperations caused by misunderstandings, but also makes the entire relocation process smooth and efficient, greatly improving task execution accuracy and user experience.

[0013] Furthermore, the method also includes: The return path is monitored in real time through the smart glasses; If the user deviates from the return path during movement, a deviation warning is issued to the user through the smart glasses, and a new return path is determined.

[0014] It should be noted that by introducing a real-time monitoring and dynamic replanning mechanism for user movement paths, this invention upgrades the traditional one-way, static navigation guidance into a continuous closed-loop collaborative guidance system, effectively ensuring the robustness of the guidance process and the reliability of the final task execution. Specifically, the system doesn't simply generate a path and leave the user to move freely. Instead, it continuously monitors the user's actual movement trajectory through smart glasses and compares it with the preset optimal path. This real-time feedback mechanism can immediately detect deviations caused by environmental interference, misunderstandings, or impromptu decisions. Once a deviation is detected, the system immediately provides instant feedback to the user through visual or tactile warnings, enabling them to quickly perceive the anomaly and stop erroneous movement, effectively avoiding wasting time and energy in the wrong direction. More importantly, the system doesn't mechanically require the user to return to the original path. Instead, based on the user's current location, the location of the goods, and environmental information, it intelligently recalculates an optimal path from the current location to the target. This dynamic adaptive capability ensures that the guidance path always remains consistent with the user's real-time state and environment, minimizing the interruption of the task flow due to unexpected deviations. This guarantees that the entire guidance process from start to finish is coherent, efficient, and fault-tolerant, greatly improving the success rate of operations and the user experience in complex real-world environments.

[0015] Furthermore, the RFID tag information also includes images of each product; If the current RFID location information of the specified product is consistent with the initial RFID location information of the specified product, the smart glasses will compare the current product image corresponding to each identification code with the pre-stored initial product image corresponding to each identification code. If the current product image of a specific product is inconsistent with the initial product image of that specific product, then the misalignment type of that specific product is determined to be product placement misalignment.

[0016] It should be noted that this invention introduces product image comparison as a supplementary verification method to RFID positioning detection, constructing a dual verification mechanism composed of RFID positioning and visual information. This greatly improves the accuracy and comprehensiveness of misplaced product identification and effectively solves the detection blind spots that may exist when relying solely on location data. Specifically, when RFID detects that a product is in its initially registered correct position, traditional methods would determine that the product is placed correctly. However, in reality, there may be misplacement types where "the position is correct but the product itself has been replaced" (e.g., different products are placed in the same shelf position). This invention, by further calling and comparing the current product image with the initial image pre-stored in the system, can keenly detect such anomalies where the appearance does not match the registration information, thus including such hidden misplacement problems in the system's detection scope. This dual verification mechanism allows the system to not only focus on "whether the product is in the correct position" but also further confirm "whether the product in the correct position is the correct product," thereby achieving deeper and more refined monitoring of the product placement status, significantly reducing the risk of misjudgment or omission due to limited information, and comprehensively improving the authenticity and reliability of inventory management.

[0017] Furthermore, the misalignment type also includes missing goods; the method further includes: During the process of guiding the return path using the extended reality technology of the smart glasses, images of goods within a preset range are collected and the images of goods are identified to obtain multiple identification codes to be detected. The multiple identification codes to be inspected are compared with a pre-written list of identification codes whose misalignment type is missing goods. If the misalignment type of the goods corresponding to the specified inspection code is determined to be missing goods, the radio frequency identification (RFID) positioning information corresponding to the goods with the specified inspection code is recorded so that the goods with the specified inspection code can be repositioned based on the RFID positioning information.

[0018] It should be noted that this invention creatively integrates the missing goods detection task seamlessly into the existing return path guidance process, utilizing the existing navigation route to achieve parallel inspection and recording of missing goods. This transforms the originally independent and additional inventory shortage work into a background process that automatically completes alongside the main task, resulting in a significant increase in work efficiency. Specifically, the system does not initiate a dedicated inventory shortage task after all misplaced goods have been returned to their original positions. Instead, it intelligently and continuously utilizes the visual capabilities of the user's smart glasses to automatically scan shelves along the route, collect images, and identify goods while the user moves along the preset path and performs the main return operation. It automatically compares the identified goods with the known list of missing goods in real time. Once a missing item on the list reappears (i.e., it has been replenished but not updated in the system), the system automatically records its precise location. Thus, without the user noticing and without adding any additional operational burden, the system silently completes the verification and update of the inventory shortage status, achieving both misplacement return and shortage verification without error. This greatly optimizes the workflow and comprehensively improves the automation level and overall efficiency of dynamic, real-time inventory status management.

[0019] Furthermore, if the designated goods are multiple misplaced goods, determining the relocation path based on the current RFID positioning information and the initial RFID positioning information of the designated goods includes: Obtain a list of all misplaced goods, the list including the identification code, current RFID positioning information and initial RFID positioning information for each misplaced goods; Based on the user's real-time location information and the current RFID positioning information of each misplaced item, the real-time distance from the user to the current location of each misplaced item is calculated, and the initial item processing order is generated according to the real-time distance. By combining the shelf layout information with the initial product processing sequence, a return path is generated for each misplaced product.

[0020] This invention introduces an intelligent sorting and path planning mechanism based on real-time distance and spatial layout for multiple misaligned goods, transforming the tedious and complex manual task scheduling decision-making into an automated and intelligent global optimization process. This significantly improves operational efficiency in multi-task scenarios and greatly reduces the cognitive load on operators. Specifically, when faced with multiple misplaced goods, the system does not simply list the problems or rely on the operator to decide the processing order. Instead, it proactively obtains the user's real-time location and dynamically calculates the real-time spatial distance between the user and each misplaced item. This generates an initial processing order based on the principle of proximity to distance. This mechanism ensures that each step of the user's movement is the most efficient and economical in the initial stage. Furthermore, the system does not stop at this simple distance sorting. It further integrates spatial structure information such as shelf environment and aisle layout to optimize and adjust the initial order, generating a globally optimal repositioning path with the shortest overall movement distance, avoiding repeated paths and back-and-forth trips. This allows users to complete the repositioning of all goods efficiently, as if experiencing a seamless assembly line, simply by following the system's guidance, without having to perform time-consuming and laborious task priority judgments and route planning. This achieves an upgrade from single-item processing to multi-item batch processing, ensuring the orderliness and high efficiency of operations even in complex scenarios.

[0021] This specification provides one or more embodiments of a repositioning device for misplaced goods, wherein a first radio frequency identification (RFID) reader is installed on the shelf, and the device is applied to smart glasses, comprising: The scanning unit, in response to the user wearing smart glasses to reposition misplaced goods, performs area scanning through the first RFID reader / writer to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods, and transmits the RFID tag information of all goods to the smart glasses. The comparison unit compares the current RFID positioning information corresponding to each received identification code with the pre-stored initial RFID positioning information corresponding to each identification code. If the current RFID positioning information of a specified item is inconsistent with the initial RFID positioning information of the specified item, the determination unit determines that the misalignment type of the specified item is misplacement of the item. The homing unit determines a homing path based on the current RFID location information and the initial RFID location information of the specified goods, so that the user can move the specified goods to the shelf position corresponding to the initial RFID location information of the specified goods according to the homing path.

[0022] This specification provides one or more embodiments of a product placement and repositioning device, which includes a first radio frequency identification (RFID) reader / writer installed on a shelf. The device is applied to smart glasses and includes: At least one processor and bus; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to: In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods. The system then transmits the RFID tag information of all goods to the smart glasses. The current RFID positioning information corresponding to each received identification code is compared with the initial RFID positioning information corresponding to each pre-stored identification code. If the current RFID positioning information of a specified item is inconsistent with the initial RFID positioning information of the specified item, then the misalignment type of the specified item is determined to be misplacement of the item. Based on the current RFID location information and the initial RFID location information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf location corresponding to the initial RFID location information of the specified goods according to the return path.

[0023] The above-described at least one technical solution adopted in the embodiments of this specification can achieve the following beneficial effects: This invention utilizes the synergistic application of smart glasses and RFID technology to construct a product placement system that combines proactive discovery with intelligent guidance. This transforms the traditional passive and inefficient work mode, reliant on manual memory and inspection, into a highly efficient workflow driven by technology: proactive discovery, precise positioning, and intelligent guidance. Specifically, the system uses smart glasses to trigger a shelf reader to scan an area, automatically acquiring the real-time location information of all products and comparing it with preset correct locations. This proactively and quickly identifies misplaced products, overcoming the inherent drawbacks of manual inspection, such as easy omissions and low efficiency. After detecting a misplacement, the system further integrates product location information with the user's real-time location, generating an intuitive visual guidance path using extended reality technology. This directly guides the user to the misplaced product and instructs them on its correct placement, significantly reducing reliance on the experience and memory of stock clerks, avoiding blind searching, and enabling even novice employees to quickly and accurately complete complex placement tasks. This significantly improves organization efficiency, reduces labor costs, and fundamentally enhances the accuracy of inventory management. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments or prior art of this specification, the drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. In the drawings: Figure 1 A diagram illustrating the application environment of a method for repositioning misplaced goods, provided in one or more embodiments of this specification. Figure 2 A flowchart illustrating a method for repositioning misplaced goods, provided for one or more embodiments of this specification; Figure 3 A flowchart illustrating a relocation path determination method provided in one or more embodiments of this specification; Figure 4 A schematic diagram of a repositioning device based on misplaced goods, provided for one or more embodiments of this specification; Figure 5 This is a structural diagram of a repositioning device based on misplaced goods, provided for one or more embodiments of this specification. Detailed Implementation

[0025] This specification provides a method, apparatus, and equipment for repositioning misplaced goods.

[0026] To enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this specification, and not all embodiments. Based on the embodiments of this specification, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this specification.

[0027] The solution proposed in this application can be applied to the goods placement scenario in the goods placement terminal. Figure 1 This diagram illustrates an application environment for a method for repositioning misplaced goods, as provided in an embodiment of this specification. Figure 1 As shown, terminal 102 communicates with server 103 via a network. Data storage system 101 can store data that server 103 needs to process. Data storage system 101 can be integrated on server 103 or placed on the cloud or other network servers. Terminal 102 can acquire historical behavior data of users in different operating scenarios and the operating status of XR glasses; extract common behavioral information of users from the historical behavior data of users in each operating scenario; extract common status information of XR glasses from the operating status of XR glasses in each operating scenario; combine the common behavioral information and the common status information to generate the glasses habit status of XR glasses in the operating scenario; associate the operating scenario with the glasses habit status to obtain behavioral habit tags. Alternatively, the process of constructing the tags described above can be executed on server 103. That is, the server obtains the user's historical behavior data in different operating scenarios and the operating status of the XR glasses; extracts common behavioral information from the user's historical behavior data in each operating scenario; extracts common status information of the XR glasses from the operating status of the XR glasses in each operating scenario; combines the common behavioral information and the common status information to generate the glasses habit status of the XR glasses in the operating scenario; and associates the operating scenario with the glasses habit status to obtain behavioral habit tags.

[0028] Specifically, the goods return terminal can include smartphones, smart home appliances, tablets, virtual reality headsets (VR headsets), augmented reality glasses (AR glasses), electronic displays, and mixed reality (MR) devices, etc. MR devices can include MR glasses, MR helmets, MR cameras, etc. In-vehicle systems can include in-vehicle chips, in-vehicle devices (such as in-vehicle infotainment systems, in-vehicle computers, sensors with voice recognition capabilities, etc.).

[0029] Figure 2This diagram illustrates a process flow for a method to reposition misplaced goods, provided in one or more embodiments of this specification. A first RFID reader is installed on the shelf, and the method is applied to smart glasses. Certain input parameters or intermediate results in the process can be manually adjusted to help improve accuracy.

[0030] The method flow steps of the embodiments in this specification are as follows: S201, in response to the user wearing smart glasses to reposition misplaced goods, the first RFID reader scans the area to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods. The RFID tag information of all goods is then transmitted to the smart glasses.

[0031] In the embodiments described in this specification, the smart glasses have a built-in second RFID reader. When the user wears the smart glasses and initiates the return-to-position operation mode, the smart glasses establish a connection with the first RFID reader deployed at the shelf end via near-field communication or wireless local area network. The second RFID reader can send a scanning command to the first RFID reader, triggering the first RFID reader to perform RFID scanning on all goods within its coverage area. The first RFID reader reads the identification code and current RFID positioning information contained in the electronic tags of all goods within its range, and transmits this RFID tag information to the smart glasses wirelessly.

[0032] S202, compare the current RFID positioning information corresponding to each received identification code with the pre-stored initial RFID positioning information corresponding to each identification code.

[0033] In the embodiments described in this specification, after receiving RFID tag information sent by the first RFID reader, the smart glasses access a locally stored product information database. The database contains pre-entered product identification codes and their corresponding initial RFID location information. The smart glasses compare the received current RFID location information corresponding to each identification code with the initial RFID location information of the corresponding identification code stored in the database, one by one.

[0034] S203, if the current RFID positioning information of the specified goods is inconsistent with the initial RFID positioning information of the specified goods, then the misalignment type of the specified goods is determined to be misplacement of goods.

[0035] In the embodiments described in this specification, the smart glasses determine the location status of each item by comparing the current RFID positioning information with the initial RFID positioning information. When a discrepancy is found between the current RFID positioning information of an item and the initial RFID positioning information of that item in the database, the smart glasses mark the item as a misplaced item and record its misplacement type as "item placement misalignment".

[0036] S204, based on the current RFID positioning information and the initial RFID positioning information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the return path.

[0037] In the embodiments described in this specification, for identified misplaced goods, the smart glasses calculate the optimal return path using a path planning algorithm based on the goods' current and initial RFID positioning information. The smart glasses utilize extended reality technology to overlay virtual path guidance onto the user's field of vision, including directional arrows, distance indicators, and target location markers, guiding the user to the misplaced goods' current location to retrieve them and transport them to the correct shelf position. During the movement, the smart glasses continuously update the displayed path guidance to ensure the user can accurately complete the return operation.

[0038] It should be noted that this invention, through the synergistic application of smart glasses and radio frequency identification (RFID) technology, constructs a goods placement system that combines proactive discovery and intelligent guidance. This transforms the traditional passive and inefficient work mode, reliant on manual memory and inspection, into a highly efficient workflow driven by technology: proactive discovery, precise positioning, and intelligent guidance. Specifically, the system triggers a shelf reader via smart glasses to scan the area, automatically acquiring the real-time location information of all goods and comparing it with preset correct locations. This proactively and quickly identifies misplaced goods, overcoming the inherent shortcomings of manual inspection, such as easy omissions and low efficiency. After detecting a misplacement, the system further integrates the goods' location information with the user's real-time location, generating an intuitive visual guidance path through extended reality technology. This directly guides the user to the misplaced goods and instructs them on their correct placement, greatly reducing reliance on the experience and memory of stock clerks, avoiding blind searching, and enabling even novice employees to quickly and accurately complete complex placement tasks. This significantly improves organization efficiency, reduces labor costs, and fundamentally enhances the accuracy of inventory management.

[0039] Furthermore, when determining the homing path based on the current RFID location information and the initial RFID location information of the specified goods in the embodiments of this specification, please refer to... Figure 3The diagram illustrates a method for determining a relocation path, which can be executed by smart glasses. Certain input parameters or intermediate results in the process can be manually adjusted to help improve accuracy.

[0040] S301, Obtain the user's real-time location information.

[0041] In the embodiments described in this specification, the smart glasses can continuously track and obtain the user's real-time position coordinates and orientation angle in the shelf environment through their built-in positioning module, such as a visual inertial odometry module or an ultra-wideband positioning module.

[0042] S302, obtain the current RFID positioning information and the environmental information of the initial RFID positioning information of the specified goods.

[0043] In the embodiments described in this specification, the smart glasses retrieve environmental information related to a specified product from a local or cloud database. This environmental information includes a 3D map of the shelf layout, aisle information, and obstacle distribution data, which are associated with the current and initial RFID positioning information of the specified product.

[0044] S303, based on the real-time location information, the environmental information, the current RFID positioning information of the specified goods, and the initial RFID positioning information of the specified goods, determine the homing path.

[0045] In the embodiments described in this specification, the path planning engine of the smart glasses receives the user's real-time location information, environmental information, the current RFID positioning information of the specified goods, and its initial RFID positioning information. The planning engine integrates this information and calculates an optimal path in a three-dimensional environmental map, starting from the user's current location, first heading to the location of the misplaced goods, and then heading to its correct shelf location. This path simultaneously avoids known obstacles in the environment.

[0046] It should be noted that this invention upgrades traditional one-way, static product location guidance into a personalized and executable dynamic navigation solution based on multi-dimensional spatial perception and real-time calculation by integrating real-time user location, product location, and environmental information for dynamic path planning. Specifically, the system does not simply tell the user the target location, but continuously acquires the user's precise location through smart glasses, using the user as the starting point for path planning, ensuring real-time and personalized navigation. Simultaneously, the system comprehensively considers the current misplaced position of the product, its correct position, and surrounding shelf layout, aisle, and other environmental information, ensuring that the final generated return path is not an ideal straight line, but a practically feasible route that integrates spatial structure, obstacle avoidance, and optimal order (e.g., picking up before placing). This not only significantly reduces the cognitive load and operational time of users blindly searching in complex shelf environments, but also ensures a seamless connection between the entire process from discovering misplacement, planning the path, to executing the return, guiding users to complete the operation in the most efficient and direct way, thereby significantly improving the execution efficiency of the return task and the user experience.

[0047] Furthermore, after determining the return path based on the current RFID positioning information and the initial RFID positioning information of the specified goods, the return path indication information can be generated through the extended reality technology of the smart glasses, and the corresponding indication information can be displayed in real time through the display screen of the smart glasses.

[0048] It's important to note that the extended reality rendering engine of the smart glasses receives home navigation path data provided by the path planning module. This data includes the spatial coordinate sequence of the path and action guidelines. Based on the received path data, the extended reality rendering engine generates corresponding visual guidance elements, including directional arrows pointing to the next target point, highlighted markers at the target shelf location, and distance prompts at key points along the path. The smart glasses' display overlays these visual guidance elements with the real-world environment in real time, continuously presenting them to the user in an augmented reality manner, providing full visual guidance for the home navigation process.

[0049] It should be noted that this invention uses Extended Reality (XR) technology to intuitively overlay the relocation path information onto the user's real field of vision for guidance. This transforms abstract path information into immersive, visual spatial guidance, significantly reducing the user's cognitive and operational burden and achieving a seamless transition from searching to execution. Specifically, instead of using indirect methods like traditional 2D maps or voice commands that require mental processing, the system utilizes the XR technology of smart glasses to directly render visual elements such as directional arrows, distance markers, and highlighted indicators within the user's field of vision. This precisely aligns the correct movement path and operational steps with the real physical environment, allowing the user to focus on the operation itself without interrupting the current task to understand instructions or memorize locations. This creates a direct, intuitive operational experience where what you see is what you do. This not only significantly shortens decision-making and searching time and avoids misoperations caused by misunderstandings, but also makes the entire relocation process smooth and efficient, greatly improving task execution accuracy and user experience.

[0050] Furthermore, in this embodiment of the specification, the return path can be monitored in real time through the smart glasses; if the user deviates from the return path during movement, a deviation warning is issued to the user through the smart glasses, and a new return path is determined.

[0051] It should be noted that the smart glasses continuously acquire the user's real-time spatial location and movement trajectory through their built-in positioning and posture perception system. The smart glasses' path monitoring module compares the acquired real-time user location with the pre-generated return path. When the user's location deviates from the preset path by more than an allowable threshold, it is determined as a path deviation. After determining that a deviation has occurred, the path monitoring module immediately triggers the smart glasses' feedback system, issuing a deviation warning to the user through visual cues (such as warning icons on the display screen) or tactile feedback (such as vibration). The smart glasses' path planning module, based on the user's current latest location, the target item's location information, and environmental information, recalculates and generates a new return path from the current location to the target location, and updates the extended reality guidance information.

[0052] It should be noted that by introducing a real-time monitoring and dynamic replanning mechanism for user movement paths, this invention upgrades the traditional one-way, static navigation guidance into a continuous closed-loop collaborative guidance system, effectively ensuring the robustness of the guidance process and the reliability of the final task execution. Specifically, the system doesn't simply generate a path and leave the user to move freely. Instead, it continuously monitors the user's actual movement trajectory through smart glasses and compares it with the preset optimal path. This real-time feedback mechanism can immediately detect deviations caused by environmental interference, misunderstandings, or impromptu decisions. Once a deviation is detected, the system immediately provides instant feedback to the user through visual or tactile warnings, enabling them to quickly perceive the anomaly and stop erroneous movement, effectively avoiding wasting time and energy in the wrong direction. More importantly, the system doesn't mechanically require the user to return to the original path. Instead, based on the user's current location, the location of the goods, and environmental information, it intelligently recalculates an optimal path from the current location to the target. This dynamic adaptive capability ensures that the guidance path always remains consistent with the user's real-time state and environment, minimizing the interruption of the task flow due to unexpected deviations. This guarantees that the entire guidance process from start to finish is coherent, efficient, and fault-tolerant, greatly improving the success rate of operations and the user experience in complex real-world environments.

[0053] Furthermore, the RFID tag information also includes images of each product. If the current RFID positioning information of a specified product is consistent with the initial RFID positioning information of the specified product, the smart glasses compare the current product image corresponding to each identification code with the pre-stored initial product images corresponding to each identification code. If the current product image of a specific product is inconsistent with the initial product image of that specific product, then the misalignment type of the specific product is determined to be product placement misalignment.

[0054] It should be noted that the smart glasses use their built-in camera to capture a current image of a designated product, and this image is then associated with the identification code in the RFID tag. The smart glasses access a pre-stored product information database to retrieve the initial product image corresponding to each identification code, and compare the currently captured product image with the initial product image for the corresponding identification code in the database based on visual features. When the smart glasses detect a discrepancy between the current product image and the initial product image for a specific product in terms of visual features, they determine that the product is misplaced and record this abnormal state.

[0055] It should be noted that this invention introduces product image comparison as a supplementary verification method to RFID positioning detection, constructing a dual verification mechanism composed of RFID positioning and visual information. This greatly improves the accuracy and comprehensiveness of misplaced product identification and effectively solves the detection blind spots that may exist when relying solely on location data. Specifically, when RFID detects that a product is in its initially registered correct position, traditional methods would determine that the product is placed correctly. However, in reality, there may be misplacement types where "the position is correct but the product itself has been replaced" (e.g., different products are placed in the same shelf position). This invention, by further calling and comparing the current product image with the initial image pre-stored in the system, can keenly detect such anomalies where the appearance does not match the registration information, thus including such hidden misplacement problems in the system's detection scope. This dual verification mechanism allows the system to not only focus on "whether the product is in the correct position" but also further confirm "whether the product in the correct position is the correct product," thereby achieving deeper and more refined monitoring of the product placement status, significantly reducing the risk of misjudgment or omission due to limited information, and comprehensively improving the authenticity and reliability of inventory management.

[0056] Furthermore, the misalignment type also includes missing goods; during the process of guiding the relocation path using the extended reality technology of the smart glasses, images of goods within a preset range are collected and the images are identified to obtain multiple identification codes to be inspected; the multiple identification codes to be inspected are compared with a pre-written list of identification codes for the misalignment type of missing goods; if it is determined that the misalignment type of the goods corresponding to the specified identification code to be inspected is missing goods, the radio frequency identification (RFID) positioning information corresponding to the goods of the specified identification code to be inspected is recorded so as to relocate the goods of the specified identification code to be inspected based on the RFID positioning information.

[0057] It should be noted that during the relocation path guidance process using the extended reality technology of smart glasses, the image acquisition function of the smart glasses is simultaneously activated to continuously capture images of the product display area within a preset range of the user's field of vision. The smart glasses perform real-time recognition processing on the captured product images, extracting the visual features of visible products in the images through image recognition algorithms and converting them into corresponding identification codes. The smart glasses then match and compare the identified identification codes with a locally stored list of missing product identification codes, which contains product identification codes that have been recorded as missing. When a matching identification code is found to be in the list of missing product identification codes, the smart glasses record the current RFID location information of the product and update this information to the system database, providing a location basis for subsequent relocation operations.

[0058] It should be noted that this invention creatively integrates the missing goods detection task seamlessly into the existing return path guidance process, utilizing the existing navigation route to achieve parallel inspection and recording of missing goods. This transforms the originally independent and additional inventory shortage work into a background process that automatically completes alongside the main task, resulting in a significant increase in work efficiency. Specifically, the system does not initiate a dedicated inventory shortage task after all misplaced goods have been returned to their original positions. Instead, it intelligently and continuously utilizes the visual capabilities of the user's smart glasses to automatically scan shelves along the route, collect images, and identify goods while the user moves along the preset path and performs the main return operation. It automatically compares the identified goods with the known list of missing goods in real time. Once a missing item on the list reappears (i.e., it has been replenished but not updated in the system), the system automatically records its precise location. Thus, without the user noticing and without adding any additional operational burden, the system silently completes the verification and update of the inventory shortage status, achieving both misplacement return and shortage verification without error. This greatly optimizes the workflow and comprehensively improves the automation level and overall efficiency of dynamic, real-time inventory status management.

[0059] Furthermore, if the designated goods are multiple misplaced goods, when determining the return path based on the current RFID positioning information and the initial RFID positioning information of the designated goods, a list of all misplaced goods can be obtained. The list includes the identification code, current RFID positioning information, and initial RFID positioning information of each misplaced goods. Based on the user's real-time location information and the current RFID positioning information of each misplaced goods, the real-time distance from the user to the current location of each misplaced goods is calculated, and an initial goods processing order is generated according to the real-time distance. Combining the shelf environment layout information and the initial goods processing order, a return path for each misplaced goods is generated.

[0060] It should be noted that the smart glasses system first obtains a list of all identified misplaced items. This list includes a unique identifier for each misplaced item, its current location information obtained through RFID technology, and the initial correct location information recorded in the system. The smart glasses obtain the user's real-time location coordinates through its positioning system and calculates the spatial distance between the user's current location and the current location of each misplaced item, generating a preliminary item processing order based on the principle of "from near to far". The smart glasses then accesses stored shelf layout information, including shelf arrangement, aisle direction, and obstacle positions, to optimize and adjust the preliminary processing order, ultimately generating an optimal return path that comprehensively considers distance efficiency and environmental structure.

[0061] This invention introduces an intelligent sorting and path planning mechanism based on real-time distance and spatial layout for multiple misaligned goods, transforming the tedious and complex manual task scheduling decision-making into an automated and intelligent global optimization process. This significantly improves operational efficiency in multi-task scenarios and greatly reduces the cognitive load on operators. Specifically, when faced with multiple misplaced goods, the system does not simply list the problems or rely on the operator to decide the processing order. Instead, it proactively obtains the user's real-time location and dynamically calculates the real-time spatial distance between the user and each misplaced item. This generates an initial processing order based on the principle of proximity to distance. This mechanism ensures that each step of the user's movement is the most efficient and economical in the initial stage. Furthermore, the system does not stop at this simple distance sorting. It further integrates spatial structure information such as shelf environment and aisle layout to optimize and adjust the initial order, generating a globally optimal repositioning path with the shortest overall movement distance, avoiding repeated paths and back-and-forth trips. This allows users to complete the repositioning of all goods efficiently, as if experiencing a seamless assembly line, simply by following the system's guidance, without having to perform time-consuming and laborious task priority judgments and route planning. This achieves an upgrade from single-item processing to multi-item batch processing, ensuring the orderliness and high efficiency of operations even in complex scenarios.

[0062] Definitions of key terms: RFID (Radio Frequency Identification): A non-contact automatic identification technology that uses radio frequency signals to automatically identify target objects and obtain relevant data.

[0063] Smart glasses: A type of wearable device that typically features a display, camera, sensors, and communication capabilities to provide users with an extended reality (XR) experience.

[0064] The first misplaced item refers to an item that can be located using an RFID reader, but whose current position is inconsistent with its initial correct placement position.

[0065] The second type of misplaced goods refers to goods that cannot be located by the RFID reader on the shelf (e.g., due to being outside the reading range, the RFID tag being invalid or falling off, etc.) and require the user to actively search for them.

[0066] In modern warehousing and retail industries, accurate placement and rapid return of goods are crucial for improving operational efficiency and reducing management costs. However, misplacement of goods is common due to human error and customers' careless placement. Traditional methods of goods return rely mainly on manual searching and memorization, which is inefficient and prone to errors, especially when dealing with a wide variety and large quantity of goods. The workload for searching and returning goods is enormous, severely impacting work efficiency and user experience. While some automated or semi-automated warehouse management systems exist, a comprehensive and intelligent solution is still lacking for the accurate location and efficient return of misplaced goods, particularly for "missing" goods that cannot be directly located by RFID.

[0067] This invention provides an intelligent goods return system and method. Its core lies in using smart glasses worn by personnel, combined with RFID and image recognition technologies, to achieve precise positioning of goods, intelligent path planning, and effective retrieval of "missing" goods. This significantly improves goods return efficiency and reduces labor costs. Technical solution summary: 1. Personnel wear smart glasses and activate the goods return application; 2. The smart glasses obtain the current location information of the goods through the RFID reader on the shelf and compare it with the pre-stored initial location information to distinguish the first misplaced goods and the second misplaced goods. (1) Smart Glasses Hardware Configuration and Data Preloading: The smart glasses worn by personnel have built-in RFID readers and pre-store initial placement images and RFID positioning information of the goods. RFID readers are also installed on the shelves to form a collaborative positioning network.

[0068] (2) Smart glasses assist personnel in identifying misplaced goods: When personnel need to return goods to their proper place, the smart glasses will actively scan the goods using the RFID reader on the shelf, and based on the scanning results, intelligently identify two types of misplaced goods, and provide prompts to personnel through the smart glasses' display screen: (3) First misplaced goods: refers to goods that can be located by smart glasses, but whose current position is inconsistent with the initial correct placement position.

[0069] (4) Second misplaced goods: refers to goods that cannot be located by the RFID reader on the shelf (e.g., due to reasons such as exceeding the reading distance, RFID tag failure or falling off), and require personnel to actively search for them.

[0070] 3. Smart glasses plan and guide personnel through the return path of the first misplaced item using AR technology; (1) Guiding the first misplaced item back to its correct position: The smart glasses will intelligently plan the optimal return path based on the person's current location, the initial position of the first misplaced item, and its current position. The person can intuitively move the item to the correct position through the augmented reality (AR) guidance on the smart glasses' display screen.

[0071] 4. By integrating RFID signals and image recognition, smart glasses guide people to find the second misplaced item and, once found, plan and guide it back to its original location.

[0072] (1) Guiding the search and return of the second misplaced item: During the process of searching for the second misplaced item, the smart glasses will collect images within the person's field of vision in real time for identification, and combine the signal strength received by the built-in RFID reader of the smart glasses to continuously prompt the person in the direction of finding the item. Once the smart glasses identify the second misplaced item, they will immediately prompt the person through the display screen or voice, and plan the return path to guide the person to complete the return.

[0073] 5. Smart Glasses Dynamically Detect and Optimize Personnel Return Path: During the process of personnel returning to their original positions for the first misplaced item, the smart glasses continuously collect images within the personnel's field of vision in real time and perform image recognition to detect the presence of a second misplaced item. Once the smart glasses detect a new second misplaced item, the system dynamically adjusts and replans the overall return path based on the location of the newly discovered item and the status of the first misplaced item, ensuring maximum efficiency in personnel return.

[0074] Corresponding to the above embodiments, the specific implementation details are as follows: The specific implementation of the multimodal target positioning technology and the specific embodiments of the present invention will describe in detail how personnel wear and operate smart glasses, and how to complete the return of goods to their proper place in conjunction with system functions.

[0075] 1. System initialization and data preparation: (1) RFID Tagging and Data Entry: A UHF RFID tag is affixed to each item to be managed. These tags have a unique Globally Registered Identifier (EPC). In the system's backend database, the administrator enters the EPC code, the precise initial placement location (e.g., shelf number, shelf panel number, specific coordinates, etc., which will be associated with the RFID positioning coordinates), and a clear image of the item for each item. These images will be used for subsequent image recognition and comparison with the smart glasses.

[0076] (2) Deployment of RFID Reader Network on Shelves: Strategically install multiple fixed RFID readers on each shelf in the warehouse or retail area. These readers should cover the entire shelf area, forming a high-precision RFID positioning network. The readers are connected to a central server via wired or wireless means to upload scan data in real time. The installation locations of the readers are optimized to minimize blind spots and signal interference.

[0077] (3) Smart Glasses Configuration and Personnel Training: The smart glasses worn by personnel are the core interactive device of the entire system. They are equipped with a high-resolution camera, a high-performance RFID reader (usually handheld or integrated), a powerful processor, a high-brightness display (supporting augmented reality), and multiple communication modules. Before personnel begin work, the smart glasses are pre-installed with an inventory management application and synchronize initial placement images and RFID location information of all goods from a central server, ensuring some operations can be performed even with poor network conditions. Personnel will receive brief training on how to wear the smart glasses, launch the application, understand the AR guided interface, and hear voice prompts.

[0078] 2. Personnel use smart glasses to detect and classify misplaced goods: (1) Initiating the repositioning operation: When warehouse managers or store staff find that goods are misplaced and need to be repositioned, they only need to wear smart glasses and activate the pre-installed "Goods Repositioning" application through simple voice commands or gestures. The smart glasses' display screen will immediately show the current task status and prompt the personnel to enter the repositioning area.

[0079] (2) Smart Glasses-Assisted RFID Scanning and Data Comparison: After a person enters the designated area, the smart glasses will actively trigger the fixed RFID readers on the shelves to scan the area via their built-in RFID reader. The shelf reader will read the EPC codes of all goods' RFID tags within its coverage area and transmit this data to the person's smart glasses in real time. The smart glasses will then cross-compare the received current goods' EPC codes and their corresponding RFID positioning information with the locally stored initial RFID positioning information of the goods.

[0080] (3) Smart glasses identify and alert the first misplaced item: During the comparison process, if the smart glasses find that the EPC code of an item is read in the current scan data, but its current RFID location is inconsistent with the initial location recorded by the system, the smart glasses will immediately mark it as the "first misplaced item". The smart glasses' display screen will show the person the picture of the item, its current location and the correct initial location in a conspicuous manner (such as a red border and text prompts), and record its detailed information.

[0081] (4) Smart glasses identify and prompt the second misplaced item: If the smart glasses find that the EPC code of an item exists in the initial item list, but cannot be read by the RFID reader on the current shelf, the smart glasses will prompt the personnel with the picture and initial location of the "missing" item, and add it to the list of items to be found, in order to guide the personnel to actively search for it.

[0082] 3. Guided by smart glasses, personnel reposition the first misplaced item: (1) Smart Glasses Optimal Path Planning: For the first misplaced item identified by the smart glasses, the glasses utilize their built-in positioning module (such as GPS, Wi-Fi fingerprint positioning, or visual SLAM) to obtain the current location of the person in real time. Combining the current location of the first misplaced item with its correct initial location, the smart glasses invoke an optimized path planning algorithm to calculate the shortest or optimal return path from the item's current location to its initial location. This path takes into account actual environmental factors such as aisles between shelves and obstacles to ensure efficient movement of personnel.

[0083] (2) Smart glasses provide augmented reality (AR) guidance: The planned return path is presented in an intuitive augmented reality (AR) manner on the smart glasses' display screen. For example, the smart glasses can overlay virtual arrows in the user's field of vision, highlight the current and target locations of goods, or display a virtual model of the goods above them, instructing the user to move them to the correct location. Users can simply follow the AR instructions provided by the smart glasses, freeing their hands and efficiently moving goods to the correct location without having to look down at paper lists or handheld devices.

[0084] (3) Real-time feedback and error correction from smart glasses: During the personnel's return to their designated positions, the smart glasses continuously monitor the changes in the position of the goods. If the personnel deviate from the planned path, the smart glasses will immediately issue visual (e.g., a red warning box) and auditory (e.g., a voice prompt "Please pay attention to the direction") warnings and automatically recalculate the path. Once the goods are successfully placed in their initial positions, the smart glasses will confirm successful return through visual (e.g., a green highlight, and a "Return successful" text prompt) and auditory (e.g., a prompt sound) feedback, automatically remove the goods from the list of items to be returned, and update the system's inventory information.

[0085] 4. Guided by smart glasses, personnel locate and reposition misplaced items: (1) Smart glasses activate item-finding mode: When a second misplaced item is found, the smart glasses will guide the user into item-finding mode. The smart glasses' display screen will show an image of the second misplaced item and its initial location information, and prompt the user to begin the search. The user can then move within the area according to the instructions from the smart glasses.

[0086] (2) Smart Glasses-Assisted Image Recognition and RFID Signal Tracking: During the search process, the smart glasses' camera captures a real-time image stream within the person's field of vision. The built-in image recognition module of the smart glasses analyzes the images in real time to identify potential items within the person's field of vision. Simultaneously, the built-in RFID reader continuously and actively transmits signals and receives weak signals from the second misplaced item (if its RFID tag is still valid). Based on the changes in the received RFID signal strength (a stronger signal indicates a closer distance) and the image recognition results, the smart glasses determine the relative distance and direction between the person and the second misplaced item.

[0087] (3) Smart glasses provide directional guidance: The smart glasses will guide people to move towards the second misaligned item through dynamic indicators on the display screen (such as signal strength bars, arrows pointing in the direction of the target, and distance display) or voice prompts (such as "a little to the left" or "signal strengthening"). People can gradually approach the target item based on these intuitive prompts. When the image recognition module of the smart glasses successfully identifies the target item and the RFID signal strength reaches the preset threshold, the smart glasses will immediately issue a "found" prompt and highlight the item in the field of vision.

[0088] (4) Dynamic Detection and Path Optimization of Smart Glasses: This is a key innovation. While personnel are searching for a second misplaced item or repositioning a first misplaced item, the smart glasses continuously collect images within the personnel's field of vision in real time and perform image recognition. The purpose is to detect other second misplaced items that have not been located by RFID without the personnel's notice. Once the smart glasses detect a new second misplaced item, the system immediately records its current location (through image recognition or close-range reading by the smart glasses' own RFID reader), adds it to the pending list, and simultaneously alerts the personnel.

[0089] (5) Smart glasses guide the handling of a single misplaced item: If there is only one misplaced item, once its current location is successfully found and identified through image recognition or near-field RFID reading, the smart glasses will immediately plan the shortest return path based on its current location and initial location, and guide the person to return the item in AR mode.

[0090] (6) Smart glasses guide the handling of multiple misplaced items: If there are multiple misplaced items, the smart glasses will not immediately guide the items back to their original positions after finding the first one. Instead, it will record the current positions of all misplaced items identified during the search process. Once all (or a preset number) misplaced items have been identified and located, the smart glasses will plan an optimal sequential repositioning path (e.g., considering the shortest total path or the fewest moves) based on the current and initial positions of these items, as well as their relative positions, guiding the person to efficiently reposition all the misplaced items.

[0091] (7) Smart Glasses Integrated Path Planning: The most intelligent aspect of this invention lies in its integrated path planning capability. During the process of personnel returning the first misplaced item, if the smart glasses dynamically detect a new second misplaced item, the system will not simply interrupt the current task. It will immediately perform a global integrated path planning based on the personnel's current location, the initial and current locations of the newly discovered second misplaced item, and the current and initial locations of all unplaced first misplaced items. This new path will consider the priority, distance, and type of all items to be returned, to achieve the most efficient and time-saving return strategy overall, avoiding repeated routes or omissions, and maximizing personnel work efficiency.

[0092] 5. System Architecture and Data Flow: (1) Data Acquisition Layer: This includes shelf RFID readers and smart glasses worn by personnel (with built-in RFID readers, cameras, and positioning modules). It is responsible for real-time acquisition of RFID information of goods, image data, and personnel location data.

[0093] (2) Data Processing Layer: Located on the local or cloud server of the smart glasses. It is responsible for preprocessing the collected data, RFID positioning comparison, image recognition (goods recognition, posture estimation), path planning algorithm calculation (A*, Dijkstra, genetic algorithm, etc.), and dynamic task scheduling and optimization.

[0094] (3) Data storage layer: Central database, which stores basic information of goods (EPC, initial location, pictures), historical return records, shelf layout diagram, RFID reader network topology, etc.

[0095] (4) Human interaction layer: The display screen and voice module of the smart glasses. Through augmented reality (AR) interface, text prompts, graphic indicators and voice commands, intuitive return guidance and real-time feedback are provided to the human body.

[0096] (5) Communication module: responsible for data transmission between smart glasses, shelf RFID readers, and central server, supporting multiple communication methods such as Wi-Fi, Bluetooth, and 5G to ensure the real-time performance and stability of data transmission.

[0097] 6. Safety and reliability considerations: (1) Data encryption: All data transmitted between devices and servers should be encrypted to prevent information leakage.

[0098] (2) Access control: The system should have a strict user access control mechanism to ensure that only authorized personnel can perform the return operation and access the data.

[0099] (3) Fault tolerance: When the RFID tag is damaged or the reader fails, the system can automatically switch to the image recognition-based item finding mode to ensure continuous operation of the system.

[0100] (4) Tag anti-collision: Advanced RFID anti-collision algorithm is adopted to ensure that all tags can be read accurately in dense goods areas.

[0101] (5) Image recognition robustness: The image recognition model should be trained for complex environments such as different lighting, angles, and occlusions to improve recognition accuracy and robustness.

[0102] 7. Future scalability: (1) Multi-user collaboration: Supports multiple people to perform the return operation at the same time. The system can coordinate the tasks of different people, avoid conflicts and optimize overall efficiency.

[0103] (2) Robot integration: In the future, it can be integrated with AGV (Automated Guided Vehicle) or drone to realize the automated placement of some goods or large-scale item retrieval, further reducing the burden on personnel.

[0104] (3) Data analysis and optimization: Through in-depth analysis of the data of the return process, the path planning algorithm, recognition model and shelf layout are continuously optimized to further improve the system performance.

[0105] (4) Inventory counting function: During the return process, inventory counting can be carried out at the same time, improving the efficiency and accuracy of inventory counting and providing more comprehensive assistance to personnel.

[0106] Figure 4 This is a schematic diagram of a repositioning device based on misplaced goods, provided for one or more embodiments of this specification. A first radio frequency identification reader is installed on the shelf. The device is applied to smart glasses and includes: a scanning unit 401, a comparison unit 402, a determination unit 403, and a repositioning unit 404.

[0107] The scanning unit 401, in response to a user wearing smart glasses to reposition misplaced goods, performs area scanning through the first RFID reader / writer to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods, and transmits the RFID tag information of all goods to the smart glasses. The comparison unit 402 compares the current radio frequency identification (RFID) positioning information corresponding to each received identification code with the pre-stored initial RFID positioning information corresponding to each identification code. If the current RFID positioning information of the specified goods is inconsistent with the initial RFID positioning information of the specified goods, the determination unit 403 determines that the misalignment type of the specified goods is misplacement. The homing unit 404 determines a homing path based on the current RFID positioning information and the initial RFID positioning information of the specified goods, so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0108] Figure 5 This specification provides a schematic diagram of a repositioning device for misplaced goods, as shown in one or more embodiments. A first RFID reader is installed on the shelf. The device is applied to smart glasses and includes: At least one processor and bus; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to: In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods and the current RFID positioning information of the corresponding goods. The system then transmits the RFID tag information of all goods to the smart glasses. The current RFID positioning information corresponding to each received identification code is compared with the initial RFID positioning information corresponding to each pre-stored identification code. If the current RFID positioning information of a specified item is inconsistent with the initial RFID positioning information of the specified item, then the misalignment type of the specified item is determined to be misplacement of the item. Based on the current RFID location information and the initial RFID location information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf location corresponding to the initial RFID location information of the specified goods according to the return path.

[0109] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the embodiments of apparatus, devices, and non-volatile computer storage media are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0110] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0111] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0112] In the embodiments provided in this application, it should be understood that the disclosed apparatus / network devices and methods can be implemented in other ways. For example, the apparatus / network device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0113] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0114] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The aforementioned units can be implemented in hardware or software.

[0115] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electrical carrier signals and telecommunication signals.

[0116] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for returning misplaced goods based on misplaced goods, characterized in that, The first radio frequency identification read-write device is arranged on the shelf, and the method is applied to the smart glasses end and includes the following steps: In response to the user wearing the smart glasses to arrange the misplaced goods, the first radio frequency identification read-write device is used for area scanning, so as to read the radio frequency identification tag information of all goods in a specified range through the first radio frequency identification read-write device, and the radio frequency identification tag information includes the identification code of the corresponding goods and the current radio frequency identification positioning information of the corresponding goods, and the radio frequency identification tag information of all goods is transmitted to the smart glasses. The current radio frequency identification positioning information corresponding to each identification code is compared with the initial radio frequency identification positioning information corresponding to each identification code which is stored in advance. If the current radio frequency identification positioning information of the specified goods is inconsistent with the initial radio frequency identification positioning information of the specified goods, it is determined that the type of the misplaced goods is the goods placement misplacement. Based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, the arrangement path is determined, so that the user moves the specified goods to the shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the arrangement path.

2. The method of claim 1, wherein, The second radio frequency identification read-write device is arranged in the smart glasses, and the area scanning through the first radio frequency identification read-write device to read the radio frequency identification tag information of all goods in a specified range includes the following steps: The second radio frequency identification read-write device triggers the first radio frequency identification read-write device to perform area scanning, so as to read the radio frequency identification tag information of all goods in a specified range through the first radio frequency identification read-write device.

3. The method of claim 1, wherein, The determination of the arrangement path based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods includes the following steps: Real-time position information of the user is obtained. The environment information of the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods is obtained. Based on the real-time position information, the environment information, the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, the arrangement path is determined.

4. The method of claim 1, wherein, After the arrangement path is determined based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, the method further includes the following steps: The smart glasses generate the indication information of the arrangement path through the extended reality technology, and display the corresponding indication information in real time through the display screen of the smart glasses.

5. The method of claim 1, wherein, The method further includes the following steps: The smart glasses monitor the arrangement path in real time. If the user deviates from the arrangement path during the movement, the smart glasses issue a deviation warning to the user, and the latest arrangement path is determined again.

6. The method of claim 1, wherein, ​ ​ If the current product image of a specific product is inconsistent with the initial product image of the specific product, it is determined that the misplacement type of the specific product is product placement misplacement.

7. The method of claim 1, wherein, The misplacement type further includes product absence; and the method further includes: During the guiding process of the homing path by the extended reality technology of the smart glasses, product images within a preset range are collected, and the product images are identified to obtain a plurality of to-be-inspected identification codes; The plurality of to-be-inspected identification codes are compared with an identification code list of the misplacement type of product absence which is written in advance; If it is determined that the misplacement type of a product corresponding to a specified to-be-inspected identification code is product absence, radio frequency identification positioning information corresponding to the product of the specified to-be-inspected identification code is recorded, so as to homing the product of the specified to-be-inspected identification code based on the radio frequency identification positioning information.

8. The method of claim 1, wherein, If the specific product is a plurality of misplacement products, the homing path is determined based on the current radio frequency identification positioning information of the specific product and the initial radio frequency identification positioning information of the specific product, including: A list of all misplacement products is obtained, the list including an identification code, current radio frequency identification positioning information and initial radio frequency identification positioning information of each misplacement product; Based on real-time position information of the user and the current radio frequency identification positioning information of each misplacement product, real-time distances from the user to current positions of each misplacement product are calculated, and an initial product processing sequence is generated according to the real-time distances; Combined with shelf environment layout information and the initial product processing sequence, a homing path of each misplacement product is generated.

9. A device for homing based on misplacement of goods, characterized in that, A first radio frequency identification read-write device is arranged on a shelf, and the device is applied to a smart glasses end, including: A scanning unit, in response to a user wearing smart glasses to homing misplacement products, performs area scanning through the first radio frequency identification read-write device, so as to read radio frequency identification tag information of all products within a specified range through the first radio frequency identification read-write device, the radio frequency identification tag information including an identification code of a corresponding product and current radio frequency identification positioning information of the corresponding product, and the radio frequency identification tag information of all products is transmitted to the smart glasses; A comparison unit compares the current radio frequency identification positioning information corresponding to each identification code received with the initial radio frequency identification positioning information corresponding to each identification code stored in advance; A determination unit, if the current radio frequency identification positioning information of a specific product is inconsistent with the initial radio frequency identification positioning information of the specific product, determines that the misplacement type of the specific product is product placement misplacement; A homing unit determines a homing path based on the current radio frequency identification positioning information of the specific product and the initial radio frequency identification positioning information of the specific product, so that the user moves the specific product to a shelf position corresponding to the initial radio frequency identification positioning information of the specific product according to the homing path.

10. A homing device based on misplacement of goods, characterized in that, A first radio frequency identification read-write device is arranged on a shelf, and the device is applied to a smart glasses end, including: At least one processor and a bus; and A memory in communication connection with the at least one processor; wherein The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to: In response to the user wearing the smart glasses to align the misaligned goods, the first radio frequency identification reader is used to perform area scanning, so as to read the radio frequency identification tag information of all goods in a specified range through the first radio frequency identification reader, the radio frequency identification tag information including an identification code of the corresponding goods and current radio frequency identification positioning information of the corresponding goods, and the radio frequency identification tag information of all goods is transmitted to the smart glasses; The current radio frequency identification positioning information corresponding to each identification code received is compared with the initial radio frequency identification positioning information corresponding to each identification code stored in advance; If the current radio frequency identification positioning information of the specified goods is inconsistent with the initial radio frequency identification positioning information of the specified goods, it is determined that the misalignment type of the specified goods is goods placement misalignment; Based on the current radio frequency identification positioning information of the specified goods and the initial radio frequency identification positioning information of the specified goods, an alignment path is determined, so that the user moves the specified goods to the shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the alignment path.

Images