Goods homing method, device and equipment based on goods missing

Abstract

The invention discloses a goods returning method, device and equipment based on goods missing, and the method comprises the steps: responding to a situation that a user wears intelligent glasses to return staggered goods, carrying out the region scanning through a first radio frequency identification reader-writer, and reading the radio frequency identification tag information of all goods in a designated range through first radio frequency identification; comparing whether the received identification codes of all the goods are consistent with a pre-stored identification code list within a specified range or not; if the identification code of the specified goods is not in the identification code list, judging that the dislocation type of the specified goods is goods missing; determining actual radio frequency identification position information of the specified goods in a preset range; and determining a homing path based on the actual radio frequency identification positioning information of the specified goods and pre-stored initial radio frequency identification positioning information of the specified goods, so that a user moves the specified goods to a shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the homing path.

Description

TECHNICAL FIELD

[0001] The present application relates to the warehouse management technical field, and in particular to a goods homing method, device and equipment based on goods loss. BACKGROUND

[0002] In the modern retail, warehousing and logistics industry, the accurate management of goods is the key to improving operational efficiency and optimizing customer experience. In large supermarkets, warehouses and other places, goods on shelves often appear to be misplaced, missing or placed in the wrong area due to customer selection, staff negligence and other reasons, which is called the "goods misplacement" problem. Among them, "goods loss" is a common but particularly troublesome type of misplacement, which specifically refers to goods not being placed in their originally designated shelf location, but may be left in a shopping cart, other shelf area or a corner of the mall.

[0003] Currently, for the management of goods misplacement, most rely on staff to conduct visual inspection and inventory of shelves at regular intervals. This method is not only inefficient, time-consuming and labor-intensive, but also extremely prone to missed detection due to fatigue and negligence, and cannot achieve real-time misplacement detection and processing. SUMMARY

[0004] One or more embodiments of the present specification provide a goods homing method, device and equipment based on goods loss, to solve the technical problems proposed in the background.

[0005] One or more embodiments of the present specification adopt the following technical solutions: A goods homing method based on goods loss provided by one or more embodiments of the present specification, a first radio frequency identification reader is arranged on a shelf, the method is applied to an intelligent glasses end, and includes: In response to a user wearing intelligent glasses homing a mislocated goods, scanning an area through the first radio frequency identification reader, so as to read radio frequency identification tag information of all goods in a specified range through the first radio frequency identification reader, the radio frequency identification tag information includes an identification code of the corresponding goods, and transmit the radio frequency identification tag information of all goods to the intelligent glasses; Compare the received identification codes of all goods with a pre-stored identification code list in the specified range to determine whether they are consistent; If the identification code of the specified goods is not in the identification code list, it is determined that the misplacement type of the specified goods is goods loss; Determine the actual radio frequency identification location information of the specified goods within a preset range; determine a homing path based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, so as to move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0006] It should be noted that the present application realizes real-time detection and accurate homing guidance for goods missing problems by combining smart glasses with RFID technology, thereby effectively solving the problems of low efficiency, high missing rate and delayed processing inherent in traditional manual visual inspection and inventory. Specifically, when the user wears smart glasses to operate, the first RFID reader is used to scan the area, automatically collect the tag information of all goods, and compare it with the correct list stored locally in real time. Once the missing goods are identified, the system can dynamically determine the actual position of the goods through the augmented reality technology and generate the optimal homing path to visually guide the user to quickly and accurately put the goods back to the correct position. This process not only greatly reduces the time and energy consumption of manual investigation, but also significantly improves the real-time and accuracy of goods management, thereby optimizing the overall operational efficiency and customer experience, and avoiding sales losses or inventory chaos caused by goods misplacement.

[0007] Further, the smart glasses are built-in with a second RFID reader, which is used to trigger the first RFID reader to scan the area, so as to read the RFID tag information of all goods within a specified range through the first RFID reader, including: The second RFID reader triggers the first RFID reader to scan the area, so as to read the RFID tag information of all goods within a specified range through the first RFID reader.

[0008] Further, the RFID tag information further includes pictures of each goods; The actual RFID positioning information of the specified goods within the predetermined range includes: Issue a search instruction so that the user moves based on the search instruction, and the search instruction includes a moving direction indication; The camera of the smart glasses real-time collects image streams of the predetermined range and performs real-time identification on the image streams; If the picture of the specified goods is identified, the actual RFID positioning information of the specified goods is determined.

[0009] It should be noted that the present application introduces the product picture information and the visual recognition ability of the smart glasses in the method, and the system realizes the accurate visual search and positioning of the missing products, thereby greatly improving the finding efficiency and accuracy in complex environment. Specifically, when the system determines that a product is missing through the radio frequency identification technology, the smart glasses will send a dynamic moving direction indication to the user to guide the user to move purposefully within a predetermined range. At the same time, the camera of the glasses continuously collects the environmental image stream, and matches the picture of the missing product through real-time image recognition technology. Once the identification is successful, the actual position of the product can be immediately locked. This process combines the wide range monitoring ability of the radio frequency identification technology and the fine identification ability of the computer vision, so that the user does not need to search blindly, and the position ambiguity problem caused by relying on the radio frequency signal strength positioning alone is avoided, thereby significantly shortening the search time, reducing the operation difficulty, and ensuring that the product can be quickly and reliably returned to the position, further enhancing the intelligence and humanization level of the overall product management process.

[0010] Further, the sending of the finding indication so as to cause the user to move based on the finding indication comprises: continuously sending signals to the specified product by the second radio frequency identification reader and receiving feedback signals from the specified product; determining direction information of the specified product based on the feedback signals; sending a finding indication based on the direction information so as to cause the user to move based on the finding indication.

[0011] It should be noted that the present application actively transmits and receives radio frequency signals through the smart glasses to determine the direction of the missing product in the method, and the system realizes real-time and dynamic guidance of the user's search process, thereby significantly improving the intuitiveness and operation efficiency of product positioning. Specifically, when it is determined that a product is missing, the built-in reader of the smart glasses will continuously send signals to the target product and receive its feedback, and the accurate direction of the product relative to the user is calculated in real time by analyzing the signal characteristics (such as signal strength or phase difference); then, the glasses immediately convert this direction information into intuitive visual or auditory indications (such as arrows or pointing light spots), guiding the user to move in the correct direction. This process seamlessly combines the non-contact direction finding ability of radio frequency technology with the interactive ability of smart glasses, so that the user does not need to rely on his own sense of direction or search blindly, but quickly approaches the target under the continuous update of accurate guidance, effectively avoiding the difficulty of finding in complex environment due to visual obstruction or hidden products, greatly shortening the search time and reducing the operation burden, and further ensuring the smoothness and reliability of the entire return process.

[0012] Further, the radio frequency identification tag information further comprises pictures of each product; The method comprises the following steps: The second radio frequency identification reader continuously emits signals to the specified goods and receives feedback signals from the specified goods; The direction information of the specified goods is determined based on the feedback signals; Based on the direction information, a search instruction is issued so that the user moves based on the search instruction and detects the strength value of the feedback signal in real time; If the strength value of the feedback signal reaches a preset threshold, an image stream of a preset range is collected, and the image stream is identified in real time; If the goods picture of the specified goods is identified, the actual radio frequency identification positioning information of the specified goods is determined.

[0013] It should be noted that the present application is based on the cooperative mechanism of triggering image recognition by radio frequency signal strength threshold in the method. The system realizes intelligent switching of coarse positioning and fine positioning in the missing goods searching process, thereby significantly improving the efficiency and accuracy of the searching operation. Specifically, when the user moves according to the direction instruction provided by the smart glasses, the system continuously monitors the strength of the radio frequency feedback signal, and only when the signal strength reaches a preset threshold (indicating that the user has approached the target goods), the camera is automatically activated for image collection and real-time identification. This design makes the system not need to rely on high-energy image processing all the time, but starts visual matching at a key distance, and finally confirms the identity and position through the goods picture. This phased positioning strategy effectively combines the wide-range orientation advantage of radio frequency technology and the accurate identification ability of visual technology, avoiding the instability and resource consumption of image recognition at a long distance, and preventing the near miss caused by relying solely on radio frequency signals. The user can quickly approach the target under efficient guidance and ensure the absolute accuracy of the operation through visual verification in the final link, thereby significantly reducing the complexity and uncertainty of the searching process and improving the intelligence and reliability of the overall homing process.

[0014] Further, the method further comprises: During the guiding process of the homing path by the extended reality technology of the smart glasses, the goods images in a preset range are collected, and the goods images are identified to obtain a plurality of to-be-detected identification codes; The plurality of to-be-detected identification codes are compared with an identification code list of the mislocation type of goods missing which is written in advance; If it is determined that the mislocation type of the goods corresponding to the specified to-be-detected identification code is goods missing, the radio frequency identification positioning information of the goods corresponding to the specified to-be-detected identification code is recorded, so as to homing the goods corresponding to the specified to-be-detected identification code based on the radio frequency identification positioning information.

[0015] It should be noted that the present application is based on the method of synchronously identifying the product image and detecting the misplacement in the path guiding process, and the system realizes the intelligent fusion of the homing operation and the dynamic inspection, thereby significantly improving the comprehensiveness and efficiency of the product management. Specifically, when the user moves along the guided path of the extended reality technology, the smart glasses continuously collect the surrounding product images and identify multiple identification codes in real time. By comparing them with the pre-stored missing product list, the system can automatically find and record the current location information of other potential missing products. This process converts a single homing task into a continuous dynamic inspection, so that the user can detect and record other misplacement products simultaneously without additional time or resource investment while completing the main goal. This not only avoids the necessity of subsequent repeated inspection, but also significantly enhances the overall response capability of the system to complex misplacement situations, thereby further improving the coherence and intelligent level of the product management process on the basis of optimizing the efficiency of single operation.

[0016] Further, the method further comprises: determining whether the number of missing products is multiple; If not, after determining the actual radio frequency identification location information of the specified product, the homing path is determined based on the actual radio frequency identification location information of the specified product and the pre-stored initial radio frequency identification location information of the specified product.

[0017] It should be noted that the present application is based on the method of synchronously identifying the product image and detecting the misplacement in the path guiding process, and the system realizes the intelligent fusion of the homing operation and the dynamic inspection, thereby significantly improving the comprehensiveness and efficiency of the product management. Specifically, when the user moves along the guided path of the extended reality technology, the smart glasses continuously collect the surrounding product images and identify multiple identification codes in real time. By comparing them with the pre-stored missing product list, the system can automatically find and record the current location information of other potential missing products. This process converts a single homing task into a continuous dynamic inspection, so that the user can detect and record other misplacement products simultaneously without additional time or resource investment while completing the main goal. This not only avoids the necessity of subsequent repeated inspection, but also significantly enhances the overall response capability of the system to complex misplacement situations, thereby further improving the coherence and intelligent level of the product management process on the basis of optimizing the efficiency of single operation.

[0018] Further, if the number of missing products is multiple, the method further comprises: determining the remaining products of the misplacement type of missing products; determine actual radio frequency identification positioning information corresponding to the remaining goods respectively; determine the homing path based on the actual radio frequency identification positioning information of the specified goods, the pre-stored initial radio frequency identification positioning information of the specified goods, the actual radio frequency identification positioning information corresponding to the remaining goods respectively, and the pre-stored initial radio frequency identification positioning information corresponding to the remaining goods respectively.

[0019] It should be noted that, based on the method, when multiple missing goods are detected, the system can synchronously acquire the actual and initial position information of all missing goods and perform unified path planning. The method realizes efficient collaborative processing of complex misplacement scenarios, thereby significantly improving the overall efficiency and resource utilization of multi-task homing. Specifically, when the system identifies that there are multiple missing goods, instead of processing a single target in isolation, the real-time positions and original shelf positions of all related goods are actively collected, and an optimal path that can link multiple homing tasks is calculated based on these comprehensive information. This global path planning enables the user to complete the homing of all goods in sequence through a coherent and reasonable moving route without repeatedly going back and forth between different goods or processing each task individually, thereby greatly reducing unnecessary walking distance and operation time, and reducing human errors or omissions that may be caused by multiple target switching. Thus, on the basis of ensuring accuracy, the allocation of human resources and time cost is further optimized, and the ability of the system to deal with batch misplacement problems and the overall operational intelligence level are enhanced.

[0020] One or more embodiments of the present specification provide a goods homing device based on goods missing, a first radio frequency identification reader-writer is arranged on a shelf, the device is applied to an intelligent glasses end, and comprises: A scanning unit, in response to a user wearing intelligent glasses homing misplaced goods, performs area scanning through the first radio frequency identification reader-writer, so as to read radio frequency identification tag information of all goods in a specified range through the first radio frequency identification reader-writer, the radio frequency identification tag information includes an identification code of corresponding goods, and the radio frequency identification tag information of all goods is transmitted to the intelligent glasses; A comparison unit compares whether the received identification codes of all goods are consistent with a pre-stored identification code list in the specified range; A determination unit determines that the misplacement type of the specified goods is goods missing if the identification code of the specified goods is not in the identification code list; A determination unit determines actual radio frequency identification position information of the specified goods within a preset range; The homing unit determines a homing path based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, so as to move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0021] The one or more embodiments of the present specification provide a goods homing device based on goods loss, a first RFID reader-writer is arranged on a shelf, the device is applied to an intelligent glasses end, and the device comprises: at least one processor and a bus; and a memory in communication connection with the at least one processor; wherein The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to: In response to a user wearing intelligent glasses to homing misplaced goods, the first RFID reader-writer is used for area scanning, so as to read RFID tag information of all goods in a specified range through the first RFID reader-writer, the RFID tag information comprises an identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the intelligent glasses; Compare whether the received identification codes of all goods are consistent with a pre-stored identification code list in the specified range; If the identification code of the specified goods is not in the identification code list, it is determined that the type of the misplaced goods is goods loss; Determine the actual RFID position information of the specified goods within a preset range; Based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, a homing path is determined, so that the user moves the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

[0022] The above at least one technical solution adopted by the embodiments of the present specification can achieve the following beneficial effects: The application realizes real-time detection and accurate guiding of the missing goods problem by combining smart glasses with radio frequency identification technology, thereby effectively solving the problems of low efficiency, high missed detection rate and delayed processing inherent in traditional manual visual inspection and counting. Specifically, when the user wears smart glasses to operate, the first radio frequency identification read-write device performs area scanning, automatically collects the label information of all goods, and compares it with the correct list stored locally in real time. Once the missing goods are identified, the system can dynamically determine the actual location of the goods through the augmented reality technology and generate the optimal homing path to visually guide the user to quickly and accurately put the goods back to the correct position. This process not only greatly reduces the time and energy consumption of manual investigation, but also significantly improves the real-time and accuracy of goods management, thereby optimizing the overall operation efficiency and customer experience, and avoiding sales losses or inventory chaos caused by misplacement of goods. BRIEF DESCRIPTION OF DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present specification or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the present specification, and those skilled in the art can also obtain other drawings according to these drawings without creative labor. In the drawings: Figure 1 An application environment diagram of a goods homing method based on goods missing provided by one or more embodiments of the present specification; Figure 2 A flowchart of a goods homing method based on goods missing provided by one or more embodiments of the present specification; Figure 3 A flowchart of a goods actual radio frequency identification location information determination method provided by one or more embodiments of the present specification; Figure 4 A structural diagram of a goods homing device based on goods missing provided by one or more embodiments of the present specification; Figure 5 A structural diagram of a goods homing device based on goods missing provided by one or more embodiments of the present specification. DETAILED DESCRIPTION

[0024] The embodiments of the present specification provide a goods homing method, device and equipment based on goods missing.

[0025] In order for those skilled in the art to better understand the technical solutions in the specification, the technical solutions in the specification will be clearly and completely described in the specification below in combination with the drawings in the specification. Obviously, the described embodiments are only part of the embodiments of the specification, not all. Based on the embodiments of the specification, all other embodiments obtained by those skilled in the art without creative labor should be within the protection scope of the specification.

[0026] The scheme of the present application can be applied in the goods homing scene of the goods homing terminal. Figure 1 An application environment diagram of a goods homing method based on goods loss provided by an embodiment of the specification is shown in FIG. 1. Figure 1 As shown in FIG. 1, the terminal 102 communicates with the server 103 through a network. The data storage system 101 can store data required to be processed by the server 103. The data storage system 101 can be integrated on the server 103, or placed on a cloud or other network server. The terminal 102 can obtain historical behavior data of a user in different operation scenes and running states of an XR glasses; extract behavior common information of the user from the historical behavior data of the user in each operation scene; extract state common information of the XR glasses from the running states of the XR glasses in each operation scene; generate glasses habit states of the XR glasses in the operation scenes in combination with the behavior common information and the state common information; and associate the operation scenes with the glasses habit states to obtain behavior habit tags. Or the above process of constructing the tags is executed in the server 103, that is, the server obtains historical behavior data of a user in different operation scenes and running states of an XR glasses; extracts behavior common information of the user from the historical behavior data of the user in each operation scene; extracts state common information of the XR glasses from the running states of the XR glasses in each operation scene; generates glasses habit states of the XR glasses in the operation scenes in combination with the behavior common information and the state common information; and associates the operation scenes with the glasses habit states to obtain behavior habit tags.

[0027] The goods homing terminal can specifically include a smart phone, a smart home appliance, a tablet computer, a virtual reality headset (VR headset), an augmented reality glasses (AR glasses), an electronic display screen, a mixed reality (MR) device, and the like. The MR device can be MR glasses, an MR helmet, an MR camera, and the like. The vehicle-mounted system can be a vehicle-mounted chip, a vehicle-mounted device (for example, an in-vehicle infotainment, a vehicle-mounted computer, a sensor with a voice recognition function, and the like), and the like.

[0028] Figure 2A flowchart of a method for locating missing goods based on missing goods is provided for one or more embodiments of the present specification. A first radio frequency identification reader is provided on a shelf, and the flowchart is executed by a smart glasses end. Some input parameters or intermediate results in the flowchart allow manual intervention to adjust to help improve accuracy.

[0029] The method flow steps of the embodiments of the present specification are as follows: S201, in response to a user wearing smart glasses to locate misplaced goods, scanning the area by the first radio frequency identification reader to read the radio frequency identification tag information of all goods in the specified range by the first radio frequency identification reader, the radio frequency identification tag information including the identification code of the corresponding goods, and transmitting the radio frequency identification tag information of all goods to the smart glasses.

[0030] In the embodiments of the present specification, the user wearing smart glasses starts to perform the task of locating goods. The smart glasses are built-in with a second radio frequency identification reader, which is activated to send a trigger instruction to the first radio frequency identification reader on the target shelf area. The instruction wakes up the first radio frequency identification reader to perform a round of radio frequency scanning on the specified shelf area covered by its own antenna. The first radio frequency identification reader reads the radio frequency identification tags attached to all goods in the area, obtains the tag information including the unique identification code of each good, and then sends the data packet of all the read tags back to the smart glasses.

[0031] S202, compare all the received identification codes of the goods with the pre-stored identification code list in the specified range to see if they are consistent.

[0032] In the embodiments of the present specification, after the smart glasses receive all the identification codes of the goods from the first radio frequency identification reader, they call the locally stored database. The database stores the list of identification codes of goods that each shelf area should have in theory. The system compares the real-time identification code list just scanned with the locally stored standard identification code list of the area one by one to check if they are completely consistent.

[0033] S203, if the identification code of the specified goods is not in the identification code list, it is determined that the type of misplacement of the specified goods is missing goods.

[0034] In the embodiments of the present specification, after the comparison is completed, the system analyzes. If it is found that a certain identification code existing in the standard list stored locally does not appear in the real-time identification code list just scanned, the system determines that the goods have been misplaced. Since the goods do not appear in the shelf area where they should be, the type of misplacement of the goods is determined to be "missing goods".

[0035] S204, determining the actual radio frequency identification position information of the specified goods within a preset range.

[0036] In the embodiments of the present application, after determining that a certain goods is missing, the system starts a search program. The smart glasses use the integrated second radio frequency identification reader to continuously search for the radio frequency identification tag signal of the missing goods within a certain signal receiving range (preset range). By analyzing the received radio frequency signal characteristics, the smart glasses calculate and determine the actual position coordinate information of the missing goods in the physical space.

[0037] S205, determining a homing path based on the actual radio frequency identification positioning information of the specified goods and the pre-stored initial radio frequency identification positioning information of the specified goods, so that the user moves the specified goods to the shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the homing path.

[0038] In the embodiments of the present application, the system calls the local database to obtain the correct shelf position coordinates (initial radio frequency identification positioning information) to which the missing goods originally belongs. Then, the system path planning module calculates an optimal physical movement path according to the real-time position of the missing goods and its target position. This planned path is superimposed and displayed in the user's real field of view in the form of virtual arrows, highlighted paths or similar navigation indications through the extended reality technology of the smart glasses. The user carries or absent goods along the path according to the visual guidance in the field of view, and finally places it back to the correct shelf position, completing the homing.

[0039] It should be noted that the present application realizes real-time detection and accurate homing guidance for goods missing problem through the combination of smart glasses and radio frequency identification technology, thereby effectively solving the problems of low efficiency, high omission rate and delayed processing inherent in traditional manual visual inspection and counting. Specifically, when the user wears smart glasses to operate, the first radio frequency identification reader performs area scanning to automatically collect the tag information of all goods and compare it with the correct list stored locally in real time; once the missing goods are identified, the system can dynamically determine the actual position of the goods and generate an optimal homing path through the extended reality technology, to visually guide the user to quickly and accurately place the goods back to the correct position. This process not only greatly reduces the time and energy consumption of manual investigation, but also significantly improves the real-time and accuracy of goods management, thereby optimizing the overall operation efficiency and customer experience, and avoiding sales loss or inventory confusion caused by goods misplacement.

[0040] Further, the radio frequency identification tag information further includes pictures of each goods; when determining the actual radio frequency identification position information of the specified goods within a preset range, the pictures of each goods can be referred to. Figure 3A flowchart of the method for determining the actual RFID location information of the goods is shown, which can be executed by the smart glasses. Some input parameters or intermediate results in the flow allow manual intervention to adjust to help improve accuracy.

[0041] The method flow steps of the embodiments of the present specification are as follows: S301, an indication is issued to find, so that the user moves based on the finding indication, and the finding prompt includes a moving direction indication.

[0042] S302, the image stream of the preset range is collected in real time by the camera of the smart glasses, and the image stream is identified in real time.

[0043] S303, if the goods picture of the specified goods is identified, the actual RFID positioning information of the specified goods is determined.

[0044] It should be noted that for the above flow, when the actual RFID location information of the specified goods is determined by the smart glasses, a cooperative search process is started by the system. First, the smart glasses will issue a finding indication to the user, which is based on the analysis of the radio frequency signal to present in the form of a clear moving direction indication (such as displaying an arrow or a light spot in the extended reality interface) to guide the user to move to the area with stronger signal. In this process, the camera of the smart glasses is activated to continuously collect the image stream within the current field of view of the user. The system analyzes the collected real-time image stream in real time, and uses image recognition algorithms to compare the items in the picture with the picture of the target goods. When the image recognition algorithm successfully identifies the visual features matching the goods picture of the target goods in the image stream, the system determines that the target has been found, and then calculates the accurate actual RFID positioning information (such as coordinates) of the goods in combination with the radio frequency signal data at that moment, and completes the positioning.

[0045] It should be noted that the present application introduces the product picture information and the visual recognition ability of the smart glasses into the method, and the system realizes accurate visual search and positioning of the missing products, thereby greatly improving the finding efficiency and accuracy in complex environments. Specifically, when the system determines that a product is missing through radio frequency identification technology, the smart glasses will send a dynamic moving direction indication to the user, guiding the user to move purposefully within a predetermined range. At the same time, the camera of the glasses continuously collects environmental image streams and matches the picture of the missing product through real-time image recognition technology. Once the identification is successful, the actual position of the product can be immediately locked. This process combines the wide-range monitoring ability of radio frequency identification technology with the fine identification ability of computer vision, so that the user does not need to search blindly, and the location ambiguity problem that may be caused by relying solely on radio frequency signal strength positioning is avoided, thereby significantly shortening the search time, reducing the operation difficulty, and ensuring that the product can be quickly and reliably returned to the position, further enhancing the intelligence and humanization level of the overall product management process.

[0046] Further, when the user moves based on the finding indication, the second radio frequency identification reader can continuously emit signals to the specified product and receive feedback signals from the specified product, determine the direction information of the specified product based on the feedback signals, and emit the finding indication based on the direction information.

[0047] It should be noted that when it is necessary to send a finding indication to the user through the smart glasses, the system starts an active radio frequency detection process. The radio frequency identification reader built-in the smart glasses starts to continuously emit radio frequency signals to the radio frequency identification tag of the target product (i.e. the specified product determined to be missing). The tag is activated and returns a feedback signal. The radio frequency identification reader of the smart glasses continuously receives and analyzes this feedback signal. The system calculates the direction information of the target product relative to the current position of the user in real time according to the characteristics of the received feedback signal. The smart glasses then use this direction information to send a clear finding indication to the user through its display interface (such as an augmented reality superimposed arrow) or audio prompt, guiding the user to move in the calculated direction to approach the target product.

[0048] It should be noted that the present application is based on the method of actively transmitting and receiving radio frequency signals through smart glasses to determine the direction of missing goods, and the system realizes real-time and dynamic guidance of the user's search process, thereby significantly improving the intuitiveness and operation efficiency of goods positioning. Specifically, when it is determined that the goods are missing, the built-in reader / writer of the smart glasses will continuously transmit signals to the target goods and receive feedback therefrom, and the accurate direction of the goods relative to the user is calculated in real time by analyzing the signal characteristics (such as signal strength or phase difference); then, the glasses immediately convert this direction information into intuitive visual or auditory indications (such as arrows or pointing light spots), guiding the user to move in the correct direction. This process seamlessly combines the non-contact direction finding capability of radio frequency technology with the interactive capability of smart glasses, so that the user does not need to rely on his own sense of direction or conduct blind search, but quickly approaches the target under the continuous updating of accurate guidance, effectively avoiding the difficulty of finding in complex environment due to visual obstruction or hidden goods, greatly shortening the search time and reducing the operation burden, and further ensuring the smoothness and reliability of the entire homing process.

[0049] Further, the radio frequency identification tag information further includes pictures of each goods; when determining the actual radio frequency identification position information of the specified goods within the preset range, the second radio frequency identification reader / writer can continuously actively transmit signals to the specified goods and receive feedback signals from the specified goods; the direction information of the specified goods is determined based on the feedback signals; the search indication is issued based on the direction information, so that the user moves based on the search indication, and the strength value of the feedback signal is detected in real time; if the strength value of the feedback signal reaches a preset threshold, an image stream of the preset range is collected, and the image stream is identified in real time; if the picture of the specified goods is identified, the actual radio frequency identification position information of the specified goods is determined.

[0050] It should be noted that when the actual radio frequency identification position information of the specified goods is determined through the smart glasses, the system can start a phased cooperative positioning process. First, the radio frequency identification reader / writer built-in the smart glasses will continuously actively transmit signals to the radio frequency identification tag of the target specified goods and receive feedback signals from the tag. The system calculates the direction information of the target goods relative to the current position of the user in real time based on the received feedback signals. The smart glasses immediately use the direction information to issue a search indication (such as a directional visual arrow) to the user through its display interface, guiding the user to move in that direction to gradually approach the target goods. During this movement, the system synchronously monitors and analyzes the strength value of the received feedback signal. When the system detects that the strength value of the feedback signal is enhanced and reaches a preset threshold (indicating that the user is close enough to the target goods), the next operation is automatically triggered.

[0051] Once triggered, the smart glasses immediately start its camera to collect image stream within the current preset visual field of the user. The system analyzes the collected real-time image stream instantly, and uses image recognition algorithm to compare the objects in the picture with the target goods picture. If the image recognition algorithm successfully identifies the visual object in the image stream that matches the target goods picture, the system finally confirms that the target is found, and then calculates the accurate actual radio frequency identification positioning information of the goods combined with the radio frequency signal data at this moment, to complete the entire positioning process.

[0052] It should be noted that, based on the cooperative mechanism of triggering image recognition by radio frequency signal strength threshold in the method, the system realizes intelligent switching of coarse positioning and precise positioning in the missing goods finding process, thereby significantly improving the efficiency and accuracy of the finding operation. Specifically, when the user moves according to the direction indication provided by the smart glasses, the system continuously monitors the strength of the radio frequency feedback signal, and only when the signal strength reaches the preset threshold (indicating that the user has approached the target goods), the camera is automatically activated for image collection and real-time recognition. This design makes the system not need to rely on high energy consumption image processing all the time, but starts visual matching within the key distance, and finally confirms the identity and locks the position through the goods picture. This phased positioning strategy effectively combines the large-scale orientation advantage of radio frequency technology and the accurate recognition ability of visual technology, avoids the instability and resource consumption of image recognition at a long distance, and prevents the near miss caused by relying solely on radio frequency signals, so that the user can quickly approach the target under efficient guidance, and finally ensure the absolute accuracy of the operation through visual verification, thereby greatly reducing the complexity and uncertainty of the finding process, and improving the intelligence and reliability of the overall homing process.

[0053] Further, in the guidance process of the homing path through the extended reality technology of the smart glasses, the embodiment of the specification can collect goods images within a preset range, identify the goods images to obtain a plurality of to-be-detected identification codes, compare the plurality of to-be-detected identification codes with an identification code list of the mislocation type of goods missing written in advance, determine whether the mislocation type of the goods corresponding to a specified to-be-detected identification code is goods missing, record the radio frequency identification positioning information corresponding to the goods of the specified to-be-detected identification code, and then homing the goods of the specified to-be-detected identification code based on the radio frequency identification positioning information.

[0054] It should be noted that in the process of guiding the user to the homing path through the extended reality technology of the smart glasses, the system synchronously starts an auxiliary inspection process. The smart glasses will use its camera to continuously collect the images of goods within the current field of view (preset range) of the user. The system analyzes these real-time collected images of goods in real time, identifies one or more identification codes corresponding to the goods in the images through image recognition technology, and obtains a plurality of to-be-inspected identification codes.

[0055] Subsequently, the system compares these identified to-be-inspected identification codes with a specific list pre-written and stored locally. The list contains identification codes of all goods that have been determined to be mispositioned as “goods missing”.

[0056] During the comparison process, if the system finds that a specific to-be-inspected identification code exists in the above-mentioned “goods missing” identification code list, it indicates that the goods is a missing goods that has been recorded. The system will immediately record the current position information (i.e. the actual radio frequency identification positioning information) of the goods corresponding to the specified to-be-inspected identification code obtained through the radio frequency identification technology at this time.

[0057] The recorded positioning information will be saved so that the system can subsequently plan a path for the goods and guide the user or others to perform homing operations based on this information, just like handling the main homing task.

[0058] It should be noted that the embodiments of the present specification synchronize goods image recognition and misposition detection in the path guiding process based on the method, and the system realizes the intelligent integration of homing operation and dynamic inspection, thereby significantly improving the comprehensiveness and efficiency of goods management. Specifically, when the user moves along the guided path of the extended reality technology, the smart glasses will continuously collect the images of surrounding goods and identify a plurality of to-be-inspected identification codes in real time. By comparing them with the pre-stored missing goods list, the system can automatically find and record the current position information of other potential missing goods. This process converts a single homing task into a continuous dynamic inspection, enabling the user to detect and record other mispositioned goods simultaneously while completing the main goal without additional time or resource investment. This not only avoids the necessity of subsequent repeated inspection, but also significantly enhances the overall response capability of the system to complex mispositioning situations, thereby further improving the coherence and intelligent level of the goods management process on the basis of optimizing the efficiency of single operation.

[0059] Further, when determining the homing path based on the actual radio frequency identification positioning information of the specified goods and the pre-stored initial radio frequency identification positioning information of the specified goods, it can be judged whether the number of goods missing in the misplacement type is multiple; if not, after determining the actual radio frequency identification positioning information of the specified goods, the homing path is determined based on the actual radio frequency identification positioning information of the specified goods and the pre-stored initial radio frequency identification positioning information of the specified goods.

[0060] It should be noted that when the embodiment of the present application determines the homing path based on the actual radio frequency identification positioning information of the specified goods and the locally stored initial radio frequency identification positioning information, the system first performs a judgment step: whether the number of goods currently judged as the misplacement type of "goods missing" is multiple.

[0061] If not, that is, the system determines that only one piece of goods is confirmed as missing, the system will directly enter the path planning stage after successfully determining the actual radio frequency identification positioning information of the specified goods. At this time, the path planning module will separately calculate based on the two key information of the specified goods, the actual radio frequency identification positioning information it has just obtained and the initial radio frequency identification positioning information retrieved from the local database, to generate an optimal path to send the goods back to the homing target position from the current position of the goods.

[0062] If yes, that is, the system determines that there are multiple pieces of goods missing, the system can start a different processing logic. It will first determine the actual radio frequency identification positioning information of all goods judged as missing in turn. Subsequently, the path planning module will comprehensively optimize the global path based on the actual position information of all missing goods and their respective initial radio frequency identification positioning information, and finally generate a comprehensive optimal path that can efficiently complete the homing task of all goods.

[0063] It should be noted that the present application determines whether the number of missing goods is single based on the method, and generates a dedicated homing path for it after confirming that it is single. The system realizes rapid response and accurate processing for single misplacement, thereby significantly improving the operation efficiency and resource utilization rate in simple scenarios. Specifically, when the system detects that there is only one missing goods, it does not need to start a complex multi-target path planning algorithm, but directly calculates the optimal path based on the actual position and original position information of the goods, and provides clear and direct guidance to the user through extended reality technology. This simplified processing mode for single task avoids the calculation redundancy and operation delay that may be caused by multi-target scheduling, so that the user can quickly lock the target and complete the homing, reducing unnecessary intermediate steps and decision-making interference, thereby further optimizing the execution speed and overall process fluency while ensuring accuracy.

[0064] Further, if the dislocation type is multiple missing goods, the remaining goods of the dislocation type of missing goods are determined, actual radio frequency identification positioning information corresponding to the remaining goods is determined, and a homing path is determined based on the actual radio frequency identification positioning information of the specified goods, the pre-stored initial radio frequency identification positioning information of the specified goods, the actual radio frequency identification positioning information corresponding to the remaining goods, and the pre-stored initial radio frequency identification positioning information corresponding to the remaining goods.

[0065] It should be noted that the operation of determining the homing path when the system determines that there are multiple goods missing in the dislocation type in the embodiments of the present specification can be implemented in the following steps: Firstly, the system needs to complete the acquisition of the actual radio frequency identification positioning information of the currently specified primary target goods. Subsequently, the system will successively start the search and positioning process of all the remaining goods determined to be missing, and determine the actual radio frequency identification positioning information of each of the remaining goods.

[0066] After acquiring the actual positions of all the missing goods (including the specified goods and all the remaining goods), the system will retrieve the initial radio frequency identification positioning information corresponding to each of the goods from the local storage database.

[0067] The path planning module will comprehensively analyze all these information, i.e., the actual radio frequency identification positioning information of all the missing goods and their respective initial radio frequency identification positioning information, and perform global calculation. The module will analyze the spatial relationship between the current positions and target positions of all the goods, and finally plan to generate an optimal movement path that can efficiently connect multiple homing tasks and ultimately guide the user to successively return all the missing goods to the original positions.

[0068] It should be noted that based on the method, when multiple goods are missing, the system can simultaneously acquire the actual and initial position information of all the missing goods and perform unified path planning, which realizes efficient cooperative processing of complex dislocation scenarios, thereby significantly improving the overall efficiency and resource utilization of multi-task homing. Specifically, when the system identifies that there are multiple missing goods, instead of processing a single target in isolation, the real-time positions and original shelf positions of all related goods are actively collected, and an optimal path that can connect multiple homing tasks is calculated based on these comprehensive information. This global path planning enables the user to complete the homing of all goods in sequence through a coherent and reasonable movement route without repeatedly going back and forth between different goods or individually processing each task, thereby greatly reducing unnecessary walking distance and operation time, and reducing human errors or omissions caused by multiple target switching. Therefore, on the basis of ensuring accuracy, the allocation of human resources and time cost is further optimized, and the ability of the system to deal with batch dislocation problems and the overall operation intelligence level are enhanced.

[0069] Definitions of key terms: RFID (Radio Frequency Identification): A non-contact automatic identification technology that automatically identifies target objects and obtains related data through radio frequency signals.

[0070] Smart glasses: A wearable device that usually has display, camera, sensor and communication functions, and can provide users with extended reality (XR) experience.

[0071] First mispositioned goods: Goods that can be located by RFID readers, but whose current position is inconsistent with the initial correct placement position.

[0072] Second mispositioned goods: Goods that cannot be located by RFID readers on the shelf (for example, due to reasons such as exceeding the reading distance, RFID tag failure or falling off, etc.), which need to be actively found by users.

[0073] In modern warehousing, retail and other industries, accurate placement and quick homing of goods are the key to improving operational efficiency and reducing management costs. However, due to human error, customer random placement and other reasons, misplacement of goods is common. Traditional goods homing methods mainly rely on manual searching and memory, which is inefficient and prone to error, especially in cases where there are many types and large quantities of goods, the workload of searching and homing is huge, which seriously affects work efficiency and user experience. Although there are some automated or semi-automated warehouse management systems, there is still a lack of a perfect and intelligent solution for accurate positioning and efficient homing of mispositioned goods, especially for "missing" goods that cannot be directly located by RFID.

[0074] The present application provides an intelligent goods homing system and method, which is characterized by personnel wearing smart glasses, combining RFID technology and image recognition technology to realize accurate positioning of goods, intelligent path planning and effective recovery of "missing" goods, thereby greatly improving goods homing efficiency and reducing labor costs. The technical solution is as follows: 1. Personnel wear smart glasses and start the goods homing application. 2. The smart glasses obtain the current position information of the goods through the RFID reader on the shelf, and compare it with the pre-stored initial position information to distinguish the first mispositioned goods and the second mispositioned goods. (1) Smart glasses hardware configuration and data preloading: The smart glasses worn by personnel are equipped with an RFID reader, and pre-stored with initial placement pictures and RFID positioning information of goods. The shelf is also equipped with an RFID reader, forming a cooperative positioning network.

[0075] (2) Smart glasses assist personnel to identify misplaced goods: when personnel need to put goods in place, smart glasses will actively scan goods through RFID readers on the shelf, and according to the scanning results, smartly identify two types of misplaced goods, and prompt personnel through the display screen of smart glasses: (3) First misplaced goods: refers to goods that smart glasses can locate, but their current location is inconsistent with the initial correct placement position.

[0076] (4) Second misplaced goods: refers to goods that smart glasses cannot locate through RFID readers on the shelf (such as exceeding the reading distance, RFID tag failure or falling off, etc.), which need to be actively found by personnel.

[0077] 3. Smart glasses plan and guide the first misplaced goods to the correct position in AR mode; (1) Guide the first misplaced goods to the correct position: smart glasses will intelligently plan the optimal return path according to the current position of personnel, the initial position and current position of the first misplaced goods. Personnel intuitively move the goods to the correct position through augmented reality (AR) guidance on the smart glasses display screen.

[0078] 4. Smart glasses guide personnel to find the second misplaced goods by fusing RFID signals and image recognition, and plan and guide the return path after finding.

[0079] (1) Guide the second misplaced goods to find and return: during the process of personnel finding the second misplaced goods, smart glasses will continuously collect and identify images in the field of view of personnel, and combine the signal strength received by the built-in RFID reader of smart glasses to continuously prompt the direction of personnel. Once smart glasses identify the second misplaced goods, it will immediately prompt personnel through the display screen or voice, and plan the return path to guide personnel to complete the return.

[0080] 5. Smart glasses dynamically detect and optimize personnel return path: during the process of personnel returning the first misplaced goods, smart glasses will continuously collect and identify images in the field of view of personnel to detect whether there are second misplaced goods in the field of view of personnel. Once smart glasses find new second misplaced goods, the system will dynamically adjust and re-plan the overall return path according to the location of the newly found goods and the situation of the first misplaced goods that have not been returned, to maximize the efficiency of personnel return.

[0081] Corresponding to the above embodiments, the specific detailed implementation is as follows: The specific implementation of the multi-modal target positioning technology, the specific implementation of the present application, will detail how personnel wear and operate smart glasses, and complete goods return in combination with system functions.

[0082] 1. System initialization and data preparation: (1) RFID Tagging and Data Entry: Each item to be managed is tagged with an Ultra-High Frequency (UHF) RFID tag. These tags have a unique Global Identification Code (EPC). In the system's backend database, the administrator enters the EPC code for each item, its precise initial placement location (e.g., shelf number, layer number, specific coordinates, etc., which will be associated with the RFID positioning coordinates), and a clear image of the item. These item images will be used for subsequent image recognition comparison by the smart glasses.

[0083] (2) Fixed RFID Reader Network Deployment: Strategically install multiple fixed RFID readers on each shelf in the warehouse or retail area. These readers should cover the entire area of the shelf, forming a high-precision RFID positioning network. The readers are connected to the central server through wired or wireless means, uploading scan data in real time. The installation positions of the readers are optimized to minimize blind spots and signal interference.

[0084] (3) Smart Glasses Configuration and Personnel Training: The smart glasses worn by personnel are the core interactive devices of the entire system. They are equipped with high-resolution cameras, high-performance RFID readers (usually handheld or integrated), powerful processors, high-brightness display screens (supporting augmented reality display), and various communication modules. Before personnel start work, the smart glasses are pre-installed with the item management application and synchronized with the central server for all initial placement images and RFID positioning information of the items, ensuring partial operations even in poor network conditions. Personnel receive brief training on how to wear smart glasses, start the application, understand the AR guide interface, and follow voice prompts.

[0085] 2. Personnel Conducting Item Misplacement Detection and Classification via Smart Glasses: (1) Starting the Homing Operation: When warehouse administrators or store clerks find item misplacement and need to perform a homing operation, they simply wear smart glasses and start the pre-installed "item homing" application through simple voice commands or hand gestures. The smart glasses' display screen immediately displays the current task status and prompts the personnel to enter the area to be homed.

[0086] (2) Smart Glasses Assisted RFID Scanning and Data Comparison: After personnel enter the designated area, the smart glasses use their built-in RFID readers to actively trigger the fixed RFID readers on the shelves to perform area scanning. The shelf readers read the EPC codes of all item RFID tags within their coverage and transmit these data to the personnel's smart glasses in real time. The smart glasses' application cross-comparisons the received current item EPC codes and their corresponding RFID positioning information with the locally stored initial RFID positioning information of the items.

[0087] (3) Smart glasses identify and prompt the first misplaced goods: During the comparison process, if the smart glasses find that the EPC code of a certain goods is read in the current scanning data, but its current RFID positioning is inconsistent with the initial positioning recorded by the system, the smart glasses will immediately mark it as "first misplaced goods". The display screen of the smart glasses will show the picture, current position and correct initial position of the goods to the person in a prominent way (such as red frame, text prompt), and record its detailed information.

[0088] (4) Smart glasses identify and prompt the second misplaced goods: If the smart glasses find that the EPC code of a certain goods exists in the initial goods list, but fails to be read in the current shelf RFID reader scanning, the smart glasses will prompt the picture and initial position of the "missing" goods to the person, and list it in the list of goods to be found, ready to guide the person to actively find.

[0089] 3. Personnel return the first misplaced goods under the guidance of smart glasses: (1) Smart glasses plan the optimal path: For the first misplaced goods identified by the smart glasses, the smart glasses will use its built-in positioning module (such as GPS, Wi-Fi fingerprint positioning or visual SLAM) to obtain the current position of the person in real time. Combined with the current position of the first misplaced goods and its correct initial position, the smart glasses will call the optimized path planning algorithm to calculate a shortest or optimal return path from the current position of the goods to its initial position. This path will take into account the actual environmental factors such as the passage between shelves, obstacles, etc., to ensure efficient movement of the person.

[0090] (2) Smart glasses provide augmented reality (AR) guidance: The planned return path will be presented to the person's field of view through the display screen of the smart glasses in an intuitive augmented reality (AR) way. For example, the smart glasses can superimpose virtual arrows, highlight the current position and target position of the goods, or display a virtual goods model above the goods, indicating that the person moves it to the correct position. The person only needs to follow the AR instructions provided by the smart glasses, without needing to look down at paper lists or handheld devices, to free up both hands and efficiently move the goods to the correct position.

[0091] (3) Smart glasses provide real-time feedback and error correction: During the return process of the person, the smart glasses will continuously monitor the position change of the goods. If the person deviates from the planned path, the smart glasses will immediately issue a visual (such as a red warning frame) and auditory (such as a voice prompt "Please pay attention to direction") warning, and automatically recalculate the path. When the goods are successfully placed in the initial position by the person, the smart glasses will provide feedback through vision (such as green highlight display, "Return success" text prompt) and hearing (such as prompt sound) to confirm the success of the return, and automatically remove the goods from the list of goods to be returned, while updating the system inventory information.

[0092] 4. Personnel searching for misplaced items and returning to the second misplaced item under the guidance of smart glasses: (1) Smart glasses start searching mode: When there is a second misplaced item, the smart glasses will preferentially guide the personnel into the searching mode. The display screen of the smart glasses will display the picture and initial position information of the second misplaced item to be found, and prompt the personnel to start searching. Personnel can start moving in the area according to the instructions of the smart glasses.

[0093] (2) Smart glasses assist image recognition and RFID signal tracking: During the personnel searching process, the camera of the smart glasses will collect image streams in the field of view of the personnel in real time. The image recognition module built-in the smart glasses will analyze the images in real time to identify possible existing items in the field of view of the personnel. At the same time, the RFID reader built-in the smart glasses will continuously and actively emit signals and receive weak signals from the second misplaced item (if its RFID tag is still valid). The smart glasses will determine the relative distance and direction of the personnel and the second misplaced item according to the received RFID signal strength changes (the stronger the signal, the closer the distance), combined with the image recognition results.

[0094] (3) Smart glasses provide searching direction prompts: The smart glasses will guide the personnel to move in the direction of the second misplaced item through dynamic indicators on the display screen (such as signal strength bars, arrows pointing to the target direction, distance display) or voice prompts (such as "a little to the left", "signal enhancement"). Personnel can gradually approach the target item according to these intuitive prompts. When the image recognition module of the smart glasses successfully identifies the target item and the RFID signal strength reaches the preset threshold, the smart glasses will immediately issue a "found" prompt and highlight the item in the field of view.

[0095] (4) Smart glasses dynamic detection and path optimization: This is a key innovation. During the process of personnel searching for the second misplaced item or returning the first misplaced item, the smart glasses will continuously collect images in the field of view of the personnel and perform image recognition. The purpose is to inadvertently discover other second misplaced items that are not positioned by RFID. Once the smart glasses detect a new second misplaced item, the system will immediately record its current position (through image recognition or close-range reading by the RFID reader of the smart glasses) and add it to the to-do list, while prompting the personnel.

[0096] (5) Smart glasses guide single second misplaced item processing: If there is only one second misplaced item, once it is successfully found and its current position is identified through image recognition or close-range RFID reading, the smart glasses will immediately plan a shortest return path according to its current position and initial position, and guide the personnel to complete the return in AR mode.

[0097] (6) Smart glasses guide multiple second mislocated items processing: If there are multiple second mislocated items, the smart glasses will not guide the first one immediately after finding it. Instead, it will record the current positions of all second mislocated items identified during the staff's search process. When all (or a preset number of) second mislocated items are identified and located, the smart glasses will plan an optimal sequential homing path based on the current positions and initial positions of these items, as well as their relative positions, to guide the staff to efficiently complete the homing of all second mislocated items.

[0098] (7) Smart glasses comprehensive path planning: The most intelligent aspect of the invention is its comprehensive path planning capability. During the staff's homing of the first mislocated item, if the smart glasses dynamically detect a new second mislocated item, the system will not simply interrupt the current task. It will immediately re-plan a comprehensive path based on the staff's current position, the initial and current positions of the newly discovered second mislocated item, and the current and initial positions of all first mislocated items that have not yet been homed. This new path will consider the priorities, distances, and types of all items to be homed to achieve the most efficient and time-saving homing strategy overall, avoiding repeated routes or omissions, and maximizing staff efficiency.

[0099] 5. System architecture and data flow: (1) Data acquisition layer: including shelf RFID readers and staff-worn smart glasses (with built-in RFID readers, cameras, and positioning modules). Responsible for real-time acquisition of item RFID information, image data, and staff position data.

[0100] (2) Data processing layer: located in the smart glasses locally or on the cloud server. Responsible for pre-processing the collected data, RFID positioning comparison, image recognition (item recognition, pose estimation), path planning algorithm calculation (A*, Dijkstra, genetic algorithm, etc.), and dynamic task scheduling and optimization.

[0101] (3) Data storage layer: central database, storing item basic information (EPC, initial position, picture), historical homing records, shelf layout, RFID reader network topology, etc.

[0102] (4) Staff interaction layer: smart glasses display screen and voice module. Through augmented reality (AR) interface, text prompts, graphical indications, and voice instructions, provide intuitive homing guidance and real-time feedback for staff.

[0103] (5) Communication module: responsible for data transmission between smart glasses, shelf RFID readers, and central server, supporting Wi-Fi, Bluetooth, 5G, and other communication methods to ensure real-time and stable data transmission.

[0104] 6. Security and Reliability Considerations: (1) Data Encryption: All data transmitted between devices and servers should be encrypted to prevent information leakage.

[0105] (2) Permission Management: The system should have a strict user permission management mechanism to ensure that only authorized personnel can perform homing operations and data access.

[0106] (3) Fault Tolerance: When RFID tags are damaged or readers fail, the system can automatically switch to an image recognition-based search mode to ensure continuous operation.

[0107] (4) Tag Anti-collision: Advanced RFID anti-collision algorithms are used to ensure accurate reading of all tags in dense product areas.

[0108] (5) Image Recognition Robustness: Image recognition models should be trained for different lighting, angles, and occlusions in complex environments to improve recognition accuracy and robustness.

[0109] 7. Future Extensibility: (1) Multi-user Collaboration: Supports multiple personnel performing homing operations simultaneously, and the system can coordinate different personnel's tasks to avoid conflicts and optimize overall efficiency.

[0110] (2) Robot Integration: Future integration with AGV (Automatic Guided Vehicle) or drones can achieve automatic homing or large-scale search of some products, further reducing personnel burden.

[0111] (3) Data Analysis and Optimization: Through deep analysis of homing process data, continuously optimize path planning algorithms, recognition models, and shelf layouts to further improve system performance.

[0112] (4) Inventory Counting Function: During the homing process, inventory counting can be done simultaneously to improve counting efficiency and accuracy, providing more comprehensive assistance to personnel.

[0113] Figure 4 A structural diagram of a product homing device based on product loss is provided for one or more embodiments of the present specification, a first radio frequency identification reader is arranged on the shelf, the device is applied to the smart glasses end, comprising: a scanning unit 401, a comparison unit 402, a determination unit 403, a determination unit 404 and a homing unit 405.

[0114] The scanning unit 401, in response to the user wearing the smart glasses to position the misplaced goods, performs area scanning through the first radio frequency identification reader, so as to read the radio frequency identification tag information of all goods in the specified range through the first radio frequency identification reader, the radio frequency identification tag information including the identification code of the corresponding goods, and transmit the radio frequency identification tag information of all goods to the smart glasses; The comparison unit 402 compares whether the received identification codes of all goods are consistent with the pre-stored identification code list in the specified range; The determination unit 403 determines that the type of the misplaced goods is goods missing if the identification code of the specified goods is not in the identification code list. The determination unit 404 determines the actual radio frequency identification position information of the specified goods within a preset range; The positioning unit 405 determines the positioning path based on the actual radio frequency identification positioning information of the specified goods and the pre-stored initial radio frequency identification positioning information of the specified goods, so as to move the specified goods to the shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the positioning path.

[0115] Figure 5 A structural schematic diagram of a goods positioning device based on goods missing is provided for one or more embodiments of the present specification, a first radio frequency identification reader is arranged on a shelf, the device is applied to the smart glasses end, and includes: At least one processor and a bus; and, The memory is in communication connection with the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to: In response to the user wearing the smart glasses to position the misplaced goods, the first radio frequency identification reader performs area scanning, so as to read the radio frequency identification tag information of all goods in the specified range through the first radio frequency identification reader, the radio frequency identification tag information including the identification code of the corresponding goods, and transmit the radio frequency identification tag information of all goods to the smart glasses; Compare whether the received identification codes of all goods are consistent with the pre-stored identification code list in the specified range; If the identification code of the specified goods is not in the identification code list, it is determined that the type of the misplaced goods is goods missing. Determine the actual radio frequency identification position information of the specified goods within a preset range; Based on the actual radio frequency identification positioning information of the specified goods and the pre-stored initial radio frequency identification positioning information of the specified goods, a homing path is determined, so that the user moves the specified goods to the shelf position corresponding to the initial radio frequency identification positioning information of the specified goods according to the homing path.

[0116] Each of the embodiments in the specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the difference from other embodiments. In particular, for the device, equipment, and non-volatile computer storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0117] Each of the embodiments in the specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the difference from other embodiments. In particular, for the device, equipment, and non-volatile computer storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0118] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0119] In the embodiments provided in the present application, it should be understood that the disclosed apparatus / network device and method can be implemented by other manners. For example, the apparatus / network device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed each other can be through some interface, indirect coupling or communication connection between the devices or units, which can be electrical, mechanical or other forms.

[0120] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0121] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The above-mentioned units can be realized in the form of hardware or in the form of software.

[0122] The integrated module / unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on such understanding, all or part of the processes in the above-mentioned embodiment methods can also be completed by a computer program instructing related hardware, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of each method embodiment described above can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or some intermediate forms, etc. The computer-readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content included in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.

[0123] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. A method for relocating missing goods, characterized in that, A first radio frequency identification (RFID) reader / writer is installed on the shelf, and the method is applied to smart glasses, including: In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the smart glasses. Compare the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match; If the identification code of the specified product is not in the identification code list, the misalignment type of the specified product is determined to be product missing. Determine the actual radio frequency identification location information of the specified goods within a preset range; Based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the return path.

2. The method according to claim 1, characterized in that, The smart glasses have a built-in second RFID reader / writer. The first RFID reader / writer is used to scan an area, allowing the reader / writer to read the RFID tag information of all goods within a specified range. This includes: The second RFID reader triggers the first RFID reader to perform an area scan, so as to read the RFID tag information of all goods within the specified range through the first RFID reader.

3. The method according to claim 2, characterized in that, The RFID tag information also includes images of each product; Determining the actual RFID location information of the designated goods within a preset range includes: Issue a search instruction so that the user can move based on the search instruction, the search instruction including the direction of movement; The smart glasses' camera captures a stream of images within a preset range in real time and performs real-time recognition on the image stream. If the image of the specified goods is identified, the actual radio frequency identification (RFID) location information of the specified goods is determined.

4. The method according to claim 3, characterized in that, The step of issuing a search instruction so that the user can move based on the search instruction includes: The second radio frequency identification reader continuously and actively transmits signals to the designated goods and receives feedback signals from the designated goods. The orientation information of the designated goods is determined based on the feedback signal; Based on the directional information, a search instruction is issued so that the user can move according to the search instruction.

5. The method according to claim 2, characterized in that, The RFID tag information also includes images of each product; Determining the actual RFID location information of the designated goods within a preset range includes: The second radio frequency identification reader continuously and actively transmits signals to the designated goods and receives feedback signals from the designated goods. The orientation information of the designated goods is determined based on the feedback signal; Based on the directional information, a search instruction is issued so that the user can move according to the search instruction, and the strength value of the feedback signal is detected in real time; If the intensity value of the feedback signal reaches a preset threshold, an image stream within a preset range is acquired, and the image stream is identified in real time. If the image of the specified goods is identified, the actual radio frequency identification (RFID) location information of the specified goods is determined.

6. The method according to claim 1, characterized in that, The method further includes: During the process of guiding the return path using the extended reality technology of the smart glasses, images of goods within a preset range are collected and the images of goods are identified to obtain multiple identification codes to be inspected. The multiple identification codes to be inspected are compared with a pre-written list of identification codes whose misalignment type is missing goods. If the misalignment type of the goods corresponding to the specified inspection identification code is determined to be goods missing, the radio frequency identification (RFID) positioning information corresponding to the goods with the specified inspection identification code is recorded so that the goods with the specified inspection identification code can be repositioned based on the RFID positioning information.

7. The method according to claim 1, characterized in that, The step of determining the homing path based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods includes: Determine whether there are multiple items with the misalignment type of missing goods; If not, after determining the actual RFID location information of the specified goods, a homing path is determined based on the actual RFID location information of the specified goods and the pre-stored initial RFID location information of the specified goods.

8. The method according to claim 7, characterized in that, If the misalignment type involves multiple instances of missing goods, the method further includes: The misalignment type is determined to be the remaining goods where the goods are missing; Determine the actual radio frequency identification (RFID) location information corresponding to the remaining goods; Based on the actual RFID positioning information of the specified goods, the pre-stored initial RFID positioning information of the specified goods, the actual RFID positioning information of the remaining goods, and the pre-stored initial RFID positioning information of the remaining goods, a homing path is determined.

9. A goods return device based on missing goods, characterized in that, A first radio frequency identification (RFID) reader / writer is installed on the shelf. The device is used in smart glasses and includes: The scanning unit, in response to the user wearing smart glasses to reposition misplaced goods, performs area scanning through the first RFID reader / writer to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the smart glasses. The comparison unit compares the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match. If the identification code of the specified product is not in the identification code list, the determination unit determines that the misalignment type of the specified product is product missing. The determining unit determines the actual radio frequency identification location information of the designated goods within a preset range; The homing unit determines a homing path based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the homing path.

10. A goods return device based on missing goods, characterized in that, A first radio frequency identification (RFID) reader / writer is installed on the shelf. The device is used in smart glasses and includes: At least one processor and bus; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to: In response to a user wearing smart glasses to reposition misplaced goods, the system performs an area scan using the first RFID reader to read the RFID tag information of all goods within a specified range. The RFID tag information includes the identification code of the corresponding goods, and the RFID tag information of all goods is transmitted to the smart glasses. Compare the identification codes of all received goods with the pre-stored list of identification codes within the specified range to see if they match; If the identification code of the specified product is not in the identification code list, the misalignment type of the specified product is determined to be product missing. Determine the actual radio frequency identification location information of the specified goods within a preset range; Based on the actual RFID positioning information of the specified goods and the pre-stored initial RFID positioning information of the specified goods, a return path is determined so that the user can move the specified goods to the shelf position corresponding to the initial RFID positioning information of the specified goods according to the return path.

Images