A method and system for article access status detection

Abstract

The application relates to the technical field of cargo entry and exit detection systems, and provides a method for detecting the entry and exit state of articles, which comprises the following steps: S1: starting detection in response to a cabinet door opening instruction; S2: when a sensing detection module outputs a detection change signal, determining a detection change area where a state change occurs according to the detection change signal; the sensing detection module comprises magnetic sensors arranged in different detection areas and magnetic pieces that move with the articles; the detection change signal is generated by the magnetic sensors sensing the state change of the magnetic pieces; S3: acquiring a detection change image for the detection change area; S4: acquiring article information and an article access state based on the detection change image, and updating or recording the article information according to the article access state. Based on this, the real-time performance and detection accuracy of reading can be improved.

Description

Technical Field

[0001] This invention relates to the field of cargo entry and exit detection systems, and specifically to a method and system for detecting the entry and exit status of goods. Background Technology

[0002] Currently, with the development of smart retail, unmanned retail and other models, real-time detection of the entry and exit status of items in smart lockers and inventory management have become key links in improving operational efficiency.

[0003] In some applications, item detection technologies include two categories: weighing detection and RFID sensing identification. Weighing detection uses weight sensors installed on shelves or racks to determine the weight change caused by the removal and placement of items. RFID technology requires attaching an electronic tag to each item to track its movement via radio frequency identification. Weighing detection is susceptible to interference from environmental vibrations and temperature changes, leading to large detection errors and a high false positive rate, especially in vibrating environments such as refrigerated display cases where stability is poor. RFID technology requires a tag for each item and relies on a reader operating within a limited range; it often suffers from signal delays and missed reads, resulting in detection lag and affecting real-time performance and accuracy.

[0004] Therefore, this application studies a method for detecting the entry and exit status of items, which can improve the real-time performance of reading and the accuracy of detection. Summary of the Invention

[0005] In order to improve the real-time performance of reading and the accuracy of detection.

[0006] On the one hand, the method for detecting the entry and exit status of items provided in this application adopts the following technical solution:

[0007] A method for detecting the entry and exit status of items includes the following steps: S1: In response to the cabinet door opening command, initiate detection; S2: When a detection change signal is received from the sensing module, the detection change area where the state change has occurred is determined based on the detection change signal; the sensing module includes magnetic sensors disposed in different detection areas and magnetic components that move with the object; the detection change signal is generated by the magnetic sensors sensing the state change of the magnetic components. S3: For the detected change area, acquire the detected change image; S4: Based on the detected change image, obtain item information and item access status, and update or record the item information according to the item access status.

[0008] By adopting the above technical solution, the detection process is linked to the cabinet door status for triggering. A dual verification mechanism combining sensor detection module and visual recognition is used. Each magnetic sensor corresponds to a detection area. The magnetic sensor in a fixed position and the magnetic component that moves with the item provide a dynamic and static magnetic detection method with fast response speed and less susceptibility to environmental factors (vibration, temperature) interference, providing a foundation for high real-time performance and high stability. The image acquisition is triggered by the change signal of magnetic sensing, and a collaborative detection process is constructed to realize real-time detection and accurate identification of the item entry and exit status, thereby improving the real-time performance and detection accuracy of reading.

[0009] Optionally, in step S1, the open / closed state of the cabinet door is detected. When the cabinet door is detected to switch from the closed state to the open state, the cabinet door opening command is triggered and the sensing detection module is started.

[0010] By adopting the above technical solution, the accuracy and reliability of the detection initiation are ensured, false triggering is avoided, and the subsequent detection process is guaranteed to be carried out within the effective time period, thereby improving the detection accuracy and real-time performance.

[0011] Optionally, the magnetic sensor and the voltage divider module are connected one-to-one to form a voltage divider branch, and at least two sets of the voltage divider branches are connected in parallel to form a parallel voltage divider circuit.

[0012] By adopting the above technical solution and designing a parallel voltage divider circuit, the status of multiple sensors can be read with a small number of signal lines (ADC port), which significantly reduces the complexity of system wiring and the cost of controller interface, thus solving the problem of high cost of RFID technology.

[0013] Optionally, the following steps are included before step S3: S21: Receive cabinet door closing signal. When the cabinet door closing signal is received, step S3 is executed.

[0014] By adopting the above technical solution, the final confirmation step of visual recognition is delayed until the user has completed the operation. This effectively avoids image recognition misjudgment caused by intermediate states such as occlusion or item movement during the user's operation, further improving the accuracy of item information acquisition and status determination, and ensuring the reliability of settlement or inventory updates.

[0015] Optionally, step S4 specifically includes: S40: decomposing the detected change image to obtain a single-frame change image; S41: determining the item information and single-frame item access status based on the single-frame change image; S42: integrating the single-frame item access status corresponding to the same item information in all detection areas to obtain the final item access status, and outputting the final item access status as the item access status.

[0016] Optionally, in step S4, "updating and recording item information according to item storage and retrieval status" specifically means: if it is determined to be an item storage event, then the item category information and the corresponding storage location information are entered into the inventory database; if it is determined to be an item retrieval event, then the item category information is associated with a transaction order, and the inventory database is updated.

[0017] By adopting the above technical solutions, the detection events are accurately and automatically integrated with the back-end business logic (inventory management, transaction settlement), which improves the real-time performance and automation level of the entire management system, avoids manual intervention or delayed processing, and further solves the problem of settlement accuracy being affected by detection delays.

[0018] On the other hand, the system for detecting the entry and exit status of items provided in this application adopts the following technical solution: A system for detecting the entry and exit status of items, applied to the aforementioned method for detecting the entry and exit status of items.

[0019] Optionally, it includes a control module, and a cabinet door status detection module, a sensor detection module, a vision recognition module, and a communication module electrically connected to the control module.

[0020] Optionally, the magnetic component is mounted on a movable pusher, the movement trajectory of which passes through the detection area of ​​each of the magnetic sensors; it also includes an elastic reset component for driving the pusher to move after the item is removed.

[0021] In summary, this application includes the following beneficial technical effects: 1. By linking the detection process with the cabinet door status, a dual verification mechanism combining sensor detection module and visual recognition is adopted. The image acquisition is triggered by the change signal of magnetic sensing, and a collaborative detection process is constructed to realize the real-time detection and accurate identification of the entry and exit status of items, thereby improving the real-time performance and detection accuracy of reading. 2. Each magnetic sensor corresponds to a detection area. Magnetic sensors are not easily affected by vibration and temperature, which improves the stability and accuracy of detection. Through the design of parallel voltage divider circuit, the status of multiple sensors can be read with a small number of signal lines (ADC port), which significantly reduces the complexity of system wiring and controller interface cost, and solves the problem of high cost of RFID technology. 3. The combination of a fixed-position magnetic sensor and a magnetic component that moves with the object, along with the dynamic magnetic detection method, directly senses changes in the object through physical displacement. It has a fast response speed and is not easily affected by environmental factors (vibration, temperature), providing a foundation for high real-time performance and high stability in the sensing principle. Attached Figure Description

[0022] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other embodiments can be obtained based on these drawings without creative effort.

[0023] In the diagram: Figure 1 This is a flowchart of the item storage process in the method for detecting the entry and exit status of items according to an embodiment of this application; Figure 2 This is a flowchart of the article removal process in the article entry / exit status detection method of this application embodiment; Figure 3 This is a system diagram of a system for detecting the entry and exit status of items according to an embodiment of this application. Detailed Implementation

[0024] The following is in conjunction with the appendix Figure 1-3 This application will be described in further detail.

[0025] This application discloses a method for detecting the entry and exit status of items. (Refer to...) Figure 1 and Figure 2 The method for detecting the entry and exit status of items includes the following steps: S1: In response to the cabinet door opening command, start the detection.

[0026] Specifically, in step S1, the cabinet door opening command is generated by detecting the opening and closing status of the cabinet door through the cabinet door status detection module. When the cabinet door is detected to switch from the closed state to the open state, the cabinet door opening command is triggered and the sensor detection module is started, providing triggering conditions for real-time detection.

[0027] S2: When a detection change signal is received from the sensor detection module, the detection change area where the state change has occurred is determined based on the detection change signal; the sensor detection module includes magnetic sensors set in different detection areas and magnetic components that move with the object; the detection change signal is generated by the magnetic sensors sensing the state change of the magnetic components; In some embodiments, the magnetic sensor and the voltage divider module are connected one-to-one to form a voltage divider branch. The voltage divider module includes a voltage divider resistor. The magnetic sensor and the voltage divider resistor are connected in series. At least two voltage divider branches are connected in parallel to form a parallel voltage divider circuit.

[0028] Specifically, the magnetic sensors in different detection areas of the sensing module can be arrayed, based on a grid of N columns and M rows on the shelf. N and M can be equal or unequal, such as 5 columns and 8 rows. As items move along the column direction, one grid corresponds to one detection area, and one magnetic sensor is placed within each grid. The magnetic sensor can be a Hall sensor, reed switch, or magnetoresistive sensor. Each column of magnetic sensors forms a detection group. Each magnetic sensor in the same column is connected in series with an independent voltage divider module, forming an independent voltage divider branch. The outputs of the voltage divider branches in the same column are connected in parallel to form the column-level analog voltage signal output. Therefore, N columns of magnetic sensors only require N ADC interfaces, which can save costs.

[0029] A magnetic component is provided, which can be set on the push component. The push component moves with the item. When the item is taken out, the push component moves towards the front of the shelf. When the item is put in, the push component is pushed by the item to move towards the rear of the shelf. When the magnetic component moves with the item, the magnetic component passes through the sensing area of ​​the magnetic sensor at the corresponding position and triggers the magnetic sensor. When the magnetic sensor is triggered, the resistance state of the voltage divider branch where it is located changes, and the total voltage of the parallel output points of the column undergoes a specific and unique jump.

[0030] The control module continuously collects analog voltage signals from each column. When a voltage change in a certain column is detected, the module can decode and determine which voltage divider branch has changed by querying the pre-stored "voltage-position mapping table", thus determining the detection change area.

[0031] S3: For the detected change area, acquire the detected change image; Based on the detection change area determined by S2, the control module controls the visual recognition module, such as a camera, to acquire an image of the detection change area. The acquired image is the detection change image.

[0032] In some embodiments, the following step is included before step S3: S21: Receive a cabinet door closing signal. When the cabinet door closing signal is received, step S3 is executed. After S2, the control module continues to monitor the cabinet door status and only triggers the visual recognition step after confirming that the cabinet door is closed, so as to avoid interference during the operation process.

[0033] S4: Based on the detected changes in the image, obtain item information and item storage / retrieval status, and update and record the item information according to the item storage / retrieval status. If an item appears in the image from nothing, it is determined as an item storage event; if it disappears from something, it is determined as an item retrieval event.

[0034] In some embodiments, step S4 specifically includes: S40: decomposing the detected change image to obtain a single-frame change image; S41: determining the item information and the single-frame item access status based on the single-frame change image; S42: integrating the single-frame item access status corresponding to the same item information in all detection areas to obtain the final item access status, and outputting the final item access status as the item access status.

[0035] In some embodiments, step S4, "updating and recording item information according to item storage and retrieval status" specifically means: if it is determined to be an item storage event, then the item category information and the corresponding storage location information are entered into the inventory database; if it is determined to be an item retrieval event, then the item category information is associated with a transaction order, and the inventory database is updated.

[0036] The implementation principle of a method for detecting the entry and exit status of items in this application embodiment is as follows: the detection process is triggered by association with the cabinet door status, and a dual verification mechanism combining sensor detection module and visual recognition is adopted. Each magnetic sensor corresponds to a detection area. The magnetic sensor with a fixed position and the magnetic component that moves with the item provide a dynamic and static magnetic detection method with fast response speed and less susceptibility to environmental factors (vibration, temperature) interference, providing a foundation for high real-time performance and high stability. The image acquisition is triggered by the change signal of magnetic sensing, and a collaborative detection process is constructed to realize the real-time detection and accurate identification of the entry and exit status of items, thereby improving the real-time performance and detection accuracy of reading.

[0037] This application also discloses a system for detecting the entry and exit status of items. The system for detecting the entry and exit status of items is applied to the aforementioned method for detecting the entry and exit status of items.

[0038] In some embodiments, the system includes a control module, and a cabinet door status detection module, a sensor detection module, a vision recognition module, and a communication module electrically connected to the control module.

[0039] The control module is responsible for process control and signal processing, the cabinet door status detection module provides the control module with trigger signals for opening and closing the cabinet door, the sensor detection module is used to determine the detection change area, and the vision recognition module is used to acquire images under control commands.

[0040] The control module responds to the cabinet door opening command by activating the sensor detection module. Based on the received detection change signal, it determines the area of ​​state change. The control module then controls the visual recognition module to acquire images of the detected change area. The acquired images are recognized to obtain item information and determine the item's storage or retrieval status. Based on the determined item storage or retrieval status, the control module inputs the item information to the corresponding inventory or transaction management system via the communication module. The inventory or transaction management system can be a remote intelligent management cloud platform, enabling inventory synchronization, event reporting, and remote management.

[0041] This embodiment also includes an indicator module, a control module, and a power module, all of which are connected to the control module. The indicator module is used to provide visual feedback on the system status, such as using LEDs, to provide feedback on normal operation, successful item storage or retrieval, fault alarms, and other operations. The control module includes physical buttons for local operation. The power module provides a reliable operating voltage for the system.

[0042] In some embodiments, a magnetic element is mounted on a movable pusher, which abuts against an article, and the movement trajectory of the pusher passes through the detection areas of each magnetic sensor; an elastic reset element is also included to drive the pusher to move after the article is removed. When an article is inserted, the article causes the pusher to move, which in turn causes a coil spring to unfold; when the article is removed, the coil spring resets, causing the pusher to push the article.

[0043] Specifically, this can be applied to shelves inside smart cabinets, such as smart cabinets, smart refrigerators, smart freezers, air curtain cabinets, or smart vending machines. The elastic reset element is a coil spring. Items and the pushing element move along each column of the shelf's grid. One end of the coil spring is installed at the front end of the shelf, and the other end is set on the pushing element and moves with it. When an item is added, it is pushed towards the rear of the shelf, thereby moving the pushing element backward and causing the coil spring to unfold. When an item is removed, the coil spring resets, causing the pushing element to push the item forward.

[0044] The above are exemplary embodiments disclosed in this invention. However, it should be noted that various changes and modifications can be made without departing from the scope of the embodiments of this invention as defined by the claims. The functions, steps, and / or actions of the methods according to the disclosed embodiments described herein do not need to be performed in any particular order. Furthermore, although the elements disclosed in the embodiments of this invention may be described or claimed individually, they may be understood as multiple unless explicitly limited to a singular number.

[0045] It should be understood that, as used herein, the singular form "a" is intended to include the plural form as well, unless the context clearly supports an exception. It should also be understood that, as used herein, "and / or" refers to any and all possible combinations of one or more of the associatedly listed items. The embodiment numbers disclosed above are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0046] Those skilled in the art should understand that the discussion of any of the above embodiments is merely exemplary and is not intended to imply that the scope of the invention (including the claims) is limited to these examples. Within the framework of the invention, technical features of the above embodiments or different embodiments can be combined, and many other variations of different aspects of the invention exist, which are not provided in the details for the sake of brevity. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the invention should be included within the protection scope of the invention.

Claims

1. A method for detecting the entry and exit status of items, characterized in that: Includes the following steps: S1: In response to the cabinet door opening command, initiate detection; S2: When a detection change signal is received from the sensing module, the detection change area where the state change has occurred is determined based on the detection change signal; the sensing module includes magnetic sensors disposed in different detection areas and magnetic components that move with the object; the detection change signal is generated by the magnetic sensors sensing the state change of the magnetic components. S3: For the detected change area, acquire the detected change image; S4: Based on the detected change image, obtain item information and item access status, and update or record the item information according to the item access status.

2. The method for detecting the entry and exit status of items according to claim 1, characterized in that: In step S1, the open / closed state of the cabinet door is detected. When the cabinet door is detected to switch from the closed state to the open state, the cabinet door opening command is triggered and the sensing detection module is started.

3. The method for detecting the entry and exit status of items according to claim 1, characterized in that: The magnetic sensor and the voltage divider module are connected one-to-one to form a voltage divider branch, and at least two sets of the voltage divider branches are connected in parallel to form a parallel voltage divider circuit.

4. The method for detecting the entry and exit status of items according to claim 1, characterized in that: Before step S3, The process includes the following steps: S21: Receive the cabinet door closing signal. When the cabinet door closing signal is received, execute step S3.

5. The method for detecting the entry and exit status of items according to claim 1, characterized in that: Step S4 specifically includes: S40: Decompose the detected change image to obtain a single-frame change image; S41: Determine the item information and the single-frame item access status based on the single-frame changed image; S42: Integrate the single-frame item access states corresponding to the same item information in all detection areas to obtain the final item access state, and output the final item access state as the item access state.

6. The method for detecting the entry and exit status of items according to claim 1, characterized in that: In step S4, "updating and recording item information according to item storage and retrieval status" specifically means: if it is determined to be an item storage event, then the item category information and the corresponding storage location information are entered into the inventory database; If an event is determined to be an item retrieval event, the item category information is associated with a transaction order, and the inventory database is updated.

7. A system for detecting the entry and exit status of items, characterized in that: Applied to a method for detecting the entry and exit status of items as described in any one of claims 1-6.

8. A system for detecting the entry and exit status of items according to claim 7, characterized in that: It includes a control module, as well as a cabinet door status detection module, a sensor detection module, a vision recognition module, and a communication module that are electrically connected to the control module.

9. A system for detecting the entry and exit status of items according to claim 7, characterized in that: The magnetic component is mounted on a movable pusher, the movement trajectory of which passes through the detection areas of each of the magnetic sensors; it also includes an elastic reset component for driving the pusher to move after the item is removed.

Images