Mailbox item access monitoring method, apparatus, and storage medium

Abstract

The application discloses a mailbox article access monitoring method and device and a storage medium. The method comprises the following steps: acquiring first pressure change data of a first time period through a pressure sensor; determining whether a preset triggering condition of a preset event is met according to the first pressure change data; if yes, acquiring second pressure change data of a second time period through the pressure sensor; the starting moment of the second time period is later than the ending moment of the first time period; taking a picture at a preset moment through a camera to obtain a live image; the preset moment is not earlier than the ending moment of the second time period; determining target event correlation information of the preset event according to the second pressure change data; generating a structured storage log according to the target event correlation information and the live image, and storing the structured storage log. The application can ensure reliable identification of access behavior and traceable evidence of access disputes.

Description

Technical Field

[0001] This application relates to the field of email security technology, specifically to a method, device, and storage medium for monitoring the access to items in an email mailbox. Background Technology

[0002] With the advancement of digital transformation in postal services, smart shared mailboxes are gradually becoming an important component of urban last-mile delivery systems. They address the pain points of traditional private mailboxes, such as small capacity, inability to receive packages, and lack of unattended access, leading to their increasingly widespread adoption. However, unlike traditional closed private mailboxes, smart shared mailboxes need to support multiple users taking turns accessing the contents (e.g., delivery by couriers, self-collection by users), requiring no staff supervision throughout the process. Therefore, accurate perception of changes in the contents of the mailbox, reliable identification of access behavior, and traceable evidence of disputes are the core technical issues determining the product's practicality.

[0003] Currently, the main approach to sensing the internal status of smart mailboxes is through independent video surveillance. While this solution can acquire visual information, it also has significant drawbacks. Specifically, smart shared mailboxes are installed outdoors in complex lighting environments, and the image quality of the cameras is greatly affected by light. In low-light conditions at night or in backlit scenes, the images are blurry, or even completely unable to identify objects, posing a risk of functional failure. At the same time, due to the limitations of the internal space of the mailbox and the installation location of the camera, blind spots are unavoidable. For example, when items are placed in a corner or obstructed by the user's hand, no effective images can be obtained. In the event of a dispute over access and the need to retrieve evidence, independent video surveillance, if it suffers from obstruction, insufficient light, or blind spots, cannot capture key access images, thus failing to provide valid evidence.

[0004] Therefore, it is urgent to solve the problem of how to provide a solution for intelligent shared mailboxes that accurately perceives changes in the contents of the mailbox, reliably identifies access behavior, and provides traceable evidence for access disputes. Summary of the Invention

[0005] This application provides a method, device, and storage medium for monitoring the access to items in a mailbox. It can provide a solution for accurately perceiving changes in items inside a smart shared mailbox, reliably identifying access behavior, and providing traceable evidence for access disputes.

[0006] In a first aspect, embodiments of this application provide a method for monitoring the access of items inside a mailbox, applied to a control module in a smart mailbox. The smart mailbox further includes a pressure sensor and a camera. The pressure sensor is disposed at the bottom of the smart mailbox; the pressure sensor includes a pressure distribution thin-film sensor; the camera is disposed inside the smart mailbox; the method includes: The pressure sensor acquires first pressure change data over a first time period. Based on the first pressure change data, determine whether the preset triggering conditions of the preset event are met; the preset event includes any of the following: object placement event, object removal event, object replacement event; If so, the pressure change data for the second time period is acquired through the pressure sensor; the start time of the second time period is later than the end time of the first time period. The camera takes a picture at a preset time to obtain a scene image; the preset time is not earlier than the end time of the second time period. Based on the second pressure change data, the target event association information of the preset event is determined, and the target event association information includes at least one of the following: event type, object type, and object weight; A structured storage log is generated based on the target event association information and the on-site image, and the structured storage log is stored.

[0007] Secondly, embodiments of this application provide a device for monitoring the storage and retrieval of items inside a mailbox, applied to a control module in a smart mailbox. The smart mailbox further includes a pressure sensor and a camera. The pressure sensor is disposed at the bottom of the smart mailbox; the pressure sensor includes a pressure distribution thin-film sensor; the camera is disposed inside the smart mailbox; the device includes: The acquisition unit is used to acquire first pressure change data over a first time period through the pressure sensor; The judgment unit is used to determine whether the preset triggering conditions of the preset event are met based on the first pressure change data; the preset event includes any one of the following: object placement event, object removal event, object replacement event; The acquisition unit is further configured to acquire second pressure change data for a second time period through the pressure sensor if the judgment result of the judgment unit is yes; the start time of the second time period is later than the end time of the first time period. The camera unit is used to take a picture at a preset time to obtain a scene image; the preset time is not earlier than the end time of the second time period. The determining unit is configured to determine the target event association information of the preset event based on the second pressure change data, wherein the target event association information includes at least one of the following: event type, object type, and object weight; The generation unit is used to generate a structured storage log based on the target event association information and the scene image, and to store the structured storage log.

[0008] Thirdly, embodiments of this application provide an electronic device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for performing the steps in the first aspect of embodiments of this application.

[0009] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program for electronic data interchange, wherein the computer program causes a computer to perform some or all of the steps described in the first aspect of embodiments of this application.

[0010] Fifthly, embodiments of this application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in the first aspect of embodiments of this application. The computer program product may be a software installation package.

[0011] Implementing the embodiments of this application has the following beneficial effects: As can be seen, the mailbox item access monitoring method, device, and storage medium described in this application embodiment firstly collects first pressure change data for a first time period using a pressure distribution film sensor installed at the bottom of the mailbox to complete a pre-judgment of a preset event. This allows for precise differentiation of three different events: item placement, removal, and replacement, based on pressure change characteristics. Then, after the pre-judgment is triggered, second pressure change data for a second time period is collected, and after the second time period ends, a camera is activated to capture images of the scene. This not only supplements the pressure sensing judgment with visual verification information but also reduces the camera's operating frequency through step-by-step triggering logic, extending the lifespan of the smart mailbox. By extending the battery life of the smart mailbox and reducing cloud storage resource consumption, it can also extract related information such as event type, item weight, and item type by combining second-pressure change data. Combined with on-site images, it generates structured storage logs, which not only allows users to easily review mailbox usage records and verify item retrieval and delivery status at any time, but also provides traceable evidence for abnormal retrieval and misdelivery issues. While ensuring the accuracy of smart mailbox status recognition, it can also optimize hardware power consumption and storage efficiency, improve the intelligence and traceability of smart mailbox retrieval and delivery management, and thus achieve functions such as accurate perception of changes in items inside the mailbox, reliable identification of storage and retrieval behavior, and traceable evidence of storage and retrieval disputes. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 This is a schematic diagram of the structure of a smart mailbox provided in an embodiment of this application; Figure 2 This is another structural schematic diagram of a smart mailbox provided in an embodiment of this application; Figure 3 This is another structural schematic diagram of a smart mailbox provided in an embodiment of this application; Figure 4 This is a flowchart illustrating a method for monitoring the storage and retrieval of items in a mailbox, as provided in an embodiment of this application. Figure 5 This is another flowchart illustrating a method for monitoring the storage and retrieval of items in a mailbox, as provided in an embodiment of this application. Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application; Figure 7 This is a block diagram of the functional units of a mailbox item access monitoring device provided in an embodiment of this application. Detailed Implementation

[0014] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0015] The terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0016] It should be understood that the term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this document indicates that the preceding and following related objects are in an "or" relationship. In the embodiments of this application, "multiple" refers to two or more.

[0017] In the embodiments of this application, "at least one item" or its similar expression refers to any combination of these items, including any combination of a single item or a plurality of items. "One or more" means one or more, while "multiple" means two or more. For example, "at least one item" of a, b, or c can represent the following seven cases: a, b, c; a and b; a and c; b and c; a, b, and c. Each of a, b, and c can be an element or a set containing one or more elements.

[0018] In this application, the term "connection" refers to various connection methods, such as direct connection or indirect connection, to achieve communication between devices. This application does not impose any limitations on this.

[0019] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0020] The following is an explanation of the relevant terms used in this application: The "object placement event" specifically refers to the placement of a new object (such as mail or parcel) inside the smart mailbox. The pressure sensor will detect an increase in overall pressure at the bottom of the mailbox and an expansion of the pressure distribution range. For example, when the first pressure change data meets the preset pressure increase threshold, the event can be triggered, and a notification of "new mail / parcel has been delivered" can also be pushed to the user.

[0021] The "object removal event" can specifically refer to the complete removal of an object that was originally placed in the smart mailbox. In response, the pressure sensor will detect a significant drop in the overall pressure at the bottom of the mailbox. For example, it can be triggered when the first pressure change data meets a preset pressure reduction threshold.

[0022] Among them, the "object replacement event" can specifically refer to the original object being removed and a new object being placed in it, or it can also refer to the original object being directly replaced with a new object. The pressure sensor will detect the continuous change of pressure first decreasing and then increasing, and the final pressure value and the initial pressure value have a stable difference. It is triggered after meeting the preset change pattern and is mostly used in scenarios such as taking old and putting new in express delivery and exchanging letters.

[0023] Please see Figures 1-3 , Figure 1 This is a schematic diagram of the structure of a smart mailbox provided in an embodiment of this application, such as... Figure 1 As shown, the smart mailbox includes a control module, a pressure sensor, and a camera. The pressure sensor is located at the bottom of the smart mailbox and includes a pressure distribution film sensor. The camera is located inside the smart mailbox.

[0024] The smart mailbox can be a smart shared mailbox or a smart private mailbox. The smart mailbox may include a control module, a pressure sensor, and a camera. The control module, pressure sensor, and camera are communicatively connected and / or electrically connected.

[0025] Furthermore, the control module can be located inside the smart mailbox (e.g., at the bottom) or externally. The pressure sensor may include a pressure distribution film sensor, which can be located at the bottom of the smart mailbox. The camera is located inside the smart mailbox; there can be one or more cameras, for example, cameras can be located at the top, bottom, sides, etc. of the smart mailbox. Specifically, as shown... Figure 2 As shown, a smart mailbox may include a mailbox door, a control module (not shown in the figure), which may be located inside the smart mailbox (e.g., at the bottom) or outside, a camera located at the top of the smart mailbox, and a pressure sensor located at the bottom of the smart mailbox.

[0026] The control module can be understood as the core hub of the entire smart mailbox. It can integrate computing chips, signal processing units, and power supply units, etc. Its main responsibility is to receive signals collected by pressure sensors and cameras, process them, and realize functions such as opening reminders, delivery status recognition, and network notifications. Specifically, it can be installed in a hidden area inside the mailbox.

[0027] The pressure sensor can accurately collect changes in pressure distribution inside the mailbox to determine if new mail has been delivered. It can also estimate the volume and weight of the mail for accurate delivery status identification. The thin-film sensor is flexible and lightweight, making it suitable for installation in the bottom of the smart mailbox.

[0028] Among them, the camera can be installed inside the smart mailbox, which can capture the situation inside the mailbox in real time. Users (such as administrators) can remotely view the quantity and size of the mail in the mailbox via the Internet. It can also be used in conjunction with abnormal opening detection to record the information of the person who opened the mailbox, thereby improving the security and traceability of the mailbox.

[0029] The pressure distribution film sensor can be laid across the entire bearing plane at the bottom of the mailbox. This sensor can be implemented using a gridded piezoresistive / capacitive sensing unit, for example, with a density of 16×16 (256 sensing points). Specifically, the pressure distribution film sensor outputs a pressure matrix P(x, y), representing the real-time pressure values ​​of the 256 sensing points. For example, its sampling frequency can be 10Hz. x and y represent the positions of the sensing points, and P(x, y) represents the pressure values ​​corresponding to those positions. The total pressure F(t) is the sum of the pressures at all points in the pressure matrix, representing the real-time weight. The pressure center (Cx, Cy) is the coordinate of the center of mass calculated from the pressure matrix. The contact area A(t) can be understood as the area of ​​the region formed by the number of sensing points with pressure values ​​exceeding a threshold (e.g., 5g), where t represents time t.

[0030] In practical implementation, for example, the data support of the pressure distribution thin-film sensor is as follows: single-point measurement range 0-5kg, resolution <2g, overall weight measurement error <±10g. Based on this pressure distribution thin-film sensor, it is possible to distinguish between a 20g letter and a 200g small package.

[0031] The camera can be a low-power wide-angle camera module. Specifically, the camera's operating mode is strictly controlled by the main controller, and it is normally in a "deep sleep" mode (power consumption <10μA). The camera is triggered by the main controller waking it up via I2C / GPIO and taking pictures when any of the following conditions are met: 1. Access Event Trigger: When the rate of change of weight detected by the pressure sensor (|dF / dt|, where F represents the total pressure and t represents the time) exceeds the threshold (e.g., 50g / s) for 100ms, it can be determined that a valid access action has started. After the action ends (dF / dt returns to zero), a 200ms delay is set to take a picture to avoid hand obstruction.

[0032] 2. External collaborative triggering: Specifically, when the risk level of the behavior outside the smart mailbox is determined to be high, for example, when it is detected that "a single person is approaching" and "the mailbox door is not open", the camera can be pre-wake up to enter the "standby" state and take a baseline image of the inside of the mailbox.

[0033] Among them, such as Figure 3As shown, the smart mailbox may also include an infrared sensor, which is communicatively connected and / or electrically connected to the control module, pressure sensor, and camera. Specifically, the infrared sensor can be used to detect whether someone is approaching the smart mailbox.

[0034] Please see Figure 4 , Figure 4 This is a flowchart illustrating a method for monitoring the access to items in a mailbox, as provided in an embodiment of this application. The method is applied to… Figures 1-3 The control module of the smart mailbox shown includes a pressure sensor and a camera. The pressure sensor is located at the bottom of the smart mailbox; the pressure sensor includes a pressure distribution film sensor; the camera is located inside the smart mailbox; the method for monitoring the storage and retrieval of items inside the mailbox may include: S401: Obtain the first pressure change data for the first time period through the pressure sensor.

[0035] The pressure sensor can collect pressure data at a first sampling frequency, obtaining multiple pressure data points. Each pressure data point includes a pressure dataset and a sampling time. Based on this method, multiple pressure data points can be collected within a first time period at the first sampling frequency. Combining these multiple pressure data points yields the first pressure change data. The pressure dataset can include pressure data from multiple sensing points.

[0036] In practice, the duration of the first time period can be preset or set by the system default; for example, the duration of the first time period is 1 second. Specifically, the step of acquiring the first pressure change data of the first time period through the pressure sensor can be executed at preset time intervals. The preset time interval can be preset or set by the system default, thus enabling real-time monitoring of pressure changes inside the smart mailbox.

[0037] S402: Determine whether the preset triggering conditions of the preset event are met based on the first pressure change data; the preset event includes any one of the following: object placement event, object removal event, object replacement event.

[0038] The preset events can include any of the following: object placement event, object removal event, and object replacement event.

[0039] The preset trigger conditions can be set in advance or set by system default.

[0040] Optionally, step S402 above, determining whether the preset triggering condition of the preset event is met based on the first pressure change data, can be implemented in the following manner: The first weight change data is determined based on the first pressure change data; Determine the first weight change rate curve based on the first weight change data; Determine whether the preset triggering condition is met based on the first weight change rate curve.

[0041] In the specific implementation, since the first pressure change data consists of multiple pressure data, each pressure data includes a pressure dataset and a sampling time. The pressure dataset can include pressure data from multiple sensing points. The total pressure corresponding to each sampling time can be calculated to obtain multiple total pressures. The multiple total pressures and their corresponding sampling times can then correspond to the first weight change data.

[0042] Next, the first weight change rate curve can be determined from the first weight change data. Specifically, the weight change rate between two adjacent time points can be determined. For example, the weight at time t1 is g1, and the weight at time t+1 is g2. The weight change is calculated as (g2 - g1) / (t+1 - t1). Thus, the weight change rate at multiple sampling times can be calculated. Based on these multiple weight change rates and their corresponding sampling times, a first weight change rate curve can be fitted. Furthermore, the first weight change rate curve can be used to determine whether a preset trigger condition is met. That is, the first pressure change data is first converted into first weight change data before generating the first weight change rate curve. This transforms the raw dynamic changes collected by the pressure sensor into more intuitive weight change trend characteristics, avoiding the problem of interference from sensor zero-point drift in the raw pressure data. Then, through... The first weight change rate curve determines the preset trigger conditions. It can clearly distinguish the dynamic characteristics of different events such as object placement, removal, and replacement based on the direction of change and fluctuation amplitude of the curve. For example, the object placement event corresponds to a weight change rate curve that rises continuously and then stabilizes, while the object removal event corresponds to a weight change rate curve that falls continuously and then stabilizes. This can more accurately identify different picking and throwing actions. Compared with the solution that relies solely on pressure judgment, it can significantly reduce the probability of false triggers. In this example, during the pre-judgment stage, invalid pressure fluctuation interference (such as data changes caused by mosquitoes staying or external force collisions with the box) can be filtered out. This retains the low power consumption advantage of the pressure sensor and eliminates the need to activate the camera for verification throughout the process, further reducing the overall power consumption and computing resource consumption of the smart mailbox. In this way, the reliability and operational stability of smart mailbox event recognition can be improved.

[0043] Furthermore, optionally, the above step of determining whether the preset triggering condition is met based on the first weight change rate curve can be implemented in the following manner: Extract the portion of the weight change rate curve from the first weight change rate curve that satisfies the condition that the absolute value of the weight change rate is greater than a preset threshold. Determine the duration of the partial weight change rate curve; When the duration exceeds a preset duration, the preset triggering condition is determined to be met.

[0044] The preset threshold can be set in advance or left as a system default; for example, the preset threshold can be 50g / s. The preset duration can also be set in advance or left as a system default; for example, the preset duration can be 100ms.

[0045] In practice, the portion of the first weight change rate curve where the absolute value of the weight change rate exceeds a preset threshold can be extracted. This means selecting the portion of the first weight change rate curve where the absolute value exceeds the preset threshold. This quickly filters out invalid interference fluctuations such as insects landing on the surface or slight shaking of the smart mailbox, retaining only the valid change range that matches the characteristics of actual object handling. This avoids misjudging minor disturbances as valid handling events, narrowing the judgment range and improving screening efficiency from the very first step. Furthermore, determining the duration of a portion of the weight change rate curve allows for further determination of the weight change within the valid range. The duration of the event can be verified by setting a duration threshold. This can effectively distinguish between accidental changes caused by external force scratches or short-term touches to the box and continuous weight changes caused by the actual insertion and removal of objects. It can further eliminate the possibility of false triggering due to low-amplitude interference. As long as the duration exceeds the preset duration, the preset triggering condition can be determined. Through the judgment logic of important change threshold screening and duration verification, no additional hardware sensing devices are needed. Accurate judgment can be completed based on pressure sensor data. This retains the advantages of low power consumption and low cost of pressure sensing and can greatly improve the accuracy of preset triggering condition judgment.

[0046] For example, when triggering object access events (object placement event, object removal event), for instance, if |dF / dt| (weight change rate) continuously exceeds a threshold (e.g., 50g / s) for 100ms, it can be determined that a valid access action has started. For example, when the dF / dt threshold is set to 50g / s, environmental vibrations (e.g., usually <10g / s) can be filtered out, ensuring that only real access actions are responded to, which helps to ensure the trigger sensitivity of preset events.

[0047] S403: If so, acquire second pressure change data for the second time period through the pressure sensor; the start time of the second time period is later than the end time of the first time period.

[0048] When the preset triggering conditions are met, the pressure sensor can be used to obtain the second pressure change data for the second time period. The start time of the second time period is later than the end time of the first time period, which helps to extract related information such as event type, object weight, and object type by combining the second pressure change data.

[0049] The start time of the second time period can be the end time of the first time period, or a time after that end time (e.g., the next time after that end time). The end time of the second time period can include a time when the weight change rate is less than the preset threshold. Specifically, the second weight change data can be determined based on the second pressure change data, the second weight change rate curve can be determined based on the second weight change data, the time when the weight change rate equals the preset threshold can be determined based on the second weight change rate curve, and the end time of the second time period can be determined based on that time. For example, the end time is the time when the weight change rate equals the preset threshold for the second time, or the next time after that time.

[0050] Optionally, step S401 above, acquiring the first pressure change data for the first time period through the pressure sensor, can be implemented in the following manner: The pressure sensor acquires the first pressure change data for the first time period at a first sampling frequency; Then, step S403 above, which involves acquiring the second pressure change data over the second time period using the pressure sensor, can be implemented in the following manner: The pressure sensor acquires the second pressure change data for the second time period at a second sampling frequency greater than the first sampling frequency.

[0051] The first and second sampling frequencies can both be preset or set by system default. The second sampling frequency is greater than the first sampling frequency; for example, if the first sampling frequency is 1Hz, the second sampling frequency is 10Hz.

[0052] In practice, the pressure sensor first acquires the first pressure change data for a first time period at a first sampling frequency. When the preset triggering conditions are met, the pressure sensor can then acquire the second pressure change data for a second time period at a second sampling frequency. That is, in the first time period of the pre-judgment stage, a lower first sampling frequency is used to collect the first pressure change data. This not only allows for continuous monitoring of the mailbox's status changes but also reduces the power consumption of the pressure sensor and the data processing load of the control module, meeting the requirements of long standby and low power consumption operation of the smart mailbox. When the pre-judgment meets the preset triggering conditions, the sampling frequency is switched to a higher second sampling frequency to collect the second pressure change data in the second time period. The higher sampling frequency can capture more detailed pressure / weight changes, providing more accurate data support for subsequent determination of object weight, object type, and event type. This avoids the loss of detailed information caused by the low sampling frequency, thereby effectively improving the accuracy of the smart mailbox's status recognition and extending its battery life.

[0053] S404: Take a picture at a preset time using the camera to obtain a scene image; the preset time is not earlier than the end time of the second time period.

[0054] The preset time is no earlier than the end time of the second time period. For example, the preset time is the time after the end time of the second time period. After the second time period ends, the camera is activated to capture images of the scene. This can not only supplement the pressure sensor judgment with visual verification information, but also reduce the working frequency of the camera through the step-by-step triggering logic, extend the battery life of the smart mailbox hardware, and reduce the consumption of cloud storage resources.

[0055] S405: Determine the target event association information of the preset event based on the second pressure change data. The target event association information includes at least one of the following: event type, object type, and object weight.

[0056] The target event-related information includes at least one of the following: event type, object type, object weight, object location, object outline image, object centroid location, etc., without limitation.

[0057] Among them, the contour image of the object: a binary pressure distribution map can be generated based on the pressure matrix corresponding to the second pressure change data, which can be used as the pressure fingerprint of the object.

[0058] Optionally, when the target event association information includes an event type, step S405 above, determining the target event association information of the preset event based on the second pressure change data, can be implemented in the following manner: The first pressure change curve is determined based on the second pressure change data; Extract the characteristic parameters from the first pressure change curve, the characteristic parameters including: monotonic change range, rising edge feature, and falling edge feature; The event type is determined based on the characteristic parameters.

[0059] In specific implementation, the second pressure change data can include multiple pressure data points. Each pressure data point corresponds to a pressure dataset and a sampling time. The pressure dataset can include pressure data from multiple sensor points. Based on the change situation, for example, the number and location of sensor points whose pressure values ​​exceed a threshold (e.g., 5g) can be first located. Based on these sensor point locations, the coordinates of the center of mass can be determined, and the pressure change data at these center of mass coordinates can be obtained. Based on this pressure change data, a first pressure change curve can be determined. That is, the pressure data corresponding to the pressure change data can be fitted with its corresponding sampling time. Specifically, each pressure data point and its corresponding sampling time can be regarded as a coordinate point to obtain the first pressure change curve, where the horizontal axis of the first pressure change curve is time and the vertical axis is pressure. Alternatively, the mean value of the pressure change data at each sampling time corresponding to all positions of these sensor points can be obtained. Each mean value corresponds to a sampling time, and the first pressure change curve can be obtained by fitting these mean values ​​and their corresponding sampling times. Specifically, each mean value and its corresponding sampling time can be regarded as a coordinate point to obtain the first pressure change curve, where the horizontal axis of the first pressure change curve is time and the vertical axis is pressure.

[0060] Next, characteristic parameters can be extracted from the first pressure change curve. These characteristic parameters include: monotonic change range, rising edge characteristics, and falling edge characteristics. Then, the event type can be determined based on the characteristic parameters. Specifically, reference characteristic parameters corresponding to each event type can be stored in advance. The characteristic parameters are matched with the reference characteristic parameters corresponding to each event type, and the event type corresponding to the successfully matched reference characteristic parameters is taken as the event type for this event.

[0061] In this example, the high-precision second pressure change data collected in the second time period is first converted into a first pressure change curve. This transforms discrete sampling data into an intuitive and continuous dynamic trend, and the originally abstract pressure data into a visual trend with extractable features. Then, core dynamic features such as monotonic change intervals, rising edge features, and falling edge features are extracted from the first pressure change curve. This allows for accurate correspondence to the change patterns of different object placement events. For example, the object placement event corresponds to a stable rising edge, the object removal event corresponds to a clear falling edge, and the replacement event corresponds to a continuous monotonic interval that first falls and then rises. The feature differences of different events are clearly distinguishable, enabling rapid type differentiation.

[0062] For example, the first pressure change curve is represented by F(t). Features can be extracted from F(t) to obtain characteristic parameters such as rising edge, falling edge, steady-state value, number of fluctuations, etc. The event type can then be determined based on these characteristic parameters. For instance, for an object placement event, F(t) monotonically rises to a new platform, with a rising edge duration of T_up (typically 0.5s-2s); for an object removal event, F(t) monotonically falls to a new platform, with a falling edge duration of T_down; for an object replacement event, F(t) exhibits a V-shaped sequence of "falling-rising," and the pressure distribution P(x, y) before and after the change is significantly different.

[0063] Optionally, when the target event association information includes an object type, step S405 above, determining the target event association information of the preset event based on the second pressure change data, can be implemented in the following manner: The major and minimum weight values ​​are determined based on the second pressure change data; Determine the difference between the major weight value and the minimum weight value to obtain a first difference; The number and location of sensing points where the force change on the object exceeds a preset value are determined based on the second pressure change data. The object type is determined based on the first difference, the number of sensor points, and the location of the sensor points.

[0064] The preset value can be set in advance or be the system default. For example, the preset value can be 5g.

[0065] In practical implementation, the maximum and minimum weight values ​​can be determined based on the second pressure change data. Then, the difference between the maximum and minimum weight values ​​is determined to obtain the first difference, i.e., the first difference = maximum weight value - minimum weight value. Next, the number and location of sensing points where the force change of the object exceeds the preset value can be determined based on the second pressure change data. Finally, the object type can be determined based on the first difference, the number of sensing points, and the location of the sensing points. That is, the overall weight range of the object to be identified can be directly obtained based on the weight difference. Combining the characteristics of the pressure distribution film sensor, the number and location of sensing points where the force exceeds the preset value can be further counted. The force-bearing area and placement position of the object can be accurately obtained to determine the outline size of the object. Then, the three types of information, namely the weight difference, the number of sensing points, and the location, are fused to determine the object type. This fully utilizes the advantages of multi-dimensional acquisition by the pressure distribution film sensor without increasing the hardware cost, and can achieve high accuracy in object classification under low computing power conditions.

[0066] Furthermore, optionally, the above step of determining the object type based on the first difference, the number of sensing points, and the location of the sensing points can be implemented in the following manner: The contact area of ​​the object is determined based on the number of sensing points and the location of the sensing points; When the first difference is less than or equal to the first weight threshold and the contact area is greater than the preset area value, the thin part type is used as the object type; When the first difference is greater than the first weight threshold and less than the second weight threshold, and the contact area is not greater than the preset area value, the small package type is used as the item type; the second weight threshold is greater than the first weight threshold. When the first difference is greater than or equal to the second weight threshold, the large package type is used as the item type.

[0067] The first weight threshold and the second weight threshold can be preset or set by the system default. The second weight threshold is greater than the first weight threshold. For example, the first weight threshold is 30g and the second weight threshold is 500g.

[0068] The preset area value can be set in advance or set by the system default; the preset area value is 150 square centimeters.

[0069] In practical implementation, the contact area of ​​an object can be determined based on the number and location of sensor points. For example, the closed area formed by the number and location of sensor points can be used as the contact area. If the first difference is less than or equal to a first weight threshold and the contact area is greater than a preset area value, it indicates that it may be a letter or a book, and a thin item type can be used as the object type. If the first difference is greater than the first weight threshold but less than a second weight threshold and the contact area is not greater than the preset area value, a small package type can be used as the object type. If the first difference is greater than or equal to the second weight threshold, a large package type can be used as the object type. That is, it can be combined with sensing... The number and location of points are used to calculate the contact area between the object and the pressure sensor, fully leveraging the multi-dimensional acquisition capabilities of the pressure distribution film sensor. It can supplement the object shape information that cannot be covered by the weight dimension by relying on the contact area dimension, solving the problem of difficulty in classifying objects of the same weight but different shapes. Furthermore, through the hierarchical logic of dividing the weight difference range and judging the contact area threshold, clear classification rules are given for three common types of objects: thin items, small packages, and large packages. It can achieve high-accuracy object classification without relying on complex algorithm models or a large amount of training data, which greatly reduces the computing power requirements of the control module and meets the low computing power and low power consumption requirements of smart mailboxes.

[0070] For example, F1 represents the weight before the preset event, F2 represents the weight after the preset event, ΔF represents the weight of the object, ΔF = F2 - F1, and A represents the contact area of ​​the object. For example, if ΔF ≤ 30g and A > 150 square centimeters, it can be inferred that it is a thin item, such as a letter or booklet. If 30g < ΔF < 500g and A ≤ 150 square centimeters, it can be inferred that it is a small package. If ΔF ≥ 500g, it can be inferred that it is a large package, such as a large package or a foreign object.

[0071] S406: Generate a structured storage log based on the target event association information and the scene image, and store the structured storage log.

[0072] Each structured storage log corresponds to one record. In specific implementation, a structured storage log can be generated based on the target event association information and on-site images. This structured storage log can include the target event association information and on-site images, and is then stored locally or in the cloud. For example, the structured storage log can include a timestamp, behavior type, item weight and estimated type, and key on-site images. Specifically, a record can be generated: "2026-3-28 14:30:15, placed, small package (approximately 250g), photo ID: IMG_20260327_143015.jpg". This record can then serve as arbitration evidence for courier companies, e-commerce platforms, and users, providing irrefutable proof of storage and retrieval, effectively resolving delivery disputes.

[0073] Furthermore, smart mailboxes can communicate with user terminals to achieve granular digital management of assets within the mailbox. For example, users can view a clear history of access via a mobile app, knowing not only "what time the door was opened," but also "what came in" and "what was taken out." For home users, this is an important mail / parcel tracking tool; for businesses or properties, it is a powerful means of managing centralized mailboxes.

[0074] As can be seen, the method for monitoring the storage and retrieval of items in a mailbox described in this application embodiment is applied to the control module of a smart mailbox. The smart mailbox also includes a pressure sensor and a camera. The pressure sensor is located at the bottom of the smart mailbox and includes a pressure distribution film sensor. The camera is located inside the smart mailbox. The pressure sensor acquires first pressure change data for a first time period. Based on the first pressure change data, it is determined whether the preset triggering conditions of a preset event are met. The preset event includes any one of the following: an object placement event, an object removal event, or an object replacement event. If so, the pressure sensor acquires second pressure change data for a second time period. The start time of the second time period is later than the end time of the first time period. The camera takes a picture at the preset time to obtain a scene image. The preset time is not earlier than the end time of the second time period. Based on the second pressure change data, the target event association information of the preset event is determined. The target event association information includes at least one of the following: event type, object type, and object weight. A structured storage log is generated based on the target event association information and the scene image. The structured storage log is stored. First, relying on the data set in the mailbox... The pressure distribution film sensor at the bottom can first collect the first pressure change data in the first time period to complete the pre-judgment of preset events. It can accurately distinguish three different events: object placement, removal, and replacement by pressure change characteristics. Then, after the pre-judgment is triggered, it collects the second pressure change data in the second time period and starts the camera to capture on-site images after the second time period ends. This not only supplements the pressure sensing judgment with visualized verification information, but also reduces the working frequency of the camera through the step-by-step triggering logic, extending the hardware battery life of the smart mailbox and reducing the consumption of cloud storage resources. Then, it can also extract related information such as event type, object weight, and object type by combining the second pressure change data, and generate structured storage logs with on-site images. This allows users to easily review mailbox usage records and verify the object placement and removal status at any time, and also provides traceable evidence for abnormal retrieval and misplacement issues. While ensuring the accuracy of smart mailbox status recognition, it can also optimize hardware power consumption and storage efficiency, and improve the intelligence and traceability of smart mailbox retrieval and removal management. In this way, it can achieve functions such as accurate perception of changes in items inside the mailbox, reliable identification of storage and retrieval behavior, and traceable evidence of storage and retrieval disputes.

[0075] Optionally, the smart mailbox also includes an infrared sensor, such as... Figure 5 As shown, before obtaining the first pressure change data for the first time period through the pressure sensor in step S401 above, the following steps may also be included: S1: Acquire infrared data using the infrared sensor; S2: When infrared data is detected to be approaching the smart mailbox, the camera is woken up and controlled to take a picture to obtain a reference image, and the camera is controlled to enter standby mode. Then, step S406, generating a structured storage log based on the target event association information and the scene image, can be implemented in the following manner: The structured storage log is generated based on the target event association information, the on-site image, and the reference image.

[0076] Specifically, the smart mailbox can also include an infrared sensor. This sensor acquires infrared data and then monitors for anyone approaching the mailbox. When infrared data detects someone approaching, the camera is activated and takes a picture to obtain a baseline image. The camera then enters a standby state. In other words, the infrared sensor can monitor people approaching the smart mailbox in real time, only activating the camera to capture a baseline image when someone is detected. Afterward, the camera returns to a low-power standby state. Compared to keeping the camera constantly working or in pre-wake mode, this significantly reduces camera energy consumption. Furthermore, the pre-captured baseline image records the initial state inside the mailbox before the retrieval or disposal action. This allows for a clear comparison with the image taken after the event, providing a more intuitive view of changes to the objects inside the mailbox. This avoids the problem of not being able to confirm the state before and after changes based solely on post-event photos, improving the completeness of the state record.

[0077] Furthermore, the target event association information, on-site images, and baseline images can be integrated to generate structured storage logs. This not only allows users to intuitively verify the changes before and after the items are retrieved and delivered, but also provides complete and traceable comparison evidence in case of misdelivery, loss, or other abnormal situations, further improving the traceability and credibility of smart mailbox retrieval and delivery records.

[0078] Please see Figure 6 , Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device includes a processor, a memory, a communication interface, and one or more programs. The one or more programs are stored in the memory and configured to be executed by the processor. In this embodiment, the electronic device may include a smart mailbox or a control module within a smart mailbox. The smart mailbox also includes a pressure sensor and a camera. The pressure sensor is disposed at the bottom of the smart mailbox; the pressure sensor includes a pressure distribution thin-film sensor; the camera is disposed inside the smart mailbox; the processor may include the control module, or the processor and the control module may be two independent modules. The program includes instructions for performing the following steps: The pressure sensor acquires first pressure change data over a first time period. Based on the first pressure change data, determine whether the preset triggering conditions of the preset event are met; the preset event includes any of the following: object placement event, object removal event, object replacement event; If so, the pressure change data for the second time period is acquired through the pressure sensor; the start time of the second time period is later than the end time of the first time period. The camera takes a picture at a preset time to obtain a scene image; the preset time is not earlier than the end time of the second time period. Based on the second pressure change data, the target event association information of the preset event is determined, and the target event association information includes at least one of the following: event type, object type, and object weight; A structured storage log is generated based on the target event association information and the on-site image, and the structured storage log is stored.

[0079] Figure 7 This is a functional unit block diagram of a mailbox item access monitoring device provided in this application embodiment. The mailbox item access monitoring device 700 is applied to the control module of a smart mailbox. The smart mailbox also includes a pressure sensor and a camera. The pressure sensor is disposed at the bottom of the smart mailbox; the pressure sensor includes a pressure distribution thin-film sensor; the camera is disposed inside the smart mailbox; the mailbox item access monitoring device 700 includes: Acquisition unit 710 is used to acquire first pressure change data for a first time period through the pressure sensor; The judgment unit 720 is used to determine whether the preset triggering conditions of the preset event are met based on the first pressure change data; the preset event includes any one of the following: object placement event, object removal event, object replacement event; The acquisition unit 710 is further configured to acquire second pressure change data for a second time period through the pressure sensor if the judgment result of the judgment unit 720 is yes; the start time of the second time period is later than the end time of the first time period. The camera unit 730 is used to take a picture at a preset time using the camera to obtain a scene image; the preset time is not earlier than the end time of the second time period. The determining unit 740 is configured to determine the target event association information of the preset event based on the second pressure change data, wherein the target event association information includes at least one of the following: event type, object type, and object weight. The generation unit 750 is used to generate a structured storage log based on the target event association information and the scene image, and to store the structured storage log.

[0080] It is understood that the functions of each program module of the mailbox item access monitoring device 700 in this embodiment can be specifically implemented according to the methods in the above method embodiments. The specific implementation process can be referred to the relevant descriptions in the above method embodiments, and will not be repeated here.

[0081] This application also provides a computer storage medium storing a computer program for electronic data interchange, which causes a computer to perform some or all of the steps of any of the methods described in the above method embodiments.

[0082] This application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods described in the above method embodiments. This computer program product can be a software installation package.

[0083] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0084] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0085] In the several embodiments provided in this application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical or other forms.

[0086] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0087] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0088] If the aforementioned integrated units are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0089] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage device, which may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0090] The embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A method for monitoring the storage and retrieval of items in a mailbox, characterized in that, A control module for use in a smart mailbox, the smart mailbox further including a pressure sensor and a camera, the pressure sensor being disposed at the bottom of the smart mailbox; the pressure sensor including a pressure distribution thin film sensor; the sensing unit density of the pressure distribution thin film sensor being not less than 16×16, i.e., not less than 256 sensing points; the camera being disposed inside the smart mailbox; the method comprising: The pressure sensor acquires first pressure change data over a first time period. Based on the first pressure change data, determine whether the preset triggering conditions of the preset event are met; the preset event includes any of the following: object placement event, object removal event, object replacement event; If so, the pressure change data for the second time period is acquired through the pressure sensor; the start time of the second time period is later than the end time of the first time period. The camera takes a picture at a preset time to obtain a scene image; the preset time is not earlier than the end time of the second time period. Based on the second pressure change data, the target event association information of the preset event is determined, and the target event association information includes at least one of the following: event type, object type, and object weight; A structured storage log is generated based on the target event association information and the on-site images, and the structured storage log is stored. Wherein, when the target event association information includes an event type, determining the target event association information of the preset event based on the second pressure change data includes: The first pressure change curve is determined based on the second pressure change data; Extract the characteristic parameters from the first pressure change curve, the characteristic parameters including: monotonic change range, rising edge feature, and falling edge feature; The event type is determined based on the characteristic parameters; Wherein, acquiring the first pressure change data over a first time period through the pressure sensor includes: The pressure sensor acquires the first pressure change data for the first time period at a first sampling frequency; The step of acquiring second pressure change data over a second time period via the pressure sensor includes: The pressure sensor acquires the second pressure change data for the second time period at a second sampling frequency, wherein the second sampling frequency is greater than the first sampling frequency and is not less than 10 times the first sampling frequency.

2. The method according to claim 1, characterized in that, When the target event association information includes an object type, determining the target event association information of the preset event based on the second pressure change data includes: The maximum and minimum weight values ​​are determined based on the second pressure change data; Determine the difference between the maximum weight value and the minimum weight value to obtain a first difference; The number and location of sensing points where the force change on the object exceeds a preset value are determined based on the second pressure change data. The object type is determined based on the first difference, the number of sensor points, and the location of the sensor points.

3. The method according to claim 2, characterized in that, Determining the object type based on the first difference, the number of sensing points, and the location of the sensing points includes: The contact area of ​​the object is determined based on the number of sensing points and the location of the sensing points; When the first difference is less than or equal to the first weight threshold and the contact area is greater than the preset area value, the thin part type is used as the object type; When the first difference is greater than the first weight threshold and less than the second weight threshold, and the contact area is not greater than the preset area value, the small package type is used as the item type; the second weight threshold is greater than the first weight threshold. When the first difference is greater than or equal to the second weight threshold, the large package type is used as the item type.

4. The method according to any one of claims 1-3, characterized in that, The step of determining whether the preset triggering conditions of the preset event are met based on the first pressure change data includes: The first weight change data is determined based on the first pressure change data; Determine the first weight change rate curve based on the first weight change data; Determine whether the preset triggering condition is met based on the first weight change rate curve.

5. The method according to claim 4, characterized in that, The step of determining whether the preset triggering condition is met based on the first weight change rate curve includes: Extract the portion of the weight change rate curve from the first weight change rate curve that satisfies the condition that the absolute value of the weight change rate is greater than a preset threshold. Determine the duration of the partial weight change rate curve; When the duration exceeds a preset duration, the preset triggering condition is determined to be met.

6. The method according to any one of claims 1-3, characterized in that, The smart mailbox also includes an infrared sensor, and before acquiring the first pressure change data for the first time period via the pressure sensor, the method further includes: Infrared data is acquired through the infrared sensor; When infrared data is detected to be approaching the smart mailbox, the camera is activated and controlled to take a picture to obtain a reference image, and then the camera is put into standby mode. The step of generating a structured storage log based on the target event association information and the on-site image includes: The structured storage log is generated based on the target event association information, the on-site image, and the reference image.

7. A device for monitoring the access of items in a mailbox, used to perform the method as described in any one of claims 1-6, characterized in that, A control module for use in a smart mailbox, the smart mailbox further including a pressure sensor and a camera, the pressure sensor being disposed at the bottom of the smart mailbox; the pressure sensor including a pressure distribution thin-film sensor; the camera being disposed inside the smart mailbox; the device comprising: The acquisition unit is used to acquire first pressure change data over a first time period through the pressure sensor; The judgment unit is used to determine whether the preset triggering conditions of the preset event are met based on the first pressure change data; the preset event includes any one of the following: object placement event, object removal event, object replacement event; The acquisition unit is further configured to acquire second pressure change data for a second time period through the pressure sensor if the judgment result of the judgment unit is yes; the start time of the second time period is later than the end time of the first time period. The camera unit is used to take a picture at a preset time to obtain a scene image; the preset time is not earlier than the end time of the second time period. The determining unit is configured to determine the target event association information of the preset event based on the second pressure change data, wherein the target event association information includes at least one of the following: event type, object type, and object weight; The generation unit is used to generate a structured storage log based on the target event association information and the scene image, and to store the structured storage log. Wherein, when the target event association information includes an event type, determining the target event association information of the preset event based on the second pressure change data includes: The first pressure change curve is determined based on the second pressure change data; Extract the characteristic parameters from the first pressure change curve, the characteristic parameters including: monotonic change range, rising edge feature, and falling edge feature; The event type is determined based on the characteristic parameters.

8. An electronic device, characterized in that, The electronic device includes a processor and a memory for storing one or more programs and configured to be executed by the processor, the programs including instructions for performing the steps of the method as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, A computer program for storing electronic data interchange is provided, wherein the computer program causes a computer to perform the method as described in any one of claims 1-6.

Images