Operation execution method, apparatus, storage medium and electronic device

Abstract

This invention provides an operation execution method, apparatus, storage medium, and electronic device. The method includes: identifying a target object within the monitoring range of a target monitoring device, identifying the target behavior of the target object, and obtaining a target identification result; determining a target mode corresponding to the target behavior based on the target identification result; and controlling a target item container to perform a target operation corresponding to the target mode. The storage mode stores one or more items in a corresponding container space within the target item container and sets the corresponding container space to a closed state after storage. The retrieval mode sets the container space containing one or more items in the target item container to an open state. This invention solves the problem of a high risk of cross-infection from viruses in related technologies, achieving the effect of improving the efficiency of item storage and retrieval while reducing the risk of cross-infection.

Description

Technical Field

[0001] The present invention relates to the field of communications, and more specifically, to an operation execution method, apparatus, storage medium, and electronic device. Background Technology

[0002] With the rapid development of the epidemic, the demand for online shopping, food delivery, and parcel delivery has been increasing. However, food delivery and parcel delivery require human contact for handling and transportation, which keeps the risk of cross-infection of the virus high.

[0003] In related technologies, items are typically accessed and retrieved via touchscreen on a smart locker, or by scanning barcodes, QR codes, or fingerprints. However, this method is ineffective in reducing the risk of cross-infection and further contributes to low efficiency in item access.

[0004] There is currently no effective solution to the high risk of cross-infection of viruses in related technologies. Summary of the Invention

[0005] This invention provides an operation execution method, apparatus, storage medium, and electronic device to at least address the problem of high risk of cross-infection by viruses in related technologies.

[0006] According to an embodiment of the present invention, an operation execution method is provided, comprising: when a target object is identified within the monitoring range of a target monitoring device, identifying the target behavior of the target object to obtain a target identification result; determining a target mode corresponding to the target behavior based on the target identification result, wherein the target mode is a storage mode or a retrieval mode; controlling a target item container to perform a target operation corresponding to the target mode, wherein the storage mode is used to store one or more items in a corresponding container space in the target item container and to set the corresponding container space to a closed state after storage, and the retrieval mode is used to set the container space containing one or more items in the target item container to an open state.

[0007] In an exemplary embodiment, when a target object is identified within the monitoring range of the target monitoring device, identifying the target behavior of the target object to obtain a target identification result includes: when the target object is identified within the monitoring range of the target monitoring device and the temperature of the target object is less than or equal to a preset temperature threshold, identifying the target behavior of the target object to obtain the target identification result.

[0008] In an exemplary embodiment, the method further includes: when the target object is identified within the monitoring range of the target monitoring device and the temperature of the target object is greater than the preset temperature threshold, a target prompt message is displayed according to a preset prompting method, wherein the preset prompting method includes at least one of the following: voice prompt and screen prompt, and the target prompt message is used to indicate that the temperature of the target object is abnormal.

[0009] In an exemplary embodiment, determining the target pattern corresponding to the target behavior based on the target identification result includes one of the following: when the target identification result indicates that the target behavior is a first behavior, the target pattern corresponding to the first behavior is determined as the storage pattern, wherein the first behavior refers to the target object holding the target item for a first preset time; when the target identification result indicates that the target behavior is a second behavior, the target pattern corresponding to the second behavior is determined as the retrieval pattern, wherein the second behavior refers to at least one of the following: the target object does not hold the item, or a target transportation device for transporting items is identified adjacent to the target object within the monitoring range.

[0010] In one exemplary embodiment, controlling the target item container to perform a target operation corresponding to the target mode includes one of the following: when the target mode is the storage mode, displaying a first interface corresponding to the storage mode on the target screen of the target item container; if no operation by the target object is detected on the first interface within a second preset time period, prompting the target object to perform a storage operation; when the target mode is the retrieval mode, displaying a second interface corresponding to the retrieval mode on the target screen of the target item container; if no operation by the target object is detected on the second interface within a third preset time period, prompting the target object to perform a retrieval operation.

[0011] In one exemplary embodiment, the control of the target item container to perform the target operation corresponding to the target mode includes one of the following: when the target mode is the item retrieval mode, displaying a second interface corresponding to the item retrieval mode on the target screen of the target item container; when the target object's input target retrieval code is detected on the second interface within a second preset time period, setting the container space corresponding to the target retrieval code to an open state; when the target mode is the item retrieval mode, prompting the target object to input a retrieval code; when the target object's target voice is obtained and the target retrieval code is recognized in the target voice, setting the container space corresponding to the target retrieval code to an open state.

[0012] In an exemplary embodiment, the above-mentioned control of the target item container to perform the target operation corresponding to the target mode further includes: when the target mode is the item retrieval mode, after setting the container space corresponding to the target retrieval code to the open state, detecting whether the container space corresponding to the target retrieval code is in the closed state; and when it is detected that the container space corresponding to the target retrieval code is in the closed state, disinfecting the container space corresponding to the target retrieval code.

[0013] In an exemplary embodiment, the above-mentioned control of the target item container to perform the target operation corresponding to the target mode further includes one of the following: when the target mode is the storage mode, controlling the target screen of the target item container to be on and displaying a first interface corresponding to the storage mode on the target screen; when the target mode is the retrieval mode, controlling the target screen of the target item container to be on and displaying a second interface corresponding to the retrieval mode on the target screen; after controlling the target item container to perform the target operation corresponding to the target mode, the method further includes: when the target object is detected to leave the monitoring range, controlling the target screen to be off.

[0014] In one exemplary embodiment, the method further includes: when the target mode is the storage mode, displaying a first interface corresponding to the storage mode on the target screen of the target item container; when a first mode switching operation is detected on the first interface within a second preset time period, switching the interface displayed on the target screen from the first interface to a second interface corresponding to the retrieval mode; when the target mode is the retrieval mode, displaying the second interface corresponding to the retrieval mode on the target screen of the target item container; and when a second mode switching operation is detected on the second interface within a third preset time period, switching the interface displayed on the target screen from the second interface to the first interface corresponding to the storage mode.

[0015] According to another embodiment of the present invention, an operation execution device is provided, comprising: an identification module, configured to identify the target behavior of the target object when the target object is identified within the monitoring range of the target monitoring device, and obtain a target identification result; a determination module, configured to determine a target mode corresponding to the target behavior based on the target identification result, wherein the target mode is a storage mode or a retrieval mode; and a first control module, configured to control a target item container to perform a target operation corresponding to the target mode, wherein the storage mode is used to store one or more items in a corresponding container space in the target item container and to set the corresponding container space to a closed state after storage, and the retrieval mode is used to set the container space containing one or more items in the target item container to an open state.

[0016] According to yet another embodiment of the present invention, a locker is also provided, including an execution device for the operation as described above.

[0017] According to yet another embodiment of the present invention, a computer-readable storage medium is also provided, wherein a computer program is stored therein, wherein the computer program is configured to perform the steps in any of the above method embodiments when executed.

[0018] According to yet another embodiment of the present invention, an electronic device is also provided, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0019] This invention identifies a target object within the monitoring range of a target monitoring device, identifies the target object's behavior to obtain a target identification result, and then determines the target pattern corresponding to the target behavior based on the target identification result. Subsequently, it controls the target item container to perform the target operation corresponding to the target pattern. By using this method, the target identification result obtained from identifying the target behavior of a target object within the monitoring range of the target monitoring device determines the target pattern corresponding to that target behavior, and then controls the target item container to perform the target operation corresponding to that target pattern. This achieves the goal of contactless and rapid storage and retrieval of items, solving the problem of high risk of cross-infection of viruses in related technologies, and achieving the effect of improving the efficiency of item storage and retrieval while reducing the risk of cross-infection of viruses. Attached Figure Description

[0020] Figure 1 This is a hardware structure block diagram of a mobile terminal for an operation execution method according to an embodiment of the present invention.

[0021] Figure 2This is a flowchart of an operation execution method according to an embodiment of the present invention;

[0022] Figure 3 This is a flowchart illustrating a specific access mode according to an embodiment of the present invention.

[0023] Figure 4 This is a structural block diagram of an operation execution device according to an embodiment of the present invention. Detailed Implementation

[0024] The embodiments of the present invention will be described in detail below with reference to the accompanying drawings and examples.

[0025] It should be noted that the terms "first," "second," etc., in the specification, claims, and drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0026] The methods and embodiments provided in this application can be executed on a mobile terminal, computer terminal, or similar computing device. Taking running on a mobile terminal as an example, Figure 1 This is a hardware structure block diagram of a mobile terminal for an operation execution method according to an embodiment of the present invention. For example... Figure 1 As shown, a mobile terminal may include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 104 for storing data are also shown. The mobile terminal may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the mobile terminal described above. For example, the mobile terminal may also include components that are more... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0027] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the operation execution method in this embodiment of the invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the mobile terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0028] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the mobile terminal's communication provider. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module, used for wireless communication with the Internet.

[0029] This embodiment provides a method for performing an operation. Figure 2 This is a flowchart of an operation execution method according to an embodiment of the present invention, such as... Figure 2 As shown, the process includes the following steps:

[0030] S202, when a target object is identified within the monitoring range of the target monitoring device, the target behavior of the target object is identified to obtain the target identification result;

[0031] S204, determine the target pattern corresponding to the target behavior based on the target recognition result, wherein the target pattern is a storage pattern or a retrieval pattern;

[0032] S206, control the target item container to perform the target operation corresponding to the target mode, wherein the storage mode is used to store one or more items in the corresponding container space of the target item container and set the corresponding container space to the closed state after storage is completed, and the retrieval mode is used to set the container space where one or more items in the target item container are located to the open state.

[0033] The device performing the above operations can be a controller, a processor, or other processing devices or units with similar processing capabilities.

[0034] In the above embodiments, the target objects include, but are not limited to, children, teenagers, young adults, and the elderly. The target item containers include, but are not limited to, parcel lockers and takeout lockers. The monitoring range can be preset, such as 0.8 meters, 1 meter, or 1.5 meters. For example, when the monitoring range is 1 meter, if a target object is detected within 1 meter of the monitoring device, the target object's behavior is identified to obtain the target identification result, and so on. It should be noted that the above examples of monitoring range are merely exemplary embodiments, and the monitoring range is not limited to the examples described above.

[0035] In the above embodiments, there can be multiple target monitoring devices. The target behavior of the identified target object can be identified within the monitoring range of multiple target monitoring devices to obtain multiple target identification results. That is, the monitoring angles corresponding to the multiple target monitoring devices are the same or different. When the monitoring angles corresponding to the multiple target monitoring devices are all the same, the target behavior of the target object can be monitored and identified according to the priority or weight of the multiple target monitoring devices. For example, when there are three target monitoring devices (target monitoring device 1, target monitoring device 2, and target monitoring device 3) with the same monitoring angle, and the priority or weight of the three target monitoring devices is target monitoring device 1 > target monitoring device 2 > target monitoring device 3, the target behavior of the identified target object can be identified first within the monitoring range of target monitoring device 1 according to this priority or weight order. When the monitoring angles corresponding to the multiple target monitoring devices are all different, the multiple target monitoring devices with different monitoring angles can be used simultaneously to monitor and identify the target behavior of the target object, and so on. It should be noted that the above examples of target monitoring devices are only exemplary embodiments, and the target monitoring devices are not limited to the above examples.

[0036] In the above embodiments, when a target object is identified within the monitoring range of the target monitoring device, the target behavior of the target object is identified to obtain a target identification result. Then, based on the target identification result, a target pattern corresponding to the target behavior is determined, and subsequently, the target item container is controlled to perform the target operation corresponding to the target pattern. By employing the method of this invention, the target identification result obtained by identifying the target behavior of a target object identified within the monitoring range of the target monitoring device determines the target pattern corresponding to that target behavior, and then controls the target item container to perform the target operation corresponding to that target pattern. This achieves the purpose of contactless and rapid storage and retrieval of items, solving the problem of a high risk of cross-infection of viruses in related technologies, and achieving the effect of improving the storage and retrieval efficiency of items while reducing the risk of cross-infection of viruses.

[0037] In one exemplary embodiment, when a target object is identified within the monitoring range of the target monitoring device, the target behavior of the target object is identified to obtain a target identification result. This includes: when a target object is identified within the monitoring range of the target monitoring device and the temperature of the target object is less than or equal to a preset temperature threshold, the target behavior of the target object is identified to obtain a target identification result. In this embodiment, the preset temperature threshold can be pre-set, such as 36℃, 36.5℃, 37℃, etc. For example, when the preset temperature threshold is 37℃, when a target object is identified within the monitoring range of the target monitoring device and the temperature of the target object is less than or equal to 37℃, the target behavior of the target object is identified to obtain a target identification result. It should be noted that the above example of the preset temperature threshold is only an exemplary embodiment, and the preset temperature threshold is not limited to the above example.

[0038] In one exemplary embodiment, the method further includes: when a target object is identified within the monitoring range of the target monitoring device and the temperature of the target object is greater than a preset temperature threshold, providing target prompt information according to a preset prompting method, wherein the preset prompting method includes at least one of the following: voice prompt, screen prompt, and the target prompt information is used to indicate that the temperature of the target object is abnormal. In this embodiment, the preset prompting method also includes SMS prompts, telephone prompts, etc. For example, when a target object is identified within the monitoring range of the target monitoring device and the temperature of the target object is greater than the preset temperature threshold, the target prompt information is provided via voice and / or screen, and / or when a target object is identified within the monitoring range of the target monitoring device and the temperature of the target object is greater than the preset temperature threshold, the target prompt information is provided via SMS and / or telephone. Furthermore, when the target object is identified as a child or an elderly person within the monitoring range of the target monitoring device, and the temperature of the child or the elderly person is greater than the preset temperature threshold, the target prompt information is provided via voice and / or screen, and the target prompt information is also provided to the guardian of the child or the elderly person via SMS and / or telephone, etc. It should be noted that the above examples of preset prompting methods are only exemplary embodiments, and the preset prompting methods are not limited to the above examples.

[0039] In the above embodiments, when the target object is abnormal, the target prompt information is used not only to indicate that the target object's temperature is abnormal, but also to indicate that the target item container cannot be operated.

[0040] In an exemplary embodiment, determining the target mode corresponding to the target behavior based on the target recognition result includes one of the following: when the target recognition result indicates that the target behavior is a first behavior, the target mode corresponding to the first behavior is determined as a storage mode, wherein the first behavior refers to the target object holding the target item for a first preset time period; when the target recognition result indicates that the target behavior is a second behavior, the target mode corresponding to the second behavior is determined as a retrieval mode, wherein the second behavior refers to at least one of the following: the target object does not hold the item, or a target transportation device for transporting the item is identified adjacent to the target object within the monitoring range. In this embodiment, the first preset time period can be preset and can be set to 2s, 3s, 4s, etc. For example, when the first preset time period is 2s, if the target recognition result indicates that the target behavior is the target object holding the target item for 2s, the target mode corresponding to the first behavior is determined as a storage mode, and so on. Furthermore, after the first preset time period is preset, it can be adjusted according to the actual application situation or actual needs. The target transportation device includes, but is not limited to, a trolley, a handheld storage basket, etc. It should be noted that the above-described first preset duration and target transportation equipment are merely exemplary embodiments, and the first preset duration and target transportation equipment are not limited to the above examples.

[0041] In one exemplary embodiment, controlling the target item container to perform a target operation corresponding to the target mode includes one of the following: when the target mode is a storage mode, displaying a first interface corresponding to the storage mode on the target screen of the target item container; if no operation by the target object is detected on the first interface within a second preset time period, prompting the target object to perform a storage operation; when the target mode is a retrieval mode, displaying a second interface corresponding to the retrieval mode on the target screen of the target item container; if no operation by the target object is detected on the second interface within a third preset time period, prompting the target object to perform a retrieval operation. In this embodiment, the second preset time period can be preset and can be set to 3s, 4s, 5s, etc. For example, when the second preset time period is 3s, when the target mode is a storage mode, displaying the first interface corresponding to the storage mode on the target screen of the target item container, and then prompting the target object to perform a storage operation if no operation by the target object is detected on the first interface within 3s, etc. Furthermore, after the second preset time period is preset, it can be adjusted according to the actual application situation or actual needs. It should be noted that the above example of the second preset duration is only an exemplary embodiment, and the second preset duration is not limited to the above example.

[0042] In the above embodiments, the third preset duration can be pre-set, such as 3s, 4s, 5s, etc. For example, when the third preset duration is 4s, if the target mode is the retrieval mode, the second interface corresponding to the retrieval mode is displayed on the target screen of the target item container. Then, if no operation of the target object is detected on the second interface within 4s, the target object is prompted to perform the retrieval operation, and so on. Furthermore, after the third preset duration is pre-set, it can be adjusted according to the actual application or actual needs. It should be noted that the above example of the second preset duration is only an exemplary embodiment, and the second preset duration is not limited to the above example.

[0043] In one exemplary embodiment, controlling the target item container to perform a target operation corresponding to the target mode includes one of the following: when the target mode is a retrieval mode, displaying a second interface corresponding to the retrieval mode on the target screen of the target item container; if the target object's input retrieval code is detected on the second interface within a second preset time period, setting the container space corresponding to the target retrieval code to an open state; when the target mode is a retrieval mode, prompting the target object to input a retrieval code; and if the target object's target voice is obtained and the target retrieval code is recognized in the target voice, setting the container space corresponding to the target retrieval code to an open state. In this embodiment, if the target mode is the retrieval mode and an incorrect retrieval code is detected on the second interface corresponding to the retrieval mode displayed on the target screen of the target item container within a second preset time period, the incorrect retrieval code can be prompted via voice and / or screen. Furthermore, when the target is a child or an elderly person, if an incorrect retrieval code is detected multiple times on the second interface corresponding to the retrieval mode displayed on the target screen of the target item container within a second preset time period, the target item container will temporarily enter a locked mode, and the guardian of the child or elderly person will be notified via SMS and / or telephone that the retrieval code input is abnormal, resulting in the temporary locking of the target item container. When the target mode is in retrieval mode, the target person is prompted to enter a retrieval code. If the target person's voice is received and the target retrieval code is not recognized in the voice, a voice and / or screen prompt will be displayed indicating that the retrieval code has not been recognized. In addition, when the target person is a child or elderly person, when the target mode is in retrieval mode, the target person is prompted to enter a retrieval code. If the target person's voice is received multiple times and the target retrieval code is not recognized in any of the multiple voices, the container of the target item will temporarily enter a locked mode, and the guardian of the child or elderly person will be notified via SMS and / or telephone that the retrieval code recognition error has caused the container of the target item to be temporarily locked, and so on.

[0044] In one exemplary embodiment, controlling the target item container to perform the target operation corresponding to the target mode further includes: when the target mode is a retrieval mode, after setting the container space corresponding to the target retrieval code to an open state, detecting whether the container space corresponding to the target retrieval code is in a closed state; if the container space corresponding to the target retrieval code is detected to be in a closed state, disinfecting the container space corresponding to the target retrieval code. In this embodiment, when the container space corresponding to the target retrieval code is detected to be in a closed state, in addition to disinfecting the container space corresponding to the target retrieval code, the outer surface of the container space corresponding to the target retrieval code and the portion of air in contact with the outer surface can also be disinfected. Furthermore, disinfection can be performed using ultraviolet light, alcohol, or other safer and more effective disinfection methods, etc.

[0045] In one exemplary embodiment, controlling the target item container to perform a target operation corresponding to the target mode further includes one of the following: when the target mode is a storage mode, controlling the target screen of the target item container to be on and displaying a first interface corresponding to the storage mode on the target screen; when the target mode is a retrieval mode, controlling the target screen of the target item container to be on and displaying a second interface corresponding to the retrieval mode on the target screen; after controlling the target item container to perform the target operation corresponding to the target mode, the method further includes: when it is detected that the target object has left the monitoring range, controlling the target screen to be off. In this embodiment, there can be one or more target objects. When there is only one target object and it is detected that the target object has left the monitoring range, the target screen is controlled to be off.

[0046] In one exemplary embodiment, the method further includes: when the target mode is a storage mode, displaying a first interface corresponding to the storage mode on the target screen of the target item container; if a first mode switching operation is detected on the first interface within a second preset time period, switching the interface displayed on the target screen from the first interface to a second interface corresponding to the retrieval mode; when the target mode is a retrieval mode, displaying the second interface corresponding to the retrieval mode on the target screen of the target item container; and if a second mode switching operation is detected on the second interface within a third preset time period, switching the interface displayed on the target screen from the second interface to the first interface corresponding to the storage mode. In this embodiment, after displaying the first interface corresponding to the storage mode on the target screen of the target item container when the target mode is a storage mode, and then switching the interface displayed on the target screen from the first interface to the second interface corresponding to the retrieval mode when a first mode switching operation is detected on the first interface within a second preset time period, the switching record is stored for deep learning, thereby making the subsequent retrieval mode recognition results more accurate. When the target mode is the retrieval mode, the second interface corresponding to the retrieval mode is displayed on the target screen of the target item container. Then, if the second mode switching operation is detected on the second interface within the third preset time period, the interface displayed on the target screen is switched from the second interface to the first interface corresponding to the storage mode. The switching record is stored for deep learning, so that the subsequent storage mode recognition results are more accurate.

[0047] Obviously, the embodiments described above are only some embodiments of the present invention, and not all embodiments.

[0048] The present invention will be described in detail below with reference to specific embodiments:

[0049] First, the application scenarios and solutions involved in the specific embodiments of the present invention will be described:

[0050] The application scenarios of this specific embodiment include:

[0051] This application uses a network camera (IP camera, or IPC) as an example (corresponding to the aforementioned target monitoring device), which can be applied to parcel lockers and / or food delivery lockers (corresponding to the aforementioned target item containers) in residential communities, companies, and other organizations. Furthermore, the IPC camera, in conjunction with an infrared module, a sound pickup module, a disinfection module, a power supply module, a voice module, a display module, and an intelligent module (which includes, but is not limited to, intelligent sound recognition algorithms, intelligent human figure recognition algorithms, and intelligent algorithms for recognizing items carried by people), forms a contactless item storage and retrieval IPC application scenario. It should be noted that the above-described IPC application scenario is only an exemplary embodiment, and IPC application scenarios are not limited to the above examples.

[0052] The main solutions of this specific embodiment include:

[0053] When the IPC camera detects a person (corresponding to the aforementioned target object) entering the monitoring range, the smart locker automatically lights up. Simultaneously, the infrared module begins detecting the person's body temperature to determine if it is normal. If the person's body temperature is abnormal, a voice and screen prompt will indicate that the smart locker cannot be operated due to an abnormal body temperature. If the person's body temperature is normal, the IPC camera intelligently detects whether the person is carrying packages or items, and intelligently identifies whether the person's behavior is storing or retrieving items by analyzing the behavior of the person entering the monitoring range (corresponding to the aforementioned target behavior). Specifically, if the person holds a package with both hands directly below the monitor for 2 seconds (corresponding to the aforementioned first preset duration, which can also be set to 3 seconds, 4 seconds, 5 seconds, etc.), it is identified as a storage mode. If the person is not holding a package or item directly below the monitor and / or a trolley or other transport vehicle (corresponding to the aforementioned target transport equipment) is detected around the person within the monitoring range, it is identified as a retrieval mode. Alternatively, if the person has retrieved one or more items, and then holds an item with one hand or has an item on the ground directly below the monitor for 2 seconds, it is identified as a retrieval mode. Furthermore, both storage and retrieval modes will be simultaneously displayed on the smart locker's screen (corresponding to the target item container) when the locker is identified as being in storage or retrieval mode. The screen will then prompt the user to exit storage or retrieval mode, instructing them to verify that their actual intention to store or retrieve items matches the identification result, allowing for manual correction in case of discrepancies. After successful smart identification, there will be no screen operation for 3 seconds (corresponding to the third preset time mentioned above; this third preset time can also be set to 2 seconds, 4 seconds, 5 seconds, etc.). The screen and voice prompts will then ask for the retrieval code, and the voice pickup module will begin recognizing the retrieval code (corresponding to the target retrieval code mentioned above). When the retrieval code is correctly recognized, the locker opens, and the screen displays that the locker door is open. After the locker is closed, the smart locker undergoes disinfection (corresponding to the disinfection process mentioned above), and the screen returns to the homepage. When the IPC camera detects that the user has left the monitoring range, a voice prompt will appear saying "It's nice to serve you," and the smart locker's screen will automatically turn off.

[0054] In a specific embodiment of the present invention, a process for accessing an object is also provided. Figure 3 This is a flowchart illustrating a specific access mode according to an embodiment of the present invention, such as... Figure 3 As shown, the process includes the following steps:

[0055] S302, Begin;

[0056] S304: When a person enters the monitoring range, the smart cabinet screen lights up upon detecting the human figure via the camera.

[0057] S306, make the first judgment to determine whether the person's body temperature is normal;

[0058] When a human figure is detected by a camera, an infrared module is used to detect the person's temperature.

[0059] S308, if the above first judgment result is negative, an abnormal body temperature will be displayed and the operation cannot be performed;

[0060] S310, if the first judgment result is yes, a second judgment is made to determine whether the intelligent recognition is in the item retrieval mode;

[0061] S312, if the second judgment result is negative, intelligently identify it as the item storage mode;

[0062] Using IPC cameras, artificial intelligence deep learning is applied based on factors such as whether a person is carrying items. (That is, when the intelligent recognition is inaccurate, the person can manually correct it on the relevant screen (corresponding to the target screen mentioned above), and after the correction is detected, the correction record is stored for deep learning, thereby making the intelligent recognition result more accurate.) When items are detected, human behavior analysis is used to identify the items carried, further determining whether it is a retrieval or storage mode. When no items are detected, it is considered a retrieval mode, and so on.

[0063] S314, if the second judgment result is yes, the system is intelligently identified as item retrieval mode and the screen displays item retrieval mode;

[0064] S316, perform a third judgment to determine whether to exit the item retrieval mode;

[0065] After the system intelligently identifies the item as being in retrieval mode, the identification result needs to be verified.

[0066] S318, if the above third judgment result is yes (i.e., it is verified to be the item storage mode), the screen exits the item retrieval mode and enters the item storage mode.

[0067] S320, if the above third judgment result is negative (i.e., it is verified to be the item retrieval mode), the smart cabinet will provide a friendly prompt, with the screen and voice prompts asking for the retrieval code. In front of the smart cabinet, the voice pickup module will start to intelligently recognize the voice of the person speaking and obtain the retrieval code.

[0068] S322, perform the fourth judgment to determine whether the pickup code is correct. If the result of the fourth judgment is negative, proceed to step S320.

[0069] S324, if the result of the fourth judgment above is yes, open the cabinet and the screen will indicate that the cabinet door has been opened;

[0070] S326: After retrieving the item, close the cabinet, disinfect the inside of the cabinet, and the screen returns to the home page;

[0071] When the camera detects that a person has left the monitoring range, the S328 smart cabinet turns off its screen and prompts with a voice message: "It's nice to serve you."

[0072] It should also be noted that even when the IPC camera or the microphone module is damaged, the screen operation for storing and retrieving items still works. Furthermore, the screen can be disinfected before using this method to store and retrieve items, further ensuring a low risk of cross-infection from viruses caused by storing and retrieving items under abnormal conditions. In addition, this invention also achieves the following objectives:

[0073] This achieves the goal of contactless storage and retrieval of items. It reduces contact with screens and the risk of cross-infection, making item delivery safer.

[0074] No need to carry a smart mobile device. By recognizing the person's voice to obtain a retrieval code, elderly people and children in the household who do not have smart mobile devices can store and retrieve items, or they can store and retrieve items even if their smart mobile devices are damaged or out of power, etc.;

[0075] Disinfection and safety assurance. Items stored in the smart locker undergo ultraviolet (or other sterilization and disinfection methods) disinfection. After the items are removed and the locker is closed, disinfection is performed again for effective disinfection.

[0076] Energy-saving and environmentally friendly. Human figure recognition is achieved through IPC cameras. The smart cabinet's screen only lights up when a person enters the detection area and automatically turns off when the person leaves, making power supply more intelligent.

[0077] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0078] This embodiment also provides an operation execution device for implementing the above embodiments and preferred embodiments, and details already described will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0079] Figure 4 This is a structural block diagram of an operation execution device according to an embodiment of the present invention, such as... Figure 4 As shown, the device includes:

[0080] The identification module 42 is used to identify the target behavior of the target object when the target object is identified within the monitoring range of the target monitoring device, and to obtain the target identification result.

[0081] The determination module 44 is used to determine the target pattern corresponding to the target behavior based on the target recognition result, wherein the target pattern is a storage pattern or a retrieval pattern;

[0082] The first control module 46 is used to control the target item container to perform the target operation corresponding to the target mode. The storage mode is used to store one or more items in the corresponding container space of the target item container and set the corresponding container space to a closed state after storage. The retrieval mode is used to set the container space where one or more items in the target item container are located to an open state.

[0083] In one exemplary embodiment, the identification module 42 includes:

[0084] The identification submodule is used to identify the target object within the monitoring range of the target monitoring device, and when the temperature of the target object is less than or equal to a preset temperature threshold, to identify the target object's target behavior and obtain the target identification result.

[0085] In one exemplary embodiment, the above-described apparatus further includes:

[0086] The prompting module is used to identify a target object within the monitoring range of the target monitoring device and, when the temperature of the target object is greater than a preset temperature threshold, to prompt the target object with a prompting message according to a preset prompting method. The preset prompting method includes at least one of the following: voice prompt and screen prompt. The target prompting message is used to indicate that the temperature of the target object is abnormal.

[0087] In one exemplary embodiment, the determining module 44 described above includes one of the following:

[0088] The first determining submodule is used to determine the target pattern corresponding to the first behavior as the storage pattern when the target recognition result indicates that the target behavior is the first behavior. The first behavior refers to the target object holding the target item for a first preset time.

[0089] The second determination submodule is used to determine the target pattern corresponding to the second behavior as the object retrieval mode when the target recognition result indicates that the target behavior is the second behavior. The second behavior refers to at least one of the following: the target object does not hold the object, or a target transportation device for transporting the object is identified within the monitoring range.

[0090] In one exemplary embodiment, the first control module 46 described above includes one of the following:

[0091] The first display submodule is used to display the first interface corresponding to the storage mode on the target screen of the target item container when the target mode is the storage mode; the first prompt submodule is used to prompt the target object to perform the storage operation if no operation of the target object is detected on the first interface within a second preset time period.

[0092] The second display submodule is used to display the second interface corresponding to the retrieval mode on the target screen of the target item container when the target mode is the retrieval mode; the second prompt submodule is used to prompt the target object to perform the retrieval operation if no operation of the target object is detected on the second interface within a third preset time period.

[0093] In one exemplary embodiment, the first control module 46 described above includes one of the following:

[0094] The third display submodule is used to display the second interface corresponding to the retrieval mode on the target screen of the target item container when the target mode is the retrieval mode; the first setting submodule is used to set the container space corresponding to the target retrieval code to the open state when the target object inputs the target retrieval code on the second interface within the second preset time period.

[0095] The third prompt submodule is used to prompt the target object to enter the pickup code when the target mode is pickup mode; the second setting submodule is used to set the container space corresponding to the target pickup code to the open state when the target object's target voice is obtained and the target pickup code is recognized in the target voice.

[0096] In one exemplary embodiment, the first control module 46 further includes:

[0097] The first detection submodule is used to detect whether the container space corresponding to the target pickup code is in a closed state after the container space corresponding to the target pickup code is set to an open state when the target mode is pickup mode.

[0098] The first processing submodule is used to disinfect the container space corresponding to the target pickup code when it is detected that the container space is closed.

[0099] In one exemplary embodiment, the first control module 46 further includes one of the following: a second processing submodule, configured to control the target screen of the target item container to be on when the target mode is storage mode, and to display the first interface corresponding to the storage mode on the target screen; and a third processing submodule, configured to control the target screen of the target item container to be on when the target mode is retrieval mode, and to display the second interface corresponding to the retrieval mode on the target screen.

[0100] The aforementioned device further includes: a second control module, used to control the target screen to be in a screen-off state after the target object container performs a target operation corresponding to the target mode and the target object is detected to leave the monitoring range.

[0101] In one exemplary embodiment, the above-described apparatus further includes:

[0102] The first display module is used to display the first interface corresponding to the storage mode on the target screen of the target item container when the target mode is the storage mode; the first switching module is used to switch the interface displayed on the target screen from the first interface to the second interface corresponding to the retrieval mode when the first mode switching operation is detected on the first interface within a second preset time period.

[0103] The second display module is used to display the second interface corresponding to the retrieval mode on the target screen of the target item container when the target mode is the retrieval mode; the second switching module is used to switch the interface displayed on the target screen from the second interface to the first interface corresponding to the storage mode when the second mode switching operation is detected on the second interface within a third preset time period.

[0104] It should be noted that the above modules can be implemented by software or hardware. For the latter, they can be implemented in the following ways, but are not limited to: all the above modules are located in the same processor; or, the above modules are located in different processors in any combination.

[0105] According to yet another embodiment of the present invention, a locker is also provided, including an execution device for the operation as described above.

[0106] Embodiments of the present invention also provide a computer-readable storage medium storing a computer program, wherein the computer program is configured to perform the steps in any of the above method embodiments when executed.

[0107] In one exemplary embodiment, the aforementioned computer-readable storage medium may include, but is not limited to, various media capable of storing computer programs, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard disk, magnetic disk, or optical disk.

[0108] Embodiments of the present invention also provide an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0109] In one exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0110] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.

[0111] The operation execution method provided by this invention achieves contactless access to items without using QR codes and / or barcodes on mobile terminals, solving the problem of high risk of cross-infection caused by contact-based item access, and effectively realizing an integrated service of safe delivery and worry-free consumption.

[0112] It is obvious to those skilled in the art that the modules or steps of the present invention described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. They can be implemented using computer-executable program code, and thus can be stored in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those described herein, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0113] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for performing an operation, characterized in that, include: When a target object is identified within the monitoring range of the target monitoring device, the target behavior of the target object is identified to obtain the target identification result; Based on the target recognition result, a target pattern corresponding to the target behavior is determined, wherein the target pattern is a storage pattern or a retrieval pattern; Control the target item container to perform the target operation corresponding to the target mode, wherein the storage mode is used to store one or more items in the corresponding container space in the target item container and set the corresponding container space to a closed state after storage is completed, and the retrieval mode is used to set the container space where one or more items in the target item container are located to an open state. The determination of the target pattern corresponding to the target behavior based on the target recognition result includes one of the following: when the target recognition result indicates that the target behavior is a first behavior, the target pattern corresponding to the first behavior is determined as the storage pattern, wherein the first behavior refers to the target object holding the target item for a first preset time; when the target recognition result indicates that the target behavior is a second behavior, the target pattern corresponding to the second behavior is determined as the retrieval pattern, wherein the second behavior refers to at least one of the following: the target object does not hold the item, or a target transportation device for transporting items is identified adjacent to the target object within the monitoring range; After the target item container performs the target operation corresponding to the target mode: when the target mode is the item retrieval mode, the target object is a child or an elderly person, and within a second preset time period, if the retrieval code entered by the target object is incorrectly detected multiple times on the second interface corresponding to the retrieval mode displayed on the target screen of the target item container, the target item container temporarily enters the locked mode; the guardian of the target object is prompted that the retrieval code input is abnormal, and the target item container is temporarily locked.

2. The method according to claim 1, characterized in that, When a target object is identified within the monitoring range of the target monitoring device, the target behavior of the target object is identified to obtain a target identification result, including: When the target object is detected within the monitoring range of the target monitoring device and the temperature of the target object is less than or equal to a preset temperature threshold, the target behavior of the target object is identified to obtain the target identification result.

3. The method according to claim 2, characterized in that, The method further includes: When the target object is detected within the monitoring range of the target monitoring device and the temperature of the target object is greater than the preset temperature threshold, a target prompt message is displayed according to a preset prompt method, wherein the preset prompt method includes at least one of the following: voice prompt and screen prompt, and the target prompt message is used to indicate that the temperature of the target object is abnormal.

4. The method according to claim 1, characterized in that, The control of the target item container to perform the target operation corresponding to the target mode includes one of the following: When the target mode is the storage mode, the first interface corresponding to the storage mode is displayed on the target screen of the target item container; if no operation of the target object is detected on the first interface within a second preset time, the target object is prompted to perform a storage operation. When the target mode is the item retrieval mode, a second interface corresponding to the item retrieval mode is displayed on the target screen of the target item container; If no operation of the target object is detected on the second interface within a third preset time period, the target object is prompted to perform a retrieval operation.

5. The method according to claim 1, characterized in that, The control of the target item container to perform the target operation corresponding to the target mode includes one of the following: When the target mode is the item retrieval mode, the second interface corresponding to the item retrieval mode is displayed on the target screen of the target item container; if the target retrieval code input by the target object is detected on the second interface within a second preset time, the container space corresponding to the target retrieval code is set to the open state. When the target mode is the item retrieval mode, the target object is prompted to enter a retrieval code; If the target voice of the target object is obtained and the target pickup code is identified in the target voice, the container space corresponding to the target pickup code is set to open.

6. The method according to claim 5, characterized in that, The step of controlling the target item container to perform the target operation corresponding to the target mode further includes: When the target mode is the item retrieval mode, after setting the container space corresponding to the target retrieval code to the open state, it is detected whether the container space corresponding to the target retrieval code is in the closed state; If the container space corresponding to the target pickup code is detected to be in a closed state, the container space corresponding to the target pickup code shall be disinfected.

7. The method according to any one of claims 1 to 6, characterized in that, The method of controlling the target item container to perform the target operation corresponding to the target mode further includes one of the following: when the target mode is the storage mode, controlling the target screen of the target item container to be on and displaying the first interface corresponding to the storage mode on the target screen; when the target mode is the retrieval mode, controlling the target screen of the target item container to be on and displaying the second interface corresponding to the retrieval mode on the target screen. After controlling the target item container to perform the target operation corresponding to the target mode, the method further includes: when the target object is detected to leave the monitoring range, controlling the target screen to be in a screen-off state.

8. The method according to any one of claims 1 to 6, characterized in that, The method further includes: When the target mode is the storage mode, a first interface corresponding to the storage mode is displayed on the target screen of the target item container; if a first mode switching operation is detected on the first interface within a second preset time, the interface displayed on the target screen is switched from the first interface to a second interface corresponding to the retrieval mode. When the target mode is the item retrieval mode, the second interface corresponding to the item retrieval mode is displayed on the target screen of the target item container; if a second mode switching operation is detected on the second interface within a third preset time period, the interface displayed on the target screen is switched from the second interface to the first interface corresponding to the item storage mode.

9. An operation execution device, characterized in that, include: The identification module is used to identify the target behavior of the target object when the target object is identified within the monitoring range of the target monitoring device, and to obtain the target identification result; The determination module is used to determine the target pattern corresponding to the target behavior based on the target recognition result, wherein the target pattern is a storage pattern or a retrieval pattern; The first control module is used to control the target item container to perform the target operation corresponding to the target mode. The storage mode is used to store one or more items in the corresponding container space of the target item container and set the corresponding container space to a closed state after storage. The retrieval mode is used to set the container space where one or more items in the target item container are located to an open state. The determining module includes one of the following: a first determining submodule, used to determine the target pattern corresponding to the first behavior as a storage mode when the target recognition result indicates that the target behavior is a first behavior, wherein the first behavior refers to the target object holding the target item for a first preset time; and a second determining submodule, used to determine the target pattern corresponding to the second behavior as a retrieval mode when the target recognition result indicates that the target behavior is a second behavior, wherein the second behavior refers to at least one of the following: the target object does not hold the item, or a target transportation device for transporting items is identified adjacent to the target object within the monitoring range. The device is also used to control the target item container to perform the target operation corresponding to the target mode. When the target mode is the item retrieval mode, the target object is a child or an elderly person, and the retrieval code entered by the target object is incorrectly detected multiple times on the second interface corresponding to the item retrieval mode displayed on the target screen of the target item container within a second preset time period, the target item container temporarily enters the lock mode; the guardian of the target object is prompted that the retrieval code input is abnormal, and the target item container is temporarily locked.

10. A storage cabinet, characterized in that, Includes the execution device for the operation as described in claim 9.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein the computer program, when executed by a processor, implements the steps of the method described in any one of claims 1 to 8.

12. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method described in any one of claims 1 to 8.

Images