Banking outlet portable office terminal PAD management method and related device
Through the combination of real-time image acquisition and recognition models, the number and location of PADs in bank outlets' portable office terminals are automatically identified, which solves the problems of PAD loss and illegal use, and realizes automatic storage of PAD and data security guarantees.
Patent Information
- Application Number
- CN202411548314.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-01
- Publication Date
- 2025-02-25
AI Technical Summary
The portable office terminal PAD of bank branches is easily lost or illegally obtained during use and storage, resulting in threats to customer information and bank data security.
By collecting images of storage areas and possible legacy areas in real time, using the pre-constructed PAD identification model and personnel identity identification model, the number and location of PADs are automatically identified, and whether there is any loss or illegal use is determined, and early warning operations are performed according to the specific circumstances.
It realizes automatic storage of PAD, quickly discovers and handles lost or illegal use, and ensures the security of customer information and bank data.
Smart Images

Figure CN119516467A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of artificial intelligence technology, and in particular to a management method and related devices for a portable office terminal PAD at a bank branch. Background Art
[0002] The PAD (Portable Application Description) of bank branches is an important tool for bank business processing. It has powerful front-end processing capabilities and can process customer information, transaction requests and business operations in real time. It is a key link in the smooth operation of bank business. PAD usually stores a large amount of customer information and transaction data. Once leaked or illegally obtained, it may cause serious economic losses to customers and banks. Therefore, properly keeping PAD is an important measure to ensure the security of customer information and bank data. Summary of the invention
[0003] In view of the above problems, the present application provides a management method and related device for a portable office terminal PAD at a bank branch to achieve the purpose of automatic storage of the PAD. The specific scheme is as follows:
[0004] The first aspect of the present application provides a management method for a portable office terminal PAD at a bank branch, comprising:
[0005] Acquire a first image of the storage area collected in real time;
[0006] Inputting the first image into a pre-built PAD recognition model, and obtaining a first number of PADs located in the storage area through the PAD recognition model;
[0007] If the first number is less than the preset PAD number, obtaining second images corresponding to each possible residual area collected in real time;
[0008] Inputting a plurality of the second images into the PAD recognition model, and obtaining second numbers corresponding to each of the possible legacy areas through the PAD recognition model, wherein the second number corresponding to the possible legacy area refers to the number of PADs located in the possible legacy area;
[0009] Acquire the corresponding second number of non-zero target second images from the plurality of second images;
[0010] If the sum of the first number and the second numbers corresponding to each of the possible left-behind areas is less than the preset PAD number, performing a first warning operation;
[0011] Inputting the target second image into a pre-built personnel identification model, obtaining personnel identification information through the personnel identification model, the personnel identification information including the third number of personnel and a business personnel evaluation result of the target personnel closest to the PAD, the business personnel evaluation result being that the target personnel is a business personnel or that the target personnel is not a business personnel;
[0012] If the third number corresponding to the target second image is zero, performing a second warning operation;
[0013] If the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, a third warning operation is performed.
[0014] In a possible implementation, the method further includes:
[0015] After a preset time interval, a third image of the target possible remaining area acquired in real time is input into the PAD recognition model, and a fourth number corresponding to the target possible remaining area is acquired through the PAD recognition model, wherein the target second image and the third image are images acquired at different times for the target possible remaining area;
[0016] If the fourth number is not zero, inputting the third image into the personnel identification model, and obtaining the personnel identification information corresponding to the third image through the personnel identification model;
[0017] If the third number corresponding to the third image is zero, executing the second warning operation;
[0018] If the third number corresponding to the third image is not zero and the corresponding business personnel evaluation result is that the target person is not a business person, the third warning operation is performed.
[0019] In a possible implementation, the method further includes:
[0020] Acquire business handling information from the business server, the business handling information including a target business type of a target business being handled corresponding to the institution code of the bank branch and a fifth number of the target business belonging to the target business type and being handled;
[0021] If the target service type belongs to the preset PAD processing service type, obtaining the sum of the first number and the fifth number;
[0022] If the sum of the first number and the fifth number is less than the preset PAD number, the step of acquiring the second image corresponding to each possible residual area collected in real time is performed.
[0023] In a possible implementation, the personnel identification information further includes the location area of the target person;
[0024] capturing a first captured image located in the position area of the target second image;
[0025] From the preset correspondence between the possible leftover area and the business personnel image, searching for the target business personnel image corresponding to the target possible leftover area; the target business personnel image and the target second image are images taken at the same shooting angle using the same camera for the target possible leftover area; the target business personnel image includes an image of the business personnel wearing work clothes;
[0026] The first captured image and the target business personnel image are input into a pre-built image comparison model, and the similarity between the first captured image and the target business personnel image is obtained through the image comparison model.
[0027] In a possible implementation, if the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, executing a third warning operation step includes:
[0028] If the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, and the similarity is less than or equal to a preset threshold, the third warning operation is performed.
[0029] In a possible implementation, the method further includes:
[0030] If the business personnel evaluation result corresponding to the target second image is that the target person is a business personnel, and the similarity is less than or equal to a preset threshold, the third warning operation is performed.
[0031] In a possible implementation, the step of inputting the plurality of second images into the PAD recognition model includes:
[0032] Obtaining the legacy probabilities corresponding to each of the possible legacy areas;
[0033] Sorting the possible legacy areas from high to low according to the legacy probability to obtain a first sorting result;
[0034] Inputting the second images corresponding to the possible leftover areas into the PAD recognition model in sequence according to the first sorting result;
[0035] If the sum of the second number corresponding to the second images obtained by the PAD recognition model and the first number is equal to the preset PAD number, stop inputting the second images that have not been input into the PAD recognition model into the PAD recognition model.
[0036] In a possible implementation, performing the second warning operation includes:
[0037] Sending reminder information to the first preset number of communication addresses in the second sorting result;
[0038] The second sorting result is the communication addresses of the business personnel sorted from high to low according to the number of legacy PADs.
[0039] A second aspect of the present application provides a management device for a bank branch portable office terminal PAD, comprising:
[0040] A first acquisition module, used to acquire a first image of the storage area collected in real time;
[0041] A second acquisition module, configured to input the first image into a pre-built PAD recognition model, and acquire a first number of PADs located in the storage area through the PAD recognition model;
[0042] A third acquisition module, configured to acquire, if the first number is less than a preset PAD number, second images corresponding to each possible residual area acquired in real time;
[0043] a fourth acquisition module, configured to input the plurality of the second images into the PAD recognition model, and acquire second numbers corresponding to the respective possible legacy areas through the PAD recognition model, wherein the second numbers corresponding to the possible legacy areas refer to the number of PADs located in the possible legacy areas;
[0044] a fifth acquisition module, configured to acquire, from a plurality of the second images, corresponding target second images whose second number is not zero;
[0045] A first execution module, configured to execute a first warning operation if the sum of the first number and the second numbers respectively corresponding to the possible left-behind areas is less than the preset PAD number;
[0046] a sixth acquisition module, configured to input the target second image into a pre-built personnel identification model, and acquire personnel identification information through the personnel identification model, wherein the personnel identification information includes a third number of personnel and a business personnel evaluation result of the target personnel closest to the PAD, wherein the business personnel evaluation result is that the target personnel is a business personnel or the target personnel is not a business personnel;
[0047] A second execution module, configured to execute a second warning operation if the third number corresponding to the target second image is zero;
[0048] The third execution module is used to execute a third warning operation if the business personnel evaluation result corresponding to the target second image is that the target person is not a business person.
[0049] The third aspect of the present application provides a computer program product, including computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements the management method of the portable office terminal PAD of a bank branch according to the first aspect or any implementation method of the first aspect.
[0050] A fourth aspect of the present application provides an electronic device, comprising at least one processor and a memory connected to the processor, wherein:
[0051] The memory is used to store computer programs;
[0052] The processor is used to execute the computer program so that the electronic device can implement the management method of the bank branch portable office terminal PAD according to the above-mentioned first aspect or any implementation method of the first aspect.
[0053] The fifth aspect of the present application provides a computer storage medium, which carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement a method for managing a portable office terminal PAD at a bank branch according to the first aspect or any implementation method of the first aspect.
[0054] By means of the above technical solution, the present application provides a management method for portable office terminals PADs at bank branches, which collects a first image of a storage area in real time. If the number of PADs in the first image is less than the preset number of PADs, collects second images corresponding to each possible remaining area in real time; obtains a target second image whose corresponding second number is not zero from multiple second images; thereby determining the possible remaining area of the remaining PAD; if there are business personnel around the PAD in the target second image, no warning is issued; if there are no people or business personnel around the PAD in the target second image, a warning is issued. If the sum of the first number and the second number corresponding to all second images is less than the preset number of PADs, it means that a PAD is lost, and a warning is issued. Thus, the PAD can be quickly put back into the storage area, achieving the purpose of properly keeping the PAD. BRIEF DESCRIPTION OF THE DRAWINGS
[0055] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.
[0056] Figure 1 A schematic diagram of a system architecture provided for this application;
[0057] Figure 2 A schematic diagram of an optional hardware structure of a portable office terminal 100 provided in this application;
[0058] Figure 3 A schematic diagram of the structure of a service server 200 provided in this application;
[0059] Figure 4 A flowchart of a method for managing a portable office terminal PAD at a bank branch provided in an embodiment of the present application;
[0060] Figure 5 A schematic diagram of the structure of a management device for a portable office terminal PAD at a bank branch provided in an embodiment of the present application;
[0061] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0062] The following describes the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation method section of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.
[0063] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0064] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.
[0065] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.
[0066] See also Figure 1 , Figure 1 A schematic diagram of a system architecture is shown. The system may include a plurality of portable office terminals 100 , a plurality of service servers 200 , a plurality of cameras 300 and an electronic device 400 .
[0067] The business server 200 may include one or more servers ( Figure 1 A business server is used as an example for explanation).
[0068] The service server 200 is a server for interacting with the PAD 100 to handle corresponding services. For example, the services that the PAD 100 can handle include, but are not limited to: smart counter identity verification and identity entry.
[0069] Exemplarily, different service servers 200 may handle different service types.
[0070] Among them, applications and web pages can be installed on the portable office terminal 100. The above applications and web pages can provide an interface. The portable office terminal 100 can receive relevant information entered by the business personnel on the interface and send the above information to the business server 200. The business server 200 can obtain processing results based on the received information and return the processing results to the portable office terminal 100, thereby completing the business processing through the interaction between PAD (Portable Application Description, portable office terminal) and the business server 200.
[0071] Each bank branch has a unique organization code. A bank branch has multiple devices, such as self-service terminals, desktop computers at bank counters, and PADs. When a device belonging to a bank branch interacts with the business server 200, the information sent to the business server carries the organization code of the bank branch. Therefore, the business server 200 can distinguish which bank branch the PAD comes from based on the organization code.
[0072] Exemplarily, the self-service terminal includes, but is not limited to: ATM (Automated Teller Machine), self-service terminal, foreign currency exchange machine, night deposit machine.
[0073] For example, the services that need to be handled by PAD in bank branches are different from those handled by other devices, so it can be determined whether the service is handled by PAD or other devices based on the service type of the service handled by the service server 200. For example, one PAD can handle one service at the same time.
[0074] Exemplarily, multiple cameras 300 are deployed at a bank branch. It is understandable that the space of a bank branch is relatively large, and if a small number of cameras are set, there may be blind spots for monitoring. Based on this, multiple cameras can be set.
[0075] Exemplarily, the camera 300 is used to capture still images or videos. The subject (object or organism) generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal.
[0076] Exemplarily, the camera 300 may be connected to an NVR (Network Video Recorder), which receives, stores and manages the video images captured by the camera.
[0077] For example, multiple cameras 300 collect images of different areas (referred to as possible leftover areas and storage areas in this embodiment of the application) of a bank branch in real time. One camera 300 collects images of a possible leftover area in real time; different cameras collect images of different possible leftover areas. One camera collects images of the storage area in real time.
[0078] Exemplarily, the electronic device 400 is respectively connected to multiple cameras 300 and multiple business servers 200 for communication, so that images captured by multiple cameras 300 can be analyzed, thereby executing the management method of the bank branch portable office terminal PAD provided in this application.
[0079] Exemplarily, the electronic device 400 may be an edge computing box or a server cluster or a server or an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc., and the embodiments of the present application do not impose any limitations on this.
[0080] Exemplarily, if the electronic device 400 is an edge computing box, the electronic device 400 is deployed at a bank branch.
[0081] Figure 2 An optional hardware structure diagram of the portable office terminal 100 is shown.
[0082] refer to Figure 2 As shown, the portable office terminal 100 may include a radio frequency unit 110, a memory 120, an input unit 130, a display unit 140, a camera 150 (optional), an audio circuit 160 (optional), a speaker 161 (optional), a microphone 162 (optional), an earphone jack 163 (optional), a processor 170, an external interface 180, a power supply 190 and other components. Those skilled in the art will understand that Figure 2 This is only an example of a portable office terminal and does not constitute a limitation on the portable office terminal. The portable office terminal may include more or fewer components than shown in the figure, or a combination of certain components, or different components.
[0083] The input unit 130 can be used to receive input digital or character information, and generate key signal input related to the user settings and function control of the portable office terminal. Specifically, the input unit 130 may include a touch screen 131 (optional) and / or other input devices 132. The touch screen 131 can collect the user's touch operations on or near it (such as the user's operation on or near the touch screen using any suitable object such as fingers, joints, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch screen can detect the user's touch action on the touch screen, convert the touch action into a touch signal and send it to the processor 170, and can receive and execute the command sent by the processor 170; the touch signal at least includes the touch point coordinate information. The touch screen 131 can provide an input interface and an output interface between the portable office terminal 100 and the user. In addition, the touch screen can be implemented using multiple types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch screen 131, the input unit 130 can also include other input devices. Specifically, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.
[0084] Among them, the input device 132 can receive input data and the like.
[0085] The display unit 140 may be used to display information input by the user or provided to the user, various menus of the portable office terminal 100, interactive interfaces, file display, and / or playback of any multimedia file. In the embodiment of the present application, the display unit 140 may be used to display the interface of the business being processed, the processing results, etc.
[0086] The memory 120 can be used to store instructions and data. The memory 120 can mainly include an instruction storage area and a data storage area. The data storage area can store various data, such as multimedia files, texts, etc.; the instruction storage area can store software units such as operating systems, applications, instructions required for at least one function, or their subsets and extensions. It can also include a non-volatile random access memory; provide the processor 170 with hardware, software and data resources including management of computing and processing equipment, and support control software and applications. It is also used for the storage of multimedia files, and the storage of running programs and applications.
[0087] The processor 170 is the control center of the portable office terminal 100. It uses various interfaces and lines to connect various parts of the entire portable office terminal 100. By running or executing instructions stored in the memory 120 and calling data stored in the memory 120, it executes various functions of the portable office terminal 100 and processes data, thereby controlling the portable office terminal device as a whole. Optionally, the processor 170 may include one or more processing units; preferably, the processor 170 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application program, and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 170. In some embodiments, the processor and the memory may be implemented on a single chip, and in some embodiments, they may also be implemented separately on separate chips. The processor 170 may also be used to generate corresponding operation control signals, send them to corresponding components of the computing and processing device, read and process data in the software, especially read and process data and programs in the memory 120, so that each functional module therein performs corresponding functions, thereby controlling the corresponding components to act according to the requirements of the instructions.
[0088] The radio frequency unit 110 (optional) can be used for receiving and sending information or receiving and sending signals during a call, for example, after receiving the downlink information of the base station, it is sent to the processor 170 for processing; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, etc. In addition, the radio frequency unit 110 can also communicate with network devices and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (SMS), etc.
[0089] In this embodiment of the present application, the radio frequency unit 110 can send data to the service server 200 and receive a processing result sent by the service server 200.
[0090] It should be understood that the radio frequency unit 110 is optional and can be replaced by other communication interfaces, such as a network port.
[0091] The portable office terminal 100 also includes a power supply 190 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 170 through a power management system, so that the power management system can manage charging, discharging, power consumption and other functions.
[0092] The portable office terminal 100 also includes an external interface 180 , which may be a standard Micro USB interface or a multi-pin connector, and may be used to connect the portable office terminal 100 to other devices for communication, or may be used to connect a charger to charge the portable office terminal 100 .
[0093] Although not shown, the portable office terminal 100 may also include a flashlight, a wireless fidelity (WiFi) module, a Bluetooth module, sensors with different functions, etc., which will not be described in detail here. Part or all of the methods described below can be applied to Figure 2 In the portable office terminal 100 shown.
[0094] Next describe Figure 1 The product form of the middle business server 200;
[0095] Figure 3 A structural diagram of a business server 200 is provided, such as Figure 3 As shown, the service server 200 includes a bus 201, a processor 202, a communication interface 203 and a memory 204. The processor 202, the memory 204 and the communication interface 203 communicate with each other via the bus 201.
[0096] The bus 201 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0097] The processor 202 may be any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).
[0098] The memory 204 may include a volatile memory, such as a random access memory (RAM). The memory 204 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).
[0099] The memory 204 may be used to store software codes related to the business processing method, the processor 202 may execute the steps of the business processing method of the chip, and may also schedule other units to implement corresponding functions.
[0100] It should be understood that the portable office terminal 100 and the business server 200 may be centralized or distributed devices, and the processors in the portable office terminal 100 and the business server 200 (e.g., the processor 170 and the processor 202) may be hardware circuits (e.g., application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), general-purpose processors, digital signal processors (DSP), microprocessors or microcontrollers, etc.), or a combination of these hardware circuits. For example, the processor may be a hardware system with an instruction execution function, such as a CPU, a DSP, etc., or a hardware system without an instruction execution function, such as an ASIC, an FPGA, etc., or a combination of the above-mentioned hardware systems without an instruction execution function and hardware systems with an instruction execution function.
[0101] Reference Figure 4 , Figure 4 A flow chart of a method for managing a portable office terminal PAD at a bank branch provided in an embodiment of the present application is shown as follows: Figure 4As shown, a method for managing a portable office terminal PAD at a bank branch provided in an embodiment of the present application may include steps S401 to S409, and these steps are described in detail below.
[0102] Step S401: Acquire a first image of the storage area collected in real time.
[0103] The safekeeping area is where the PAD is kept. If the business personnel need to use the PAD to handle business, they need to take the PAD out of the safekeeping area. The business personnel may take the PAD to other areas of the bank branch to handle business for customers. After the business personnel complete the business with the PAD, they should return the PAD to the safekeeping area.
[0104] For example, the PADs located in the storage area are all PADs that have completed business processing, that is, the PADs located in the storage area are in a state of not processing business. In theory, the PADs not located in the storage area should be in the process of processing business, but because some business personnel do not return the PAD to the storage area in time after completing business processing through the PAD, the PADs not located in the storage area may also be in a state of not processing business.
[0105] It can be understood that in order to collect the first image of the storage area in real time, a camera can be set for the storage area, and the first image of the storage area can be collected in real time through the camera.
[0106] Step S402: input the first image into a pre-built PAD recognition model, and obtain a first number of PADs located in the storage area through the PAD recognition model.
[0107] Exemplarily, the PAD recognition model can be obtained by training by taking the first sample image as input and the number of PADs contained in the first sample image as a training target. Exemplarily, the number of PADs contained in different first sample images may be different or the same; the placement of PADs in different first sample images may be the same or different.
[0108] Step S403: if the first number is less than the preset PAD number, obtain second images corresponding to each possible leftover area collected in real time.
[0109] In the embodiment of the present application, the area in a bank branch where PADs may be left behind is referred to as a possible left-behind area.
[0110] Among them, the preset PAD number is the total number of PADs in bank branches. It can be understood that if the first number is less than the preset PAD number, it means that there are PADs whose number is the difference between the preset PAD number and the first number in the possible legacy area.
[0111] It can be understood that among the PADs that are the difference between the preset number of PADs and the first number, there are the following four situations: situation one: the PAD is in the process of handling business and the business personnel are around the PAD. This is a compliant use of the PAD. Since the business personnel are around the PAD, there is no risk of customer information leakage or PAD loss, and no warning is required; situation two: the PAD is in the process of handling business and the business personnel are not around the PAD. This is a non-compliant use of the PAD. Since the business personnel are not around the PAD, there is a risk of customer information leakage or PAD loss, and a warning can be issued; situation three: the PAD has been completed The business has been completed and the business personnel are around the PAD. For example, after completing the business, the customer needs to consult the business personnel on other issues. At this time, the business personnel cannot put the PAD back to the storage area in time. Since the business personnel are around the PAD, there is no risk of customer information leakage or PAD loss, and no warning is required; Situation 4: The PAD has completed the business and the business personnel are not around the PAD. This means that the business personnel may have forgotten to put the PAD back to the storage area after completing the business through the PAD. Since the business personnel are not around the PAD, there is a risk of customer information leakage or PAD loss, and a warning can be issued. The purpose of collecting the second image in step S403 is to distinguish the above four situations.
[0112] Step S404: input the plurality of second images into the PAD recognition model, and obtain the second numbers corresponding to the respective possible leftover regions through the PAD recognition model.
[0113] The second number corresponding to the possible legacy area refers to the number of PADs located in the possible legacy area.
[0114] Exemplarily, the PAD recognition model can be obtained by training by taking the first sample image as input and the number of PADs contained in the first sample image as a training target. The acquisition process of the first sample image is described below, and the acquisition process of the first sample image includes but is not limited to the following steps A1 to A6.
[0115] Step A1: Acquire images of the PAD, images of the storage area, images corresponding to each possible legacy area, images of business personnel wearing work clothes collected by each camera deployed at the bank branch, and images of personnel not wearing work clothes collected by each camera deployed at the bank branch.
[0116] Step A2: Synthesize the image of the PAD, the image of the storage area, the images corresponding to each possible legacy area, the images of business personnel wearing work clothes collected by each camera deployed at the bank branch, and the images of personnel not wearing business personnel clothes collected by each camera deployed at the bank branch to obtain a first sample image.
[0117] Exemplarily, some first sample images only include PAD, some first sample images only include PAD and images of business personnel wearing work clothes, some first sample images only include PAD and images of business personnel not wearing work clothes, some first sample images only include PAD, images of business personnel wearing work clothes and images of business personnel not wearing work clothes, and some first sample images include images of storage areas.
[0118] For example, if the PAD is left behind in a possible leftover area more times, a larger number of first sample images containing the possible leftover area are generated. If the PAD is left behind in a possible leftover area less times, a smaller number of first sample images containing the possible leftover area are generated.
[0119] Step S405: acquiring corresponding target second images whose second number is not zero from the plurality of second images.
[0120] It is understandable that if the second number is zero, it means that there is no PAD left in the possible leftover area. If the second number is not zero, it means that there is PAD left in the possible leftover area corresponding to the second image.
[0121] Step S406: If the sum of the first number and the second numbers corresponding to each of the possible leftover areas is less than the preset PAD number, a first warning operation is performed.
[0122] It can be understood that the sum of the first number and the second number corresponding to each possible left-behind area is the total number of all PADs that the bank branch can find. If it is less than the preset number of PADs, it means that a PAD has been lost, for example, it may have been taken outside the bank branch or hidden.
[0123] If the sum of the first number and the second numbers corresponding to each of the possible left-behind areas is equal to the preset number of PADs, it means that all PADs are in the bank branch and have not been lost.
[0124] Step S407: input the target second image into a pre-built personnel identity recognition model, and obtain personnel identity recognition information through the personnel identity recognition model.
[0125] The personnel identification information includes a third number of personnel and a business personnel evaluation result of a target person closest to the PAD, wherein the business personnel evaluation result is that the target person is a business person or the target person is not a business person. The third number of personnel in the personnel identification information obtained by inputting the image into the personnel identification model refers to the number of personnel located in the image.
[0126] Exemplarily, the personnel identification model is obtained by training by taking the second sample image as input, and taking the actual number of personnel in the second sample image and the actual business personnel evaluation result of the personnel closest to the PAD as training targets. The second sample image can be obtained from the first sample image.
[0127] Step S408: If the third number corresponding to the target second image is zero, execute a second warning operation.
[0128] If the third number corresponding to the target second image is zero, it means that there is no one around the PAD, let alone any business personnel, so an early warning is required.
[0129] Exemplarily, since the first warning operation is mainly a warning for recovering a lost PAD, and the second warning operation is a warning for recovering a PAD with no business personnel around, the warning level of the first warning operation is higher than or equal to the warning level of the second warning operation.
[0130] Exemplarily, the number of the target second images may be one or more.
[0131] Step S409: If the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, a third warning operation is performed.
[0132] It can be understood that the implementation basis of step S409 is that the third number is not zero.
[0133] Exemplarily, if the business personnel evaluation result corresponding to the target second image is that the target person is a business personnel, the third warning operation is not performed.
[0134] Exemplarily, since there are non-business personnel around the PAD, there is a possibility that the PAD is lost, so the warning level of the third warning operation is higher than the warning level of the second warning operation; the warning level of the first warning operation is higher than the warning level of the third warning operation.
[0135] The embodiment of the present application can determine the specific matters of the early warning operation based on the actual situation, for example, sending early warning information to the communication terminal of the security personnel, sending early warning information to the communication terminal of the staff, and sending reminder information to the first preset number of communication addresses in the second sorting result. Among them, the second sorting result is the communication addresses of the business personnel sorted from high to low according to the number of legacy PADs. The specific matters of the early warning operation corresponding to different early warning levels may be different or the same.
[0136] In the embodiment of the present application, the staff refers to the employees who search for the legacy PAD, and the business personnel refers to the employees who use the PAD to handle business.
[0137] It is understandable that the business personnel with a higher number of times of leaving PAD behind have the highest probability of leaving PAD behind, so reminder information can be sent to the first preset number of communication addresses in the second sorting result to remind business personnel with a higher number of times of leaving PAD behind whether they have left PAD behind, thereby facilitating the quick retrieval of PAD.
[0138] Exemplarily, the preset number may be determined based on actual conditions and is not limited here.
[0139] Exemplarily, the information sent to the communication terminal of the business personnel or security personnel also includes the target second image and the actual location of the target second image, so that the business personnel or security personnel can quickly find the leftover PAD.
[0140] The embodiment of the present application provides a management method for a portable office terminal PAD at a bank branch, which collects a first image of a storage area in real time. If the number of PADs in the first image is less than a preset number of PADs, collects second images corresponding to each possible remaining area in real time; obtains a target second image whose corresponding second number is not zero from multiple second images; thereby determining the possible remaining area of the remaining PAD; if there are business personnel around the PAD in the target second image, no warning is issued; if there are no people or business personnel around the PAD in the target second image, a warning is issued. If the sum of the first number and the second number corresponding to all second images is less than the preset number of PADs, it means that a PAD is lost, and a warning is issued. In this way, the PAD can be quickly put back into the storage area, achieving the purpose of properly keeping the PAD.
[0141] It is understandable that the possible remaining areas corresponding to the cameras deployed at the bank outlets are pre-set. Since step S408 and step S409 have determined the corresponding third number of zero target second image G1 and the target second image G2 in which the business personnel judged that the target personnel is not a business personnel, it is determined that the possible target remaining area corresponding to the camera corresponding to the target second image G1 has PAD left and there is no one around the PAD; it is determined that the target possible remaining area corresponding to the camera corresponding to the target second image G2 has PAD left and there are non-business personnel around the PAD. After the early warning, in order to detect whether the corresponding staff has put the PAD back to the custody area, the third image can be acquired again in real time for the target remaining area after a preset time interval to determine whether there is still a PAD in the third image, or whether there are business personnel around the PAD. This is explained in detail below. The process includes the following steps B1 to B4.
[0142] Step B1: After a preset time interval, the third image of the target possible remaining area acquired in real time is input into the PAD recognition model, and the fourth number corresponding to the target possible remaining area is obtained through the PAD recognition model, and the target second image and the third image are images acquired at different times for the target possible remaining area.
[0143] The fourth number refers to the number of PADs in the third image.
[0144] It can be understood that the third image and the second target image are images of the possible remaining area of the target acquired at different times. The time of acquiring the third image is later than the time of acquiring the second target image.
[0145] Step B2: If the fourth number is not zero, input the third image into the personnel identification model, and obtain the personnel identification information corresponding to the third image through the personnel identification model.
[0146] It can be understood that if the fourth number is zero, it means that a staff member has already put the PAD back to the storage area.
[0147] Step B3: If the third number corresponding to the third image is zero, execute the second warning operation.
[0148] Step B4: If the third number corresponding to the third image is not zero and the corresponding business personnel evaluation result is that the target person is not a business person, execute the third warning operation.
[0149] It is understandable that if there is no staff handling the matter after the first warning, a second warning will be issued.
[0150] It is understandable that, with respect to the first and second situations, the probability of the second situation is very low, so if the sum of the number of PADs currently handling services and the first number is equal to the preset number of PADs, it is not necessary to perform step S403 "obtaining the second images corresponding to each possible residual area acquired in real time". The first and second situations are described again below.
[0151] Case 1: The PAD is processing business and the business personnel are around the PAD. This is compliant use of the PAD. Since the business personnel are around the PAD, there is no risk of customer information leakage or PAD loss, and no warning is required. Case 2: The PAD is processing business and the business personnel are not around the PAD. This is non-compliant use of the PAD. Since the business personnel are not around the PAD, there is a risk of customer information leakage or PAD loss, and a warning may be issued.
[0152] In summary, the method includes the following steps C1 to C3.
[0153] Step C1: Acquire business handling information from a business server, wherein the business handling information includes a target business type of a target business being handled corresponding to the institution code of the bank branch and a fifth number of the target business belonging to the target business type and being handled.
[0154] Exemplarily, the number of target service types may be one or more.
[0155] Step C2: If the target service type belongs to the preset PAD processing service type, the sum of the first number and the fifth number is obtained.
[0156] It is understandable that each bank branch has a unique organization code, and the bank branch has multiple devices, such as self-service terminals, desktop computers at bank counters, and PADs. When the devices belonging to the bank branch interact with the business server 200, the information sent to the business server carries the organization code of the bank branch. Therefore, the business server 200 can distinguish which bank branch the PAD comes from based on the organization code. The business that needs to be handled by the PAD in the bank branch is different from the business handled by other devices, so it can be determined based on the business type of the business handled by the business server 200 whether the business is handled by the PAD or by other devices.
[0157] For example, the same PAD can handle one service at the same time, so the fifth number of the target service being handled can represent the number of PADs that are handling the service.
[0158] Step C3: If the sum of the first number and the fifth number is less than the preset PAD number, execute step S403.
[0159] Exemplarily, if the sum of the first number and the fifth number is equal to the preset PAD number, it means that the PADs that are not located in the storage area are all processing business, which is most likely the case of the first situation mentioned above, so step S403 does not need to be executed.
[0160] It is understandable that the personnel identification model trained by the present application is relatively accurate. However, due to the complexity of the actual scenario, for example, some customers' attire is very similar to the work clothes of the business personnel, which may cause the personnel identification model to mistakenly identify customers as business personnel, or mistakenly identify business personnel as customers. Based on this, the present application also provides the following method, which includes the following steps D1 to D3 during implementation.
[0161] Step D1: capturing a first captured image located in the position area of the target second image.
[0162] Exemplarily, the person identification information also includes the location area of the target person, that is, the location area of the target person in the target second image.
[0163] Step D2: searching for a target business personnel image corresponding to a target possible leftover area from the preset correspondence between possible leftover areas and business personnel images.
[0164] The target business personnel image and the target second image are images taken at the same shooting angle using the same camera and targeting the possible remaining area of the target; the target business personnel image includes an image of a business personnel wearing work clothes.
[0165] Exemplarily, the shooting angle of each camera deployed at a bank branch in the embodiment of the present application is fixed, so that multiple cameras can monitor the bank branch without blind spots. In order to avoid the inability to accurately distinguish between the customer's attire and the business staff's attire due to the shooting angle, the embodiment of the present application has pre-captured multiple business staff images corresponding to each camera deployed at the bank branch. The business staff image corresponding to a camera refers to an image taken when the business staff is wearing work clothes and is in the possible legacy area corresponding to the camera. Exemplarily, the postures of the business staff in different business staff images corresponding to the same possible legacy area may be different.
[0166] Step D3: inputting the first captured image and the target business personnel image into a pre-built image comparison model, and obtaining the similarity between the first captured image and the target business personnel image through the image comparison model.
[0167] Exemplarily, the image comparison model is obtained by training by taking the third sample image and the fourth sample image as input and taking the actual result of whether the clothing of the person in the third sample image is consistent with the clothing of the person in the fourth sample image as the training target.
[0168] The corresponding step S409 includes: if the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, and the similarity is less than or equal to a preset threshold, executing the third warning operation.
[0169] Exemplarily, the preset threshold may be determined based on actual conditions, for example, the preset threshold is 70%.
[0170] Correspondingly, it also includes: if the business personnel evaluation result corresponding to the target second image is that the target person is a business person, and the similarity is less than or equal to a preset threshold, executing the third warning operation.
[0171] In summary, in the embodiments of the present application, it is believed that the accuracy of the results obtained by the image comparison model is higher than the accuracy of the results obtained by the personnel identification model, because the image comparison model is a relatively general and very mature model.
[0172] In an optional implementation, there are multiple implementations of step S404, and the embodiments of the present application provide but are not limited to the following two.
[0173] The first implementation of step S404 includes: inputting all second images into the PAD recognition model at the same time, and obtaining the second numbers corresponding to each of the possible leftover regions through the PAD recognition model. However, this method consumes more computing resources.
[0174] In an optional implementation, multiple second images can be serially input into the PAD recognition model in sequence. Assuming that after the first second image is input, the sum of the second number corresponding to the second image obtained by the PAD recognition model and the first number is equal to the preset PAD number, there is no need to input the second second image, the third second image, ... into the PAD recognition model. The method is described below, that is, the second implementation of step S404 includes the following steps F1 to F4.
[0175] Step F1: Obtain the legacy probabilities corresponding to each of the possible legacy areas.
[0176] Exemplarily, the number of legacy PADs corresponding to each possible legacy area can be counted; for each possible legacy area, the legacy probability of the possible legacy area is determined = the number of legacy PADs of the possible legacy area / (the sum of the number of legacy PADs corresponding to all possible legacy areas).
[0177] Step F2: Sort the possible legacy areas from high to low according to the legacy probability to obtain a first sorting result.
[0178] Assume that the bank branches include 4 possible legacy areas, namely the first possible legacy area, the second possible legacy area, the third possible legacy area and the fourth possible legacy area. Assume that the legacy probability of the first possible legacy area is 50%, the legacy probability of the second possible legacy area is 25%, the legacy probability of the third possible legacy area is 10%, and the legacy probability of the fourth possible legacy area is 15%. Then the first sorting result is: the first possible legacy area, the second possible legacy area, the fourth possible legacy area, and the third possible legacy area.
[0179] Step F3: inputting the second images corresponding to the possible leftover areas into the PAD recognition model in sequence according to the first sorting result.
[0180] Still taking the above example, the order of the second images input into the PAD recognition model is: the second image of the first possible legacy area, the second image of the second possible legacy area, the second image of the fourth possible legacy area, and the second image of the third possible legacy area.
[0181] Step F4: If the sum of the second number corresponding to the second image obtained by the PAD recognition model and the first number is equal to the preset PAD number, stop inputting the second image that has not been input into the PAD recognition model into the PAD recognition model.
[0182] For example, if after the second image of the first possible legacy area is input into the PAD recognition model, the sum of the second number and the first number of the second images of the first possible legacy area is equal to the preset PAD number, then there is no need to input the second image of the second possible legacy area, the second image of the fourth possible legacy area, and the second image of the third possible legacy area into the PAD recognition model, because there is no PAD in the second image of the second possible legacy area, the second image of the fourth possible legacy area, and the second image of the third possible legacy area. If the sum of the second number and the first number of the second images of the first possible legacy area is less than the preset PAD number, then the second image of the second possible legacy area is input into the PAD recognition model, and so on, which will not be elaborated here.
[0183] It can be understood that after determining that the target person closest to the PAD in the target second image is a business personnel, if the actual distance between the target person closest to the PAD and the PAD is greater than 1 meter, due to the far distance between the target person and the PAD, it can also be considered that there are no staff around the PAD. At this time, an early warning should also be given. Based on this, an embodiment of the present application also provides the following method, which includes the following steps G1 to G3 during implementation.
[0184] Step G1: If it is determined that the target person closest to the PAD is a business person, the actual distance between the PAD and the target person is obtained based on the shooting angle and position of the camera that captures the target second image and the pixel distance between the PAD and the target person in the target second image.
[0185] Step G2: If the actual distance is greater than the preset distance, the second warning operation is performed.
[0186] Exemplarily, the preset distance may be determined based on actual conditions, which will not be elaborated here.
[0187] In an optional implementation, the reserved PAD duration corresponding to each business personnel can be obtained. The reserved PAD duration corresponding to the business personnel refers to the difference between the end time and the start time, the start time refers to the time when the business personnel completes the business through the PAD, and the end time refers to the time when the PAD is returned to the storage area. In the process of performing the first warning operation, the second warning operation, or the third warning operation, the communication address of the business personnel with a longer reserved PAD duration can be preferentially sent a prompt message. If the business personnel with a longer reserved PAD duration receive the prompt message, they can feedback whether they carry a PAD, which is convenient for quickly finding the remaining PAD.
[0188] A method for managing a portable office terminal PAD at a bank branch provided in an embodiment of the present application is introduced above. A device for executing the method for managing a portable office terminal PAD at a bank branch is introduced below.
[0189] See also Figure 5 , Figure 5 A schematic diagram of a management device for a bank branch portable office terminal PAD provided in an embodiment of the present application. Figure 5 As shown in the figure, the management of the bank branch's portable office terminal PAD includes:
[0190] A first acquisition module 501 is used to acquire a first image of the storage area collected in real time;
[0191] A second acquisition module 502 is used to input the first image into a pre-built PAD recognition model, and acquire a first number of PADs located in the storage area through the PAD recognition model;
[0192] A third acquisition module 503 is used to acquire second images corresponding to each possible residual area collected in real time if the first number is less than a preset PAD number;
[0193] A fourth acquisition module 504 is used to input the plurality of second images into the PAD recognition model, and obtain second numbers corresponding to each of the possible legacy areas through the PAD recognition model, where the second number corresponding to the possible legacy area refers to the number of PADs located in the possible legacy area;
[0194] A fifth acquisition module 505, configured to acquire the corresponding second number of non-zero target second images from the plurality of second images;
[0195] A first execution module 506, configured to execute a first warning operation if the sum of the first number and the second numbers respectively corresponding to the possible left-behind areas is less than the preset PAD number;
[0196] a sixth acquisition module 507, configured to input the target second image into a pre-built personnel identification model, and obtain personnel identification information through the personnel identification model, wherein the personnel identification information includes a third number of personnel and a business personnel evaluation result of the target personnel closest to the PAD, wherein the business personnel evaluation result is that the target personnel is a business personnel or the target personnel is not a business personnel;
[0197] A second execution module 508, configured to execute a second warning operation if the third number corresponding to the target second image is zero;
[0198] The third execution module 509 is configured to execute a third warning operation if the business personnel evaluation result corresponding to the target second image is that the target person is not a business person.
[0199] In an optional implementation, the method further includes:
[0200] A sixth acquisition module is used to input the third image of the target possible leftover area acquired in real time into the PAD recognition model after a preset time interval, and acquire a fourth number corresponding to the target possible leftover area through the PAD recognition model, wherein the target second image and the third image are images acquired at different times for the target possible leftover area;
[0201] a seventh acquisition module, configured to input the third image into the personnel identification model if the fourth number is not zero, and acquire the personnel identification information corresponding to the third image through the personnel identification model;
[0202] a fourth execution module, configured to execute the second warning operation if the third number corresponding to the third image is zero;
[0203] The fifth execution module is used to execute the third warning operation if the third number corresponding to the third image is not zero and the corresponding business personnel evaluation result is that the target person is not a business person.
[0204] In an optional implementation, the method further includes:
[0205] an eighth acquisition module, configured to acquire business handling information from the business server, the business handling information including a target business type of a target business being handled corresponding to the institution code of the bank branch and a fifth number of the target business belonging to the target business type and being handled;
[0206] A ninth acquisition module, configured to acquire the sum of the first number and the fifth number if the target service type belongs to a preset PAD processing service type;
[0207] A triggering module is used to trigger the third acquisition module if the sum of the first number and the fifth number is less than the preset PAD number.
[0208] In an optional implementation, the personnel identification information further includes the location area of the target person; and further includes:
[0209] A captured image is used to capture a first captured image located in the position area of the target second image;
[0210] A search module is used to search for a target business personnel image corresponding to a target possible left-behind area from a preset correspondence between a possible left-behind area and a business personnel image; the target business personnel image and the target second image are images taken at the same shooting angle using the same camera for the target possible left-behind area; the target business personnel image includes an image of a business personnel wearing work clothes;
[0211] The tenth acquisition module is used to input the first captured image and the target business personnel image into a pre-built image comparison model, and obtain the similarity between the first captured image and the target business personnel image through the image comparison model.
[0212] In an optional implementation, the third execution module is specifically used to: if the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, and the similarity is less than or equal to a preset threshold, execute the third warning operation.
[0213] In an optional implementation, the method further includes:
[0214] The sixth execution module is used to execute the third warning operation if the business personnel evaluation result corresponding to the target second image is that the target person is a business personnel and the similarity is less than or equal to a preset threshold.
[0215] In an optional implementation, the second acquisition module includes:
[0216] A first acquisition unit is used to acquire the legacy probabilities corresponding to each of the possible legacy areas;
[0217] A sorting unit, configured to sort the possible legacy areas from high to low according to the legacy probability, so as to obtain a first sorting result;
[0218] An input unit, used for inputting the second images corresponding to the possible leftover areas into the PAD recognition model in sequence according to the first sorting result;
[0219] A control unit, used for stopping inputting the second image which has not been inputted into the PAD recognition model into the PAD recognition model if the sum of the second number corresponding to the second image obtained by the PAD recognition model and the first number is equal to the preset PAD number.
[0220] In an optional implementation, the second execution module includes:
[0221] A sending unit, used for sending reminder information to a preset number of communication addresses in the second sorting result;
[0222] The second sorting result is the communication addresses of the business personnel sorted from high to low according to the number of legacy PADs.
[0223] The present application also provides an electronic device in an embodiment. Figure 6 As shown, it shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiments of the present application. The electronic device in the embodiments of the present application may include but is not limited to fixed portable office terminals such as mobile phones, notebook computers, PDAs (personal digital assistants), PADs (tablet computers), desktop computers, etc. Figure 6 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0224] like Figure 6As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. When the electronic device is powered on, various programs and data required for the operation of the electronic device are also stored in the RAM 603. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0225] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 including, for example, a memory card, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 An electronic device having various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0226] Also provided in an embodiment of the present application is a computer program product including computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements a management method for any bank branch portable office terminal PAD provided in an embodiment of the present application.
[0227] A computer-readable storage medium is also provided in an embodiment of the present application. The storage medium carries one or more computer programs. When one or more computer programs are executed by an electronic device, the electronic device can implement any management method of a bank branch portable office terminal PAD provided in an embodiment of the present application.
[0228] It should be noted that the management method and related devices of a bank branch portable office terminal PAD provided by the present invention can be used in the field of artificial intelligence or finance. The above is only an example and does not limit the application field of the management method and related devices of a bank branch portable office terminal PAD provided by the present invention.
[0229] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.
[0230] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0231] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.
[0232] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.
Claims
1. A management method for a portable office terminal PAD at a bank branch, characterized in that: include: Acquire a first image of the storage area collected in real time; Inputting the first image into a pre-built PAD recognition model, and obtaining a first number of PADs located in the storage area through the PAD recognition model; If the first number is less than the preset PAD number, obtaining second images corresponding to each possible residual area collected in real time; Inputting a plurality of the second images into the PAD recognition model, and obtaining second numbers corresponding to each of the possible legacy areas through the PAD recognition model, wherein the second number corresponding to the possible legacy area refers to the number of PADs located in the possible legacy area; Acquire the corresponding second number of non-zero target second images from the plurality of second images; If the sum of the first number and the second numbers corresponding to each of the possible left-behind areas is less than the preset PAD number, performing a first warning operation; Inputting the target second image into a pre-built personnel identification model, obtaining personnel identification information through the personnel identification model, the personnel identification information including the third number of personnel and a business personnel evaluation result of the target personnel closest to the PAD, the business personnel evaluation result being that the target personnel is a business personnel or that the target personnel is not a business personnel; If the third number corresponding to the target second image is zero, performing a second warning operation; If the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, a third warning operation is performed.
2. The method for managing a portable office terminal PAD at a bank branch according to claim 1, characterized in that: Also includes: After a preset time interval, a third image of the target possible remaining area acquired in real time is input into the PAD recognition model, and a fourth number corresponding to the target possible remaining area is acquired through the PAD recognition model, wherein the target second image and the third image are images acquired at different times for the target possible remaining area; If the fourth number is not zero, inputting the third image into the personnel identification model, and obtaining the personnel identification information corresponding to the third image through the personnel identification model; If the third number corresponding to the third image is zero, executing the second warning operation; If the third number corresponding to the third image is not zero and the corresponding business personnel evaluation result is that the target person is not a business person, the third warning operation is performed.
3. The management method of the bank branch portable office terminal PAD according to claim 1 is characterized in that: Also includes: Acquire business handling information from the business server, the business handling information including a target business type of a target business being handled corresponding to the institution code of the bank branch and a fifth number of the target business belonging to the target business type and being handled; If the target service type belongs to the preset PAD processing service type, obtaining the sum of the first number and the fifth number; If the sum of the first number and the fifth number is less than the preset PAD number, the step of acquiring the second image corresponding to each possible residual area collected in real time is performed.
4. The method for managing a portable office terminal PAD at a bank branch according to any one of claims 1 to 3, characterized in that: The personnel identification information also includes the location area of the target person; The management method of the bank branch portable office terminal PAD also includes: capturing a first captured image located in the position area of the target second image; From the preset correspondence between the possible leftover area and the business personnel image, searching for the target business personnel image corresponding to the target possible leftover area; the target business personnel image and the target second image are images taken at the same shooting angle using the same camera for the target possible leftover area; the target business personnel image includes an image of the business personnel wearing work clothes; The first captured image and the target business personnel image are input into a pre-built image comparison model, and the similarity between the first captured image and the target business personnel image is obtained through the image comparison model.
5. The method for managing a portable office terminal PAD at a bank branch according to claim 4, characterized in that: If the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, executing a third early warning operation step includes: If the business personnel evaluation result corresponding to the target second image is that the target person is not a business person, and the similarity is less than or equal to a preset threshold, the third warning operation is performed.
6. The method for managing a portable office terminal PAD at a bank branch according to claim 5, characterized in that: Also includes: If the business personnel evaluation result corresponding to the target second image is that the target person is a business personnel, and the similarity is less than or equal to a preset threshold, the third warning operation is performed.
7. The method for managing a portable office terminal PAD at a bank branch according to claim 1, characterized in that: The step of inputting the plurality of second images into the PAD recognition model comprises: Obtaining the legacy probabilities corresponding to each of the possible legacy areas; Sorting the possible legacy areas from high to low according to the legacy probability to obtain a first sorting result; Inputting the second images corresponding to the possible leftover areas into the PAD recognition model in sequence according to the first sorting result; If the sum of the second number corresponding to the second images obtained by the PAD recognition model and the first number is equal to the preset PAD number, stop inputting the second images that have not been input into the PAD recognition model into the PAD recognition model.
8. The method for managing portable office terminals PAD at bank outlets according to claim 1, characterized in that: The performing of the second warning operation comprises: Sending reminder information to the first preset number of communication addresses in the second sorting result; The second sorting result is the communication addresses of the business personnel sorted from high to low according to the number of legacy PADs.
9. A management device for a portable office terminal PAD at a bank branch, characterized in that: include: A first acquisition module, used to acquire a first image of the storage area collected in real time; A second acquisition module, configured to input the first image into a pre-built PAD recognition model, and acquire a first number of PADs located in the storage area through the PAD recognition model; A third acquisition module, configured to acquire, if the first number is less than a preset PAD number, second images corresponding to each possible residual area acquired in real time; a fourth acquisition module, configured to input the plurality of the second images into the PAD recognition model, and acquire second numbers corresponding to the respective possible legacy areas through the PAD recognition model, wherein the second numbers corresponding to the possible legacy areas refer to the number of PADs located in the possible legacy areas; a fifth acquisition module, configured to acquire, from a plurality of the second images, corresponding target second images whose second number is not zero; A first execution module, configured to execute a first warning operation if the sum of the first number and the second numbers respectively corresponding to the possible left-behind areas is less than the preset PAD number; a sixth acquisition module, configured to input the target second image into a pre-built personnel identification model, and acquire personnel identification information through the personnel identification model, wherein the personnel identification information includes a third number of personnel and a business personnel evaluation result of the target personnel closest to the PAD, wherein the business personnel evaluation result is that the target personnel is a business personnel or the target personnel is not a business personnel; A second execution module, configured to execute a second warning operation if the third number corresponding to the target second image is zero; The third execution module is used to execute a third warning operation if the business personnel evaluation result corresponding to the target second image is that the target person is not a business person.
10. A computer program product, characterized in that It includes computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements the management method of the portable office terminal PAD of a bank branch as claimed in any one of claims 1 to 8.