Counter operation control method and device, electronic equipment and storage medium

Abstract

The invention relates to an artificial intelligence technology, in particular to a counter operation control method and device, electronic equipment and a storage medium. When the salesman carries out business handling through counter operation, obtaining a monitoring video of the salesman; identifying a portrait in the monitoring video; if the number of the portraits is smaller than the preset number of people, controlling to lock target equipment operated by a counter, and controlling to store transacted service information so as to generate an interrupted service; and when the number of the portraits is greater than or equal to the preset number of people, confirming the operation authority, and controlling to unlock the target equipment after confirming that the operation authority is passed. According to the embodiment of the invention, illegal counter operation is controlled and prevented in time, the standardization of counter operation is improved, and rights and interests of enterprises and clients are guaranteed.

Description

Technical Field

[0001] The embodiments of the present application relate to artificial intelligence technology, and in particular to a counter operation control method, device, electronic device and storage medium. Background Art

[0002] In some industries, in order to prevent favoritism, fraud and collusion for profit, there are strict rules and regulations for counter operations.

[0003] In the prior art, related image data is usually checked and corrected for violations afterwards, and the counter salespersons involved are educated and warned.

[0004] However, conducting violation inspections and corrections afterwards and failing to prevent illegal operations in a timely manner may cause losses to the company and its customers and damage their rights and interests. Summary of the invention

[0005] The present application provides a counter operation control method, device, electronic device and storage medium to control and promptly prevent illegal counter operations, improve the standardization of counter operations, and protect the rights and interests of enterprises and customers.

[0006] In a first aspect, an embodiment of the present application provides a counter operation control method, the counter operation control method comprising:

[0007] When the salesperson is handling business through counter operations, obtain the surveillance video of the salesperson;

[0008] Identify people in surveillance videos;

[0009] If the number of portraits is less than the preset number of people, the target device for counter operation is locked and the business information handled is saved to generate an interruption business;

[0010] When the number of portraits is greater than or equal to the preset number of people, the operation authority is confirmed, and after confirming that the operation authority is passed, the target device is controlled to be unlocked.

[0011] In a second aspect, an embodiment of the present application further provides a counter operation control device, the counter operation control device comprising:

[0012] The monitoring video acquisition module is used to obtain the monitoring video of the business personnel when the business personnel are handling business through counter operations;

[0013] Portrait recognition module, used to identify portraits in surveillance videos;

[0014] The target device locking module is used to control the locking of the target device for counter operation if the number of human portraits is less than the preset number of people, and to control the saving of the business information handled to generate an interruption business;

[0015] The target device unlocking module is used to confirm the operation authority when the number of portraits is greater than or equal to the preset number of people, and control the unlocking of the target device after confirming that the operation authority is passed.

[0016] In a third aspect, an embodiment of the present application further provides an electronic device, the electronic device comprising:

[0017] one or more processors;

[0018] A storage device for storing one or more programs;

[0019] When one or more programs are executed by one or more processors, the one or more processors implement any one of the counter operation control methods provided in the embodiments of the present application.

[0020] In a fourth aspect, an embodiment of the present application further provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute any one of the counter operation control methods provided in the embodiments of the present application.

[0021] This application obtains the monitoring video of the business personnel when the business personnel conduct business through counter operation; identifies the portraits in the monitoring video; if the number of portraits is less than the preset number, controls the locking of the target device for counter operation, and controls the preservation of the business information handled to generate interrupted business. When it is detected that the number of people does not meet the counter operation regulations, the illegal counter operation can be controlled to be stopped in time, the standardization of counter operation can be improved, and the rights and interests of enterprises and customers can be protected; when the number of portraits is greater than or equal to the preset number of people, the operation authority is confirmed, and after confirming that the operation authority is passed, the target device is controlled to be unlocked, and the operation authority confirmation is performed before the target device is unlocked, which can also ensure the standardization of counter operation to protect the rights and interests of enterprises and customers. Therefore, through the technical solution of this application, the problem of conducting illegal inspections and corrections afterwards, failing to prevent illegal operations in time, and damaging the rights and interests of enterprises and customers is solved, and the effect of controlling and preventing illegal counter operations in time, improving the standardization of counter operations, and protecting the rights and interests of enterprises and customers is achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 is a flow chart of a counter operation control method in Embodiment 1 of the present application;

[0023] Figure 2 is a flow chart of a counter operation control method in Embodiment 2 of the present application;

[0024] Figure 3 It is a flow chart of a counter operation control method in Embodiment 3 of the present application;

[0025] Figure 4It is a structural schematic diagram of a counter operation control device in Embodiment 4 of the present application;

[0026] Figure 5 It is a structural diagram of an electronic device in Example 5 of the present application. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0028] It should be noted that the terms "first" and "second" etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0029] Embodiment 1

[0030] Figure 1 A flow chart of a counter operation control method provided in Example 1 of the present application. This embodiment can be applied to monitoring the standardization of counter operations and timely controlling and intervening when they are not standard. The method can be executed by a counter operation control device, which can be implemented in software and / or hardware and specifically configured in the counter operation control device.

[0031] See also Figure 1 The counter operation control method shown in the figure specifically comprises the following steps:

[0032] S110. When the salesperson is handling business through counter operations, a surveillance video of the salesperson is obtained.

[0033] In some scenarios, customers need to handle counter services at the counters of offline outlets of enterprises, and the operations of business personnel handling counter services for customers at the counters are called counter operations. For example, in banks, hotels, and administrative agencies, there are needs for business personnel to handle business for customers through counter operations. Especially in banks, the standardization of counter operations may directly affect the property safety of users and enterprises. Therefore, counter operations must be standardized to protect the rights and interests of customers and enterprises.

[0034] When a salesperson conducts business through counter operations, there is usually a monitor to collect video of the area where the salesperson conducts counter operations. The surveillance video may be a video that monitors the business handling area when the salesperson conducts business through counter operations, and is used to determine the number of people performing counter operations. Exemplarily, the surveillance video may be obtained through a camera. The monitoring range of the surveillance video may be determined based on the closedness of the site, the analysis capability of the surveillance video, and the storage space, etc., and this application does not make specific limitations on this. For example, when the space where the counter operation is located is a closed space, the monitoring area of ​​the surveillance video may be the entire closed space to avoid the situation where the salesperson has not left the counter operation area but is mistakenly judged to have left because it cannot be detected in the surveillance video.

[0035] S120: Recognize a person in the surveillance video.

[0036] The portrait may be a recognized human image for counting people. The portrait may be recognized by a target recognition algorithm to recognize the portrait from the surveillance video. Exemplarily, the portrait may be recognized by a deep learning network. For example, the portrait may be recognized by a convolutional neural network.

[0037] For example, a portrait can be identified by recognizing a face. A real-time video processing method is used to recognize a portrait in a surveillance video by recognizing a face. This method is relatively mature and can process at a speed of seconds, which can meet the application requirements of real-time portrait recognition.

[0038] S130. If the number of human portraits is less than the preset number of people, the target device for counter operation is locked and the processed business information is saved to generate an interrupted business.

[0039] The preset number of people may be a preset number of people for counter operations, which is used to judge the standardization of counter operations. Specifically, the preset number of people may be determined by professional technicians according to the business type of counter operations and corporate regulations, etc., and this application does not make specific restrictions on this. For example, in a bank, the preset number of people may be 2.

[0040] The target device can be an electronic device operated by the salesperson when handling counter operations, and is used to handle counter operations. Since current counter operations all rely on electronic devices, especially computers, the target device can be a computer host. If the number of portraits is less than the preset number of people, the counter operation does not meet the operating specifications, and the target device for the counter operation is controlled to be locked. For example, if the number of portraits is less than the preset number of people, the computer host for the counter operation is controlled to be locked.

[0041] Locking can be to prohibit the target device from continuing to process business, and lock the business being processed. Exemplarily, the target device may include an input module, a communication module, and a display module, etc. Accordingly, locking can include prohibiting the input module from inputting, prohibiting the communication module from sending information outward, and prohibiting the display module from displaying the processing interface. For example, locking can be at least one of prohibiting mouse control, prohibiting data upload, and locking the screen.

[0042] Specifically, a locking plug-in can be installed in the target device. When the camera or video analysis device recognizes that the number of people in the surveillance video is less than the preset number, a locking instruction is sent to the locking plug-in. The locking plug-in receives the locking instruction and controls the target device to lock. For example, controlling the target device to lock can be to control the host to lock the screen and display "The current number of people at the counter does not meet the requirements and business is prohibited."

[0043] Interrupted business can be the business that is interrupted when the target device for counter operation is controlled and locked, and can be used for subsequent processing or risk assessment. When the target device for counter operation is controlled and locked, the target device is also controlled to save the processed business information to generate interrupted business. Optionally, after the interrupted business is generated, the interrupted business can be uploaded to the enterprise's server for archiving to facilitate subsequent risk assessment.

[0044] S140: When the number of portraits is greater than or equal to the preset number of people, confirm the operation authority, and after confirming that the operation authority is passed, control the unlocking of the target device.

[0045] When the number of portraits is greater than or equal to the preset number of people, that is, after identifying that the number of portraits in the surveillance video is less than the preset number, when the number of portraits in the surveillance video is again identified to be greater than or equal to the preset number. The operation authority confirmation can be a confirmation of the operation authority of the identified salesperson for interrupting the business. Optionally, the operation authority confirmation can be a confirmation of the operation authority of the newly added salesperson for counter operations, and the operation authority confirmation may not be performed for the salesperson who has not left in the surveillance video to reduce the requirements for computing resources. It should be noted that the salesperson who has not left in the surveillance video has passed the operation authority confirmation when starting the counter operation. Exemplarily, the operation authority confirmation can be achieved by an authority authentication device. Exemplarily, the authentication method for operation authority confirmation can include at least one of certificate authentication, biometric information authentication and behavioral feature authentication.

[0046] Confirming that the operation authority has been passed, that is, confirming that the salesperson has the operation authority, at this time, the target device can be controlled to be unlocked. Specifically, after the authority authentication device confirms that the operation authority has been passed, it can send an unlock instruction to the lock plug-in, and the lock plug-in receives the unlock instruction and controls the target device to be unlocked. For example, controlling the target device to be unlocked can be controlling the host to release the lock screen.

[0047] Optionally, after unlocking the target device, the terminal task can be released to continue processing, or, after unlocking the target device, a new window can be opened to re-process the interrupted service. Different processing rules can be set according to specific services, and this application does not make specific limitations on this.

[0048] In the banking industry, there are strict rules and regulations for counter operations. It is prohibited to conduct business when there are less than two people in the counter operation room, and it is ensured that no business is conducted when one person is alone, so as to prevent favoritism, fraud and collusion for profit.

[0049] In the existing technology, it is impossible to prevent the occurrence of single-person counter operations. The main way is to check and correct errors afterwards. By using face recognition technology and image processing technology, the time period when there are less than 2 people operating the counter is extracted, and all counter operations in this time period are taken out to conduct illegal inspections and corrections, and educate and warn the counter salespersons involved.

[0050] However, once some customer-related businesses occur, even if they involve violations, the cost of recovery is high, which damages the rights and interests of the company. Moreover, the established facts have already occurred, and forced recovery will have a negative impact on customer experience and even damage customer rights and interests.

[0051] The technical solution of this embodiment is to obtain the monitoring video of the business personnel when the business personnel handle the business through the counter operation; identify the portrait in the monitoring video; if the number of portraits is less than the preset number, then control the locking of the target device of the counter operation, and control the saving of the business information handled to generate an interrupted business. When it is detected that the number of people does not meet the counter operation regulations, the illegal counter operation can be controlled to be stopped in time, the standardization of the counter operation can be improved, and the rights and interests of enterprises and customers can be protected; when the number of portraits is greater than or equal to the preset number, the operation authority is confirmed, and after confirming that the operation authority is passed, the target device is controlled to be unlocked, and the operation authority confirmation is performed before the target device is unlocked, which can also ensure the standardization of the counter operation to protect the rights and interests of enterprises and customers. Therefore, through the technical solution of this application, the problem of conducting illegal inspections and corrections afterwards, failing to prevent illegal operations in time, and damaging the rights and interests of enterprises and customers is solved, and the effect of controlling and preventing illegal counter operations in time, improving the standardization of counter operations, and protecting the rights and interests of enterprises and customers is achieved.

[0052] Embodiment 2

[0053] Figure 2 This is a flow chart of a counter operation control method provided in Example 2 of the present application. The technical solution of this embodiment is further refined on the basis of the above technical solution.

[0054] Furthermore, "when the number of portraits is greater than or equal to the preset number, confirm the operation authority" is refined as: "when the number of portraits is greater than or equal to the preset number, determine whether the salesperson to be authenticated is an authorized salesperson who interrupts the business; if so, confirm that the operation authority is passed; otherwise, confirm whether the salesperson to be authenticated has the operation authority for the business corresponding to the interrupted business" to confirm the operation authority.

[0055] See also Figure 2 A counter operation control method shown includes:

[0056] S210. When the salesperson is handling business through counter operations, a surveillance video of the salesperson is obtained.

[0057] S220: Identify a person in the surveillance video.

[0058] In an optional embodiment, after identifying a person in a surveillance video, the process includes: analyzing the facial expressions of the identified person, and issuing facial expression warnings when any business personnel has an abnormal facial expression.

[0059] Expression analysis can be to extract the expression features of the portrait through a deep learning model, and analyze the expression features, so as to provide an expression warning when any business personnel has an abnormal expression. The abnormal expression can be a state of mind that is not suitable for handling business, such as distraction, drowsiness, and emotional excitement, which is not specifically limited in this application. Expression warning can be a prompt to alarm the abnormal expression of the salesperson. Exemplarily, an early warning can be given through voice, light, and alarm bells, etc., which is not specifically limited in this application. Exemplarily, the deep learning model can be a convolutional neural network. When the business personnel have an abnormal expression, problems such as low business handling efficiency and high error rate may occur. Therefore, the expression analysis of the identified portrait is performed, and the expression warning is given in time when any business personnel have an abnormal expression.

[0060] After identifying the portraits in the surveillance video, the system continuously analyzes the facial expressions of the identified portraits and issues facial expression warnings when any business personnel show abnormal expressions, thus ensuring that the business personnel's processing status is normal and ensuring the efficiency and accuracy of business processing.

[0061] S230. If the number of the portraits is less than the preset number of people, the target device for counter operation is locked and the processed business information is saved to generate an interrupted business.

[0062] S240: When the number of portraits is greater than or equal to the preset number, determine whether the salesperson to be authenticated is an authorized salesperson who has interrupted the business.

[0063] When the number of portraits is greater than or equal to the preset number of people, it means that a new salesperson has entered the counter operation area. At this time, the operation authority of the newly entered salesperson needs to be confirmed. The salesperson to be authenticated can be a salesperson who has just entered the counter operation area. The authorized salesperson can be the person who handled the interrupted business before it was locked. It should be noted that the salesperson will confirm the operation authority before performing the counter operation to ensure that the salesperson has the counter operation authority for the business to be handled. Judging whether the salesperson to be authenticated is an authorized salesperson who interrupted the business can be understood as judging whether the newly added salesperson is a salesperson who left.

[0064] After the target device is locked, when the number of portraits is greater than or equal to the preset number again, there may be two situations. The first situation is that after salesperson A goes out, salesperson A comes in again; the second situation is that after salesperson A goes out, salesperson B comes in. In the first situation, the salesperson has been confirmed to have the operation authority to interrupt the business before leaving, so it is only necessary to confirm the identity of the salesperson to confirm that the salesperson has the operation authority to interrupt the business at the counter. In the second situation, after confirming the identity of the salesperson, it is also necessary to confirm whether the salesperson has the operation authority to interrupt the business at the counter.

[0065] Specifically, the salesperson who leaves can be marked. When the number of portraits is greater than or equal to the preset number, the newly added salesperson will be determined as the salesperson to be authenticated. The salesperson to be authenticated performs operation authority authentication in the authority authentication device. The authority authentication device authenticates the personal identity of the salesperson to be authenticated, and determines whether the salesperson to be authenticated is an authorized salesperson who interrupts the business, that is, determines whether the salesperson to be authenticated is a salesperson marked as leaving.

[0066] In an optional embodiment, determining whether the salesperson to be authenticated is an authorized salesperson who interrupts the service includes: determining the identity of the salesperson to be authenticated based on biometrics and behavioral characteristics; and determining whether the identity of the salesperson to be authenticated is the same as the identity of the authorized salesperson who interrupts the service.

[0067] The identity identifier may be a unique identifier of the salesperson to be authenticated, and is used to determine the identity of the salesperson to be authenticated. For example, the identity identifier may be any one of a work number and a name, or a combination of a work number and a name, etc., and this application does not make specific limitations on this.

[0068] The biometric feature may be a static feature of the salesperson to be authenticated, and is used to determine the identity of the salesperson to be authenticated. Exemplarily, the biometric information authentication may include at least one of facial feature authentication, iris feature authentication, and fingerprint feature authentication.

[0069] The behavior feature may be a dynamic feature of the salesperson to be authenticated, and is used to determine the identity of the salesperson to be authenticated. Exemplarily, the behavior information authentication may include at least one of gait feature authentication, gesture feature authentication, and keyboard tapping feature authentication.

[0070] Specifically, static authentication can be performed first through biometrics, and then dynamic authentication can be performed by collecting the behaviors of the salesperson to be authenticated, determining the behavioral characteristics. For example, dynamic authentication can be performed by having the salesperson to be authenticated type text on the keyboard, collecting the salesperson's typing actions, obtaining keyboard typing characteristics, and performing keyboard typing feature authentication. The identity of the salesperson to be authenticated can be determined based on biometrics and behavioral characteristics, which can improve the accuracy of identity authentication.

[0071] After determining the identity of the salesperson to be authenticated, it is determined whether the identity of the salesperson to be authenticated is the same as the identity of the authorized salesperson who interrupts the service, so as to determine whether the salesperson to be authenticated is the authorized salesperson who interrupts the service.

[0072] By determining the identity of the salesperson to be authenticated based on biometrics and behavioral characteristics, the accuracy of identity authentication is improved; it is determined whether the identity of the salesperson to be authenticated is the same as the identity of the authorized salesperson who interrupts the business, and whether the salesperson to be authenticated is the authorized salesperson who interrupts the business is confirmed through the identity. There is no need to compare biometrics and behavioral characteristics one by one, which reduces the amount of calculation in the judgment process and improves the judgment efficiency.

[0073] S250: If yes, confirm that the operation authority is passed.

[0074] If so, that is, the salesperson to be authenticated is an authorized salesperson of the interrupted business, it can be understood that the salesperson to be authenticated is the salesperson who handled the business before the interrupted business was locked. At this time, the operation authority can be directly confirmed to be passed, and there is no need to confirm the counter operation authority of the salesperson to be authenticated again, which reduces the calculation amount of authentication and improves authentication efficiency.

[0075] S260: Otherwise, confirm whether the operator to be authenticated has the authority to operate the business corresponding to the interrupted business.

[0076] Otherwise, that is, the business person to be authenticated is not the authorized business person of the interrupted business, which can be understood as the business person to be authenticated is not the business person who handled the interrupted business before the business was locked. At this time, after the identity of the business person to be authenticated is verified, it is also necessary to confirm whether the business person to be authenticated has the operation authority of the interrupted business. Specifically, the enterprise stores the operation authority data of each business person in the authority database in advance. When it is confirmed that the business person to be authenticated is not the authorized business person of the interrupted business, the operation authority data is read from the authority database according to the identity information of the business person to be authenticated to confirm whether the business person to be authenticated has the operation authority of the corresponding business of the interrupted business.

[0077] S270: After confirming that the operation authority is passed, control the unlocking of the target device.

[0078] After confirming that the operation authority has been passed, that is, confirming that the salesperson to be authenticated has the operation authority to interrupt the corresponding business, at this time the number of counter operators reaches the preset number and they all have the operation authority to interrupt the business, and the target device can be controlled to unlock.

[0079] In an optional embodiment, if it is confirmed that the service provider to be authenticated has the operation authority for the service corresponding to the interrupted service, after controlling to unlock the target device, the process further includes: opening a new operation interface for the service corresponding to the interrupted service to re-handle the interrupted service.

[0080] The new operation interface is used to re-process the interrupted business. When the salesperson to be certified is not the one who handled the interrupted business before it was locked, after confirming that the salesperson to be certified has the operation authority for the business corresponding to the interrupted business, the new operation interface for the business corresponding to the interrupted business is opened to re-process the interrupted business for the customer, so as to avoid the new salesperson not understanding the previous handling information and affecting the business handling, and difficulty in accountability after problems with the interrupted business occur.

[0081] If it is confirmed that the certified business operator has the operation authority for the business corresponding to the interrupted business, the target device will be unlocked and a new operation interface for the business corresponding to the interrupted business will be opened to re-process the interrupted business, so as to avoid the interrupted business being processed by multiple people, resulting in errors due to unfamiliarity with business data and difficulties in subsequent accountability.

[0082] The technical solution of this embodiment is to determine whether the salesperson to be authenticated is an authorized salesperson who interrupts the business when the number of portraits is greater than or equal to the preset number; if so, confirm that the operation authority is passed, and there is no need to repeat the judgment of the operation authority, simplify the operation authority judgment process, and improve the efficiency of authorization judgment; otherwise, confirm whether the salesperson to be authenticated has the operation authority of the business corresponding to the interrupted business, and through the judgment of the operation authority, ensure that the subsequent counter operations comply with the regulations, and promptly avoid salespersons without operation authority from performing counter operations, thereby ensuring the standardization of counter operations.

[0083] Embodiment 3

[0084] Figure 3 This is a flow chart of a counter operation control method provided in Example 3 of the present application. The technical solution of this embodiment is further refined on the basis of the above technical solution.

[0085] Furthermore, after “control and save the business information handled to generate interrupted business”, add “perform risk identification on the interrupted business and the related business information of the business handled within the preset risk period before the interrupted business” to conduct risk assessment on the interrupted business and related businesses in a timely manner.

[0086] See also Figure 3 A counter operation control method shown includes:

[0087] S310. When the salesperson is handling business through counter operations, a surveillance video of the salesperson is obtained.

[0088] S320: Identify a person in the surveillance video.

[0089] S330. If the number of human portraits is less than the preset number of people, the target device for counter operation is locked and the processed business information is saved to generate an interrupted business.

[0090] S340: When the number of portraits is greater than or equal to the preset number of people, confirm the operation authority, and after confirming that the operation authority is passed, control the unlocking of the target device.

[0091] S350. Risk identification is performed on the business information related to the interrupted business and the business handled within a preset risk period before the interruption of the business.

[0092] The preset risk duration can be a pre-set time period before the business is interrupted to handle the risk, which is used to determine the relevant business information for risk identification. For example, the preset risk duration can be 30 minutes. Specifically, the preset risk duration can be determined by professional technicians through experiments or experience, and this application does not make specific limitations on this. Risk identification is used to identify whether there is a risk of non-compliance with operating specifications in the relevant business information. Exemplarily, supervised training can be performed through a deep learning model to learn all the specification information and obtain a risk identification model. Risk identification is performed through the risk identification model to improve the accuracy of risk identification.

[0093] Since the salesperson left midway, it can be considered that the risk value of the interrupted business is high, and it can be considered that the business handled within a certain period of time before the salesperson left also has risks. Therefore, risk identification is carried out on the relevant information of the interrupted business and the business handled within the preset risk period before the interruption of the business.

[0094] The existing technical solution is a post-processing method, which requires saving all facial monitoring data and processing it frame by frame. The amount of data processed for subsequent scanning and verification of violations is large. This application effectively reduces the amount of data processed for violation data by interrupting business and presetting risk time.

[0095] The technical solution of this embodiment identifies risks in the relevant business information of the interrupted business and the business handled within the preset risk period before the interruption of the business, promptly determines whether there are risks in the interrupted business and the business handled within the preset risk period before the interruption of the business, and handles illegal operations in a timely manner, effectively reduces the data processing volume for verifying illegal operations, and improves the efficiency of discovering illegal operations.

[0096] Embodiment 4

[0097] Figure 4 The structure diagram of a counter operation control device provided in the fourth embodiment of the present application is shown. This embodiment can be applied to monitor the standardization of counter operations and timely control intervention when they are not standardized. The specific structure of the counter operation control device is as follows:

[0098] The monitoring video acquisition module 410 is used to acquire the monitoring video of the business personnel when the business personnel are handling business through counter operations;

[0099] A portrait recognition module 420, used to recognize portraits in surveillance videos;

[0100] The target device locking module 430 is used to control the locking of the target device for counter operation if the number of human portraits is less than the preset number of people, and to control the saving of the handled business information to generate an interruption business;

[0101] The target device unlocking module 440 is used to confirm the operation authority when the number of portraits is greater than or equal to the preset number of people, and control the unlocking of the target device after confirming that the operation authority is passed.

[0102] The technical solution of this embodiment is to obtain the monitoring video of the business personnel when the business personnel handle the business through the counter operation; identify the portrait in the monitoring video; if the number of portraits is less than the preset number, then control the locking of the target device of the counter operation, and control the saving of the business information handled to generate an interrupted business. When it is detected that the number of people does not meet the counter operation regulations, the illegal counter operation can be controlled to be stopped in time, the standardization of the counter operation can be improved, and the rights and interests of enterprises and customers can be protected; when the number of portraits is greater than or equal to the preset number, the operation authority is confirmed, and after confirming that the operation authority is passed, the target device is controlled to be unlocked, and the operation authority confirmation is performed before the target device is unlocked, which can also ensure the standardization of the counter operation to protect the rights and interests of enterprises and customers. Therefore, through the technical solution of this application, the problem of conducting illegal inspections and corrections afterwards, failing to prevent illegal operations in time, and damaging the rights and interests of enterprises and customers is solved, and the effect of controlling and preventing illegal counter operations in time, improving the standardization of counter operations, and protecting the rights and interests of enterprises and customers is achieved.

[0103] Optionally, the target device unlocking module 440 includes:

[0104] The authentication agent judgment unit is used to judge whether the authentication agent is an authorized agent who interrupts the service when the number of portraits is greater than or equal to a preset number of people;

[0105] The operation authority passing unit is used to confirm that the operation authority is passed if yes;

[0106] The operation authority authentication unit is used to confirm whether the business operator to be authenticated has the operation authority of the business corresponding to the interrupted business.

[0107] Optionally, if it is confirmed that the to-be-authenticated operator has the operation authority for the service corresponding to the interrupted service, the target device unlocking module 440 further includes:

[0108] The new operation interface opening unit is used to open a new operation interface corresponding to the interrupted service to re-handle the interrupted service.

[0109] Optional, the judgment unit for the salesperson to be certified includes:

[0110] The identity confirmation subunit is used to determine the identity of the salesperson to be authenticated based on biometrics and behavioral characteristics;

[0111] The identity comparison subunit is used to determine whether the identity of the salesperson to be authenticated is the same as the identity of the authorized salesperson who interrupts the business.

[0112] Optionally, the counter operation control device also includes:

[0113] The risk identification module is used to identify risks of the interrupted business and the related business information of the business handled within the preset risk period before the interruption of the business.

[0114] Optionally, the counter operation control device also includes:

[0115] The expression analysis module is used to analyze the expression of the recognized portrait and issue an expression warning when any business personnel shows an abnormal expression.

[0116] The counter operation control device provided in the embodiment of the present application can execute the counter operation control method provided in any embodiment of the present application, and has the corresponding functional modules and beneficial effects for executing the counter operation control method.

[0117] According to an embodiment of the present invention, the present invention also provides an electronic device, a readable storage medium and a computer program product.

[0118] Embodiment 5

[0119] Figure 5 A schematic diagram of the structure of an electronic device provided in Embodiment 5 of the present application is shown in FIG. Figure 5 As shown, the electronic device includes a processor 510, a memory 520, an input device 530 and an output device 540; the number of the processor 510 in the electronic device can be one or more. Figure 5 A processor 510 is taken as an example; the processor 510, the memory 520, the input device 530 and the output device 540 in the electronic device can be connected via a bus or other means. Figure 5 The example of connecting through bus is taken in the following.

[0120] The memory 520, as a computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the counter operation control method in the embodiment of the present application (for example, the monitoring video acquisition module 410, the portrait recognition module 420, the target device locking module 430 and the target device unlocking module 440). The processor 510 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the memory 520, that is, realizes the above-mentioned counter operation control method.

[0121] The memory 520 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 520 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 520 may further include a memory remotely arranged relative to the processor 510, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0122] The input device 530 may be used to receive input character information and generate key signal input related to user settings and function control of the electronic device. The output device 540 may include a display device such as a display screen.

[0123] Embodiment 6

[0124] Embodiment 6 of the present application also provides a storage medium containing computer executable instructions, which, when executed by a computer processor, are used to execute a counter operation control method, the method comprising: obtaining a surveillance video of a business person when the business person performs business operations through counter operations; identifying portraits in the surveillance video; if the number of portraits is less than a preset number, controlling the locking of a target device for counter operations, and controlling the saving of the business information handled to generate an interrupted business; when the number of portraits is greater than or equal to a preset number, performing operation authority confirmation, and after confirming that the operation authority is passed, controlling the unlocking of the target device.

[0125] Of course, the storage medium containing computer executable instructions provided in the embodiment of the present application is not limited to the method operations described above, and the computer executable instructions can also execute related operations in the counter operation control method provided in any embodiment of the present application.

[0126] Through the above description of the implementation method, the technicians in the relevant field can clearly understand that the present application can be implemented with the help of software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for an electronic device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0127] It is worth noting that in the embodiment of the above-mentioned counter operation control device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application.

[0128] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A counter operation control method, characterized in that: include: When the salesperson is handling business through counter operations, obtaining surveillance video of the salesperson; Identify a person in the surveillance video; If the number of the portraits is less than the preset number of people, the target device for counter operation is locked, and the business information handled is saved to generate an interruption business; When the number of the portraits is greater than or equal to the preset number of people, the operation authority is confirmed, and after confirming that the operation authority is passed, the target device is controlled to be unlocked.

2. The method according to claim 1, characterized in that: When the number of the portraits is greater than or equal to the preset number of people, confirming the operation authority includes: When the number of portraits is greater than or equal to the preset number, determining whether the salesperson to be authenticated is an authorized salesperson who interrupts the service; If yes, confirm that the operation permission is passed; Otherwise, it is confirmed whether the service provider to be authenticated has the authority to operate the service corresponding to the interrupted service.

3. The method according to claim 2, characterized in that If it is confirmed that the service provider to be authenticated has the operation authority of the service corresponding to the service interruption, after the control unlocks the target device, the method further includes: Open a new operation interface for the service corresponding to the interrupted service to re-process the interrupted service.

4. The method according to claim 2, characterized in that: The step of judging whether the operator to be authenticated is an authorized operator of the interrupted service includes: Determine the identity of the salesperson to be authenticated based on the biometrics and behavioral characteristics; It is determined whether the identity identifier of the salesperson to be authenticated is the same as the identity identifier of the authorized salesperson who interrupts the service.

5. The method according to claim 1, characterized in that: After the control saves the handled business information to generate the interruption business, it also includes: Risk identification is performed on the interrupted business and relevant business information of the business handled within a preset risk period before the interrupted business.

6. The method according to claim 1, characterized in that After identifying the human figure in the surveillance video, the method further includes: Perform facial expression analysis on the identified human portrait, and issue facial expression warning when any business personnel shows abnormal facial expression.

7. A counter operation control device, characterized in that: include: A monitoring video acquisition module is used to obtain monitoring videos of business personnel when the business personnel are handling business through counter operations; A portrait recognition module, used to recognize the portrait in the surveillance video; A target device locking module, used for controlling the locking of the target device for counter operation if the number of the portraits is less than a preset number of people, and controlling the saving of the handled business information to generate an interruption business; The target device unlocking module is used to confirm the operation authority when the number of the portraits is greater than or equal to a preset number of people, and control the unlocking of the target device after confirming that the operation authority is passed.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the counter operation control method as described in any one of claims 1-6 is implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the counter operation control method as described in any one of claims 1 to 6 is implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the counter operation control method according to any one of claims 1 to 6 is implemented.

Images