Early warning method for abnormal behavior of bid evaluation experts during remote bid evaluation video conference

Abstract

The present application proposes an early warning method for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference, which relates to the field of bid evaluation technology. The method includes: obtaining a facial video screen of the bid evaluation expert during the process of the bid evaluation expert conducting remote bid evaluation on a preset project through a video conference bid evaluation tool; performing face detection on the facial video screen to obtain a face detection result; performing human body detection on the facial video screen to obtain a human body detection result, wherein the human body detection result includes whether the facial video screen contains a human body part whose corresponding display ratio exceeds a preset ratio; judging whether the bid evaluation expert has abnormal behavior during the bid evaluation process based on the face detection result and the human body detection result; outputting early warning information when the bid evaluation expert has abnormal behavior during the bid evaluation process. Thus, the abnormal behavior of the bid evaluation expert can be automatically identified during the remote bid evaluation process, and the labor cost of manual monitoring is reduced.

Description

Technical Field

[0001] The present application relates to the technical field of bidding and evaluation, and in particular to an early warning method for abnormal behavior of evaluation experts during a remote bidding evaluation video conference. Background Art

[0002] Bidding and bid evaluation is a form of comprehensive economic responsibility system to promote competition in the field of infrastructure construction. Generally, several construction units participate in the project bidding, and the bidding unit (such as the construction unit) selects the best one. The construction unit with the shortest construction period, low cost, high quality and good reputation will be the one to whom the project task is awarded. It can be seen that bid evaluation in the bidding process is particularly important.

[0003] At present, remote off-site bid evaluation can be used for bid evaluation. However, in the process of remote off-site bid evaluation, abnormal behaviors may occur, such as bid evaluation experts entrusting others to evaluate on their behalf, bid evaluation experts not evaluating at the bid evaluation position, or others breaking into the bid evaluation room where the bid evaluation experts are located. In the related art, during the remote off-site bid evaluation, the project manager usually monitors the bid evaluation process of the bid evaluation experts manually through the screen of the bid evaluation experts displayed on the video conference display interface to determine whether there are the above abnormal behaviors in the bid evaluation process. This method requires the bid evaluation experts to continuously watch the video conference display interface, which has high labor costs. Summary of the invention

[0004] The present application proposes an early warning method for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference, which is used to solve the technical problem of high labor cost in the abnormal behavior identification method during remote and off-site bid evaluation in related technologies.

[0005] The first aspect of the present application provides an early warning method for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference, the method comprising: obtaining a facial video screen of the bid evaluation expert during the process of the bid evaluation expert conducting remote bid evaluation on a preset project through a video conference bid evaluation tool; performing face detection on the facial video screen to obtain a face detection result, wherein the face detection result includes whether the facial video screen contains a face; performing human body detection on the facial video screen to obtain a human body detection result, wherein the human body detection result includes whether the facial video screen contains a human body part whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body part is located to the facial video screen; judging whether the bid evaluation expert has abnormal behavior during the bid evaluation process based on the face detection result and the human body detection result; and outputting early warning information when the bid evaluation expert has abnormal behavior during the bid evaluation process.

[0006] The second aspect of the present application proposes an early warning device for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference, the device comprising: an acquisition module, used to acquire a facial video image of the bid evaluation expert during the process of the bid evaluation expert remotely evaluating a preset project through a video conference bid evaluation tool; a recognition module, used to perform face detection on the facial video image to obtain a face detection result, wherein the face detection result includes whether the facial video image contains a face; a detection module, used to perform human body detection on the facial video image to obtain a human body detection result, wherein the human body detection result includes whether the facial video image contains a human body part whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body part is located to the facial video image; a judgment module, used to judge whether the bid evaluation expert has abnormal behavior during the bid evaluation process based on the face detection result and the human body detection result; and an output module, used to output early warning information when the bid evaluation expert has abnormal behavior during the bid evaluation process.

[0007] The third aspect embodiment of the present application proposes an electronic device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it executes the early warning method for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference as described in the first aspect embodiment.

[0008] The fourth aspect embodiment of the present application proposes a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, it implements the early warning method for abnormal behavior of evaluation experts during a remote bid evaluation video conference as proposed in the first aspect embodiment of the present application.

[0009] The fifth aspect embodiment of the present application proposes a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the early warning method for abnormal behavior of evaluation experts during a remote bid evaluation video conference proposed in the first aspect embodiment of the present application.

[0010] The technical solution provided by this application has the following beneficial effects:

[0011] By obtaining facial video images of bid evaluation experts during the process of remote bid evaluation of preset projects through video conference bid evaluation tools, performing face detection on the facial video images to obtain face detection results, wherein the face detection results include whether the facial video images contain faces; performing human body detection on the facial video images to obtain human body detection results, wherein the human body detection results include whether the facial video images contain human body parts whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body parts are located to the facial video images; based on the face detection results and the human body detection results, it is judged whether the bid evaluation experts have abnormal behavior in the bid evaluation process; when the bid evaluation experts have abnormal behavior in the bid evaluation process, early warning information is output, thereby realizing automatic identification of abnormal behavior of bid evaluation experts in the remote bid evaluation process and reducing the manpower cost of manual monitoring.

[0012] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0014] Figure 1 A schematic diagram of the structure of the intelligent remote bid evaluation and supervision system provided in the embodiment of the present application;

[0015] Figure 2 Another structural diagram of the intelligent remote bid evaluation and supervision system provided in the embodiment of the present application;

[0016] Figure 3 A schematic diagram of the interaction between the project manager, bid evaluation expert, supervision platform, and bid monitoring personnel provided in the embodiment of the present application;

[0017] Figure 4 A flowchart of a method for early warning of abnormal behavior of bid evaluation experts during a remote bid evaluation video conference provided in an embodiment of the present application;

[0018] Figure 5 A schematic diagram of the structure of a warning device for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference provided in an embodiment of the present application;

[0019] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0021] The early warning method for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference in the embodiment of the present application can be applied to an intelligent remote bid evaluation supervision platform of an intelligent remote bid evaluation supervision system. The intelligent remote bid evaluation supervision system of the embodiment of the present application will first be described with reference to the accompanying drawings.

[0022] Figure 1 A schematic diagram of the structure of the intelligent remote bid evaluation and supervision system provided in an embodiment of the present application.

[0023] like Figure 1 As shown, the intelligent remote bid evaluation and supervision system may include a communication-connected smart recruitment platform 110 and an intelligent remote bid evaluation and supervision platform 120 , wherein the smart recruitment platform 110 includes a video conference bid evaluation tool 111 .

[0024] Among them, the smart recruitment platform 110 is used to handle bidding and procurement business; the video conference bid evaluation tool 111 is used for bid evaluation experts to enter the virtual conference room through the video conference bid evaluation tool 111 and conduct remote bid evaluation of preset projects in the virtual conference room; the intelligent remote bid evaluation supervision platform 120, hereinafter referred to as the supervision platform 120, is used to intelligently supervise the bid evaluation process of preset projects by bid evaluation experts. The preset project refers to the project that the bid evaluation expert is evaluating, which can be set arbitrarily as needed. The bid evaluation expert can be any bid evaluation expert who participates in the bid evaluation of the preset project.

[0025] Specifically, the supervision platform 120 can be deployed on the enterprise cloud, integrating the enterprise's cloud desktop resources and equipment, and developing software and hardware support platforms based on computer vision analysis technology, remote video conferencing technology, and remote video monitoring technology as the visual supervision center for bid evaluation. It has functions such as querying real-time video, historical video, and intelligent early warning.

[0026] Among them, the supervision platform 120 may include a basic service layer, a platform service layer, and an application service layer from bottom to top. Among them, the basic service layer may include modules such as enterprise cloud, cloud desktop, and video surveillance, which are used to provide the basic services required for the operation of the supervision platform 120. The platform service layer may include an audio and video communication service module, a message queue service module, an embedded security service module, a search engine service module, a distributed storage service module, a distributed computing service module, a virtualization service module, a centralized computing service module, a signaling service module, and a media service module, which are used to provide corresponding services. The application service layer may include a video surveillance management module that provides video surveillance management services, a video fusion module that provides video recording and fusion services, a video conferencing service module that provides video conferencing services, and an intelligent analysis and warning module that provides intelligent analysis and warning of video data, etc., which provide service modules that provide various services.

[0027] In addition, the supervision platform 120 can also provide a large visual screen, a display interface for a virtual conference room, and the like.

[0028] The smart recruitment platform 110 is used to handle bidding and procurement business, that is, all bidding and procurement business are carried out on the smart recruitment platform 110.

[0029] The video conference bid evaluation tool 111 can be understood as a sub-application in the smart recruitment platform 110. Bid evaluation experts, project managers and other bid evaluation related personnel can log in to the video conference bid evaluation tool 111 through the smart recruitment platform 110, and perform identity authentication through the smart recruitment platform 110 when logging in. After logging in to the video conference bid evaluation tool 111, the video conference bid evaluation tool 111 can run independently.

[0030] Taking the bid evaluation expert as an example, when the bid evaluation expert logs in to the video conference bid evaluation tool 111, the smart recruitment platform 110 can realize the bid evaluation expert's identity verification through face recognition technology. After the identity verification is passed, the bid evaluation expert can perform relevant bid evaluation operations through the video conference bid evaluation tool 111; when the identity verification fails, the video conference bid evaluation tool 111 can prompt the expert that the identity verification fails and login is not allowed. If the current bid evaluation expert has not collected a face image, the video conference bid evaluation tool 111 can prompt the bid evaluation expert to collect a face image first.

[0031] After the bid evaluation experts log in to the video conference bid evaluation tool 111, they can enter the virtual conference room and conduct remote bid evaluation in the virtual conference room. During the process of the bid evaluation experts evaluating the preset projects, the supervision platform 120 can intelligently supervise the bid evaluation process.

[0032] The following is a detailed introduction to the intelligent remote bid evaluation and supervision system.

[0033] Specifically, the video conference bid evaluation tool 111 is deeply integrated with a video conference tool and a bid evaluation tool. The bid evaluation tool is used to handle bidding and procurement business. The video conference tool is deeply integrated with the bid evaluation tool on the basis of meeting the basic functions of video conference such as audio and video communication, text message communication, screen desktop sharing, file sharing, and application sharing, so as to be organically integrated with the bidding and procurement business and meet the business needs of different user roles (such as bid evaluation experts and project managers) in the remote bid evaluation process.

[0034] When it is necessary to evaluate the bids of the preset project, the project manager can first create a virtual conference room for the video conference for the bid evaluation. Specifically, the project manager can log in to the video conference bid evaluation tool 111, and click the entry button with the function of entering the display interface of the preset project on the display interface of the video conference bid evaluation tool 111 after successful login, and then the video conference bid evaluation tool 111 can display the project manager display interface of the preset project. It should be noted that after different user roles click the entry button, the video conference bid evaluation tool 111 will display different display interfaces of the preset project for different user roles. For example, for the project manager, the project manager display interface of the preset project will be displayed. Through this interface, the project manager can create a virtual conference room corresponding to the preset project. For the bid evaluation expert, the video conference bid evaluation tool 111 will display the bid evaluation expert display interface of the preset project. Through this interface, the bid evaluation expert can enter the created virtual conference room corresponding to the preset project to evaluate the preset project.

[0035] When the video conference bid evaluation tool 111 displays the project manager display interface of the preset project, the project manager can click the meeting creation button with the function of creating a meeting on the interface to trigger a video conference creation request. Correspondingly, the video conference bid evaluation tool 111 can send a video conference creation request to the supervision platform 120, wherein the video conference creation request includes the meeting information of the preset project. The meeting information may include the project information of the preset project, such as the project name, project identification, bid evaluation time, bid evaluation location, and any other information related to the preset project. Alternatively, the meeting information may include the project information and expert information of the preset project, wherein the expert information may include, for example, the name, identification, age, ID number, mobile phone number, and any other information related to each bid evaluation expert who needs to participate in the bid evaluation work of the preset project.

[0036] After receiving the video conference creation request, the supervision platform 120 can create a virtual conference room and generate a video conference number corresponding to the virtual conference room according to the conference information of the preset project, and then send the video conference number to the video conference evaluation tool 111 to notify the video conference evaluation tool 111 that the virtual conference room has been created. After receiving the video conference number, the video conference evaluation tool 111 can display a prompt message that the video conference has been created to prompt the project manager that the video conference has been created. The creation of the virtual conference room and the generation of the corresponding video conference number can be performed by a module that provides a video conference creation service in the application service layer of the supervision platform 120.

[0037] Correspondingly, the video conference bid evaluation tool 111 is further used to: send a video conference creation request to the intelligent remote bid evaluation supervision platform 120, wherein the video conference creation request includes conference information of the preset project;

[0038] The intelligent remote bid evaluation and supervision platform 120 is also used to: after receiving a video conference creation request, create a virtual conference room and generate a video conference number corresponding to the virtual conference room according to the conference information of the preset project, and send the video conference number to the video conference evaluation tool 111.

[0039] Among them, the video conference number is used to uniquely identify the corresponding virtual conference room, and the video conference number is automatically generated by the supervision platform 120. The generation rules can refer to relevant technologies and will not be repeated here.

[0040] Since the project manager only needs to click the meeting creation button, the video conference evaluation tool 111 can interact with the supervision platform 120 and automatically create a virtual conference room through the supervision platform 120, thereby enabling the project manager to automatically create a virtual conference room for evaluating preset projects with one click.

[0041] It should be noted that the above process is described using a virtual conference room as an example. In actual applications, multiple virtual conference rooms can be created through the above process as needed, and this application does not impose any restrictions on this.

[0042] After creating a virtual conference room for evaluating the preset project, any evaluation expert who participates in the evaluation of the preset project can enter the virtual conference room through the video conference evaluation tool 111 to evaluate the preset project. Specifically, taking one of the evaluation experts as an example, after the video conference evaluation tool 111 used by the evaluation expert receives the video conference number sent by the supervision platform 120, the video conference number can be associated with the preset project and stored under the preset project. After the evaluation expert who participates in the evaluation of the preset project enters the evaluation expert display interface of the preset project, a Join Video Conference button is displayed, and the evaluation expert can click the Join Video Conference button. Then, the video conference evaluation tool 111 can respond to the detection of the touch operation of the Join Video Conference button, obtain the video conference number associated with the preset project, and start the video conference tool, and then send the video conference number to the video conference tool, so as to enter the virtual conference room corresponding to the video conference number through the video conference tool. After entering the virtual conference room corresponding to the video conference number, the evaluation expert can start to evaluate the preset project.

[0043] Correspondingly, the video conference bid evaluation tool 111 is also used to: receive the video conference number sent by the intelligent remote bid evaluation and supervision platform 120; and enter the virtual conference room according to the video conference number.

[0044] Thus, the bid evaluation experts can join the created virtual conference room by one click through the Join Video Conference button. It should be noted that the above embodiment is described by taking the bid evaluation experts entering the created virtual conference room as an example. In actual application, the preset project related personnel such as project managers, supervisors and bid evaluation experts can enter the display interface of the preset project through the video conference bid evaluation tool 111, and join the virtual conference room of the preset project by one click through the Join Video Conference button to conduct a video conference. Since the created virtual conference room can only be joined through the Join Video Conference button after logging into the video conference bid evaluation tool 111 and entering the display interface of the preset project, it is impossible to enter the virtual conference room for bid evaluation through other means, thereby making the bid evaluation process safer and more confidential. In addition, before the preset project related personnel enter the virtual conference room, the identity of the entrant can also be verified to further improve the security and confidentiality of the bid evaluation process. Moreover, before the preset project related personnel enter the virtual conference room, the video conference bid evaluation tool 111 can also remind the precautions when participating in the video conference, and enter the virtual conference room to participate in the video conference after the preset project related personnel agree.

[0045] The project manager can create a virtual conference room with one click based on the video conference bidding evaluation tool, and the bidding evaluation experts can join the virtual conference room with one click based on the video conference bidding evaluation tool. This eliminates the need to manually set up a video conference in advance, nor does it require separate management of video conference accounts and passwords. Remote bidding evaluation of preset projects can be carried out through simple operations, which improves the efficiency of remote bidding evaluation and ensures high security and confidentiality of the bidding evaluation process.

[0046] In the embodiment of the present application, the bid evaluation experts who participate in the bid evaluation of the preset project can be obtained by extracting the expert database in advance. Figure 2 The intelligent remote bid evaluation supervision system may also include an expert extraction platform 130 that is communicatively connected to the smart recruitment platform 110, and is used to extract bid evaluation experts who participate in the bid evaluation of the preset project from multiple candidate bid evaluation experts included in the expert database. The expert database may be independent of the expert extraction platform 130, or may be configured in the expert extraction platform 130. The expert extraction platform 130 may update the expert information of multiple candidate bid evaluation experts in the expert database. The expert information of the candidate bid evaluation experts may include any information related to the bid evaluation experts, such as the candidate bid evaluation experts' majors, ages, provinces or cities where they are located, whether they are employed, education, positions, etc.

[0047] Specifically, the smart recruitment platform 110 may include an extraction button with an expert extraction function. When it is necessary to extract bid evaluation experts who participate in the bid evaluation of a preset project, personnel with extraction authority can first enter the project information and extraction requirements of the preset project, and click the extraction button in the smart recruitment platform 110 to trigger the expert extraction request. Correspondingly, the smart recruitment platform 110 can send an expert extraction request to the expert extraction platform 130, wherein the expert extraction request may include the project information and extraction requirements of the preset project. Among them, the project information may include any information related to the preset project, such as project identification, bid evaluation time, bid evaluation location, etc.; the extraction requirements may include requirements for the profession, age, province or city where the bid evaluation experts to be extracted, whether they are in office, academic qualifications, positions, etc., as well as requirements to be avoided when extracting, such as not extracting abnormal bid evaluation behaviors.

[0048] After receiving the expert extraction request, the expert extraction platform 130 can extract the bid evaluation experts corresponding to the preset project and meeting the extraction requirements from the expert database according to the project information and extraction requirements of the preset project, and send the expert information of the extracted bid evaluation experts to the smart recruitment platform 110. The expert information of the bid evaluation experts may include any information related to the bid evaluation experts, such as the bid evaluation experts' majors, ages, provinces or cities where they are located, whether they are employed, education, positions, etc.

[0049] It should be noted that the bid evaluation experts who enter the created virtual conference room corresponding to the preset project to conduct bid evaluation in the embodiment of the present application are the bid evaluation experts extracted by the expert extraction platform 130 according to the project information and extraction requirements of the preset project. After the smart recruitment platform 110 receives the expert information of the bid evaluation experts extracted by the expert extraction platform 130, the video conference bid evaluation tool 111 can determine which bid evaluation experts are conducting bid evaluation for the preset project according to the expert information of the bid evaluation experts corresponding to the preset project that has been extracted, and then after these bid evaluation experts log in to the video conference bid evaluation tool 111, the bid evaluation expert display interface of the preset project is displayed, so that these bid evaluation experts can join the virtual conference room corresponding to the preset project for bid evaluation by clicking the Join Video Conference button displayed on the bid evaluation expert display interface of the preset project.

[0050] Furthermore, after the expert is extracted, the extracted bid evaluation experts can be notified by SMS, phone, instant messaging, etc. In order to enable the supervision platform 120 to supervise the bid evaluation process of the bid evaluation experts extracted by the expert extraction platform 130, the smart recruitment platform 110 can also synchronize the expert information of the bid evaluation experts extracted by the expert extraction platform 130 to the supervision platform 120. That is, the smart recruitment platform 110 is also used to synchronize the expert information and project information of the bid evaluation experts to the intelligent remote bid evaluation supervision platform 120.

[0051] In the embodiment of the present application, the bid evaluation organization, the bid evaluation sub-center, the bid evaluation room, and the bid evaluation position can be deployed in the manner that one bid evaluation organization includes at least one bid evaluation sub-center, one bid evaluation sub-center includes at least one bid evaluation room, and one bid evaluation room includes at least one bid evaluation position. The supervision platform 120 can manage the bid evaluation organization, the bid evaluation sub-center, the bid evaluation room, and the bid evaluation position in advance, for example, the identification of at least one bid evaluation sub-center included in at least one bid evaluation organization, the identification of at least one bid evaluation room included in each bid evaluation sub-center, and the identification of at least one bid evaluation position included in each bid evaluation room can be pre-stored. And when the video conference bid evaluation tool 111 is installed in the terminal device of the corresponding bid evaluation position, the video conference bid evaluation tool 111 can automatically generate the position code and bind the position code to the identification of the bid evaluation position stored in the supervision platform 120. Among them, the terminal device can be any device that can run the video conference bid evaluation tool 111, such as a computer.

[0052] For each bid evaluation expert who enters the virtual conference room through the video conference bid evaluation tool 111 to conduct remote bid evaluation for the preset project, the video conference bid evaluation tool 111 can determine the bid evaluation position of the bid evaluation expert, so that the first camera in the terminal device of the bid evaluation position where the bid evaluation expert is located or the second camera connected to the terminal device can collect the facial video image of the bid evaluation expert in real time, and the video conference bid evaluation tool 111 can collect the display interface of the terminal device in real time to obtain the screen operation image, so that the video conference bid evaluation tool 111 can obtain the facial video image and screen operation image of the bid evaluation expert in the bid evaluation process of the preset project in real time, and then send the facial video image and screen operation image to the supervision platform 120. Among them, the video conference bid evaluation tool 111 can send the facial video image and screen operation image of the bid evaluation expert in the bid evaluation process of the preset project to the video conference service module in the supervision platform 120 in real time.

[0053] In addition, for each bid evaluation expert who successfully logs into the video conference bid evaluation tool 111, the supervision platform 120 can determine the bid evaluation position and bid evaluation room where the bid evaluation expert is located, and then retrieve the monitoring screen of the bid evaluation room where the bid evaluation expert is located collected by the third camera installed in the bid evaluation room where the bid evaluation expert is located (i.e., the bid evaluation room where the bid evaluation position of the video conference bid evaluation tool 111 is located), and obtain the monitoring screen of the bid evaluation room where the bid evaluation expert is located in real time during the bid evaluation process when the bid evaluation expert enters the virtual conference room to evaluate the preset project. Among them, the video monitoring management module in the supervision platform 120 can obtain the supervision screen of the bid evaluation room where the bid evaluation expert is located in real time.

[0054] Then, the supervision platform 120 can evaluate the bid evaluation process of each bid evaluation expert for the preset project based on the facial video images, screen operation images and monitoring images of the bid evaluation room where each bid evaluation expert is located. The intelligent analysis and early warning module in the supervision platform 120 can evaluate the bid evaluation process of each bid evaluation expert for the preset project.

[0055] In the embodiment of the present application, the evaluation process of each evaluation expert is evaluated, which may include identifying whether each evaluation expert has at least one of the following abnormal behaviors during the evaluation process: the evaluation expert views other display interfaces unrelated to the evaluation project through the terminal device, the evaluation expert uses communication equipment, the evaluation expert is not the expert himself, the evaluation expert leaves his post, or someone else breaks into the evaluation room where the evaluation expert is located. When it is identified that the evaluation expert has at least one of the above abnormal behaviors, an early warning message can be output. Among them, the early warning information may include the project information of the current preset project, the expert information of the evaluation expert with abnormal behavior, the content of the early warning (such as not the expert himself, leaving his post or someone else breaks in), the early warning time, and the early warning evidence photo (screenshot of facial video screen, screen operation screen or monitoring screen) and other information.

[0056] Specifically, for each bid evaluation expert, during the bid evaluation process of the preset project, the supervision platform 120 can identify whether the bid evaluation expert has at least one of the following abnormal behaviors during the bid evaluation process based on the bid evaluation expert's facial video screen, or the facial video screen combined with the monitoring screen of the bid evaluation room where the bid evaluation expert is located: the bid evaluation expert is not the expert himself, the bid evaluation expert is off duty, or someone else breaks into the bid evaluation room where the bid evaluation expert is located; based on the screen operation screen of the terminal device where the video conference bid evaluation tool 111 is located, identify whether the bid evaluation expert is watching other display interfaces unrelated to the bid evaluation project through the terminal device; based on the facial video screen of the bid evaluation expert, or the facial video screen combined with the monitoring screen of the bid evaluation room where the bid evaluation expert is located, use communication equipment detection technology to detect whether the bid evaluation expert uses communication equipment such as a mobile phone. Among them, the bid evaluation expert leaving his duty can refer to the bid evaluation expert not conducting bid evaluation at the bid evaluation position.

[0057] That is, in the embodiment of the present application, the supervision platform 120 is specifically used to: obtain the facial video image of the bid evaluation expert, the screen operation image of the terminal device where the video conference bid evaluation tool is located, and the monitoring image of the bid evaluation room where the bid evaluation expert is located; wherein the facial video image, the screen operation image, and the monitoring image are collected in real time during the bid evaluation process of the preset project by the bid evaluation expert; and evaluate the bid evaluation process of the preset project by the bid evaluation expert based on the facial video image. In the embodiment of the present application, the supervision platform 120 is specifically used to: during the bid evaluation process of the preset project by the bid evaluation expert, identify the abnormal behavior of the bid evaluation expert during the bid evaluation process based on the facial video image, wherein the abnormal behavior includes at least one of the following behaviors: the bid evaluation expert is not the expert himself, the bid evaluation expert leaves his post, or someone else breaks into the bid evaluation room where the bid evaluation expert is located.

[0058] Furthermore, after the supervision platform 120 obtains the facial video images of each evaluation expert, the screen operation images of the terminal device where the video conference evaluation tool 111 is located, and the monitoring images of the evaluation room where each evaluation expert is located, these three types of images can be recorded in real time to obtain facial video data, screen operation video data, and monitoring video data. In addition, during the evaluation process of each evaluation expert for the preset project, the supervision platform 120 can determine which evaluation expert is evaluating which project in which evaluation room, so that the facial video data, screen operation video data, and monitoring video data can be associated and stored with the evaluation expert and the preset project currently being evaluated to meet the needs of archiving the evaluation process data and the evaluation supervision. Furthermore, when it is necessary to display or view the facial video data, screen operation video data, and monitoring video data of a certain bid evaluation expert, the facial video data, screen operation video data, and monitoring video data associated with the bid evaluation expert can be fused to obtain the fused target audio and video data and display or view the fused target audio and video data through a display interface (i.e., the facial video data, screen operation video data, and monitoring video data of a bid evaluation expert are simultaneously displayed on a display interface). When it is necessary to display or view the facial video data, screen operation video data, and monitoring video data of each bid evaluation expert of a preset bid evaluation project, the facial video data, screen operation video data, and monitoring video data of each bid evaluation expert associated with the preset project can be fused to obtain another fused target audio and video data and display or view the fused another target audio and video data through a display interface (i.e., the facial video data, screen operation video data, and monitoring video data of each bid evaluation expert are simultaneously displayed on a display interface). In this way, it is possible to achieve separate recording of three-way video data of each evaluation expert, integrated display or viewing of three-way video data of each evaluation expert, and integrated display or viewing of multiple-way video data of each evaluation expert of a preset project.

[0059] Among them, the video conferencing service module of the supervision platform 120 can realize the recording of facial video images and screen operation images, and the video monitoring management module of the supervision platform 120 can realize the recording of monitoring images. The video fusion module of the supervision platform 120 obtains facial video data and screen operation video data from the video conferencing service module, and obtains monitoring video data from the video monitoring management module, thereby realizing the fusion of facial video data, screen operation video data, and monitoring video data.

[0060] The display of the target audio and video data can be in real time during the bid evaluation process, or it can be displayed as historical video data after the bid evaluation is completed. This application does not impose any restrictions on this.

[0061] Among them, during the bid evaluation process, for example, when it is necessary to display the monitoring screen of a bid evaluation room that is dispersed in a remote location, the monitoring screen of the bid evaluation room can be connected to the video conference through interface configuration to meet the scene monitoring needs of the bid evaluation room.

[0062] Therefore, during the bidding evaluation process where the evaluation experts conduct remote evaluation of preset projects, the supervision platform 120 can realize all-round integrated monitoring of the facial video images of the evaluation experts, the screen operation images of the terminal device where the video conference evaluation tool 111 is located, and the monitoring images of the evaluation room where the evaluation experts are located, and can perform real-time intelligent analysis of these images. When abnormal behavior of the evaluation experts is found, intelligent early warning reminders are issued, thereby achieving intelligent supervision of the evaluation process, timely detection and early prevention of abnormal behavior, and in addition, according to the evaluation expert dimension or project dimension, the three-way video data of each evaluation expert can be monitored and recorded at the same time, thereby achieving controllable, traceable and traceable entire evaluation process, and ensuring that the evaluation work is legal and compliant.

[0063] In the embodiment of the present application, in addition to the functions of querying real-time video data, historical video data and intelligent early warning, the supervision platform 120 can also provide a large-screen visual display and a virtual conference room display interface to facilitate relevant personnel to monitor and view the evaluation process of the evaluation experts.

[0064] In addition, refer to Figure 2 The supervision platform 120 can also be integrated with the third-party supervision platform 140. Among them, the third-party supervision platform refers to a platform used to supervise third-party businesses. For example, the third-party supervision platform can be a procurement supervision platform that supervises procurement transactions. The supervision platform 120 can receive third-party warning information sent by the third-party supervision platform 140 to centrally display and manage the third-party warning information. Among them, the third-party warning information sent by the procurement supervision platform can include warning information on abnormal situations of third-party businesses such as failure to pay the bid deposit, the existence of an affiliated relationship, the existence of business anomalies, the existence of illegal and dishonest situations, the existence of tax collection penalties, the existence of bribery crimes, and the high similarity of the bidding documents.

[0065] Among them, it should be noted that in the embodiment of the present application, the supervision platform 120 realizes access to cameras, NVR (Network Video Recorder), DVR (Digital Video Recorder) and other devices from different manufacturers through a unified customized system abstract interface, and through device SDK (Software Development Kit), RTMP (Real Time Messaging Protocol), ONVIF (Open Network Video Interface Forum), GB28181 (national standard protocol), RTSP (Real Time Streaming Protocol) and other network protocols, it realizes the acquisition of real-time streaming and recording of monitoring equipment, as well as parameter setting and remote control of equipment.

[0066] Reference below Figure 3 Taking the interaction process between project managers, bid evaluation experts, supervision platforms, and bid monitoring personnel as an example, the bid evaluation method based on the above intelligent remote bidding system is explained. Figure 3 The interactive diagram of the project manager, bid evaluation expert, supervision platform, and bid monitoring personnel provided in the embodiment of the present application. Among them, the bid monitoring personnel may be, for example, the project manager, the discipline inspection department, the conference staff, etc. who supervise the bid evaluation process.

[0067] refer to Figure 3, after the project manager logs in to the video conference bid evaluation tool 111 (step 301) and enters the project manager display interface of the preset project, he can create a virtual conference room with one click (step 302). When the current bid evaluation expert logs in to the video conference bid evaluation tool 111 (step 303), the video conference bid evaluation tool 111 can first determine whether the facial image of the current bid evaluation expert has been collected in advance (step 304). If the facial image of the current bid evaluation expert has not been collected, the current bid evaluation expert can be prompted to collect the facial image first, and collect the facial image of the current bid evaluation expert (step 305). If the facial image of the current bid evaluation expert has been collected, the current bid evaluation expert can be face recognized (step 306), and then it can be determined whether the current bid evaluation expert is the expert himself (step 307). Specifically, the current facial image of the current bid evaluation expert can be collected, and the current facial image can be compared with the pre-collected facial image of the current bid evaluation expert. If they are inconsistent, it can be determined that the current bid evaluation expert is not the expert himself, and the current expert is not allowed to log in to the video conference bid evaluation tool. If the current face image is consistent with the face image of the current bid evaluation expert collected in advance, it can be determined that the current bid evaluation expert is the expert himself, so that the current bid evaluation expert is allowed to log in to the video conference bid evaluation tool 111, that is, the current bid evaluation expert can successfully log in to the video conference bid evaluation tool 111 (step 308). After the current bid evaluation expert successfully logs in to the video conference bid evaluation tool 111 and enters the bid evaluation expert display interface of the preset project, he can join the virtual conference room created by the project manager with one click (step 309), and evaluate the preset project (step 310). After the evaluation is completed, he can exit the video conference bid evaluation tool (step 311).

[0068] After the current bid evaluation expert logs in to the video conference bid evaluation tool 111, the supervision platform 120 can determine the bid evaluation position and bid evaluation room where the current bid evaluation expert is located, and retrieve the monitoring screen of the bid evaluation room collected by the third camera installed in the bid evaluation room where the current bid evaluation expert is located. In addition, after the current bid evaluation expert enters the virtual conference room, the video conference bid evaluation tool 111 can send the facial video screen of the current bid evaluation expert collected in real time by the first camera in the terminal device of the bid evaluation position where the bid evaluation expert is located or the second camera connected to the terminal device, as well as the screen operation screen collected by the video conference bid evaluation tool 111 in real time from the display interface of the terminal device, to the supervision platform 120. Thus, the supervision platform 120 can obtain the monitoring screen of the bid evaluation room where the current bid evaluation expert is located (step 312), as well as the facial video screen and screen operation screen of the current bid evaluation expert (step 313), and then record and fuse the three-way screen separately (step 314) to obtain the target audio and video data.

[0069] In addition, during the evaluation process of the preset project by the current evaluation expert, the supervision platform 120 can perform intelligent analysis on the facial video of the current evaluation expert (step 315), and then determine whether the current evaluation expert has any abnormal behavior, such as being a non-expert, leaving the post, or having someone else break into the evaluation room (step 316). If not, continue to perform intelligent analysis on the facial video of the current evaluation expert. If the current evaluation expert has abnormal behavior, early warning information can be pushed to warn the monitoring personnel through the supervision platform.

[0070] After receiving the warning from the supervision platform 120, the bid monitoring personnel can process the warning in a timely manner (step 317). When processing the warning, the bid monitoring personnel can view the target audio and video data recorded and integrated by the supervision platform (step 318) to find evidence of abnormal behavior of the current bid evaluation expert.

[0071] In summary, the intelligent remote bid evaluation supervision system of the embodiment of the present application can facilitate bid evaluation experts to enter the virtual conference room efficiently and safely through the video conference bid evaluation tool, and remotely evaluate the preset project in the virtual conference room, and the supervision platform can be used to intelligently supervise the bid evaluation process of the preset project by the bid evaluation experts. And through the supervision platform in the intelligent remote bid evaluation supervision system, it is possible to realize all-round integrated monitoring of the facial video screen of the bid evaluation expert, the screen operation screen of the terminal device where the video conference bid evaluation tool is located, and the monitoring screen of the bid evaluation room where the bid evaluation expert is located, and these screens can be analyzed in real time and intelligently. When abnormal behavior of the bid evaluation expert is found, intelligent early warning reminders are given, so as to achieve intelligent supervision of the bid evaluation process, timely discovery and early prevention of abnormal behavior, and in addition, according to the bid evaluation expert dimension or project dimension, the three-way video data of each bid evaluation expert can be monitored and recorded at the same time, so as to realize the controllable, traceable and traceable whole process of bid evaluation, and ensure the legality and compliance of bid evaluation work.

[0072] Based on the above-mentioned intelligent remote bid evaluation supervision system, the present application provides an early warning method, device, electronic device and storage medium for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference. The following describes the early warning method, device, electronic device and storage medium for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference in accordance with the present application with reference to the accompanying drawings.

[0073] Figure 4 A flowchart of a method for early warning of abnormal behavior of bid evaluation experts during a remote bid evaluation video conference provided in an embodiment of the present application.

[0074] It should be noted that the early warning method for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference provided in the embodiment of the present application can be executed by an early warning device for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference, hereinafter referred to as an abnormal behavior identification device. The abnormal behavior identification device can be configured in an intelligent remote bid evaluation supervision platform to automatically identify abnormal behavior of bid evaluation experts during the remote bid evaluation process and reduce the manpower cost of manual monitoring.

[0075] like Figure 4 As shown, the early warning method for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference may include the following steps:

[0076] Step 401, when the bid evaluation expert remotely evaluates the preset project through the video conference bid evaluation tool, obtain the facial video image of the bid evaluation expert.

[0077] Among them, the preset project refers to the project that the evaluation experts are currently evaluating.

[0078] Among them, the facial video image is collected in real time by the first camera installed in the terminal device or the second camera connected to the terminal device during the bid evaluation process.

[0079] In an embodiment of the present application, when the bid evaluation expert conducts remote bid evaluation on a preset project through a video conference bid evaluation tool, the video conference bid evaluation tool can determine the bid evaluation position where the bid evaluation expert is located, so that the first camera in the terminal device of the bid evaluation position where the bid evaluation expert is located, or the second camera connected to the terminal device, can capture the facial video image of the bid evaluation expert in real time. After the video conference bid evaluation tool obtains the facial video image of the bid evaluation expert captured by the first camera or the second camera, the facial video image can be sent to the abnormal behavior identification device in real time. Accordingly, when the bid evaluation expert conducts remote bid evaluation on a preset project through the video conference bid evaluation tool, the abnormal behavior identification device can obtain the facial video image of the bid evaluation expert in real time.

[0080] Step 402: perform face detection on the facial video frame to obtain a face detection result, wherein the face detection result includes whether the facial video frame contains a face.

[0081] In an embodiment of the present application, after the abnormal behavior identification device obtains the facial video screen, the facial video screen can be input into the face detection model in the field of artificial intelligence technology, so as to use the face detection model to perform face detection on the facial video screen. Among them, the face detection model can regress the position coordinates of the face and the human detection frame to obtain the face binary classification score and the position coordinates of the face detection frame. Among them, the face binary classification score can be used to determine whether the facial video screen contains a face. For example, when the face binary classification score is greater than a preset score threshold, it is determined that the facial video screen contains a face. When the face binary classification score is less than or equal to the preset score threshold, it is determined that the facial video screen does not contain a face. The position coordinates of the face detection frame are used to indicate the position of the face detection frame in the facial video screen.

[0082] Among them, the face detection model can be any neural network model that can realize face detection, and this application does not limit the type of face detection model.

[0083] In the embodiment of the present application, the abnormal behavior identification device can obtain the face binary classification score output by the face detection model, and compare the face binary classification score with the preset score threshold to obtain the face detection result. When the face binary classification score is greater than the preset score threshold, the face detection result that includes the face in the face video screen can be obtained; when the face binary classification score is less than or equal to the preset score threshold, the face detection result that does not include the face in the face video screen can be determined.

[0084] Among them, the preset score threshold can be set arbitrarily as needed, such as 0.8, 0.85, etc., and this application does not impose any restrictions on this.

[0085] Step 403, performing human body detection on the facial video screen to obtain a human body detection result, wherein the human body detection result includes whether the facial video screen contains a human body part whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body part is located to the facial video screen.

[0086] The human body part may include any part of the human body, such as at least one of the head, left hand, right hand, left leg, right leg, left foot, right foot, upper body, and whole body. The upper body may be the upper body including the head or the upper body excluding the head, and this application does not limit this. The whole body may be the whole body including the head or the whole body excluding the head, and this application does not limit this.

[0087] The display ratio is the ratio of the sum of the areas of all human body parts contained in the facial video screen to the area of ​​the facial video screen.

[0088] In an embodiment of the present application, a human body detection model can be pre-trained, the input of the human body detection model is an image, and the output is the position information of the detection frame to which each human body part belongs contained in the image. Then, after obtaining the facial video picture of the bid evaluation expert, the facial video picture can be input into the trained human body detection model, so as to use the trained human body detection model to perform human body detection on the facial video picture, and obtain the position information of the detection frame to which each human body part belongs included in the facial video picture. Among them, the position information of the detection frame to which the human body part belongs can include the position coordinates of the four corner points of the detection frame to which the human body part belongs. Furthermore, the abnormal behavior identification device can determine the size of the detection frame to which each human body part belongs based on the position information of the detection frame to which each human body part belongs contained in the facial video picture output by the human body detection model, and use the size of the detection frame to which each human body part belongs as the size of the area where each human body part is located.

[0089] After determining the size of the area where each human body part is located, the abnormal behavior identification device can determine the sum of the areas of all human body parts contained in the facial video screen based on the size of the area where each human body part is located, and then determine the ratio of the sum of the areas to the area of ​​the facial video screen as the display ratio of all human body parts.

[0090] Furthermore, the abnormal behavior identification device can compare the display ratio of all human body parts with a preset ratio. When the display ratio of all human body parts is greater than the preset ratio, it can be determined that the facial video screen contains human body parts whose corresponding display ratios exceed the preset ratio. When the display ratio of all human body parts is not greater than the preset ratio, it can be determined that the facial video screen does not contain human body parts whose corresponding display ratios exceed the preset ratio, thereby obtaining a human body detection result.

[0091] Among them, the human body detection model can be any neural network model that can realize human body detection, and this application does not limit the type of human body detection model.

[0092] The human body detection model can be obtained by training the initial human body detection model by deep learning using preset training data. The training process can refer to relevant technologies, and this application will not go into details. Compared with other machine learning methods, deep learning performs better on large data sets. Among them, the preset training data may include multiple sample images, and each sample image is annotated with the sample position information of the detection box to which each human body part belongs. Among them, the sample position information may include the position coordinates of the four corner points of the detection box to which each human body part contained in the sample image belongs.

[0093] Step 404: Based on the face detection results and the body detection results, determine whether the bid evaluation experts have any abnormal behavior during the bid evaluation process.

[0094] Among them, judging whether the bid evaluation expert has abnormal behavior in the bid evaluation process may include judging whether the bid evaluation expert has at least one of the following abnormal behaviors: the bid evaluation expert is not the expert himself, the bid evaluation expert is off duty, or someone else breaks into the bid evaluation room where the bid evaluation expert is located. When the bid evaluation expert has at least one of the above abnormal behaviors, it can be determined that the bid evaluation expert has abnormal behavior in the bid evaluation process.

[0095] The following is an explanation of the process of determining whether there is abnormal behavior in which the bid evaluation expert is not the expert himself.

[0096] In an embodiment of the present application, when the human body detection result includes a face in a facial video screen, the abnormal behavior identification device can further perform feature extraction on the facial video screen to obtain facial features in the facial video screen, match the facial features with known facial features of the evaluation expert to obtain the degree of matching between the facial features and the known facial features, and determine whether the matching degree is greater than a preset threshold. When the matching degree is greater than the preset threshold, it can be determined that the evaluation expert is the expert himself. When the matching degree is not greater than the preset threshold, it can be determined that the evaluation expert is not the expert himself.

[0097] The preset threshold can be set arbitrarily as needed, such as 80%, 90%, etc., and this application does not impose any limitation on this. The known facial features of the bid evaluation expert are facial features extracted from the facial images of the bid evaluation expert collected in advance.

[0098] In an embodiment of the present application, when the human body detection result includes that the facial video screen does not contain a human face, the abnormal behavior identification device can determine whether the bid evaluation expert is the expert himself in combination with the human body detection result. When the human body detection result includes that the facial video screen contains a human body part whose corresponding display ratio exceeds a preset ratio, it can be determined that the bid evaluation expert is not the expert himself. When the human body detection result includes that the facial video screen does not contain a human body part whose corresponding display ratio exceeds a preset ratio, there is no need to determine whether the bid evaluation expert is the expert himself.

[0099] The following is an explanation of the process of determining whether there is abnormal behavior of the bid evaluation experts leaving their posts.

[0100] In the embodiment of the present application, the abnormal behavior identification device can combine the face detection result and the body detection result to determine whether the bid evaluation expert is off duty. Specifically, when the face detection result includes that the face video screen does not contain a face, and the body detection result includes that the face video screen does not contain a human body part whose corresponding display ratio exceeds a preset ratio, it can be determined that the bid evaluation expert is off duty. In other cases, it can be determined that the bid evaluation expert is on duty.

[0101] The following is an explanation of the process of determining whether there is abnormal behavior of someone breaking into the bid evaluation room where the bid evaluation experts are located.

[0102] In an embodiment of the present application, when the face detection result includes that a face is included in the face video screen, or when the face detection result includes that a face is not included in the face video screen, if the human body detection result includes that the face video screen contains a human body part whose corresponding display ratio exceeds a preset ratio, the abnormal behavior identification device can further determine whether each human body part belongs to the same human body according to the position information of the detection frame to which each human body part belongs output by the human body detection model. When it is determined that each human body part belongs to the same human body, it can be determined that no one else has intruded into the bid evaluation room where the bid evaluation expert is located; when it is determined that each human body part does not belong to the same human body, it can be determined that someone else has intruded into the bid evaluation room where the bid evaluation expert is located. When the face detection result includes that a face is included in the face video screen, or when the face detection result includes that a face is not included in the face video screen, if the human body detection result includes that the face video screen does not contain a human body part whose corresponding display ratio exceeds a preset ratio, it can be determined that no one else has intruded into the bid evaluation room where the bid evaluation expert is located.

[0103] Among them, the abnormal behavior identification device can determine whether each human body part belongs to the same human body according to the position information of each human body part output by the human body detection model and the number of position information of the same human body part. Specifically, the number of human body parts of the same type contained in the facial video screen can be determined according to the number of position information of the same human body parts contained in the facial video screen, and then it can be determined whether the number of human body parts of the same type is greater than the number of human body parts of the same type included in a normal single human body. If so, it can be determined that the human body parts in the facial video screen do not belong to the same human body. If not, the abnormal behavior identification device can determine whether the areas where the human body parts are located are adjacent to each other according to the position information of each human body part output by the human body recognition model. If the areas where the human body parts are located are not adjacent to each other, it can be determined that the human body parts do not belong to the same human body. If the areas where the human body parts are located are adjacent to each other, it can be determined that the human body parts belong to the same human body.

[0104] That is, step 404 may specifically include:

[0105] When the face detection result includes a face in the face video screen, and the matching degree between the facial features corresponding to the face and the known facial features of the bid evaluation expert is not greater than a preset threshold, it is determined that the bid evaluation expert is not the expert himself;

[0106] When the face detection result includes that the face video does not contain a face, and the body detection result includes that the face video contains a body part whose corresponding display ratio exceeds the preset ratio, it is determined that the bid evaluation expert is not the expert himself;

[0107] When the face detection result includes that the face video screen does not contain a face, and the body detection result includes that the face video screen does not contain a body part whose corresponding display ratio exceeds the preset ratio, it is determined that the bid evaluation expert has left the post;

[0108] When the human body detection results include facial video footage containing human body parts whose corresponding display ratio exceeds a preset ratio, and the human body parts do not belong to the same human body, it is determined that someone else has intruded into the bid evaluation room where the bid evaluation expert is located.

[0109] Step 405: When the bid evaluation experts have abnormal behavior during the bid evaluation process, output warning information.

[0110] The early warning information includes at least one of the following: project information of the preset project, expert information of the bid evaluation expert with abnormal behavior, warning content, warning time, and a photo of the early warning evidence. The early warning content may include, for example, that the bid evaluation expert is not the expert himself, that the bid evaluation expert is off duty, or that someone else has entered the bid evaluation room where the bid evaluation expert is located. The photo of the early warning evidence may include, for example, a screenshot of the facial video screen.

[0111] In addition, after outputting the warning information, the warning information can also be displayed through the large visual screen provided by the intelligent remote bid evaluation and supervision platform.

[0112] In summary, the early warning method for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference in the embodiment of the present application obtains the facial video screen of the bid evaluation experts during the process of the bid evaluation experts remotely evaluating the preset projects through the video conference bid evaluation tool, performs face detection on the facial video screen to obtain face detection results, wherein the face detection results include whether the facial video screen contains a face, and performs human body detection on the facial video screen to obtain human body detection results, wherein the human body detection results include whether the facial video screen contains human body parts whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body parts are located to the facial video screen. Based on the face detection results and the human body detection results, it is judged whether the bid evaluation experts have abnormal behavior in the bid evaluation process. When the bid evaluation experts have abnormal behavior in the bid evaluation process, early warning information is output, thereby realizing automatic identification of abnormal behavior of bid evaluation experts in the remote bid evaluation process and reducing the manpower cost of manual monitoring.

[0113] With the above Figure 4 Corresponding to the early warning method for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference provided in the embodiment, the present application also provides an early warning device for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference. Since the early warning device for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference provided in the embodiment of the present application is similar to the above-mentioned Figure 4The embodiment provided corresponds to the early warning method for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference. Therefore, the implementation method of the early warning method for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference is also applicable to the early warning device for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference provided in the embodiment of the present application, and will not be described in detail in the embodiment of the present application.

[0114] Figure 5 A schematic diagram of the structure of a warning device for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference provided in an embodiment of the present application.

[0115] like Figure 5 As shown, the early warning device 500 for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference may include: an acquisition module 510, an identification module 520, a detection module 530, a judgment module 540 and an output module 550.

[0116] The acquisition module 510 is used to acquire the facial video image of the bid evaluation expert during the process of the bid evaluation expert remotely evaluating the preset project through the video conference bid evaluation tool;

[0117] The recognition module 520 is used to perform face detection on the facial video image to obtain a face detection result, wherein the face detection result includes whether the facial video image contains a face;

[0118] The detection module 530 is used to perform human body detection on the facial video screen to obtain a human body detection result, wherein the human body detection result includes whether the facial video screen contains a human body part whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body part is located to the facial video screen;

[0119] A judgment module 540 is used to judge whether the bid evaluation experts have abnormal behavior in the bid evaluation process based on the face detection results and the body detection results;

[0120] The output module 550 is used to output warning information when the bid evaluation experts have abnormal behavior during the bid evaluation process.

[0121] As a possible implementation method of the embodiment of the present application, the judgment module is specifically used to:

[0122] When the face detection result includes a face in the face video screen, and the matching degree between the facial features corresponding to the face and the known facial features of the bid evaluation expert is not greater than a preset threshold, it is determined that the bid evaluation expert is not the expert himself;

[0123] When the face detection result includes that the face video does not contain a face, and the body detection result includes that the face video contains a body part whose corresponding display ratio exceeds the preset ratio, it is determined that the bid evaluation expert is not the expert himself;

[0124] When the face detection result includes that the face video screen does not contain a face, and the body detection result includes that the face video screen does not contain a body part whose corresponding display ratio exceeds the preset ratio, it is determined that the bid evaluation expert has left the post;

[0125] When the human body detection results include facial video footage containing human body parts whose corresponding display ratio exceeds a preset ratio, and the human body parts do not belong to the same human body, it is determined that someone else has intruded into the bid evaluation room where the bid evaluation expert is located.

[0126] As a possible implementation method of the embodiment of the present application, the early warning information includes at least one of project information of a preset project, expert information of an evaluation expert with abnormal behavior, early warning content, early warning time, and a photo of early warning evidence.

[0127] As a possible implementation of the embodiment of the present application, the early warning device 500 for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference further includes:

[0128] The display module is used to display the warning information through a large visual screen.

[0129] The early warning device for abnormal behavior of bid evaluation experts during the remote bid evaluation video conference in the embodiment of the present application obtains the facial video screen of the bid evaluation experts during the process of the bid evaluation experts remotely evaluating the preset projects through the video conference bid evaluation tool, performs face detection on the facial video screen to obtain a face detection result, wherein the face detection result includes whether the facial video screen contains a face, and performs human body detection on the facial video screen to obtain a human body detection result, wherein the human body detection result includes whether the facial video screen contains human body parts whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body parts are located to the facial video screen. Based on the face detection result and the human body detection result, it is judged whether the bid evaluation experts have abnormal behavior in the bid evaluation process. When the bid evaluation experts have abnormal behavior in the bid evaluation process, early warning information is output, thereby realizing automatic identification of abnormal behavior of bid evaluation experts in the remote bid evaluation process and reducing the manpower cost of manual monitoring.

[0130] In order to implement the above-mentioned embodiments, the present application also proposes an electronic device, which may include: a memory, a processor, and a computer program stored in the memory and run on the processor. When the processor executes the program, it executes the early warning method for abnormal behavior of evaluation experts during a remote evaluation video conference as proposed in the first aspect of the aforementioned embodiment of the present application.

[0131] It should be noted that the above explanation of the embodiment of the method for early warning of abnormal behavior of bid evaluation experts during a remote bid evaluation video conference proposed in the first aspect embodiment is also applicable to the electronic equipment of this embodiment and will not be repeated here.

[0132] The electronic device of the embodiment of the present application obtains the facial video screen of the bid evaluation expert during the process of the bid evaluation expert conducting remote bid evaluation of the preset project through the video conference bid evaluation tool, performs face detection on the facial video screen to obtain a face detection result, wherein the face detection result includes whether the facial video screen contains a face, performs human body detection on the facial video screen to obtain a human body detection result, wherein the human body detection result includes whether the facial video screen contains human body parts whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body parts are located to the facial video screen. Based on the face detection result and the human body detection result, it is judged whether the bid evaluation expert has abnormal behavior in the bid evaluation process. When the bid evaluation expert has abnormal behavior in the bid evaluation process, an early warning message is output, thereby realizing automatic identification of abnormal behavior of the bid evaluation expert in the remote bid evaluation process and reducing the manpower cost of manual monitoring.

[0133] In order to implement the above-mentioned embodiments, the present application also proposes a computer-readable storage medium on which a computer program is stored, characterized in that when the program is executed by a processor, an early warning method for abnormal behavior of evaluation experts during a remote evaluation video conference as proposed in the first aspect embodiment of the present application is implemented.

[0134] In order to implement the above-mentioned embodiments, the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the early warning method for abnormal behavior of evaluation experts during the remote evaluation video conference proposed in the above-mentioned first aspect embodiment of the present application.

[0135] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0136] like Figure 6 As shown, the electronic device may include:

[0137] A memory 601 , a processor 602 , and a computer program stored in the memory 601 and executable on the processor 602 .

[0138] When the processor 602 executes the program, Figure 4 The illustrated embodiment provides an early warning method for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference.

[0139] Furthermore, the electronic device may further include:

[0140] The communication interface 603 is used for communication between the memory 601 and the processor 602 .

[0141] The memory 601 is used to store computer programs that can be executed on the processor 602 .

[0142] The memory 601 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0143] Processor 602, used to implement when executing the program Figure 4 The illustrated embodiment describes a method for early warning of abnormal behavior of bid evaluation experts during a remote bid evaluation video conference.

[0144] If the memory 601, the processor 602 and the communication interface 603 are implemented independently, the communication interface 603, the memory 601 and the processor 602 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0145] Optionally, in a specific implementation, if the memory 601, the processor 602 and the communication interface 603 are integrated on a chip, the memory 601, the processor 602 and the communication interface 603 can communicate with each other through an internal interface.

[0146] The processor 602 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention.

[0147] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0148] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0149] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0150] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0151] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0152] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0153] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0154] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for early warning of abnormal behavior of bid evaluation experts during a remote bid evaluation video conference, characterized in that: Applied to an intelligent remote bid evaluation and supervision system, the intelligent remote bid evaluation and supervision system includes an intelligent recruitment platform and an intelligent remote bid evaluation and supervision platform, the intelligent recruitment platform is used to handle bidding and procurement business, the intelligent recruitment platform includes a video conference bid evaluation tool, and the intelligent remote bid evaluation and supervision platform includes a video monitoring management module, a video fusion module and a video conference service module; the project manager sends a video conference creation request to the intelligent remote bid evaluation and supervision platform through a conference creation button in the video conference bid evaluation tool, the video conference creation request includes the conference information of a preset project, after receiving the video conference creation request, the intelligent remote bid evaluation and supervision platform creates a virtual conference room and generates a video conference number corresponding to the virtual conference room according to the conference information of the preset project, and sends the video conference number to the video conference bid evaluation tool, the project manager, supervisor and bid evaluation expert all enter the display interface of the preset project through the video conference bid evaluation tool, and join the virtual conference room of the preset project with one click through the join video conference button; The intelligent remote bid evaluation supervision system also includes an expert extraction platform that is communicatively connected to the smart recruitment platform, and the expert extraction platform is used to extract bid evaluation experts who participate in the bid evaluation work of the preset project from multiple candidate bid evaluation experts included in the expert database and to update the expert information of multiple candidate bid evaluation experts in the expert database; the smart recruitment platform sends an expert extraction request to the expert extraction platform, and after receiving the expert extraction request, the expert extraction platform extracts bid evaluation experts corresponding to the preset project and meeting the extraction requirements from the expert database according to the project information and extraction requirements of the preset project, and sends the expert information of the extracted bid evaluation experts to the smart recruitment platform, and the smart recruitment platform synchronizes the expert information and project information of the extracted bid evaluation experts to the intelligent remote bid evaluation supervision platform; The video conference bid evaluation tool determines the bid evaluation expert for the preset project according to the extracted expert information of the bid evaluation expert, so that after the bid evaluation expert for the preset project logs into the video conference bid evaluation tool, he clicks the Join Video Conference button displayed on the bid evaluation expert display interface of the preset project to join the virtual conference room corresponding to the preset project for bid evaluation with one click; The method comprises: obtaining a facial video picture of a bid evaluation expert during a process in which the bid evaluation expert remotely evaluates a preset project through a video conference bid evaluation tool; Performing face detection on the facial video image to obtain a face detection result, wherein the face detection result includes whether the facial video image contains a face; Performing human body detection on the facial video screen to obtain a human body detection result, wherein the human body detection result includes whether the facial video screen contains a human body part whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body part is located to the facial video screen; Based on the face detection result and the body detection result, determining whether the bid evaluation expert has any abnormal behavior during the bid evaluation process; When the bid evaluation expert has abnormal behavior during the bid evaluation process, outputting warning information; Wherein, judging whether the bid evaluation expert has abnormal behavior in the bid evaluation process based on the face detection result and the body detection result includes: When the human body detection result includes human body parts whose corresponding display ratio exceeds a preset ratio in the facial video screen, and the human body parts do not belong to the same human body, it is determined that someone else has broken into the evaluation room where the evaluation expert is located; wherein, firstly, the number of human body parts of the same type contained in the facial video screen is determined according to the number of position information of the same human body parts contained in the facial video screen, and it is judged whether the number of human body parts of the same type is greater than the number of human body parts of the type included in a normal single human body; if so, it is determined that the human body parts in the facial video screen do not belong to the same human body; if not, it is determined whether the areas where the human body parts are located are adjacent to each other according to the position information of the human body parts output by the human body recognition model; if the areas where the human body parts are located are not adjacent to each other, it is determined that the human body parts do not belong to the same human body; if the areas where the human body parts are located are adjacent to each other, it is determined that the human body parts belong to the same human body.

2. The method according to claim 1, characterized in that The determining, based on the face detection result and the body detection result, whether the bid evaluation expert has abnormal behavior in the bid evaluation process further includes: When the face detection result includes that the face video contains the face, and the matching degree between the facial features corresponding to the face and the known facial features of the bid evaluation expert is not greater than a preset threshold, it is determined that the bid evaluation expert is not the expert himself; When the face detection result includes that the face video screen does not contain the face, and the body detection result includes that the face video screen contains a body part whose corresponding display ratio exceeds a preset ratio, it is determined that the bid evaluation expert is not the expert himself; When the face detection result includes that the face video screen does not contain the face, and the body detection result includes that the face video screen does not contain a human body part whose corresponding display ratio exceeds a preset ratio, it is determined that the bid evaluation expert has left his post.

3. The method according to claim 1 or 2, characterized in that: The warning information includes at least one of the project information of the preset project, the expert information of the bid evaluation expert with abnormal behavior, the warning content, the warning time, and a photo of the warning evidence.

4. The method according to claim 1 or 2, characterized in that: After outputting the warning information, the method further includes: The warning information is displayed through a large visual screen.

5. An early warning device for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference, characterized in that: Applied to an intelligent remote bid evaluation and supervision system, the intelligent remote bid evaluation and supervision system includes an intelligent recruitment platform and an intelligent remote bid evaluation and supervision platform, the intelligent recruitment platform is used to handle bidding and procurement business, the intelligent recruitment platform includes a video conference bid evaluation tool, and the intelligent remote bid evaluation and supervision platform includes a video monitoring management module, a video fusion module and a video conference service module; the project manager sends a video conference creation request to the intelligent remote bid evaluation and supervision platform through a conference creation button in the video conference bid evaluation tool, the video conference creation request includes the conference information of a preset project, after receiving the video conference creation request, the intelligent remote bid evaluation and supervision platform creates a virtual conference room and generates a video conference number corresponding to the virtual conference room according to the conference information of the preset project, and sends the video conference number to the video conference bid evaluation tool, the project manager, supervisor and bid evaluation expert all enter the display interface of the preset project through the video conference bid evaluation tool, and join the virtual conference room of the preset project with one click through the join video conference button; The intelligent remote bid evaluation supervision system also includes an expert extraction platform that is communicatively connected to the smart recruitment platform, and the expert extraction platform is used to extract bid evaluation experts who participate in the bid evaluation work of the preset project from multiple candidate bid evaluation experts included in the expert database and to update the expert information of multiple candidate bid evaluation experts in the expert database; the smart recruitment platform sends an expert extraction request to the expert extraction platform, and after receiving the expert extraction request, the expert extraction platform extracts bid evaluation experts corresponding to the preset project and meeting the extraction requirements from the expert database according to the project information and extraction requirements of the preset project, and sends the expert information of the extracted bid evaluation experts to the smart recruitment platform, and the smart recruitment platform synchronizes the expert information and project information of the extracted bid evaluation experts to the intelligent remote bid evaluation supervision platform; The video conference bid evaluation tool determines the bid evaluation expert for the preset project according to the extracted expert information of the bid evaluation expert, so that after the bid evaluation expert for the preset project logs into the video conference bid evaluation tool, he clicks the Join Video Conference button displayed on the bid evaluation expert display interface of the preset project to join the virtual conference room corresponding to the preset project for bid evaluation with one click; The device comprises: An acquisition module, used to acquire a facial video image of a bid evaluation expert during a process in which the bid evaluation expert remotely evaluates a preset project through a video conference bid evaluation tool; A recognition module, configured to perform face detection on the facial video image to obtain a face detection result, wherein the face detection result includes whether the facial video image contains a face; A detection module, configured to perform human body detection on the facial video screen to obtain a human body detection result, wherein the human body detection result includes whether the facial video screen contains a human body part whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body part is located to the facial video screen; A judgment module, used for judging whether the bid evaluation expert has abnormal behavior in the bid evaluation process based on the face detection result and the body detection result; An output module, used to output warning information when the bid evaluation expert has abnormal behavior during the bid evaluation process; Wherein, the judgment module is specifically used for: When the human body detection result includes human body parts whose corresponding display ratio exceeds a preset ratio in the facial video screen, and the human body parts do not belong to the same human body, it is determined that someone else has broken into the evaluation room where the evaluation expert is located; wherein, firstly, the number of human body parts of the same type contained in the facial video screen is determined according to the number of position information of the same human body parts contained in the facial video screen, and it is judged whether the number of human body parts of the same type is greater than the number of human body parts of the type included in a normal single human body; if so, it is determined that the human body parts in the facial video screen do not belong to the same human body; if not, it is determined whether the areas where the human body parts are located are adjacent to each other according to the position information of the human body parts output by the human body recognition model; if the areas where the human body parts are located are not adjacent to each other, it is determined that the human body parts do not belong to the same human body; if the areas where the human body parts are located are adjacent to each other, it is determined that the human body parts belong to the same human body.

6. The device according to claim 5, characterized in that The judging module is further used for: When the face detection result includes that the face video contains the face, and the matching degree between the facial features corresponding to the face and the known facial features of the bid evaluation expert is not greater than a preset threshold, it is determined that the bid evaluation expert is not the expert himself; When the face detection result includes that the face video screen does not contain the face, and the body detection result includes that the face video screen contains a body part whose corresponding display ratio exceeds a preset ratio, it is determined that the bid evaluation expert is not the expert himself; When the face detection result includes that the face video screen does not contain the face, and the body detection result includes that the face video screen does not contain a body part whose corresponding display ratio exceeds a preset ratio, it is determined that the bid evaluation expert has left his post.

7. The device according to claim 5 or 6, characterized in that The warning information includes at least one of the project information of the preset project, the expert information of the bid evaluation expert with abnormal behavior, the warning content, the warning time, and a photo of the warning evidence.

8. The device according to claim 5 or 6, characterized in that Also includes: The display module is used to display the warning information through a large visual screen.

9. An electronic device, characterized in that: The electronic device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it executes the early warning method for abnormal behavior of bid evaluation experts during a remote bid evaluation video conference as described in any one of claims 1 to 4.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method for early warning of abnormal behavior of bid evaluation experts during a remote bid evaluation video conference as described in any one of claims 1 to 4 is implemented.

Images