Special equipment operation intelligent judgment system and method based on mobile monitoring

Abstract

The invention discloses a special equipment operation intelligent judgment system and method based on mobile monitoring. The system comprises an area setting module, an identity recognition system module, a monitoring system module, a real-time communication system module and a mobile terminal module. The area setting module is used for setting different and mutually independent areas in a training examination site, and the areas are connected through a safety channel or a special channel; the identity recognition system module is used for acquiring identity information of examinees or trainees through the image acquisition and identity card information reading module; the monitoring system module is used for monitoring the real-time activity condition of the whole training examination site; the real-time communication system module is used for establishing communication between participants and workers in training examination; and the mobile terminal module is used for reading data of the participants and synchronizing practical operation information of the participants in real time. Intelligent control is realized through real-time monitoring, and timeliness and accuracy are greatly improved in training examination of participants.

Description

Technical Field

[0001] The present invention belongs to the technical field of special equipment operation, and more specifically, relates to a special equipment operation intelligent determination system and method based on mobile monitoring. Background Art

[0002] With the continuous development of industry, various special equipment has been widely used in production and life, but there are many types of special operations, and the safety production knowledge that needs to be taught involves a wide range of professions. In addition, the cultural literacy of special operation personnel is relatively low, and the ability to accept new knowledge is relatively weak. Therefore, practical training can enable special operation personnel to better master practical operation skills and safety production knowledge. There are many dangerous factors involved in the operation of special equipment. Practical training can simulate various emergency situations, improve the ability of operators to respond to emergencies, and reduce the possibility of accidents. The state has clear laws, regulations and standards for the training and management of special equipment operators. Practical training is one of the important means to meet these requirements, which can ensure that operators have the ability to operate and manage special equipment. Therefore, enterprises should attach importance to the role of practical training, strengthen the management and implementation of practical training, and ensure that special equipment operators have the ability to operate and manage special equipment.

[0003] At present, the practical training and assessment methods for special equipment operators are mainly divided into two categories: one is to rely entirely on the examiner or coach to manually confirm the identity of the candidate or trainee, and follow the candidate or trainee to complete the entire practical process, while recording the score of each operation item and the training assessment time on paper, and finally calculating the total score to comprehensively judge whether the candidate or trainee is qualified, and manually summarizing the training assessment results and manually uploading the test information; the second is that after the face recognition device independently confirms the identity of the candidate or trainee, it relies entirely on electronic sensors to track or capture the completion of the entire practical process of the candidate or trainee, and automatically transmits the relevant data to a fixed computer terminal. Finally, the computer terminal automatically judges whether the candidate or trainee is qualified, and the training assessment results are uploaded after the entire examination.

[0004] However, both training and assessment methods have defects. In the manual training and assessment method, due to inaccurate identification of candidates or trainees, false and expired identity certificates cannot be identified; practical operation records are inefficient, observation angles are not comprehensive and there are blind spots, and timeliness is not high, which makes it easy to miss key operations; the evaluation of results is not objective, the training and assessment duration is not accurately recorded, and the comprehensive judgment of candidates or trainees' results is too subjective, and the training and assessment results cannot be uploaded synchronously. In the sensor training and assessment method, because the confirmation information of the candidate or trainee's identity by the face recognition device has no substantial connection with the training and assessment system, the confirmation of the candidate or trainee's identity is meaningless; the accuracy of the practical operation record data is easily affected by the sensitivity, working status, and environmental factors of the sensor; subjective risks such as safety awareness and illegal operations in the practical operation of candidates or trainees cannot be detected, judged, and warned; after the training and assessment of a single candidate or trainee is completed, the training and assessment results are not uploaded synchronously. Summary of the invention

[0005] In view of the above defects or improvement needs of the prior art, the present invention provides a special equipment operation intelligent determination system and method based on mobile monitoring, which can reduce safety hazards in the training and assessment of candidates or trainees by monitoring the entire assessment and training process, and further improve the objectivity, scientificity, fairness and impartiality of the training and assessment process; and greatly improve the timeliness and accuracy of the training and assessment by setting a real-time communication module.

[0006] In order to achieve the above-mentioned object, according to a first aspect of the present invention, there is provided a special equipment operation intelligent determination system based on mobile monitoring, comprising an area setting module, an identity recognition system module, a monitoring system module, a real-time communication system module and a mobile terminal module;

[0007] The area setting module is used to set the waiting area for examination / training, identity verification area, invigilation / training area and training and assessment area in the training and assessment venue, and each area is connected by a secure channel;

[0008] The identity recognition system module is used to obtain the identity information of the examinee or student, compare it with the identity information database to confirm the identity, and send the confirmation result to the mobile terminal;

[0009] The monitoring system module is used to use the LANDMARC system to perform location monitoring, use visual SLAM technology to perform practical path monitoring, and monitor the activities in the training and assessment venue, and synchronize the acquired image data in the venue to the mobile terminal in real time;

[0010] The real-time communication system module is used to establish communication links between examiners or coaches, examinees or students, security officers or examination room staff through mobile terminals;

[0011] The mobile terminal module is used to set up a scoring system for training assessment items, read candidate or trainee information, and store practical test image data.

[0012] Furthermore, the identity recognition system module is deployed in the identity verification area and is provided with fixed and / or handheld face scanning and ID card recognition devices;

[0013] The identity recognition system module includes: an image acquisition module, an ID card information reading module, a citizen ID card information database of the Ministry of Public Security, and an information comparison module;

[0014] The identity recognition system module obtains the identity information of the examinee or student through the image acquisition and ID card information reading module, and compares it with the ID card information database of the Ministry of Public Security to confirm the identity of the examinee or student, and sends the confirmation result to the mobile terminal.

[0015] Furthermore, the monitoring system module includes a panoramic monitoring module, an operation monitoring module, a regional positioning monitoring module, a practical operation path key point monitoring module and a safety monitoring module;

[0016] The panoramic monitoring module is used to be deployed on the top or around the periphery of the entire examination room, and obtains the activities of people and equipment in the examination room through a 360-degree remote-controlled camera and a number of fixed-angle cameras;

[0017] The operation monitoring module is used to be deployed on the practical training and assessment equipment, and confirms through the camera that the entire process of practical training and assessment is completed independently by the examinee or trainee himself, and at the same time determines whether the examinee or trainee has any illegal or risky operations;

[0018] The regional positioning monitoring module is used to be deployed near the boundary marking line of the training assessment area, and use the LANDMARC system to determine whether the examinee or trainee exceeds the training assessment area during the practical operation, and obtain the degree of exceeding;

[0019] The practical operation path key point monitoring module is used to be deployed around the scoring points and visual blind spots of the path passed during the practical operation process, and use visual SLAM technology to monitor the practical operation path of the trainees or candidates, so as to obtain the operation status of the candidates or trainees;

[0020] The security monitoring module is used to be deployed in the waiting area for examination / training, the identity verification area, the invigilation / training area, the security passage and the entrance and exit of the examination room, and obtains the movement and security situation of the examinees or students through the camera.

[0021] Specifically, in the regional positioning monitoring module,

[0022] Use the LANDMARC system to set up N readers and T tracking tags on the trainee or candidate's device, preset M reference tags within the venue, define the signal strength vector matrix S of the tag on each reader, and calculate the Euclidean distance D between the reference tag M and the tracking tag T during the device movement. TM , thereby obtaining the position of the device in the image; at the same time, the device position is compared with the position of the boundary marking line to determine whether it is aligned with the boundary marking line, thereby realizing the boundary positioning judgment between the examinee and the device.

[0023] Specifically, in the key point monitoring module of the practical operation path, visual SLAM technology is used to track the practical operation path:

[0024] Set up the camera to extract the equipment's landmarks from the images of the actual operation process, match the landmarks in the previous frame between consecutive image frames to determine their positions in the current frame, and use the feature matching results to estimate the relative motion of the equipment between the two frames; build a three-dimensional model of the environment, and use a nonlinear optimization algorithm to optimize the entire trajectory and map of the equipment; monitor whether the equipment has returned to its previous position by comparing the images on site with those on the map, so as to track the equipment's running path in real time; visualize the tracking results, and determine the positions of the landmarks on the equipment and key points on the path.

[0025] Furthermore, the real-time communication system module is deployed in the practical operation equipment, the invigilation / training area and the training and assessment area, and establishes communication links between the examiner or coach and the examinee or trainee on the practical training and assessment equipment, the examiner or coach and the safety officer or examination room staff, and the safety officer or examination room staff and other examinees or trainees in the examination room who are not in the training and assessment state, through the camera with audio call function and the mobile terminal, so that the examiner or coach can stop the examinee or trainee from violating the rules and risky operations in time;

[0026] The real-time communication system module is composed of three sets of two-way communication modules.

[0027] Furthermore, the mobile terminal module is used to be deployed in the invigilation / training area and used by examiners or coaches to set up the scoring table and scoring standards for training assessment items according to the requirements of the examination outline, read the information of candidates or trainees, collect and file facial images of candidates or trainees whose identity cards cannot read information, and store practical examination image data.

[0028] The mobile terminal module is used to realize communication between examiners or coaches, examinees or students, security personnel, and examination room staff.

[0029] The mobile terminal module specifically operates as follows:

[0030] The image and audio data sent by the identity recognition system, monitoring system, and real-time communication system are received through the network, and displayed to the examiner or coach for comparison with the manual observation of the examination room, so as to assist the examiner or coach in giving accurate scoring values ​​to the mobile terminal. At the same time, the training assessment duration is recorded, and the total score is calculated at the end of the training assessment. The score of the overtime score is automatically calculated according to the timing situation, and the score of the candidate or trainee is determined on the spot. When the candidate or trainee finishes the training assessment, the training assessment results of the candidate or trainee are uploaded.

[0031] According to a second aspect of the present invention, there is provided a method for intelligently determining operation of special equipment based on mobile monitoring, comprising the following steps:

[0032] S1, the participant enters the identity verification area according to the instruction, the identity verification device collects the participant's face image and reads the identity information, and sends the collected data to the mobile terminal;

[0033] S2, the participant enters the invigilation / training area and uses the mobile terminal to verify his / her identity. After the verification is passed, the training or assessment begins;

[0034] S3, participants register for training and enter the training assessment area to start training or assessment;

[0035] S4, participants perform practical exercises on the training and assessment equipment, and the entire process of the participants' practical exercises is monitored and recorded;

[0036] S5, uploading the collected data to the mobile terminal in real time and synchronously;

[0037] S6, determine whether the participant operates independently and whether he / she violates the training assessment procedures, and record the participant's operation behavior;

[0038] S7, after the participant's practical operation is completed, the system scores and evaluates the entire operation behavior, verifies the scoring results, and generates a practical operation report;

[0039] S8, sending the scoring result to the participant, and the participant leaves the examination room through the safety passage after confirming the scoring result.

[0040] The intelligent determination method for special equipment operation based on mobile monitoring includes a training mode and an assessment mode;

[0041] The training mode and assessment mode are independent of each other, and the training and assessment results can be uploaded synchronously in real time for mutual reference.

[0042] 1. The method of the present invention uses the LANDMARC system in the regional positioning monitoring module to monitor the actual operation process in the venue, uses the reference tag as a reference point of the known position, and provides relative position information for the tag to be positioned, thereby achieving more accurate positioning, and can increase or decrease the number of reference tags and tags to be positioned according to actual needs, so that the system can flexibly adapt to different application scenarios and meet different positioning needs;

[0043] 2. The method of the present invention can realize autonomous positioning and map construction of the robot by using visual SLAM technology to monitor the practical operation path of the trainees or candidates. It has good adaptability to the environment and can be applied in different scenarios. Moreover, it can realize fast path planning and navigation by quickly scanning and analyzing environmental information.

[0044] 3. The method of the present invention sets up a waiting area for examination / training, an identity verification area, an invigilation area / invigilation area, and a training and assessment area in the training and assessment site, so that the areas are independent of each other, and the training and assessment area is independent of the non-training and assessment area, which can better ensure the objectivity, scientificity, fairness, and impartiality of the training and assessment, and minimize mutual interference and safety hazards;

[0045] 4. The method of the present invention uses the identity recognition system and the monitoring system as sensing devices, combined with the on-site comparison of the training assessment, to confirm the identity of the examinee or trainee, and record the entire practical training assessment process, providing a basis for the score evaluation of the examinee or trainee's independent operation, and well avoiding the influence of external factors on the training assessment score;

[0046] 5. The method of the present invention adopts a real-time communication system module to connect with other modules, synchronizes the practical operation of candidates or trainees in real time, and then processes and analyzes the data through a mobile terminal, effectively realizing the objectivity and fairness of the practical operation test judgment of special equipment operators, and synchronously uploads the results when the candidates or trainees finish the test, which greatly improves the timeliness of training and assessment. Examiners or coaches can timely warn and deal with emergencies for illegal operations, risky operations, and sudden accidents, effectively reducing the safety risks of implementing special equipment operation practical training and assessment. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 This is a structural diagram of a special equipment operation intelligent determination system based on mobile monitoring according to an embodiment of the present invention;

[0048] Figure 2 This is a structural diagram of a region setting module according to an embodiment of the present invention;

[0049] Figure 3 This is a structural diagram of the modules of the identity recognition system according to an embodiment of the present invention;

[0050] Figure 4 This is a module structure diagram of the monitoring system according to an embodiment of the present invention;

[0051] Figure 5 This is a structural diagram of the modules of the real-time communication system according to an embodiment of the present invention;

[0052] Figure 6 This is a working principle diagram of the regional positioning monitoring module according to an embodiment of the present invention;

[0053] Figure 7 This is a working principle diagram of a key point monitoring module for a practical operation path according to an embodiment of the present invention;

[0054] Figure 8 This is a flow chart of a method for intelligently determining operation of special equipment based on mobile monitoring according to an embodiment of the present invention;

[0055] Fig. 9 This is a flow chart of the operation mode of a training mode of a special equipment operation intelligent determination method based on mobile monitoring according to an embodiment of the present invention;

[0056] Fig.10 The present invention is an embodiment of an intelligent determination method for special equipment operation based on mobile monitoring and an operation flow chart of the assessment mode. DETAILED DESCRIPTION

[0057] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0058] like Figure 1-7 As shown, an embodiment of the present invention provides a special equipment operation intelligent determination system based on mobile monitoring, including an area setting module, an identity recognition system module, a monitoring system module, a real-time communication system module and a mobile terminal module;

[0059] The area setting module, such as Figure 2 As shown, it is used to set up a waiting area for examination / training, an identity verification area, an invigilation / training area, and a training and assessment area in a training and assessment venue. Each area is independent of each other and connected by a secure channel or a dedicated channel;

[0060] The identity recognition system module, such as Figure 3 As shown, it is deployed in the identity authentication area, and a fixed and / or handheld face scanning and ID card recognition device is set up to obtain the identity information of the examinee or trainee through the image acquisition and ID card information reading module, and at the same time compare with the ID card information database of the Ministry of Public Security to confirm the identity of the examinee or trainee, and send the confirmation result to the mobile terminal;

[0061] The monitoring system module, such as Figure 4 As shown, it is deployed in various areas of the entire training and assessment site to monitor the real-time activities of the entire training and assessment site and send all the acquired image data to the mobile terminal in real time;

[0062] The real-time communication system module, such as Figure 5 As shown, it is deployed in the practical equipment, the invigilation / training area, and the training and assessment area. Through the camera with audio call function and the mobile terminal, the communication between the examiner or coach and the examinee or trainee on the practical training and assessment equipment, the examiner or coach and the safety officer or examination room staff, and the safety officer or examination room staff and other examinees or trainees in the examination room who are not in the training and assessment state can be established, so that the examiner or coach can stop the examinee or trainee's violation and risky operation in time, and notify the safety officer or examination room staff of the emergency in time to assist in handling, and evacuate all examinees or trainees in time to ensure the safety of the entire training and assessment;

[0063] Furthermore, the mobile terminal module is used to be deployed in the invigilation / training area and used by examiners or coaches to set up the scoring table and scoring standards for training assessment items according to the requirements of the examination outline, read the information of candidates or trainees, collect and file facial images of candidates or trainees whose identity cards cannot read information, and store practical examination image data.

[0064] Furthermore, the identity recognition system module includes an image acquisition module, an identity card information reading module, a citizen identity card information database of the Ministry of Public Security, and an information comparison module;

[0065] Furthermore, the monitoring system module includes a panoramic monitoring module, an operation monitoring module, a regional positioning monitoring module, a practical operation path key point monitoring module and a safety monitoring module;

[0066] The panoramic monitoring module is deployed on the top or around the periphery of the entire examination room, and is used to obtain the activities of people and equipment in the examination room through a 360-degree remote-controlled camera and several fixed-angle cameras;

[0067] The operation monitoring module is deployed on the practical training and assessment equipment to confirm through the camera that the entire process of the practical training and assessment is completed independently by the examinee or trainee, and to determine whether the examinee or trainee has violated the rules and performed risky operations;

[0068] The regional positioning monitoring module is deployed near the boundary marking line of the training assessment area to determine whether the examinee or trainee exceeds the training assessment area during the practical operation and obtain the degree of exceeding the area;

[0069] The key point monitoring module of the practical operation path is deployed around the scoring points and visual blind spots of the path passed by the practical operation process, and is used to obtain the operation status of the examinee or trainee through the multi-angle camera of the scoring point;

[0070] The security monitoring module is deployed in the waiting area for examination / training, the identity verification area, the invigilation / training area, the security passage and the entrance and exit of the examination room, and is used to obtain the movement and security situation of the examinees or students through the camera.

[0071] Specifically, if Figure 6 As shown, in the regional positioning monitoring module,

[0072] Use the LANDMARC system to set up N readers and T tracking tags on the trainee or candidate's device, preset M reference tags within the venue, define the signal strength vector matrix S of the tag on each reader, and calculate the Euclidean distance D between the reference tag M and the tracking tag T during the device movement. TM , thereby obtaining the position of the device in the image; at the same time, the device position is compared with the position of the boundary marking line to determine whether it is aligned with the boundary marking line, thereby realizing the boundary positioning judgment between the examinee and the device.

[0073] Specifically, if Figure 7 As shown, in the key point monitoring module of the actual operation path, visual SLAM technology is used to track the actual operation path:

[0074] Set up the camera to extract the equipment's landmarks from the images of the actual operation process, match the landmarks in the previous frame between consecutive image frames to determine their positions in the current frame, and use the feature matching results to estimate the relative motion of the equipment between the two frames; build a three-dimensional model of the environment, and use a nonlinear optimization algorithm to optimize the entire trajectory and map of the equipment; monitor whether the equipment has returned to its previous position by comparing the images on site with those on the map, so as to track the equipment's running path in real time; visualize the tracking results, and determine the positions of the landmarks on the equipment and key points on the path.

[0075] Furthermore, the real-time communication system module is composed of three sets of two-way communication modules.

[0076] Furthermore, the mobile terminal module specifically operates in the following steps:

[0077] The image and audio data sent by the identity recognition system, monitoring system, and real-time communication system are received through the WIFI network, and displayed to the examiner or coach for comparison with the manual observation of the examination room, so as to assist the examiner or coach in giving accurate scoring values ​​to the mobile terminal. At the same time, the training assessment duration is recorded, and the total score is calculated at the end of the training assessment. The score of the overtime score is automatically calculated according to the timing situation, and the score of the candidate or trainee is determined on the spot. When the candidate or trainee finishes the training assessment, the training assessment results of the candidate or trainee are uploaded.

[0078] The mobile terminal module is used to realize communication between examiners or coaches, examinees or students, security personnel, and examination room staff.

[0079] like Figure 8 As shown, an embodiment of the present invention provides a special equipment operation intelligent determination method based on mobile monitoring,

[0080] S1, the participant enters the identity verification area according to the instruction, the identity verification device collects the participant's face image and reads the identity information, and sends the collected data to the mobile terminal;

[0081] S2, the participant enters the invigilation / training area and uses the mobile terminal to verify his / her identity. After the verification is passed, the training or assessment begins;

[0082] S3, participants register for training and enter the training assessment area to start training or assessment;

[0083] S4, participants perform practical exercises on the training and assessment equipment, and the entire process of the participants' practical exercises is monitored and recorded;

[0084] S5, uploading the collected data to the mobile terminal in real time and synchronously;

[0085] S6, determine whether the participant operates independently and whether he / she violates the training assessment regulations, and record the participant's operation behavior;

[0086] S7, after the participant's practical operation is completed, the system scores and evaluates the entire operation behavior, verifies the scoring results, and generates a practical operation report;

[0087] S8, sending the scoring result to the participant, and the participant leaves the examination room through the safety passage after confirming the scoring result.

[0088] The method includes a training mode and an assessment mode;

[0089] The training mode and assessment mode are independent of each other, and the training and assessment results can be uploaded synchronously in real time for mutual reference.

[0090] Embodiment 1

[0091] like Fig. 9 As shown, the training mode comprises the following steps:

[0092] S11, the trainee enters the identity verification area from the waiting area according to the instruction of the trainer, and the identity verification device collects the face image and reads the ID card information, and the collected information is sent to the tablet mobile terminal through the WIFI network;

[0093] S12, the trainee enters the training area through the security passage according to the instruction of the trainer, and shows the ID card and training certificate to the coach. The coach verifies the trainee's identity through the mobile terminal. If the trainee's identity is not verified, the trainee is prompted that the identity is not verified and the trainee will not be able to enter the training assessment system. The trainee should return to the identity verification area for re-verification. Otherwise, the mobile terminal prompts that the verification pass information has been received and enters the training system to start training;

[0094] S13, the trainee registers for training according to the coach's instructions, enters the training assessment area through the safety channel and starts practical training. The coach selects the training category according to the trainee's situation and confirms to start training. The training system matches the trainee's information and starts the training record;

[0095] S14, the mobile terminal starts the training timing, the trainee performs practical operations on the training equipment according to the requirements of the examination syllabus, and the monitoring system starts to record the trainee's training process. The panoramic monitoring module and the security monitoring module are responsible for recording the personnel activities of the entire training venue. The operation monitoring module starts to record the trainee's operation actions. The regional positioning monitoring module records the positioning of the trainee and the training equipment in the training area in real time. The practical path key point monitoring module shoots and records the key points or scoring item operations of the trainee's practical process from multiple angles;

[0096] S15, transmitting the data in the monitoring system to the mobile terminal in real time and synchronously;

[0097] S16, the coach retrieves the student monitoring and the training assessment area positioning monitoring to confirm the student's operation status, determine whether it exceeds the training assessment area, and provide real-time guidance on the student's operation through the real-time communication system module, and promptly stops the student's violation and risk operation warning. In an emergency, the training equipment can be remotely stopped and the training can be terminated. When the student's practical operation path reaches the key scoring point, the coach retrieves the image of the corresponding key point monitoring camera of the practical operation path in real time, compares the student with the on-site situation from multiple angles, gives the student operation suggestions, and collects relevant image data of the student's practical operation defects and operation habits. The coach comprehensively analyzes the problems existing in the student's practical operation based on the image data and on-site observations and records the number and causes of incorrect operations;

[0098] S17, after the trainee has completed the practical operation, he clicks the Submit button to end the training. The mobile terminal stops the training timer and, based on the records provided by the coach, counts the trainee's practical operation defect data by item, records the trainee's training hours, and generates a highly targeted training plan for the next step of the trainee's training.

[0099] S18, call up the corresponding images and video records of all the trainees' incorrect operations, show and explain the existing problems and the next training focus to the trainees. After the trainees clearly understand, they will quickly leave the training assessment area through the safety passage according to the instructions, and then enter the waiting area for examination or training to wait for the next round of training.

[0100] Embodiment 2

[0101] like Fig.10 As shown, the assessment mode includes the following steps:

[0102] S21, the examinee enters the identity verification area from the waiting area according to the instructions of the examiner. After the identity verification device collects the face image and reads the ID card information, the collected data is compared with the citizen ID card information database of the Ministry of Public Security. After the comparison is completed, the verification information is sent to the tablet terminal via the WIFI network;

[0103] S22, candidates should follow the instructions of the invigilator to enter the invigilation (training) area through the security channel and show the admission ticket and ID card to the examiner. The examiner will verify the candidate's identity for the second time. If there is any abnormality, the candidate can be asked to return to the identity verification area to reconfirm the identity. If it is normal, the tablet can be used to scan the QR code of the admission ticket. If it is prompted that the candidate has not verified his identity, he will not be able to enter the test score sheet. The candidate should immediately return to the identity verification area to re-verify. If it prompts whether to start the preliminary test, it means that the tablet has received the verification information and the candidate can prepare to start the test;

[0104] S23, the examinee registers for the examination according to the examiner's instructions, enters the training examination area through the security channel to prepare for the practical examination, the examiner confirms that the examinee's information displayed on the tablet terminal is correct, clicks to start the preliminary examination, the tablet computer starts the examination timer, and the examinee performs practical operations on the examination equipment according to the examination syllabus requirements;

[0105] S24, the monitoring system starts recording the candidate's assessment process. The panoramic monitoring module and the security monitoring module are responsible for recording the personnel activities in the entire examination room, the operation monitoring module starts recording the candidate's operation actions, the regional positioning monitoring module records the positioning of the candidate and the assessment equipment in the assessment area in real time, and the practical path key point monitoring module shoots and records the key points or scoring items of the candidate's practical process from multiple angles;

[0106] S25, the monitoring system data is synchronously transmitted to the tablet terminal in real time via the WIFI network;

[0107] S26, the examiner retrieves the candidate monitoring and the training assessment area positioning monitoring to confirm whether the candidate is operating independently and whether he / she has exceeded the training assessment area, and promptly stops the candidate's illegal and risky operations through real-time communication. In an emergency, the assessment equipment can be remotely stopped and the assessment can be terminated. When the candidate's practical operation path reaches the key scoring point, the examiner retrieves the image of the corresponding key point surveillance camera of the practical operation path in real time, compares the multi-angle with the on-site situation and gives the score based on the candidate's safety operation awareness;

[0108] S27, after the examinee has completed the practical operation, the examiner clicks the submit button to end the assessment, the tablet computer stops the assessment timer, and calculates the total score based on the examiner's scoring record. At the same time, it verifies whether the examinee's operation has exceeded the time limit or how much the time limit has exceeded, and gives a comprehensive judgment result on whether the examinee has passed the assessment. The examinee uploads the assessment result of the examinee at the end of the assessment;

[0109] S28. After the examinees have confirmed the test results on site, they should leave the examination room quickly through the safety passage according to the examination room instructions.

[0110] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A special equipment operation intelligent determination system based on mobile monitoring, characterized in that: It includes a region setting module, an identity recognition system module, a monitoring system module, a real-time communication system module and a mobile terminal module; The area setting module is used to set the waiting area for examination / training, identity verification area, invigilation / training area and training and assessment area in the training and assessment venue, and each area is connected by a secure channel; The identity recognition system module is used to obtain the identity information of the examinee or student, compare it with the identity information database to confirm the identity, and send the confirmation result to the mobile terminal; The monitoring system module is used to use the LANDMARC system to perform location positioning monitoring, use visual SLAM technology to perform practical path monitoring, and monitor the activities in the training and assessment venue, and synchronize the acquired image data in the venue to the mobile terminal in real time; The real-time communication system module is used to establish communication links between examiners or coaches, examinees or students, security officers or examination room staff through mobile terminals; The mobile terminal module is used to set up a scoring system for training assessment items, read candidate or trainee information, and store practical test image data.

2. According to claim 1, a special equipment operation intelligent determination system based on mobile monitoring is characterized in that: The identity recognition system module is deployed in the identity verification area and is provided with fixed and / or handheld face scanning and ID card recognition devices; The identity recognition system module includes: an image acquisition module, an ID card information reading module, a citizen ID card information database of the Ministry of Public Security, and an information comparison module; The identity recognition system module obtains the identity information of the examinee or student through the image acquisition and ID card information reading module, and compares it with the ID card information database of the Ministry of Public Security to confirm the identity of the examinee or student, and sends the confirmation result to the mobile terminal.

3. According to claim 1, a special equipment operation intelligent determination system based on mobile monitoring is characterized in that: The monitoring system modules include a panoramic monitoring module, an operation monitoring module, a regional positioning monitoring module, a practical operation path key point monitoring module and a safety monitoring module; The panoramic monitoring module is used to be deployed on the top or around the periphery of the entire examination room, and obtains the activities of people and equipment in the examination room through a 360-degree remote-controlled camera and a number of fixed-angle cameras; The operation monitoring module is used to be deployed on the practical training and assessment equipment, and confirms through the camera that the entire process of practical training and assessment is completed independently by the examinee or trainee himself, and at the same time determines whether the examinee or trainee has any illegal or risky operations; The regional positioning monitoring module is used to be deployed near the boundary marking line of the training assessment area, and use the LANDMARC system to determine whether the examinee or trainee exceeds the training assessment area during the practical operation, and obtain the degree of exceeding; The practical operation path key point monitoring module is used to be deployed around the scoring points and visual blind spots of the path passed during the practical operation process, and use visual SLAM technology to monitor the practical operation path of the trainees or candidates, so as to obtain the operation status of the candidates or trainees; The security monitoring module is used to be deployed in the waiting area for examination / training, the identity verification area, the invigilation / training area, the security passage and the entrance and exit of the examination room, and obtains the movement and security situation of the examinees or students through the camera.

4. The special equipment operation intelligent determination system based on mobile monitoring according to claim 3 is characterized in that: In the regional positioning monitoring module, Use the LANDMARC system to set up N readers and T tracking tags on the trainee or candidate's device, preset M reference tags within the venue, define the signal strength vector matrix S of the tag on each reader, and calculate the Euclidean distance D between the reference tag M and the tracking tag T during the device movement. TM , thereby obtaining the position of the device in the image; at the same time, the device position is compared with the position of the boundary marking line to determine whether it is aligned with the boundary marking line, thereby realizing the boundary positioning judgment between the examinee and the device.

5. The special equipment operation intelligent determination system based on mobile monitoring according to claim 3 is characterized in that: In the key point monitoring module of the practical operation path, visual SLAM technology is used to track the practical operation path: Set up the camera to extract the device's landmarks from the images of the actual operation process, match the landmarks in the previous frame between consecutive image frames to determine their positions in the current frame, and use the result of feature matching to estimate the relative motion of the device between two frames; build a three-dimensional model of the environment, and use a nonlinear optimization algorithm to optimize the entire trajectory and map of the device; By comparing the images on site with those on the map, the device can be monitored to see whether it has returned to its previous position, so as to track the device's running path in real time; the tracking results can be visualized, and the positions of the markers on the device and the key points on the path can be determined.

6. The special equipment operation intelligent determination system based on mobile monitoring according to claim 1 is characterized in that: The real-time communication system module is deployed in the practical equipment, the invigilation / training area, and the training and assessment area, and establishes communication links between the examiner or coach and the examinee or trainee on the practical training and assessment equipment, the examiner or coach and the safety officer or examination room staff, and the safety officer or examination room staff and other examinees or trainees in the examination room who are not in the training and assessment state through the camera with audio call function and the mobile terminal, so that the examiner or coach can stop the examinee or trainee from violating regulations and risky operations in time; The real-time communication system module is composed of three sets of two-way communication modules.

7. The special equipment operation intelligent determination system based on mobile monitoring according to claim 1 is characterized in that: The mobile terminal module is used to be deployed in the invigilation / training area and is used by examiners or coaches to set the scoring table and scoring standards for the training assessment items according to the requirements of the examination outline, read the information of candidates or trainees, collect and file the face images of candidates or trainees whose ID cards cannot read the information, and store the practical examination image data; The mobile terminal module is used to realize communication between examiners or coaches, examinees or students, security personnel, and examination room staff.

8. A special equipment operation intelligent determination system based on mobile monitoring according to any one of claims 1 to 7, characterized in that: The mobile terminal module specifically operates as follows: The image and audio data sent by the identity recognition system, monitoring system, and real-time communication system are received through the network, and displayed to the examiner or coach for comparison with the manual observation of the examination room, so as to assist the examiner or coach in giving accurate scoring values ​​to the mobile terminal. At the same time, the training assessment duration is recorded, and the total score is calculated at the end of the training assessment. The score of the overtime score is automatically calculated according to the timing situation, and the score of the candidate or trainee is determined on the spot. When the candidate or trainee finishes the training assessment, the training assessment results of the candidate or trainee are uploaded.

9. A special equipment operation intelligent determination method based on mobile monitoring, characterized in that: The following steps are included: S1, the participant enters the identity verification area according to the instruction, the identity verification device collects the participant's face image and reads the identity information, and sends the collected data to the mobile terminal; S2, the participant enters the invigilation / training area and uses the mobile terminal to verify his / her identity. After the verification is passed, the training or assessment begins; S3, participants register for training and enter the training assessment area to start training or assessment; S4, participants perform practical exercises on the training and assessment equipment, and the entire process of the participants' practical exercises is monitored and recorded; S5, uploading the collected data to the mobile terminal in real time and synchronously; S6, determine whether the participant operates independently and whether he / she violates the training assessment procedures, and record the participant's operation behavior; S7, after the participant's practical operation is completed, the system scores and evaluates the entire operation behavior, verifies the scoring results, and generates a practical operation report; S8, sending the scoring result to the participant, and the participant leaves the examination room through the safety passage after confirming the scoring result.

10. The method for intelligently determining special equipment operation based on mobile monitoring according to claim 9, characterized in that: The intelligent determination method for special equipment operation based on mobile monitoring includes a training mode and an assessment mode; The training mode and assessment mode are independent of each other, and the training and assessment results can be uploaded synchronously in real time for mutual reference.

Images