A Law Enforcement Action Assessment and Evaluation Method and System Based on Virtual Scenarios

Abstract

The present invention relates to a law enforcement action assessment and evaluation method and system based on a virtual scenario. The method includes: using a VR glasses to obtain the fingerprint information of a subject to verify the identity of the subject. After successful verification, collect the joint points of the human skeleton, determine the coordinate system of each node in the joint points, obtain the VR assessment scenario data, and determine the VR scenario plane coordinate system with position attributes in the VR assessment scenario data; establish an indexing relationship between the coordinate system of each node in the joint points and the VR scenario plane coordinate system with position attributes in the VR assessment scenario data and the VR scenario sphere coordinate system of the scenario sphere in the VR glasses, so that the VR glasses enter the VR panoramic mode for law enforcement action assessment; during the assessment process, according to the joint points of the human skeleton, obtain the instantaneous law enforcement action of the subject, and use the shortest path between the joint points of the preset standard action and the joint points of the human skeleton as the evaluation criterion for evaluation to obtain the evaluation result.

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence technology, and particularly to a law enforcement action assessment and evaluation method and system based on a virtual scenario. Background Art

[0002] Virtual Reality (VR) technology is a computer simulation system that can generate a simulated environment and provide an immersive application experience to subjects through means such as three-dimensional dynamic visual scenes and physical behavior interactions.

[0003] With the continuous improvement of computer graphics processing technology and hardware performance, Virtual Reality (VR) technology has developed rapidly. VR technology enables subjects to experience various law enforcement scenarios as if they were on the scene by simulating real or fictional environments.

[0004] Existing assessment technology solutions are often restricted by factors such as time, space, and resources, and it is difficult to meet the needs of modern law enforcement assessments. They often rely on paper tests or simple computer exams and are difficult to comprehensively evaluate the actual capabilities and skill levels of subjects. Summary of the Invention

[0005] In order to solve the problems existing in the above-mentioned prior art, the object of the present invention is to propose a law enforcement action assessment and evaluation method and system based on a virtual scenario. Through the virtual scenario, subjects can be assessed at any time and any place, and at the same time, the practicality and pertinence of learning can be enhanced by simulating real scenarios.

[0006] To achieve the above object, the present invention provides the following solutions:

[0007] A law enforcement action assessment and evaluation method based on a virtual scenario, comprising:

[0008] Obtaining the fingerprint information of a subject by using a VR glasses, verifying the identity of the subject according to the fingerprint information, after successful verification, collecting the joint points of the human skeleton, determining the coordinate systems of each node among the joint points, obtaining VR assessment scenario data, and determining the VR scenario plane coordinate system with position attributes in the VR assessment scenario data;

[0009] Establishing an index relationship between the coordinate systems of each node among the joint points and the VR scenario plane coordinate system with position attributes in the VR assessment scenario data and the VR scenario ball coordinate system of the scenario ball in the VR glasses, so that the VR glasses enter the VR panoramic mode for law enforcement action assessment;

[0010] During the assessment process, based on the joint points of the human skeleton, obtain the instantaneous law enforcement actions of the subject. Use the shortest path between the joint points of the preset standard action and the joint points of the human skeleton as the evaluation criterion, compare the instantaneous law enforcement actions of the subject with the preset standard action, and conduct an evaluation to obtain the evaluation result.

[0011] Optionally, verifying the identity of the subject based on the fingerprint information includes:

[0012] Obtain the fingerprint information of the subject using a VR glasses; wherein, the VR glasses at least include: a fingerprint collection device provided on the outer shell of the VR glasses, and a moving shrapnel device provided at the lens placement part of the VR glasses;

[0013] Compare the fingerprint information of the subject with the fingerprint information in the preset personal information to verify the identity of the subject. If the subject passes the identity verification, it indicates that the verification is successful; if the subject fails the identity verification, control the moving shrapnel device to eject a shrapnel to block the lens of the VR glasses.

[0014] Optionally, determining the coordinate system of each node among the joint points includes:

[0015] Collect the motion capture data of each point of the subject, and based on the motion capture data, determine the joint points of the corresponding human skeleton;

[0016] Use the origin of the VR scene ball coordinate system of the scene ball in the VR glasses as the origin of the coordinate system of each node to determine the coordinate system of each node among the joint points.

[0017] Optionally, the VR assessment scene data includes: panoramic pictures, panoramic videos, panoramic animations, and audio.

[0018] Optionally, establishing an index relationship between the VR scene plane coordinate system with position attributes in the VR assessment scene data and the VR scene ball coordinate system of the scene ball in the VR glasses includes:

[0019] Establish an index relationship between the VR scene plane coordinate system with position attributes in the VR assessment scene data and the VR scene ball coordinate system of the scene ball in the VR glasses according to the division method of longitude and latitude.

[0020] Optionally, enabling the VR glasses to enter the VR panoramic mode for law enforcement action assessment includes:

[0021] Obtain the vision data of the subject, and adjust the focal length of the VR glasses according to the vision data of the subject;

[0022] Obtain the texture coordinates of the VR assessment scenario data, and based on the texture coordinates and the established index relationship, render the VR assessment scenario data onto the VR glasses;

[0023] Obtain the visual acuity data of the subject, and based on the visual acuity data of the subject and the image that has been rendered and presented on the screen, adjust the focal length of the VR glasses, so as to use the VR glasses to conduct law enforcement action assessment.

[0024] Optionally, adjusting the focal length of the VR glasses includes:

[0025] Obtain the visual acuity data of the subject, adjust the distance between the centers of the two screens of the VR glasses to be the same as the interpupillary distance of the subject;

[0026] Based on the visual acuity data of the subject and the image that has been rendered and presented on the screen, adjust the focal length of the VR glasses so that the VR assessment scenario is clearly imaged on the retina of the subject.

[0027] Optionally, obtaining the instantaneous law enforcement action of the subject includes:

[0028] During the assessment process, based on the joint points of the human skeleton, obtain the acceleration data of the relevant law enforcement actions made by the subject;

[0029] Eliminate the missing values in the acceleration data, perform action frame extraction, set an observation time window, preset an instantaneous threshold to filter the extracted action frames, determine the occurrence time of the law enforcement action, and based on the filtered action frames and the occurrence time of the law enforcement action, obtain acceleration frame slice data;

[0030] Mark the acceleration frame slice data and select the instantaneous law enforcement action of the subject in the data.

[0031] To achieve the above object, the present invention provides a law enforcement action assessment and evaluation system based on a virtual scenario, including:

[0032] A position acquisition module, configured to use VR glasses to obtain the fingerprint information of the subject, verify the identity of the subject according to the fingerprint information, and after successful verification, collect the joint points of the human skeleton, determine the coordinate system of each node in the joint points, obtain VR assessment scenario data, and determine the VR scene plane coordinate system with position attributes in the VR assessment scenario data;

[0033] A position calibration module is used to establish an indexing relationship between the coordinate systems of each node in the joint points and the VR scene plane coordinate system with position attributes in the VR assessment scenario data and the VR scene sphere coordinate system of the scene sphere in the VR glasses, so that the VR glasses enter the VR panoramic mode for law enforcement action assessment;

[0034] An assessment and evaluation module is used to obtain the instantaneous law enforcement actions of the subject according to the joint points of the human skeleton during the assessment process. Taking the shortest path between the joint points of the preset standard actions and the joint points of the human skeleton as the evaluation criterion, the instantaneous law enforcement actions of the subject are compared with the preset standard actions and evaluated to obtain an evaluation result.

[0035] The beneficial effects of the present invention are:

[0036] The present invention improves the accuracy and effectiveness of the assessment by constructing a realistic virtual environment to simulate the actual law enforcement assessment scenario.

[0037] The law enforcement action assessment and evaluation method based on the virtual scene of the present invention can break through the limitation of being difficult to comprehensively evaluate the actual capabilities and skill levels of the subjects, and provide a flexible, convenient and efficient law enforcement assessment method. Through the virtual scene, the subjects can conduct law enforcement assessments at any time and any place, and at the same time, they can enhance the practicality and pertinence of learning through simulating law enforcement scenarios.

[0038] The present invention can comprehensively assess and evaluate the subjects by simulating the real law enforcement assessment scenario. This assessment method can not only examine the theoretical knowledge of the subjects, but also evaluate their actual operation capabilities and the abilities to handle complex situations, so as to more accurately reflect the true levels of the subjects. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required to be used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0040] Figure 1 It is a flowchart of a law enforcement action assessment and evaluation method based on a virtual scene according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0041] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0042] To make the above objects, features, and advantages of the present invention more obvious and understandable, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0043] As Figure 1 shown, this embodiment discloses a law enforcement action assessment method based on a virtual scenario, including: using a VR glasses to obtain the fingerprint information of the subject, verifying the identity of the subject according to the fingerprint information, and after successful verification, collecting the joint points of the human skeleton, determining the coordinate system of each node in the joint points, obtaining VR assessment scenario data, and determining the VR scenario plane coordinate system with position attributes in the VR assessment scenario data; the VR assessment scenario data includes: panoramic pictures, panoramic videos, panoramic animations, and audio; establishing an index relationship between the coordinate system of each node in the joint points and the VR scenario plane coordinate system with position attributes in the VR assessment scenario data and the VR scenario sphere coordinate system of the scenario sphere in the VR glasses, so that the VR glasses enter the VR panoramic mode for law enforcement action assessment; during the assessment process, according to the joint points of the human skeleton, obtaining the instantaneous law enforcement action of the subject, using the shortest path between the joint points of the preset standard action and the joint points of the human skeleton as the evaluation criterion, comparing the instantaneous law enforcement action of the subject with the preset standard action, and performing an evaluation to obtain an evaluation result.

[0044] Verifying the identity of the subject according to the fingerprint information includes: using a VR glasses to obtain the fingerprint information of the subject; wherein, the VR glasses at least include: a fingerprint collection device provided on the outer shell of the VR glasses, and a moving shrapnel device provided at the lens placement part of the VR glasses; comparing the fingerprint information of the subject with the fingerprint information in the preset personal information to verify the identity of the subject. If the subject passes the identity verification, it indicates successful verification; if the subject fails to pass the identity verification, the moving shrapnel device is controlled to eject a shrapnel to block the lens of the VR glasses, specifically:

[0045] Compare whether the fingerprint information is consistent with the fingerprint information in the preset personal information; if the fingerprint information is consistent with the fingerprint information in the preset personal information, determine that the subject passes the identity verification; if the fingerprint information is inconsistent with the fingerprint information in the preset personal information, determine whether the number of comparisons is greater than the threshold number of times; if the number of comparisons is not greater than the threshold number of times, return to the step of collecting the fingerprint information of the subject through the VR glasses; if the number of comparisons is greater than the threshold number of times, determine that the subject fails the identity verification, and control the movable shrapnel device to eject shrapnel to block the lens of the VR glasses.

[0046] Determining the coordinate system of each node among the joint points includes: collecting the motion capture data of each point of the subject, and determining the joint points of the human body skeleton corresponding thereto according to the motion capture data; using the origin of the VR scene ball coordinate system of the scene ball in the VR glasses as the origin of the coordinate system of each node, and determining the coordinate system of each node among the joint points.

[0047] Establishing an index relationship between the VR scene plane coordinate system with position attributes in the VR assessment scene data and the VR scene ball coordinate system of the scene ball in the VR glasses includes: according to the division method of longitude and latitude, establishing an index relationship between the VR scene plane coordinate system with position attributes in the VR assessment scene data and the VR scene ball coordinate system of the scene ball in the VR glasses.

[0048] Enabling the VR glasses to enter the VR panoramic mode for law enforcement action assessment includes: obtaining the vision data of the subject, and adjusting the focal length of the VR glasses according to the vision data of the subject; obtaining the texture coordinates of the VR assessment scene data, and rendering the VR assessment scene data onto the VR glasses based on the texture coordinates and the established index relationship; obtaining the vision data of the subject, and adjusting the focal length of the VR glasses according to the vision data of the subject combined with the image rendered and presented on the screen, so as to use the VR glasses for law enforcement action assessment.

[0049] Obtaining the texture coordinates of the VR assessment scene data, and rendering the VR assessment scene data onto the VR glasses based on the texture coordinates and the established index relationship includes: obtaining the texture coordinates of the VR assessment scene data; loading the vertex shader and the fragment shader, and compiling the vertex shader and the fragment shader; creating a rendering object, binding the compiled vertex shader and the compiled fragment shader to the rendering object, and compiling the rendering object to obtain a compiled program, and obtaining the texture coordinate handle in the rendering object; based on the texture coordinates, the index relationship and the texture coordinate handle, using the compiled program to render the real-time panoramic video stream onto the model on the VR glasses.

[0050] During the law enforcement action assessment process, the VR main perspective changes with the deflection of the gyroscope of the VR glasses. When playing the picture with position attributes on the corresponding playback window, the playback window follows the movement of the gyroscope of the VR glasses; when the gyroscope of the VR glasses rotates along the Z-axis, the VR main perspective will have a deflection angle along the Y-axis. At this time, the playback window corresponding to this picture also rotates along the Z-axis, causing the same deflection angle along the Y-axis; when the gyroscope of the VR glasses rotates along the Y-axis, the VR main perspective will have a deflection angle along the Z-axis. At this time, the playback window corresponding to this picture also rotates along the Y-axis, causing the same deflection angle along the Z-axis; when the gyroscope of the VR glasses rotates along the X-axis, the VR main perspective will have a deflection angle along the Z-axis. At this time, the playback window corresponding to this picture also rotates along the X-axis, causing the same deflection angle along the Z-axis.

[0051] Adjusting the focal length of the VR glasses includes: obtaining the visual acuity data of the subject, adjusting the distance between the centers of the two screens of the VR glasses to be the same as the interpupillary distance of the subject; adjusting the focal length of the VR glasses according to the visual acuity data of the subject combined with the image rendered on the screen, so that the VR assessment scene is clearly imaged on the retina of the subject; among them, each change in focal length takes 0.2 - 2 s, and the focal length stabilization time in each stage is 5 - 20 s.

[0052] Obtaining the instantaneous law enforcement actions of the subject includes: during the assessment process, according to the joint points of the human skeleton, obtaining the acceleration data of the subject making relevant law enforcement actions; removing the missing values in the acceleration data, extracting action frames, setting an observation time window, presetting an instantaneous threshold to filter the extracted action frames, determining the occurrence time of the law enforcement action, and obtaining the acceleration frame slice data according to the filtered action frames combined with the occurrence time of the law enforcement action; marking and selecting the instantaneous law enforcement actions of the subject in the acceleration frame slice data.

[0053] Obtaining the preset standard actions includes: for the acceleration signals collected during the law enforcement assessment from the instructor, after also extracting action frames to generate sample segments, selecting the instantaneous firing action signals among them to form the instructor's law enforcement assessment data, intercepting the high-frequency signals with a duration within 3 ms after the occurrence time point of the action signal, and then using the DTW algorithm to select the best frame data during the instructor's multiple law enforcement assessments as the instantaneous standard evaluation index for law enforcement assessment.

[0054] This embodiment also discloses a law enforcement action assessment and evaluation system based on a virtual scenario, including: a position acquisition module, which is used to obtain the fingerprint information of the subject by using VR glasses, verify the identity of the subject according to the fingerprint information, and after successful verification, collect the joint points of the human skeleton, determine the coordinate system of each node in the joint points, obtain the VR assessment scenario data, and determine the VR scenario plane coordinate system with position attributes in the VR assessment scenario data; a position calibration module, which is used to establish an index relationship between the coordinate system of each node in the joint points and the VR scenario plane coordinate system with position attributes in the VR assessment scenario data and the VR scenario sphere coordinate system of the scenario sphere in the VR glasses, so that the VR glasses enter the VR panoramic mode for law enforcement action assessment; an assessment and evaluation module, which is used to obtain the instantaneous law enforcement action of the subject according to the joint points of the human skeleton during the assessment process, use the shortest path between the joint points of the preset standard action and the joint points of the human skeleton as the evaluation criterion, compare the instantaneous law enforcement action of the subject with the preset standard action, and conduct an evaluation to obtain the evaluation result.

[0055] The embodiments described above are only descriptions of the preferred embodiments of the present invention, and do not limit the scope of the present invention. Without departing from the design spirit of the present invention, various deformations and improvements made by those of ordinary skill in the art to the technical solutions of the present invention shall fall within the protection scope determined by the claims of the present invention.

Claims

1. A method for assessing law enforcement actions based on virtual scenes, characterized in that: include: Using VR glasses to obtain fingerprint information of the subject, verify the identity of the subject according to the fingerprint information, and after successful verification, collect the joint points of the human skeleton, determine the coordinate system of each node in the joint points, obtain VR assessment scene data, and determine the VR scene plane coordinate system with position attributes in the VR assessment scene data; An index relationship is established between the coordinate system of each node in the joint point and the VR scene plane coordinate system with position attributes in the VR assessment scene data and the VR scene sphere coordinate system of the scene sphere in the VR glasses, so that the VR glasses enter the VR panoramic mode to perform law enforcement action assessment; Establishing an index relationship between the VR scene plane coordinate system with position attributes in the VR assessment scene data and the VR scene sphere coordinate system of the scene sphere in the VR glasses includes: According to the division method of longitude and latitude, an index relationship is established between the VR scene plane coordinate system with position attributes in the VR assessment scene data and the VR scene sphere coordinate system of the scene sphere in the VR glasses; The VR glasses are made to enter the VR panoramic mode to conduct law enforcement action assessment, including: Acquiring vision data of the subject, and adjusting the focal length of the VR glasses according to the vision data of the subject; Acquire the texture coordinates of the VR assessment scene data, and render the VR assessment scene data onto the VR glasses based on the texture coordinates and the established index relationship; Acquiring vision data of the subject, and adjusting the focal length of the VR glasses according to the vision data of the subject in combination with the image rendered and presented on the screen, so as to use the VR glasses to conduct law enforcement action assessment; Adjusting the focal length of the VR glasses includes: Obtaining vision data of the subject, and adjusting the distance between the center points of the two screens of the VR glasses to be the same as the eye distance of the subject; According to the visual acuity data of the subject and the image rendered on the screen, the focal length of the VR glasses is adjusted so that the VR assessment scene is clearly imaged on the retina of the subject; During the assessment, the instantaneous law enforcement action of the subject is obtained according to the joints of the human skeleton, and the shortest path between each joint of the preset standard action and the joints of the human skeleton is used as an evaluation standard. The instantaneous law enforcement action of the subject is compared with the preset standard action, and an evaluation is performed to obtain an evaluation result; Acquiring the instantaneous law enforcement actions of the subject includes: During the assessment, the acceleration data of the subject performing relevant law enforcement actions is obtained according to the joint points of the human skeleton; Eliminate missing values ​​in the acceleration data, extract action frames, set an observation time window, preset instantaneous thresholds to filter the extracted action frames, determine the occurrence time of the law enforcement action, and obtain acceleration frame data based on the filtered action frames combined with the occurrence time of the law enforcement action; The acceleration frame data are marked and the instantaneous law enforcement actions of the subject in the data are selected.

2. The virtual scene-based law enforcement action assessment and evaluation method according to claim 1 is characterized in that: Verifying the identity of the subject based on the fingerprint information includes: The fingerprint information of the subject is obtained by using VR glasses; wherein the VR glasses at least include: a fingerprint collection device arranged on the outer shell of the VR glasses, and a movable spring device arranged at the lens placement position of the VR glasses; The fingerprint information of the subject is compared with the fingerprint information in the preset personal information to verify the identity of the subject. If the subject passes the identity verification, it indicates that the verification is successful; if the subject fails the identity verification, the mobile spring device is controlled to pop out the spring to cover the lenses of the VR glasses.

3. The virtual scene-based law enforcement action assessment and evaluation method according to claim 1 is characterized in that: Determining the coordinate system of each node in the joint point includes: Collecting motion capture data of various points of the subject, and determining the corresponding joint points of the human skeleton according to the motion capture data; The coordinate system of each node in the joint point is determined by taking the origin of the VR scene sphere coordinate system of the scene sphere in the VR glasses as the origin of the coordinate system of each node.

4. The virtual scene-based law enforcement action assessment and evaluation method according to claim 1 is characterized in that: The VR assessment scene data includes: panoramic pictures, panoramic videos, panoramic animations and audio.

5. A system for the virtual scene-based law enforcement action assessment and evaluation method according to any one of claims 1 to 4, characterized in that: include: A position acquisition module is used to obtain fingerprint information of the subject using VR glasses, verify the identity of the subject according to the fingerprint information, collect joint points of the human skeleton after successful verification, determine the coordinate system of each node in the joint points, obtain VR assessment scene data, and determine the VR scene plane coordinate system with position attributes in the VR assessment scene data; A position calibration module is used to establish an index relationship between the coordinate system of each node in the joint point and the VR scene plane coordinate system with position attributes in the VR assessment scene data and the VR scene sphere coordinate system of the scene sphere in the VR glasses, so that the VR glasses enter the VR panoramic mode to perform law enforcement action assessment; The assessment and evaluation module is used to obtain the subject's instantaneous law enforcement actions according to the joints of the human skeleton during the assessment process, and use the shortest path between each joint of the preset standard action and the joints of the human skeleton as the evaluation standard, compare the subject's instantaneous law enforcement actions with the preset standard actions, and evaluate and obtain the evaluation results.

Images