Picture capture control method and device for practical training vehicle and practical training vehicle
By dynamically adjusting the camera position and lens according to historical operation records on the training vehicle, and capturing and reviewing operation actions in real time, the inaccurate review problem caused by fixed camera position in the existing technology is solved, and efficient and accurate operation review is achieved.
Patent Information
- Application Number
- CN202411310879.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-20
- Publication Date
- 2024-12-20
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The camera position on the existing training vehicles is fixed and cannot be adjusted according to the specific operation of students, resulting in insufficient capture of the key operational images of the review, which in turn affects the accuracy of the review.
By obtaining the operation links of the items to be assessed, determining the operation location based on the historical operation records, moving the camera to the corresponding position, and fine-tuning the lens to capture the operation actions, comparing the degree of conformity with the standard actions in real time, calculating the operation scores, and achieving targeted review.
It improves the accuracy of capture and review of the operation screen, realizes automatic assessment, and improves the review efficiency.
Smart Images

Figure CN119169561A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computers, and in particular to a method and device for controlling screen capture for a training vehicle, and the training vehicle. Background Art
[0002] The training vehicle is a device used for students or professionals to conduct simulated operations and training. It is a mobile demonstration teaching tool that can provide an environment that simulates real scenes, allowing trainees to perform actual operations and skills training on the training vehicle.
[0003] After completing the operation training through the training vehicle, students need to undergo corresponding assessment. The existing training vehicle assessment method mainly uses a camera installed on the training vehicle to record the student's operation process, and the later assessor can score the student's operation based on the recorded image; however, the position of the camera on the existing training vehicle is relatively fixed. Even if it can be adjusted, its position can only be adjusted before recording, and it is impossible to make targeted adjustments based on the student's specific operation actions, which may result in the loss of some key operation pictures that play a key role in the evaluation.
[0004] Therefore, the existing training vehicles have poor pertinence in capturing user operation screens, which leads to inaccurate later evaluations. Summary of the invention
[0005] Based on this, it is necessary to provide a screen capture control method, device and training vehicle for a training vehicle to address the above-mentioned problems.
[0006] The embodiment of the present invention is implemented as follows: a training vehicle screen capture control method, the method comprising: S1: Obtain each operation link of the project to be assessed; S2: Determine the operating part corresponding to each operating link according to the historical operation records, wherein the operating part is the body part used by the operator when performing the operating link; S3: before the operator performs the first operation link, move the camera to the operation part corresponding to the operation link; S4: fine-tuning the camera lens so that the operation part is located within a set area of the camera video screen; S5: When the operator performs the operation, the operation action of the operation part is captured in real time; S6: comparing the consistency of the operation action with the pre-stored standard action corresponding to the operation link; S7: Determine the operation score of the operation link according to the degree of agreement; S8: before the operator performs the next operation link, the camera is moved to the operation part corresponding to the operation link, and steps S4 to S7 are performed to obtain the operation score of the next operation link, and this step is repeated until the operation score of each operation link is obtained; S9: Calculate the total score based on the operation score of each operation link.
[0007] In one embodiment, the present invention provides a training vehicle screen capture control device, the training vehicle screen capture control device is used to execute the training vehicle screen capture control method, specifically comprising: The acquisition module is used to obtain each operation link of the project to be assessed; A first processing module is used to determine the operation part corresponding to each operation link according to the historical operation record, wherein the operation part is the body part used by the operator when performing the operation link; The second processing module is used to move the camera to the operation position corresponding to the first operation link before the operator performs the first operation link; A third processing module is used to fine-tune the camera lens so that the operation part is located within a set area of the camera video screen; A fourth processing module is used to capture the operation action of the operation part in real time when the operator performs the operation link; A fifth processing module, used for comparing the consistency between the operation action and the pre-stored standard action corresponding to the operation link; A sixth processing module, used to determine the operation score of the operation link according to the degree of coincidence; The seventh processing module is used to move the camera to the operation part corresponding to the operation link before the operator performs the next operation link, and execute steps S4 to S7 to obtain the operation score of the next operation link, and repeat this step until the operation score of each operation link is obtained; The eighth processing module is used to calculate the total score based on the operation score of each operation link.
[0008] In one embodiment, the present invention provides a training vehicle, comprising: Training frame; At least one camera, installed on the training frame, for filming the user's operation process; The computer equipment is installed on the training vehicle frame and connected to each camera, and is used to execute the picture capturing control method for the training vehicle.
[0009] The present invention provides a screen capture control method and device for a training vehicle, and a training vehicle, wherein the method comprises the following steps: obtaining each operation link of a project to be assessed; determining an operation part corresponding to each operation link according to historical operation records; before an operator performs a first operation link, moving a camera to an operation part corresponding to the operation link; fine-tuning a camera lens so that the operation part is located within a set area of a video screen of the camera; when the operator performs the operation link, capturing an operation action of the operation part in real time; comparing the consistency of the operation action with a pre-stored standard action corresponding to the operation link; determining an operation score of the operation link according to the consistency; and before the operator performs a next operation link, Move the camera to the operation part corresponding to the operation link, execute steps S4 to S7 to obtain the operation score of the next operation link, and repeat this step until the operation score of each operation link is obtained; calculate the total score according to the operation score of each operation link; in the present invention, the camera can be moved to the body part to be used in the operation link according to the operation link that the user is about to perform, and then the operation actions that are truly related to each operation link can be recorded in a targeted manner, and the present invention can also compare the actions in the recorded real-time image with the standard actions, and then score the user's operation, thereby realizing automated assessment and improving the efficiency and accuracy of the assessment. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] Figure 1 A flowchart of a training vehicle screen capture control method provided in one embodiment; Figure 2 It is a module diagram of a picture capture control device for a training vehicle in one embodiment; Figure 3 A diagram showing the composition of a training vehicle in one embodiment; Figure 4 FIG. 4 is a block diagram of the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0011] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0012] It is understood that the terms "first", "second", etc. used in the present invention may be used herein to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script without departing from the scope of the present invention.
[0013] like Figure 1 As shown, in one embodiment, a method for controlling a picture capture for a training vehicle is proposed, the method comprising: S1: Obtain each operation link of the project to be assessed; S2: Determine the operating part corresponding to each operating link according to the historical operation records, wherein the operating part is the body part used by the operator when performing the operating link; S3: before the operator performs the first operation link, move the camera to the operation part corresponding to the operation link; S4: fine-tuning the camera lens so that the operation part is located within a set area of the camera video screen; S5: When the operator performs the operation, the operation action of the operation part is captured in real time; S6: comparing the degree of consistency between the operation action and the pre-stored standard action corresponding to the operation link; S7: Determine the operation score of the operation link according to the degree of agreement; S8: before the operator performs the next operation link, the camera is moved to the operation part corresponding to the operation link, and steps S4 to S7 are performed to obtain the operation score of the next operation link, and this step is repeated until the operation score of each operation link is obtained; S9: Calculate the total score based on the operation score of each operation link.
[0014] In this embodiment, the method is executed in a computer device, which can be an independent physical server or terminal, or a server cluster composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud servers, cloud databases, cloud storage and CDN; a training vehicle refers to a vehicle specifically used for students or professionals to perform actual operations and training. It is a mobile teaching tool that provides an environment that simulates real scenes, allowing trainees to perform actual operations and skill training on the vehicle; in this application, students can use the training vehicle to learn and train a certain operation project, and after the training is completed, a corresponding assessment is required to determine whether the student's operation level after training meets the standard, and the assessment process is performed on the training vehicle; the historical operation record is a video image of each operation project shot in the history recorded in the computer device; each operation link corresponds to the need for the operator to use certain body parts for operation, the body parts are the operation parts, and the video images in the historical operation record are the images of the operation parts operating; the standard action is the action in the video image shot specifically for evaluation and assessment pre-stored in the computer device, and the computer device stores the standard action of each assessment project and each operation link.
[0015] In the present application, for each assessment item (i.e., operation item), each operation link is recorded in the computer device; when the user is to be assessed on a certain assessment item, the operation part to be used for each step and the approximate shooting angle of the part are first determined based on the relevant images of the historical operation records; then, before the operator starts to perform the first operation part, the camera is moved to a position where the corresponding operation part can be photographed at the angle; then the camera is fine-tuned so that the operation part enters a set area, and the operation part in the image corresponding to the standard action is also within the set area, so that the operation action can be compared with the standard action more accurately; after the comparison, the degree of consistency between the two can be obtained. The user's score in the operation link can be obtained based on the degree of match, and the higher the degree of match, the higher the score; for the next operation link, the same process is carried out to obtain its operation link score, and this cycle is repeated and the scores of each operation link are accumulated to obtain a total score, and then it is judged whether the user meets the standard at a later stage; in the present invention, the camera can be moved to the part of the body to be used in the operation link that the user is about to perform, and then the operation actions that are truly related to each operation link can be recorded in a targeted manner, and the present invention can also compare the actions in the recorded real-time image with the standard actions, and then score the user's operation, thereby realizing automated assessment and improving the efficiency and accuracy of the assessment.
[0016] As a preferred embodiment, the determining the operation part corresponding to each operation link according to the historical operation record includes: S21: Obtain the historical video footage of the last time the user performed the project to be assessed; S22: taking a screen segment corresponding to the first operation link from the historical video screen; S23: identifying a body part of an operator in the image segment; S24: using the identified body part as the operation part of the operation link; S25: Take a picture segment corresponding to an operation link from the historical video screen, execute steps S23 to S24 to identify the operation part of the operation link, and repeat this step until the operation part of each operation link is obtained.
[0017] In this embodiment, the image of the body part performing the operation is captured, and the name of the body part in the image is recognized by using the existing scanning and object recognition technology to obtain the name of the operation part.
[0018] As a preferred embodiment, the moving camera to the operation part corresponding to the operation link is to move the camera to a position where the operation part corresponding to each operation link is located on the video screen; The standard action is an operation part action corresponding to the pre-stored standard video screen of the operation link, and the fine-tuning camera lens is to adjust the viewing angle of the camera to the viewing angle of the pre-stored standard video screen, as follows; Taking the first frame standard image of the pre-stored standard video screen, and identifying the first outline of the operation part in the first frame standard image; Moving the first outline to a corresponding position of the real-time video screen; Identify a second outline of the operation part in the real-time video picture; The relative position of the camera and the operating part is adjusted so that the closest distance between any point on the second contour and the first contour is not greater than a first set value.
[0019] In this embodiment, the first set value can be 3mm, 5mm or other values, which are not limited here; the closest distance between any point on the second contour and the first contour is not greater than the first set value, that is, the first contour and the second contour are in a state of roughly overlapping, which facilitates the subsequent identification and comparison of the relative distance between the two.
[0020] As a preferred embodiment, a plurality of first contour points are taken on the first contour, and a plurality of second contour points corresponding to the first contour points are taken at corresponding positions on the second contour, and the real-time capture of the operation action of the operation part is to capture the real-time position of the second contour points; The degree of consistency between the comparison operation action and the pre-stored standard action corresponding to the operation link includes: S61: taking the first frame image of the real-time video screen as the first comparison image, and taking the first frame standard image as the second comparison image; S62: Calculating the contour point distance between each first contour point in the first comparison image and the corresponding second contour point in the second comparison image; S63: Calculate the average distance of each contour point; S64: determining the frame matching degree of the first frame image according to the average distance; S65: taking the next frame of the real-time video screen as the first comparison image, taking the next frame of the standard image as the second comparison image, executing steps S62 to S64 to obtain the frame consistency of the frame image, and repeating this step until the frame consistency of each frame of the operation link is obtained; S66: Determine the degree of consistency between the comparison operation action and the standard action according to the degree of consistency of each frame.
[0021] The degree of fit of any frame is calculated using the following formula: in, is the matching degree of the i-th frame, is the average distance corresponding to the i-th frame image, is the first adjustment coefficient; The degree of consistency between the comparison operation action and the standard action is calculated using the following formula: Where W is the degree of fit, n is the number of frame fits; The operation score of this operation link is obtained by the following formula: in, The operation score for this operation link is is the second adjustment factor.
[0022] In this embodiment, the first adjustment coefficient can be 20 or other values, and the second adjustment coefficient can be 10 or other values, which are not limited here. The degree of fit sought by the present invention is obtained by averaging the degrees of fit of each frame in an entire operation link, that is, the basis for calculating the degree of fit is refined to the operation action of each frame, which can characterize the degree of similarity between the operation action of each segment in the entire operation process and the standard steps. In particular, the score of the operation link is more representative, thereby improving the accuracy and fairness of the score assessment.
[0023] As a preferred embodiment, the total score is calculated according to the following formula: Among them, P is the total score, is the operation score of the mth operation link, is the mth weighting coefficient, and m is the number of operation links.
[0024] Any weighting coefficient is calculated by the following formula: in, is the jth weighting coefficient, is the number of video frames corresponding to the jth operation link, is the third adjustment coefficient, and j is an integer not greater than m.
[0025] In this embodiment, since the length of each operation link is different, the weighting coefficient of each step is determined according to the length of each operation link (represented by the number of frames), and the corresponding operation link score is weighted when calculating the total score, thereby ensuring the rationality of the total score calculation.
[0026] As a preferred embodiment, there are several cameras available for use, and each camera corresponds to at least one operating part; moving a camera to an operating part means moving the camera corresponding to the operating part to the operating part.
[0027] In this embodiment, since the distance between the operating parts may be far, such as hands and feet, the present application can set corresponding cameras for different operating parts, such as setting a camera for the hand and a camera for the foot, so as to reduce the adjustment range of the camera, thereby ensuring that it can be moved to the specified position before the user performs the next operation link.
[0028] like Figure 2 As shown, in one embodiment, the present invention provides a training vehicle screen capture control device, the training vehicle screen capture control device is used to execute the training vehicle screen capture control method, specifically comprising: The acquisition module is used to obtain each operation link of the project to be assessed; A first processing module is used to determine the operation part corresponding to each operation link according to the historical operation record, wherein the operation part is the body part used by the operator when performing the operation link; The second processing module is used to move the camera to the operation position corresponding to the first operation link before the operator performs the first operation link; A third processing module is used to fine-tune the camera lens so that the operation part is located within a set area of the camera video screen; A fourth processing module is used to capture the operation action of the operation part in real time when the operator performs the operation link; A fifth processing module, used for comparing the consistency between the operation action and the pre-stored standard action corresponding to the operation link; A sixth processing module, used to determine the operation score of the operation link according to the degree of coincidence; The seventh processing module is used to move the camera to the operation part corresponding to the operation link before the operator performs the next operation link, and execute steps S4 to S7 to obtain the operation score of the next operation link, and repeat this step until the operation score of each operation link is obtained; The eighth processing module is used to calculate the total score based on the operation score of each operation link. The process of each module realizing its own function in a training vehicle screen capture control device provided in an embodiment of the present application can be specifically referred to the aforementioned Figure 1 The description of the illustrated embodiment will not be repeated here.
[0029] like Figure 3As shown, in one embodiment, the present invention provides a training vehicle, comprising: Training frame; At least one camera, installed on the training frame, for filming the user's operation process; The computer equipment is installed on the training vehicle frame and connected to each camera, and is used to execute the picture capturing control method for the training vehicle.
[0030] In this embodiment, wheels are also provided on the training vehicle frame, and the training vehicle can move by the wheels. The computer equipment arranged on the training vehicle frame in this application cooperates with each camera to execute the image capture control method for the training vehicle, and can move the camera to the body part to be used in the operation link according to the operation link that the user is about to perform, so as to make targeted records of the operation actions that are truly related to each operation link. In addition, the present invention can also compare the actions in the recorded real-time image with the standard actions, and then score the user's operation, thereby realizing automated assessment and improving the efficiency and accuracy of the assessment.
[0031] Figure 4 FIG. 2 shows an internal structure diagram of a computer device in one embodiment. Figure 4 As shown, the computer device includes a processor, a memory, a network interface, an input device and a display screen connected via a system bus. Among them, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program. When the computer program is executed by the processor, the processor can implement the training vehicle screen capture control method provided in an embodiment of the present invention. The internal memory may also store a computer program. When the computer program is executed by the processor, the processor can execute the training vehicle screen capture control method provided in an embodiment of the present invention. The display screen of the computer device may be a liquid crystal display or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or a button, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.
[0032] Those skilled in the art will understand that Figure 4 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation on the computer device to which the solution of the present invention is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0033] In one embodiment, the training vehicle screen capture control device provided by the embodiment of the present invention can be implemented in the form of a computer program. The computer program can be used in Figure 4 The computer device shown in the figure is run. The memory of the computer device can store various program modules constituting the screen capture control device for the practical training vehicle, for example, Figure 2 The acquisition module, the first processing module, the second processing module, the third processing module, the fourth processing module, the fifth processing module, the sixth processing module, the seventh processing module, and the eighth processing module shown in the figure. The computer program composed of each program module enables the processor to execute the steps of the training vehicle screen capture control method of each embodiment of the present invention described in this specification.
[0034] For example, Figure 4 The computer device shown can be Figure 3 The acquisition module in the training vehicle screen capture control device shown executes step S1; the computer device can execute step S2 through the first processing module; the computer device can execute step S3 through the second processing module; the computer device can execute step S4 through the third processing module; the computer device can execute step S5 through the fourth processing module; the computer device can execute step S6 through the fifth processing module; the computer device can execute step S7 through the sixth processing module; the computer device can execute step S8 through the seventh processing module; the computer device can execute step S9 through the eighth processing module.
[0035] In one embodiment, a computer device is provided, the computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the following steps are implemented: S1: Obtain each operation link of the project to be assessed; S2: Determine the operation part corresponding to each operation link according to the historical operation records; S3: before the operator performs the first operation link, move the camera to the operation part corresponding to the operation link; S4: fine-tuning the camera lens so that the operation part is located within a set area of the camera video screen; S5: When the operator performs the operation, the operation action of the operation part is captured in real time; S6: comparing the degree of consistency between the operation action and the pre-stored standard action corresponding to the operation link; S7: Determine the operation score of the operation link according to the degree of agreement; S8: before the operator performs the next operation link, the camera is moved to the operation part corresponding to the operation link, and steps S4 to S7 are performed to obtain the operation score of the next operation link, and this step is repeated until the operation score of each operation link is obtained; S9: Calculate the total score based on the operation score of each operation link.
[0036] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor performs the following steps: S1: Obtain each operation link of the project to be assessed; S2: Determine the operation part corresponding to each operation link according to the historical operation records; S3: before the operator performs the first operation link, move the camera to the operation part corresponding to the operation link; S4: fine-tuning the camera lens so that the operation part is located within a set area of the camera video screen; S5: When the operator performs the operation, the operation action of the operation part is captured in real time; S6: comparing the degree of consistency between the operation action and the pre-stored standard action corresponding to the operation link; S7: Determine the operation score of the operation link according to the degree of agreement; S8: before the operator performs the next operation link, the camera is moved to the operation part corresponding to the operation link, and steps S4 to S7 are performed to obtain the operation score of the next operation link, and this step is repeated until the operation score of each operation link is obtained; S9: Calculate the total score based on the operation score of each operation link.
[0037] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps. A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0038] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0039] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.
Claims
1. A training vehicle screen capture control method, characterized in that: The method comprises: S1: Obtain each operation link of the project to be assessed; S2: Determine the operating part corresponding to each operating link according to the historical operation records, wherein the operating part is the body part used by the operator when performing the operating link; S3: before the operator performs the first operation link, move the camera to the operation part corresponding to the operation link; S4: fine-tuning the camera lens so that the operation part is located within a set area of the camera video screen; S5: When the operator performs the operation, the operation action of the operation part is captured in real time; S6: comparing the degree of consistency between the operation action and the pre-stored standard action corresponding to the operation link; S7: Determine the operation score of the operation link according to the degree of agreement; S8: before the operator performs the next operation link, the camera is moved to the operation part corresponding to the operation link, and steps S4 to S7 are performed to obtain the operation score of the next operation link, and this step is repeated until the operation score of each operation link is obtained; S9: Calculate the total score based on the operation score of each operation link.
2. The method according to claim 1, characterized in that Determining the operation parts corresponding to each operation link according to the historical operation records includes: S21: Obtain the historical video footage of the last time the user performed the project to be assessed; S22: taking a screen segment corresponding to the first operation link from the historical video screen; S23: identifying a body part of an operator in the image segment; S24: using the identified body part as the operation part of the operation link; S25: Take a picture segment corresponding to an operation link from the historical video screen, execute steps S23 to S24 to identify the operation part of the operation link, and repeat this step until the operation part of each operation link is obtained.
3. The method according to claim 1, characterized in that The moving camera to the operation part corresponding to the operation link is to move the camera to a position where the operation part corresponding to each operation link is located on the video screen; The standard action is an operation part action corresponding to the pre-stored standard video screen of the operation link, and the fine-tuning camera lens is to adjust the viewing angle of the camera to the viewing angle of the pre-stored standard video screen, as follows; Taking the first frame standard image of the pre-stored standard video screen, and identifying the first outline of the operation part in the first frame standard image; Moving the first outline to a corresponding position of the real-time video screen; Identify a second outline of the operation part in the real-time video picture; The relative position of the camera and the operating part is adjusted so that the closest distance between any point on the second contour and the first contour is not greater than a first set value.
4. The method according to claim 3, characterized in that A plurality of first contour points are taken on the first contour, and a plurality of second contour points corresponding to the first contour points are taken at corresponding positions on the second contour, wherein the real-time capture of the operation action of the operation part is to capture the real-time position of the second contour points; The degree of consistency between the comparison operation action and the pre-stored standard action corresponding to the operation link includes: S61: taking the first frame image of the real-time video screen as the first comparison image, and taking the first frame standard image as the second comparison image; S62: Calculating the contour point distance between each first contour point in the first comparison image and the corresponding second contour point in the second comparison image; S63: Calculate the average distance of each contour point; S64: determining the frame matching degree of the first frame image according to the average distance; S65: taking the next frame of the real-time video screen as the first comparison image, taking the next frame of the standard image as the second comparison image, executing steps S62 to S64 to obtain the frame consistency of the frame image, and repeating this step until the frame consistency of each frame of the operation link is obtained; S66: Determine the degree of consistency between the comparison operation action and the standard action according to the degree of consistency of each frame.
5. The method according to claim 4, characterized in that The degree of fit of any frame is calculated using the following formula: in, is the i-th frame matching degree, is the average distance corresponding to the i-th frame image, is the first adjustment coefficient; The degree of consistency between the comparison operation action and the standard action is calculated using the following formula: Where W is the degree of fit, n is the number of frame fits; The operation score of this operation link is obtained by the following formula: in, The operation score for this operation link is is the second adjustment factor.
6. The method according to claim 5, characterized in that The total score is calculated according to the following formula: Among them, P is the total score, is the operation score of the mth operation link, is the mth weighting coefficient, and m is the number of operation links.
7. The method according to claim 6, characterized in that Any weighting coefficient is calculated by the following formula: in, is the jth weighting coefficient, is the number of video frames corresponding to the jth operation link, is the third adjustment coefficient, and j is an integer not greater than m.
8. The method according to claim 1, characterized in that There are several cameras available for use, and each camera corresponds to at least one operating position; moving a camera to an operating position means moving the camera corresponding to the operating position to the operating position.
9. A picture capture control device for a training vehicle, characterized in that: The training vehicle screen capture control device is used to execute the training vehicle screen capture control method described in claim 1, specifically comprising: The acquisition module is used to obtain each operation link of the project to be assessed; A first processing module is used to determine the operation part corresponding to each operation link according to the historical operation record, wherein the operation part is the body part used by the operator when performing the operation link; The second processing module is used to move the camera to the operation position corresponding to the first operation link before the operator performs the first operation link; A third processing module is used to fine-tune the camera lens so that the operation part is located within a set area of the camera video screen; A fourth processing module is used to capture the operation action of the operation part in real time when the operator performs the operation link; A fifth processing module, used for comparing the consistency between the operation action and the pre-stored standard action corresponding to the operation link; A sixth processing module, used to determine the operation score of the operation link according to the degree of coincidence; The seventh processing module is used to move the camera to the operation part corresponding to the operation link before the operator performs the next operation link, and execute steps S4 to S7 to obtain the operation score of the next operation link, and repeat this step until the operation score of each operation link is obtained; The eighth processing module is used to calculate the total score based on the operation score of each operation link.
10. A training vehicle, characterized in that: include: Training frame; At least one camera, installed on the training frame, for filming the user's operation process; The computer device is installed on the training vehicle frame and connected to each camera, and is used to execute the training vehicle picture capture control method as described in any one of claims 1 to 8.
Citation Information
Patent Citations
Camera control method, camera control device and mobile terminal
CN108696634A
Evaluation method, model construction method, teaching machine, teaching system and electronic equipment
CN113128283A
Welding process monitoring analysis method, device and system
CN117226331A
Data management method and device for practical training room and practical training system
CN117373134A
Vehicle identification method, device and system based on movable camera
CN117373257A
