Pressure simulation training method and device for robot arm teleoperation
The time and consequence pressure in remote operation of the robot arm is simulated through video voice technology, which solves the problem of not considering the impact of pressure in the prior art, and improves the operation ability and task completion quality of trained personnel under high pressure.
Patent Information
- Application Number
- CN202111062402.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-10
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-09-10
AI Technical Summary
The existing remote operation training methods of robotic arm do not consider the impact of pressure on trainees, resulting in operation errors in high-pressure environments and affecting the quality of task completion.
The pressure simulation training method for remote operation of robotic arm based on video voice is adopted to induce audio and video through time pressure and consequence pressure, simulate different types and levels of pressure environments, and improve the pressure adaptability and operation level of trained personnel.
It effectively induces the remote operation ability of the robotic arm under different pressures, improves the operating performance under high pressure environments, and reduces the operating error rate.
Smart Images

Figure CN115798279B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of aerospace technology, and in particular to a pressure simulation training method and device for robot arm teleoperation based on video and voice. Background Art
[0002] Robot arm teleoperation plays an important role in stage missions. Although the automation level of space robots has gradually improved with the continuous development of aerospace technology, the participation of operators is indispensable in some fields with high precision requirements. Therefore, it is very important to conduct simulation training of robot arm teleoperation for operators in advance.
[0003] However, the training methods in related technologies only consider the trainees' proficiency in remote operation of robotic arms, but do not consider the impact of stress on the trainees' completion of remote operation tasks, which needs to be urgently addressed. Summary of the invention
[0004] The present invention aims to solve one of the technical problems in the related art at least to a certain extent.
[0005] To this end, an object of the present invention is to propose a pressure simulation training method for robot arm teleoperation based on video and voice, which can train trainees in robot arm teleoperation under different pressures and improve the trainees' operation level under different pressures.
[0006] Another object of the present invention is to provide a pressure simulation training device for robot arm teleoperation based on video and voice.
[0007] To achieve the above-mentioned purpose, an embodiment of the present invention proposes a pressure simulation training method for robotic arm teleoperation based on video and voice, comprising the following steps: receiving a task selection instruction from a user, and obtaining a target task and a task level according to the task selection instruction; matching the pressure-inducing audio and video of the target task according to the task level, so as to induce stress for the trainee according to the pressure-inducing audio and video, wherein the stress includes time pressure and consequence pressure; after inducing the time pressure and the consequence pressure, guiding the trainee to teleoperate a simulated robotic arm to perform the target task, and when the target task fails, playing a task failure audio and video, so as to train the trainee in robotic arm teleoperation under different types and levels of pressure.
[0008] The video and voice-based stress simulation training method for robotic arm teleoperation of an embodiment of the present invention matches the corresponding stress-inducing audio and video according to the task level of the trainee to induce a corresponding degree of stress on the trainee, and can train the trainee in robotic arm teleoperation under different types and levels of pressure, thereby improving the trainee's stress adaptability and improving the trainee's operation level under different pressures.
[0009] In addition, the pressure simulation training method for robot arm teleoperation based on video and voice according to the above embodiment of the present invention may also have the following additional technical features:
[0010] Furthermore, matching the stress-inducing audio and video of the target task according to the task level includes: determining the time pressure level and consequence pressure level of the target task according to the task level; obtaining the task time of the target task according to the time pressure level, and determining the performance reward deduction rules and point deduction rules, as well as the task performance result announcement rules and task failure audio and video in the event of task errors and task failures according to the consequence pressure level; converting the task time, the performance reward deduction rules, the point deduction rules and the task performance result announcement rules into stress-inducing voice, and composing the stress-inducing audio and video based on the stress-inducing voice and the task failure audio and video.
[0011] Further, the time pressure level includes first to third time pressure levels, and the consequence pressure level includes first to third consequence pressure levels, wherein the time pressure of the third time pressure level is greater than that of the second time pressure level, and the time pressure of the second time pressure level is greater than that of the first time pressure level; the consequence pressure of the third consequence pressure level is greater than that of the second consequence pressure level, and the second consequence pressure level is greater than the first consequence pressure level.
[0012] Furthermore, it also includes: obtaining the actual time taken by the trainee to complete the task under the current time pressure level and the current consequence pressure level; judging whether the actual time is greater than a first threshold, or less than a second threshold, wherein the first threshold is greater than the second threshold; if greater than the first threshold, lowering the current time pressure level and / or the current consequence pressure level, and if less than the second threshold, increasing the current time pressure level and / or the current consequence pressure level.
[0013] Furthermore, before receiving the user's task selection instruction, it also includes: identifying the identity information of the trainee; detecting the highest level of the trainee's completion of the target task in the identity and task level database based on the identity information; matching the stress-inducing audio and video of the target task according to the highest level, so as to induce stress on the trainee before the operation based on the stress-inducing audio and video.
[0014] To achieve the above-mentioned purpose, another embodiment of the present invention proposes a pressure simulation training device for robotic arm remote operation based on video and voice, including: a first acquisition module, used to receive the user's task selection instruction, and obtain the target task and task level according to the task selection instruction; a pressure inducing module, used to match the pressure-inducing audio and video of the target task according to the task level, so as to induce stress for the trainee according to the pressure-inducing audio and video, and the pressure includes time pressure and consequence pressure; a training module, used to guide the trainee to remotely operate the robotic arm in the simulation to perform the target task after inducing the time pressure and the consequence pressure, and when the target task fails, play the task failure audio and video, so as to train the trainee in robotic arm remote operation under different types and levels of pressure.
[0015] The video and voice-based pressure simulation training device for robot arm teleoperation in an embodiment of the present invention matches the corresponding pressure-inducing audio and video according to the task level of the trainee to induce a corresponding degree of stress on the trainee, and can train the trainee in robot arm teleoperation under different types and levels of pressure, thereby improving the trainee's stress adaptability and improving the trainee's operation level under different pressures.
[0016] In addition, the pressure simulation training device for robot arm teleoperation based on video and voice according to the above embodiment of the present invention may also have the following additional technical features:
[0017] Furthermore, the stress-inducing module includes: a first determination unit, used to determine the time pressure level and consequence pressure level of the target task according to the task level; a second determination unit, used to obtain the task time of the target task according to the time pressure level, and determine the performance reward deduction rules and point deduction rules, as well as the task performance result announcement rules and task failure audio and video according to the consequence pressure level; a conversion unit, used to convert the task time, the performance reward deduction rules, the point deduction rules and the task performance result announcement rules into stress-inducing voice, and compose the stress-inducing audio and video based on the stress-inducing voice and the task failure audio and video.
[0018] Further, the time pressure level includes first to third time pressure levels, and the consequence pressure level includes first to third consequence pressure levels, wherein the time pressure of the third time pressure level is greater than that of the second time pressure level, and the time pressure of the second time pressure level is greater than that of the first time pressure level; the consequence pressure of the third consequence pressure level is greater than that of the second consequence pressure level, and the second consequence pressure level is greater than the first consequence pressure level.
[0019] Furthermore, it also includes: a second acquisition module, used to obtain the actual time taken by the trainee to complete the task under the current time pressure level and the current consequence pressure level; a judgment module, used to judge whether the actual time is greater than a first threshold, or less than a second threshold, wherein the first threshold is greater than the second threshold; a pressure adaptation module, used to reduce the current time pressure level and / or the current consequence pressure level when it is greater than the first threshold, and to increase the current time pressure level and / or the current consequence pressure level when it is less than the second threshold.
[0020] Furthermore, it also includes: an identification module, which is used to identify the identity information of the trainee before receiving the user's task selection instruction; a detection module, which is used to detect the highest level of the trainee's completion of the target task in the identity identification and task level database based on the identity information; the stress inducing module is also used to match the stress-inducing audio and video of the target task according to the highest level, so as to induce stress on the trainee before the operation based on the stress-inducing audio and video.
[0021] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0023] Figure 1 A flowchart of a pressure simulation training method for robot arm teleoperation based on video and voice according to an embodiment of the present invention;
[0024] Figure 2 The block diagram of a pressure simulation training device for robot arm teleoperation based on video and voice according to an embodiment of the present invention. DETAILED DESCRIPTION
[0025] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.
[0026] The present invention is based on the inventor's understanding and discovery of the following problems:
[0027] Robot arm teleoperation plays an important role in stage missions. Although the automation level of space robots has gradually improved with the continuous development of aerospace technology, the participation of operators is indispensable in some fields with high precision requirements. However, due to the special complexity of personnel, operational errors may occur, resulting in human errors. Studies have shown that stress is an important cause of human errors. Therefore, studying human errors under stressful situations is of great significance to the completion of aerospace missions.
[0028] Time pressure is the subjective experience or psychological state of time pressure caused by the objective time limit of completing a task. At present, the main method of inducing time pressure in existing research is to calculate the average time for trainees to complete a given task without time pressure, as well as the standard deviation of the trainees' task completion, and use the mean-standard deviation as the task time limit. Different trainees have different perceptions of time pressure, and this method of uniformly limiting the time length cannot well induce the time pressure of each trainee. In addition, the existing stress induction method does not take into account the individual's ability to adapt to stress.
[0029] Consequence stress refers to the subjective experience or psychological state of individuals caused by the trainers' fear of the consequences of tasks (mainly failure) that may affect society, others, and individuals. It mainly emphasizes the psychological and physiological stress caused by the fear of task consequences. Most of the existing studies on consequence stress use methods such as noise stimulation, task materials, social evaluation, and speeches to induce the stress of individuals caused by the consequences of task failure. However, the existing methods of inducing time and consequence stress are not sufficient to induce time and consequence stress in robotic arm teleoperation tasks.
[0030] In order to solve the problem of inducing time and consequence pressure in the task scenario of robot arm teleoperation, the embodiment of the present invention proposes a pressure simulation training method and device for robot arm teleoperation based on video and voice, which induces time and consequence pressure in the specific task of robot arm teleoperation by creating a task scenario, setting a task time limit, matching screen images and corresponding noises, linking performance rewards, publishing performance results, etc., so as to conduct robot arm teleoperation training for trainees under different pressures and improve the training personnel's operation level under different pressures.
[0031] The following describes a pressure simulation training method and device for robotic arm remote operation based on video and voice according to an embodiment of the present invention with reference to the accompanying drawings. First, the pressure simulation training method for robotic arm remote operation based on video and voice proposed in an embodiment of the present invention will be described with reference to the accompanying drawings.
[0032] Figure 1 The present invention is a flowchart of a pressure simulation training method for robot arm teleoperation based on video and voice according to an embodiment of the present invention.
[0033] like Figure 1 As shown, the video and voice-based pressure simulation training method for robot arm teleoperation includes the following steps:
[0034] In step S101 , a task selection instruction from a user is received, and a target task and a task level are acquired according to the task selection instruction.
[0035] It should be noted that the application scenarios of the embodiments of the present invention may include training, personnel selection and evaluation under stress (pressure) situations, etc.
[0036] The target task may be any task; the task level may be determined according to the user's choice or according to the target task, and there is no specific limitation on this.
[0037] For example, the target task may be to repair solar panels with a remotely operated robotic arm. When the task is obtained, the level of the task can be selected at the same time. After the target task is obtained, the computer screen displays the cabin scene, followed by the meteorite fragment impact scene to simulate the mission scenario.
[0038] In step S102, the stress-inducing audio and video of the target task is matched according to the task level, so as to induce stress on the trainee according to the stress-inducing audio and video, and the stress includes time pressure and consequence pressure.
[0039] Among them, the stress-inducing audio and video includes stress-inducing voice and task failure audio and video, which are used to induce stress for trainees.
[0040] In this embodiment, the stress-inducing audio and video of the target task is matched according to the task level, including: determining the time pressure level and consequence pressure level of the target task according to the task level; obtaining the task time of the target task according to the time pressure level, and determining the performance reward deduction rules and point deduction rules when the task is wrong and the task fails according to the consequence pressure level, as well as the task performance result announcement rules and the task failure audio and video; converting the task time, performance reward deduction rules, point deduction rules and task performance result announcement rules into stress-inducing voice, and composing the stress-inducing audio and video according to the stress-inducing voice and the task failure audio and video.
[0041] It can be understood that, in specific applications, the embodiments of the present invention can issue tasks through on-screen instructions, explain the current task background and the consequences of failing to complete the task through text, and different task scenarios have different levels of situation creation severity, different time limits, different degrees of performance-based remuneration linkage, and different performance results announcement situations; and prompt the screen that will appear if the task is not completed, for example, playing the picture and sound effects of the cabin explosion.
[0042] It should be noted that, since different time pressure levels and consequence pressure levels correspond to different task times, performance remuneration deduction rules, point deduction rules and task performance result announcement rules, and different consequence pressure levels also correspond to different task failure images; therefore, the embodiments of the present invention need to determine the time pressure level and consequence pressure level according to the task level in order to induce corresponding stress.
[0043] The embodiment of the present invention may pre-establish a correspondence between the task level and the time pressure level and the consequence pressure level, so as to determine the time pressure level and the consequence pressure level corresponding to the task level according to the correspondence.
[0044] In this embodiment, the time pressure level includes first to third time pressure levels, and the consequence pressure level includes first to third consequence pressure levels. The time pressure of the third time pressure level is greater than that of the second time pressure level, and the time pressure of the second time pressure level is greater than that of the first time pressure level; the consequence pressure of the third consequence pressure level is greater than that of the second consequence pressure level, and the second consequence pressure level is greater than the first consequence pressure level.
[0045] Among them, the task levels may include the first to ninth task levels, as follows:
[0046] (1) The first task level may include a first time pressure level and a first consequence pressure level. The pressure corresponding to the first task level is: a situation with no time pressure and no consequence pressure. In the embodiment of the present invention, pressure can be induced by text and voice. For example, the instruction for the situation with no time pressure and no consequence pressure can be:
[0047] "This is the Yunxiao-1 control center. Operator No. 03, please note that a piece of meteorite fragment scraped the left solar panel ten seconds ago. Please immediately operate the robotic arm to cooperate with the personnel outside the cabin to check it." The subjects were also reminded that if mistakes were made during the operation of this situational task, no remuneration would be deducted, and the task performance results would not be announced in the end.
[0048] (2) The second task level may include a first time pressure level and a second consequence pressure level. The pressure corresponding to the second task level is: no time pressure and low consequence pressure situation. In the embodiment of the present invention, pressure can be induced by text and voice. For example, the instructions for the no time pressure and low consequence pressure situation are:
[0049] "This is the Yunxiao No. 1 control center. Operator No. 03, please note that ten seconds ago, the wall of the scientific research equipment was broken due to the impact of meteorite fragments, and the gas in the cabin was leaking. If the repair is not completed, it will cause the loss of equipment worth 100 million yuan (your remuneration will also be affected by the mistakes made during the mission and the completion of the mission. Each mistake will be reduced by 5 yuan based on the original remuneration level). Please immediately operate the robotic arm to cooperate with the personnel outside the cabin to carry out repairs. I wish you a triumphant return!" The subjects were reminded that if mistakes occurred during the operation of this situational task, a certain amount of remuneration would be deducted, and the task performance would be announced eventually. Minor mistakes would deduct 1 point, and mission failure would deduct 5 points.
[0050] (3) The third task level may include the first time pressure level and the third consequence pressure level. The pressure corresponding to the third task level is: no time pressure and high consequence pressure situation. In the embodiment of the present invention, pressure can be induced by text and voice. For example, the instruction for the no time pressure and high consequence pressure situation is:
[0051] "This is the Yunxiao No. 1 control center. Operator No. 03, please note that ten seconds ago, the wall of the scientific research equipment was broken due to the impact of meteorite fragments, and the gas in the cabin was leaking. If the repair is not completed, it will cause the cabin to explode, the loss of equipment worth 1 billion, and serious casualties (your remuneration will also be affected by the mistakes made during the mission and the completion of the mission. Each mistake will be reduced by 10 yuan based on the original remuneration level). Please immediately operate the robotic arm to cooperate with the personnel outside the cabin to carry out repairs. I wish you a triumphant return!" The subjects were reminded that if mistakes occurred during the operation of this situational task, more remuneration would be deducted, and the mission performance would be announced eventually. Minor mistakes would deduct 2 points, and mission failure would deduct 10 points.
[0052] It should be noted that in the following low time pressure scenario, the task duration limit can be the average task completion time of all testers in the experiment without time pressure.
[0053] (4) The fourth task level may include the second time pressure level and the first consequence pressure level. The pressure corresponding to the fourth task level is: low time pressure and no consequence pressure scenario. In the embodiment of the present invention, pressure can be induced by text and voice. For example, the instructions for the low time pressure and no consequence pressure scenario are:
[0054] "This is the Yunxiao-1 control center. Operator No. 03, please note that the life support cabin wall was broken due to the impact of meteorite fragments ten seconds ago. Please immediately operate the robotic arm to cooperate with the personnel outside the cabin to carry out repairs. The mission time limit is 5 minutes. I wish you a triumphant return!" The subjects were also reminded that if mistakes were made during the operation of this situational task, no remuneration would be deducted, and the mission performance results would not be announced in the end.
[0055] (5) The fifth task level may include a second time pressure level and a second consequence pressure level. The pressure corresponding to the fifth task level is: a low time pressure and low consequence pressure situation. In the embodiment of the present invention, pressure can be induced by text and voice. For example, the instructions for the low time pressure and low consequence pressure situation are:
[0056] "This is the Yunxiao No. 1 Control Center. Operator No. 03, please note that the cabin wall of the scientific research equipment was broken due to the impact of meteorite fragments ten seconds ago. The gas in the cabin is slowly leaking. If the repair cannot be completed within 5 minutes, it will cause the loss of equipment worth 100 million yuan (your remuneration will also be affected by the mistakes made during the mission and the completion of the mission. Each mistake will be reduced by 5 yuan based on the original remuneration level). I wish you a triumphant return!" The subject was reminded that if there was a mistake during the operation of this situational task, a certain amount of remuneration would be deducted, and the task performance would be announced eventually. 1 point would be deducted for a small mistake and 5 points would be deducted for a mission failure.
[0057] (6) The sixth task level may include the second time pressure level and the third consequence pressure level. The pressure corresponding to the sixth task level is: low time pressure and high consequence pressure situation. In the embodiment of the present invention, pressure can be induced by text and voice. For example, the instructions for the low time pressure and high consequence pressure situation are:
[0058] "This is the Yunxiao No. 1 control center. Operator No. 03, please note that ten seconds ago, the wall of the scientific research equipment was broken due to the impact of meteorite fragments. The gas in the cabin is slowly leaking. If the repair cannot be completed within 5 minutes, it will cause the cabin to explode, the loss of equipment worth 1 billion, and serious casualties (your remuneration will also be affected by the mistakes made during the mission and the completion of the mission. Each mistake will be reduced by 10 yuan based on the original remuneration level). Please immediately operate the robotic arm to cooperate with the personnel outside the cabin to carry out repairs. I wish you a triumphant return!" The subject was reminded that if there was a mistake during the operation of this situational task, a certain amount of remuneration would be deducted, and the task performance would be announced eventually. Minor mistakes would deduct 2 points, and mission failure would deduct 10 points.
[0059] It should be noted that in the following high time pressure situations, the task duration is limited to the average task completion time of all testers in the experiment without time pressure situations * 60%.
[0060] (7) The seventh task level may include the third time pressure level and the first consequence pressure level. The pressure corresponding to the seventh task level is: high time pressure without consequence pressure situation. In the embodiment of the present invention, pressure can be induced by text and voice. For example, the instructions for the high time pressure without consequence pressure situation are:
[0061] "This is the Yunxiao No. 1 control center. Operator No. 03, please take note. Ten seconds ago, the life support cabin wall was broken due to the impact of meteorite fragments. Please immediately operate the robotic arm to cooperate with the personnel outside the cabin to carry out repairs. This mission is very urgent and the time limit is 3 minutes. I wish you a triumphant return!" The subjects were also reminded that if mistakes were made during the operation of this situational task, no remuneration would be deducted, and the task performance results would not be announced in the end.
[0062] (8) The eighth task level may include a third time pressure level and a second consequence pressure level. The pressure corresponding to the eighth task level is: a high time pressure and low consequence pressure situation. In the embodiment of the present invention, pressure can be induced by text and voice. For example, the instructions for the high time pressure and low consequence pressure situation are:
[0063] "This is the Yunxiao No. 1 control center. Operator No. 03, please note that ten seconds ago, the wall of the scientific research equipment was broken due to the impact of meteorite fragments. The gas in the cabin is leaking rapidly. If the repair cannot be completed within 3 minutes, it will cause the loss of equipment worth 100 million yuan (your remuneration will also be affected by the mistakes made during the mission and the completion of the mission. Each mistake will be reduced by 5 yuan based on the original remuneration level). Please immediately operate the robotic arm to cooperate with the personnel outside the cabin to carry out repairs. I wish you a triumphant return!" The subject was reminded that if an error occurred during the operation of this situational task, a certain amount of remuneration would be deducted, and the task performance would be announced eventually. 1 point would be deducted for a small mistake and 5 points would be deducted for a mission failure.
[0064] (9) The ninth task level may include the third time pressure level and the third consequence pressure level. The pressure corresponding to the ninth task level is: high time pressure and low consequence pressure situation. The embodiment of the present invention may induce pressure through text and voice. For example, the instructions for the high time pressure and high consequence pressure situation are: "This is the Yunxiao No. 1 control center. Operator No. 03, please note that the scientific research equipment cabin wall was broken due to the impact of meteorite fragments ten seconds ago. The gas in the cabin is leaking rapidly. If the repair cannot be completed within 3 minutes, it will cause the cabin to explode, equipment worth 1 billion will be lost, and serious casualties will occur (your remuneration will also be affected by the mistakes made during the task and the completion of the task. Each mistake will be reduced by 10 yuan on the basis of the original remuneration level). Please immediately operate the robotic arm to cooperate with the personnel outside the cabin to carry out repairs. I wish you a triumphant return!" The subject is reminded that if there is a mistake during the operation of this situational task, a certain amount of remuneration will be deducted, and the task performance will be announced in the end. Minor mistakes will be deducted 2 points, and task failure will be deducted 10 points.
[0065] It should be noted that the task levels can be specifically set. For example, the levels from the first to the ninth task levels increase successively, with the ninth task level being the highest level. For another example, the task levels can be arranged from the lowest value to the highest value: the first task level, the second task level, the fourth task level, the fifth task level, the third task level, the seventh task level, the sixth task level, and the ninth task level. There is no specific limitation on this.
[0066] Furthermore, after issuing the task through instructions, and explaining the current task background, whether there is a time limit, and the consequences of failing to complete the task through text, the embodiment of the present invention also prompts the screen that will appear if the task is not completed, for example, playing the screen and sound effects of the cabin explosion. Among them, the three consequence pressure scenarios respectively play different consequences of task failure. Among them, when the task fails in the no consequence pressure scenario, the screen of task failure is presented, for example, no noise, no dynamic screen; when the task fails in the low consequence pressure scenario, the screen of gas leakage in the cabin is presented, accompanied by the noise of gas leakage in the cabin; when the task fails in the high consequence pressure scenario, the screen of cabin explosion is presented, accompanied by the explosion noise.
[0067] In step S103, after inducing time pressure and consequence pressure, the trainee is guided to remotely operate the robot arm in the simulation to perform the target task, and when the target task fails, the task failure video is played to train the trainee in remote operation of the robot arm under different types and levels of pressure.
[0068] It is understandable that the embodiment of the present invention can issue tasks through instructions, and after prompting the screen that will appear if the task is not completed, guide the trainee to imagine, that is, induce time pressure and consequence pressure, and the induction time can be set to a preset time, which can be set according to the needs of pressure induction, for example, it can be set to 5 minutes, without specific limitation. Then, the trainee starts the robot arm teleoperation task, and the time progress is displayed on the display screen used to induce pressure; different task end screens are played according to the task completion status and the type of stress situation.
[0069] Therefore, the embodiment of the present invention can conduct robot arm remote operation training based on the time and consequence pressure induction of the mission situation, fully considering the in-cabin and out-of-cabin characteristics of the mission, and in terms of time pressure induction, compared with the existing method of uniformly setting a time limit, it can effectively solve the problem of individual differences in the perception of time pressure by different trainees; in terms of consequence pressure induction, compared with the existing methods such as pure noise stimulation, task materials, social evaluation, and speech, the embodiment of the present invention has stronger applicability for research related to robot arm remote operation tasks under stressful situations, and uses situational tasks to induce time consequence pressure of space missions, and adopts effective methods to guide trainees into the role of operators; at the same time, the division of pressure levels is more detailed, which can effectively meet the pressure training needs of different trainees.
[0070] In some embodiments, it also includes: obtaining the actual time it takes for the trainee to complete the task under the current time pressure level and the current consequence pressure level; determining whether the actual time is greater than a first threshold, or less than a second threshold; if it is greater than the first threshold, lowering the current time pressure level and / or the current consequence pressure level; if it is less than the second threshold, increasing the current time pressure level and / or the current consequence pressure level.
[0071] Among them, the first threshold is greater than the second threshold, and the first threshold is greater than the second threshold and can be calibrated in advance without specific limitation.
[0072] It is understandable that the embodiments of the present invention can determine whether the current stress level is appropriate based on the task completion time. For example, if the trainee completes the task in a short time under the current stress level, it means that the trainee can easily adapt to the current stress level and the stress level can be appropriately increased. If the task completion time is long or the task is not completed, it means that the trainee cannot adapt to the current stress level and the stress level can be appropriately reduced. Therefore, a time limit threshold adaptive adjustment mechanism can be set according to the adaptability of personnel to stress, so as to effectively ensure that the individual's time pressure remains relatively stable through the establishment of personalized and adaptive stress induction, improve the effectiveness and intelligence of training, and improve the training effect of trainees.
[0073] In some embodiments, before receiving the user's task selection instruction, it also includes: identifying the identity information of the trainee; detecting the highest level of the trainee's completion of the target task in the identity information and the task level database according to the identity information; matching the stress-inducing audio and video of the target task according to the highest level, so as to induce stress on the trainee before the operation according to the stress-inducing audio and video.
[0074] It can be understood that the embodiment of the present application can pre-establish an identity identification and task level database, and record the training data of the trainees during the training process, so that before the trainees select the task level, the highest stress level task that the trainees can complete can be automatically matched according to the training data, so as to save the time required for the trainees to make the selection, improve the intelligence of the training, and enhance the user experience.
[0075] The following will describe the stress simulation training method for robot arm teleoperation based on video and voice through specific examples. In the embodiment of the present invention, the scenario program can be written through E-prime3.0, and the time and consequence stress of robot arm teleoperation task research can be induced by creating task emergency scenarios, setting personalized task time limits, task failure consequence pictures and noise stimulation, performance remuneration linkage, and publishing results. The details are as follows:
[0076] Step 1: Play the mission scenario screen
[0077] Two screens are set up in the laboratory, one for the robot arm teleoperation task and the other for presenting the images that induce stress in the trainees. The trainees enter the laboratory and sit in front of the computer to familiarize themselves with the surrounding environment. The experimenter briefly introduces the task content to the trainees, and the trainees read and sign the informed consent form. After the training on the robot arm teleoperation simulation platform handle control, the E-Prime program is opened, and the screen used to induce stress presents the image of being hit by meteorite fragments.
[0078] Step 2: Play the situational instructions
[0079] Different instructions are played in different time and consequence pressure task situations, including: instructions for no time pressure and no consequence pressure task situation, instructions for no time pressure and low consequence pressure task situation, instructions for no time pressure and high consequence pressure task situation, instructions for low time pressure and no consequence pressure task situation, instructions for low time pressure and low consequence pressure task situation, instructions for low time pressure and high consequence pressure task situation, instructions for high time pressure and no consequence pressure task situation, instructions for high time pressure and low consequence pressure task situation, instructions for high time pressure and high consequence pressure task situation.
[0080] Step 3: Prompt the screen that will appear if the task fails
[0081] Different pictures were played according to the experimental requirements. When the task failed in the three task scenarios with no consequence pressure, pictures of task failure were presented, for example, pictures without noise and dynamic images. When the task failed in the three task scenarios with low consequence pressure, pictures of gas leakage in the cabin were presented, accompanied by noise of gas leakage in the cabin. When the task failed in the three task scenarios with high consequence pressure, pictures of cabin explosion were presented, accompanied by explosion noise.
[0082] Step 4: Guide the trainees to imagine
[0083] After the above situation and instructions are introduced, the trainees are guided to imagine themselves as the operator of the manipulator in the cabin and enter the task situation. The trainees are required to block other factors and focus on their own situational task imagination. This step can last about 5 minutes.
[0084] Step 5: Enter the robot arm remote operation program
[0085] In the three task scenarios without time pressure, a forward timing status was displayed on the task scenario screen when the trainees were operating the robotic arm. In the six task scenarios with time pressure, a countdown status was displayed on the task scenario screen when the trainees were operating the robotic arm.
[0086] Step 6: Play the task result screen according to the completion of the robot arm remote operation task. If the task is successfully completed or the task scenario has no consequence pressure, play a noise-free and non-dynamic picture. If the task fails to be completed, in a scenario with low consequence pressure, play the cabin gas leakage picture accompanied by the gas leakage noise picture; in a scenario with high consequence pressure, play the cabin explosion picture accompanied by the cabin explosion noise picture.
[0087] According to the video and voice-based stress simulation training method for robot arm teleoperation proposed in an embodiment of the present invention, the corresponding stress-inducing audio and video are matched according to the task level of the trainee to induce a corresponding degree of stress on the trainee. The trainee can be trained in robot arm teleoperation under different types and levels of pressure, thereby improving the trainee's stress adaptability and improving the trainee's operation level under different pressures.
[0088] Next, a video and voice based pressure simulation training device for robot arm teleoperation according to an embodiment of the present invention will be described with reference to the accompanying drawings.
[0089] Figure 2 The present invention is a schematic block diagram of a pressure simulation training device for robot arm teleoperation based on video and voice according to an embodiment of the present invention.
[0090] like Figure 2 As shown, the video and voice-based pressure simulation training device 10 for robot arm teleoperation includes: a first acquisition module 100, a pressure inducing module 200 and a training module 300.
[0091] Among them, the first acquisition module 100 is used to receive the user's task selection instructions, and obtain the target task and task level according to the task selection instructions; the stress induction module 200 is used to match the stress inducing audio and video of the target task according to the task level, so as to induce stress for the trainees according to the stress inducing audio and video, and the stress includes time pressure and consequence pressure; the training module 300 is used to guide the trainees to remotely operate the robotic arm in the simulation to perform the target task after inducing time pressure and consequence pressure, and when the target task fails, play the task failure audio and video, so as to train the trainees to remotely operate the robotic arm under different types and levels of pressure.
[0092] Furthermore, the stress inducing module 200 includes: a first determining unit, a second determining unit, and a conversion unit. The first determining unit is used to determine the time pressure level and consequence pressure level of the target task according to the task level; the second determining unit is used to obtain the task time of the target task according to the time pressure level, and determine the performance remuneration deduction rules and point deduction rules, as well as the task performance result announcement rules and task failure audio and video according to the consequence pressure level; the conversion unit is used to convert the task time, performance remuneration deduction rules, point deduction rules and task performance result announcement rules into stress inducing voice, and compose stress inducing audio and video according to the stress inducing voice and task failure audio and video.
[0093] Further, the time pressure level includes first to third time pressure levels, and the consequence pressure level includes first to third consequence pressure levels, wherein the time pressure of the third time pressure level is greater than that of the second time pressure level, and the time pressure of the second time pressure level is greater than that of the first time pressure level; the consequence pressure of the third consequence pressure level is greater than that of the second consequence pressure level, and the second consequence pressure level is greater than the first consequence pressure level.
[0094] Furthermore, the device 10 of the embodiment of the present invention further includes: a second acquisition module, a judgment module and a pressure adaptation module. The second acquisition module is used to obtain the actual time taken by the trainee to complete the task under the current time pressure level and the current consequence pressure level; the judgment module is used to judge whether the actual time is greater than a first threshold, or less than a second threshold, wherein the first threshold is greater than the second threshold; the pressure adaptation module is used to reduce the current time pressure level and / or the current consequence pressure level when it is greater than the first threshold, and to increase the current time pressure level and / or the current consequence pressure level when it is less than the second threshold.
[0095] Furthermore, the device 10 of the embodiment of the present invention further includes: an identification module and a detection module. The identification module is used to identify the identity information of the trainee before receiving the task selection instruction from the user; the detection module is used to detect the highest level of the trainee's completion of the target task in the identity information and the task level database according to the identity information; the stress inducing module 200 is also used to match the stress inducing audio and video of the target task according to the highest level, so as to induce stress on the trainee before the operation according to the stress inducing audio and video.
[0096] It should be noted that the aforementioned explanation of the embodiment of the pressure simulation training method for robotic arm remote operation based on video and voice is also applicable to the pressure simulation training device for robotic arm remote operation based on video and voice of this embodiment, which will not be repeated here.
[0097] According to the video and voice-based pressure simulation training device for robot arm remote operation proposed in an embodiment of the present invention, the corresponding pressure-inducing audio and video are matched according to the task level of the trainee to induce corresponding degrees of stress for the trainee, and the trainee can be trained in robot arm remote operation under different pressures, thereby improving the trainee's stress adaptability and improving the trainee's operation level under different types and levels of pressure.
[0098] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0099] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.
[0100] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.
Claims
1. A video and voice based pressure simulation training method for robot arm teleoperation, characterized in that: The following steps are involved: Receive a task selection instruction from a user, and obtain a target task and a task level according to the task selection instruction; Matching the stress-inducing audio and video of the target task according to the task level, so as to induce stress for the trainee according to the stress-inducing audio and video, wherein the stress includes time pressure and consequence pressure; matching the stress-inducing audio and video of the target task according to the task level, including: determining the time pressure level and consequence pressure level of the target task according to the task level; obtaining the task time of the target task according to the time pressure level, determining the performance remuneration deduction rules and point deduction rules when the task is wrong and the task fails, as well as the task performance result announcement rules and the task failure audio and video according to the consequence pressure level; converting the task time, the performance remuneration deduction rules, the point deduction rules and the task performance result announcement rules into stress-inducing voice, and composing the stress-inducing audio and video according to the stress-inducing voice and the task failure audio and video; and After inducing the time pressure and the consequence pressure, the trainee is guided to remotely operate the robotic arm in the simulation to perform the target task, and when the target task fails, a task failure video is played to train the trainee in remote operation of the robotic arm under different types and levels of pressure.
2. The method according to claim 1, characterized in that The time pressure level includes first to third time pressure levels, and the consequence pressure level includes first to third consequence pressure levels, wherein: The time pressure of the third time pressure level is greater than that of the second time pressure level, and the time pressure of the second time pressure level is greater than that of the first time pressure level; The consequence pressure of the third consequence pressure level is greater than that of the second consequence pressure level, and the second consequence pressure level is greater than the first consequence pressure level.
3. The method according to claim 1, characterized in that: Also includes: Obtaining the actual time taken by the trainee to complete the task under the current time pressure level and the current consequence pressure level; Determine whether the actual duration is greater than a first threshold, or less than a second threshold, wherein the first threshold is greater than the second threshold; If it is greater than the first threshold, the current time stress level and / or the current consequence stress level is reduced; if it is less than the second threshold, the current time stress level and / or the current consequence stress level is increased.
4. The method according to claim 2, characterized in that: Before receiving the task selection instruction from the user, it also includes: Identify the identity information of the training personnel; Detecting the highest level of the training personnel who have completed the target task in the identity identification and task level database according to the identity identification information; The stress-inducing audio and video of the target task is matched according to the highest level, so as to induce stress on the trainee before operation according to the stress-inducing audio and video.
5. A video and voice based pressure simulation training device for robot arm teleoperation, characterized in that: include: A first acquisition module, used to receive a task selection instruction from a user, and acquire a target task and a task level according to the task selection instruction; A stress inducing module, used for matching the stress inducing audio and video of the target task according to the task level, so as to induce stress on the trainee according to the stress inducing audio and video, wherein the stress includes time pressure and consequence pressure; The stress inducing module includes: a first determining unit, used to determine the time pressure level and consequence pressure level of the target task according to the task level; a second determining unit, used to obtain the task time of the target task according to the time pressure level, and determine the performance remuneration deduction rules and point deduction rules, as well as the task performance result announcement rules and task failure audio and video according to the consequence pressure level; a conversion unit, used to convert the task time, the performance remuneration deduction rules, the point deduction rules and the task performance result announcement rules into stress inducing voice, and compose the stress inducing audio and video according to the stress inducing voice and the task failure audio and video; and The training module is used to guide the trainee to remotely operate the simulated robotic arm to perform the target task after inducing the time pressure and the consequence pressure, and to play a task failure video when the target task fails, so as to train the trainee to remotely operate the robotic arm under different types and levels of pressure.
6. The device according to claim 5, characterized in that The time pressure level includes first to third time pressure levels, and the consequence pressure level includes first to third consequence pressure levels, wherein: The time pressure of the third time pressure level is greater than that of the second time pressure level, and the time pressure of the second time pressure level is greater than that of the first time pressure level; The consequence pressure of the third consequence pressure level is greater than that of the second consequence pressure level, and the second consequence pressure level is greater than the first consequence pressure level.
7. The device according to claim 5, characterized in that Also includes: The second acquisition module is used to acquire the actual time taken by the trainee to complete the task under the current time pressure level and the current consequence pressure level; A judging module, used to judge whether the actual duration is greater than a first threshold, or less than a second threshold, wherein the first threshold is greater than the second threshold; The pressure adaptation module is used to reduce the current time pressure level and / or the current consequence pressure level when it is greater than the first threshold, and to increase the current time pressure level and / or the current consequence pressure level when it is less than the second threshold.
8. The device according to claim 6, characterized in that Also includes: An identification module, used to identify the identity information of the trainer before receiving the task selection instruction from the user; A detection module, used for detecting the highest level of the training personnel who have completed the target task in the identity identification and task level database according to the identity identification information; The stress inducing module is further used to match the stress inducing audio and video of the target task according to the highest level, so as to induce stress for the trainee before operation according to the stress inducing audio and video.
