Emotion perception recognition device of flight simulator

Abstract

The utility model relates to the field of emotion perception recognition devices, in particular to a flight simulator emotion perception recognition device which comprises a facial expression detector, a physical sign detector and a data processing module. The facial expression detector comprises an image acquisition camera and a mounting bracket, and the image acquisition camera is fixedly connected to the mounting bracket; the physical sign detector comprises a physical sign monitoring bracelet used for acquiring pulse, breath, blood pressure and body temperature data of a target person; the image acquisition camera and the physical sign detector are electrically connected with the data processing module. Facial expression images of a target person can be collected through the image collection camera, various physical sign parameters of the target person can be obtained in real time through the physical sign monitoring bracelet, and then the current emotional state of the target person is determined through the data processing module. Therefore, objective auxiliary analysis can be carried out on human factors in a more objective manner.

Description

Technical Field

[0001] The utility model relates to the field of emotion perception and recognition devices, in particular to an emotion perception and recognition device for a flight simulator. Background Art

[0002] Flight simulators are primarily used to enhance pilots' attitude awareness, particularly in training crew resource management (CRM) skills. This includes how crew members respond to and handle threats, the impact of the flight environment on crew members, and crew workload management. In recent years, the civil aviation industry has increasingly focused on CRM, hoping to improve and enhance crews' ability to cope with errors, threats, and stress through training. This will fundamentally overcome or mitigate human factors issues in flight, thereby enhancing flight safety and reliability. Specifically, human factors research aims to understand the psychological and physiological processes involved in operating complex systems (including aircraft systems), such as attention allocation, speech clarity, body language, facial expressions, stress, fatigue, and emotional states, and to design safer and more efficient work environments accordingly. However, current training and instructional processes primarily rely on subjective judgment, resulting in a lack of standardized standards and a lack of objective data to support objective analysis of human factors. Summary of the Invention

[0003] In view of this, the present invention provides an emotion perception and recognition device for a flight simulator, which at least partially solves the problems existing in the prior art.

[0004] According to one aspect of the present invention, a flight simulator emotion perception and recognition device is provided, comprising:

[0005] Facial expression detector, vital sign detector and data processing module;

[0006] The facial expression detector includes an image acquisition camera and a mounting bracket, wherein the image acquisition camera is fixedly connected to the mounting bracket, and the mounting bracket is fixedly arranged in a preset area in the simulated cabin;

[0007] The vital sign detector includes a vital sign monitoring bracelet, which is used to obtain the target person's pulse, respiration, blood pressure and body temperature data;

[0008] The image acquisition camera and the vital sign detector are both electrically connected to the data processing module.

[0009] Furthermore, the vital sign detector is electrically connected to the data processing module via a wired and / or wireless manner.

[0010] Furthermore, the image acquisition camera is electrically connected to the data processing module in a wireless manner.

[0011] Furthermore, wireless electrical connection methods include WiFi and Bluetooth.

[0012] Furthermore, the mounting bracket includes:

[0013] Suction cup and ball universal joint, the image acquisition camera is connected to the suction cup through the ball universal joint; the suction cup is used to be fixed to a preset adsorption area in the simulated cabin.

[0014] Furthermore, the preset adsorption area includes the cabin windshield area.

[0015] Furthermore, the mounting bracket includes:

[0016] Slide rails, sliders, ball joints and tightening knobs;

[0017] The slider is slidably arranged in the slide rail; a stud is arranged on the slider, a tightening knob is screwed on the stud, and the upper track wall of the slide rail is clamped between the slider and the tightening knob; the thickness of the slider is smaller than the thickness of the track in the slide rail;

[0018] The image acquisition camera is connected to the end of the stud in the slider through a ball universal joint.

[0019] Furthermore, a plurality of countersunk holes are opened in a target area on the lower track wall of the slide rail; the target area is a projection area of ​​the open area in the upper track wall on the lower track wall.

[0020] Furthermore, a conductive strip is fixedly connected to a side wall of the upper track wall of the slide rail forming the track;

[0021] A conductive block is provided on the upper surface of the slider;

[0022] The spherical universal joint and the stud are both hollow structures; the rotating sphere in the spherical universal joint is a hollow structure and has two open ends; one of the open ends is fixedly connected to the image acquisition camera, and the power connection line of the image acquisition camera passes through the other open end and is electrically connected to the conductive block.

[0023] Furthermore, the mounting bracket includes:

[0024] The plugs are filled in the two open ends of the slide rail.

[0025] The technical solution of the utility model has at least the following beneficial effects:

[0026] This utility model can capture facial expression images of a target person through an image acquisition camera, and then send the corresponding image information to a data processing module. The data processing module uses existing image recognition methods to determine the target person's current emotional state. In addition, a vital sign monitoring bracelet can be used to obtain multiple vital sign parameters of the target person in real time, such as pulse, respiration, blood pressure, and body temperature, and then transmit them to the data processing module. The above multiple parameters are analyzed using existing methods to determine the target person's current physiological and emotional state. In this way, objective auxiliary analysis of human factors can be carried out in a more objective manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0028] Figure 1 This is a structural diagram of a facial expression detector included in a flight simulator emotion perception and recognition device in one embodiment of the present application;

[0029] Figure 2 This is a schematic diagram of the exploded structure of a facial expression detector included in the flight simulator emotion perception and recognition device in another embodiment of the present application.

[0030] Reference numerals

[0031] 1. Image acquisition camera; 21. Slide rail; 22. Slider; 23. Ball joint; 24. Fastening knob; 25. Countersunk hole; 26. Plug; 27. Stud; 28. Conductive block. DETAILED DESCRIPTION

[0032] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0033] It should be noted that, in the absence of conflict, the following embodiments and features in the embodiments may be combined with each other; and, based on the embodiments in this disclosure, all other embodiments obtained by persons of ordinary skill in the art without creative work are within the scope of protection of this disclosure.

[0034] It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein can be embodied in a wide variety of forms, and any specific structure and / or function described herein is merely illustrative. Based on this disclosure, it should be understood by those skilled in the art that an aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects described herein can be used to implement an apparatus and / or practice a method. In addition, other structures and / or functionalities other than one or more of the aspects described herein can be used to implement this apparatus and / or practice this method.

[0035] As an embodiment of the present invention, Figures 1 to 2 As shown, a flight simulator emotion perception and recognition device is provided, comprising:

[0036] Facial expression detector, vital sign detector and data processing module.

[0037] The facial expression detector includes an image acquisition camera 1 and a mounting bracket. The image acquisition camera 1 is fixedly connected to the mounting bracket, and the mounting bracket is fixedly arranged in a preset area in the simulated cabin.

[0038] The mounting bracket has two structural options:

[0039] First, the mounting bracket includes a suction cup and a spherical universal joint 23 .

[0040] The image acquisition camera 1 is connected to the suction cup via a spherical universal joint 23. The suction cup is used to be fixed to a preset suction area in the simulated cabin. The preset suction area may include the cabin windshield area or other flat and smooth area that can be sucked.

[0041] In this structural scheme, the suction cup can be adsorbed and installed in any position, and the fixed position is flexible and changeable. In addition, the spherical universal joint 23 can be used to make the camera swing within a larger angle range to obtain a higher-quality face image.

[0042] Second, if Figure 1 and 2 As shown, the mounting bracket includes: a slide rail 21 , a slider 22 , a spherical universal joint 23 and a tightening knob 24 .

[0043] The overall shape of the slide rail 21 can be a long linear slide rail 21, or a long slide rail 21 with a curvature that matches the installation area. Specifically, the slide rail 21 includes an upper track wall, a lower track wall, and two side track walls, which can enclose a track with a rectangular cavity with an opening at the top. In addition, a plurality of countersunk holes 25 are provided in the target area on the lower track wall. The target area is the projection area of ​​the open area in the upper track wall on the lower track wall. Using multiple countersunk screws, the slide rail 21 can be fixed to the corresponding area in the simulated cabin through the multiple countersunk holes 25, such as being installed directly above the eye position meter of the flight simulator. This allows the facial expression detector to be more firmly integrated into the flight simulator (i.e., the simulated cabin). Since the flight simulator will experience turbulence when encountering airflow during the simulation of actual flight, and there will be certain mechanical vibrations in the various components during operation, it is necessary to fix the image acquisition camera 1 more firmly to prevent it from falling.

[0044] A conductive strip is fixedly connected to one side of the upper track wall of the slide rail 21. This strip can be connected to the power supply in the flight simulator. Therefore, when the conductive block 28 in the slider 22 contacts the strip, power is directly supplied to the image capture camera 1. This eliminates the need for power cords during the movement and adjustment of the image capture camera 1.

[0045] The slider 22 is slidably disposed in the slide rail 21. The slider 22 is provided with a stud 27, and the tightening knob 24 is screwed onto the stud 27. The upper track wall of the slide rail 21 is sandwiched between the slider 22 and the tightening knob 24. The thickness of the slider 22 is less than the thickness of the track in the slide rail 21.

[0046] The image acquisition camera 1 is connected to the end of the stud 27 in the slider 22 through a spherical universal joint 23. A conductive block 28 is provided on the upper surface of the slider 22.

[0047] By twisting the tightening knob 24, the clamping force of the slider 22 on the upper track wall can be adjusted, thereby loosening it when it is not necessary to move it, and tightening it when it is necessary to fix it.

[0048] The spherical universal joint 23 and the stud 27 are both hollow structures. The rotating sphere in the spherical universal joint 23 is a hollow structure and has two open ends. One of the open ends is fixedly connected to the image acquisition camera 1, and the power connection line of the image acquisition camera 1 passes through the other open end and is electrically connected to the conductive block 28. The spherical universal joint 23 in this embodiment can be a shower head swing joint in the prior art. By making the spherical universal joint 23 and the stud 27 both hollow structures, it is convenient to connect the power line of the image acquisition camera 1 to the two conductive blocks 28 through the internal space channel. Therefore, no matter which position the image acquisition camera 1 is slid to, it will not be affected by the power supply line of the image acquisition camera 1. At the same time, the image acquisition camera 1 needs to be electrically connected to the data processing module in a wireless manner.

[0049] In addition, the mounting bracket further comprises a plug 26. The two plugs 26 are respectively filled in the two open ends of the slide rail 21. The detachable connection of the plug 26 can facilitate later maintenance and prevent leakage and electric shock.

[0050] The vital sign detector includes a vital sign monitoring bracelet for acquiring the target person's pulse, respiration, blood pressure, and body temperature data. The image acquisition camera 1 and the vital sign detector are both electrically connected to the data processing module. The vital sign detector can be electrically connected to the data processing module via a wired and / or wireless connection. Wireless electrical connection methods include Wi-Fi and Bluetooth.

[0051] In this embodiment, the image acquisition camera 1 is used to capture the target person's facial expression image, and the corresponding image information is then sent to the data processing module. The data processing module uses existing image recognition methods to determine the target person's current emotional state. In addition, a vital sign monitoring bracelet can be used to obtain multiple vital sign parameters of the target person in real time, such as pulse, respiration, blood pressure, and body temperature, and then transmit them to the data processing module. The above multiple parameters are analyzed using existing methods to determine the target person's current physiological and emotional state. In this way, objective auxiliary analysis of human factors can be carried out in a more objective manner.

[0052] The above are only specific embodiments of the present invention, but the scope of protection of the present invention is not limited to them. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this utility model should be included in the scope of protection of the present utility model. Therefore, the scope of protection of the present utility model should be based on the scope of protection of the claims.

Claims

1. A flight simulator emotion perception and recognition device, characterized in that: include: Facial expression detector, vital sign detector and data processing module; The facial expression detector includes an image acquisition camera and a mounting bracket, wherein the image acquisition camera is fixedly connected to the mounting bracket, and the mounting bracket is fixedly arranged in a preset area in the simulated cabin; The vital sign detector includes a vital sign monitoring bracelet for obtaining pulse, respiration, blood pressure and body temperature data of the target person; The image acquisition camera and the vital sign detector are both electrically connected to the data processing module.

2. The flight simulator emotion perception and recognition device according to claim 1, characterized in that: The vital sign detector is electrically connected to the data processing module via a wired and / or wireless manner.

3. The flight simulator emotion perception and recognition device according to claim 1, characterized in that: The image acquisition camera is electrically connected to the data processing module in a wireless manner.

4. A flight simulator emotion perception and recognition device according to claim 2 or 3, characterized in that: The wireless electrical connection method includes WiFi and Bluetooth.

5. The flight simulator emotion perception and recognition device according to claim 1, characterized in that: The mounting bracket includes: A suction cup and a spherical universal joint, wherein the image acquisition camera is connected to the suction cup via a spherical universal joint; the suction cup is used to be fixed to a preset adsorption area in the simulated cabin.

6. The flight simulator emotion perception and recognition device according to claim 5, characterized in that: The preset adsorption area includes the cabin windshield area.

7. The flight simulator emotion perception and recognition device according to claim 1, characterized in that: The mounting bracket includes: Slide rails, sliders, ball joints and tightening knobs; The slider is slidably arranged in the slide rail; a stud is provided on the slider, the tightening knob is screwed on the stud, and the upper track wall of the slide rail is clamped between the slider and the tightening knob; the thickness of the slider is smaller than the thickness of the track in the slide rail; The image acquisition camera is connected to the end of the stud in the slider through a spherical universal joint.

8. The flight simulator emotion perception and recognition device according to claim 7, characterized in that: A plurality of countersunk holes are provided in a target area on the lower track wall of the slide rail; the target area is a projection area of ​​the open area in the upper track wall on the lower track wall.

9. The flight simulator emotion perception and recognition device according to claim 7, characterized in that: A conductive strip is fixedly connected to a side wall of the upper track wall of the slide rail forming the track; A conductive block is provided on the upper surface of the slider; The spherical universal joint and the stud are both hollow structures; the rotating sphere in the spherical universal joint is a hollow structure and has two open ends; one of the open ends is fixedly connected to the image acquisition camera, and the power connection line of the image acquisition camera passes through the other open end and is electrically connected to the conductive block.

10. The flight simulator emotion perception and recognition device according to claim 9, characterized in that: The mounting bracket includes: The plugs are filled in the two open ends of the slide rail.

Images