SYSTEM FOR DETECTING A PASSENGER'S PSYCHOLOGICAL STATE
A contactless sensor system with non-linear data analysis and AI evaluates passenger stress and anxiety levels in transport, addressing the need for non-invasive monitoring and enhancing passenger care.
Patent Information
- Application Number
- FR2022009485
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-09-20
- Publication Date
- 2025-09-19
- Estimated Expiration
- 2042-09-20
AI Technical Summary
Existing technologies for assessing passenger stress, anxiety, and distress require physical interfaces, making them unsuitable for use in transport environments where passengers need to be monitored.
A system comprising contactless sensors and a processing module that acquires and analyzes physiological parameters, such as body movements, to determine stress, anxiety, and distress levels without physical contact, using non-linear transformations and artificial intelligence for real-time evaluation.
Enables real-time detection of passenger stress, anxiety, and distress levels in transport settings, allowing flight personnel to provide timely assistance and improve passenger comfort.
Smart Images

Figure 00000010_0000 
Figure 00000010_0001
Abstract
Description
Title of the invention: SYSTEM FOR DETECTING A PSYCHOLOGICAL STATE OF A PASSENGER
[0001] The present invention relates to a system for detecting a psychological state of a passenger. The invention finds a particularly advantageous, but not exclusive, application in the aeronautical field in order to detect a level of stress, anxiety and / or anguish of a passenger in an aircraft cabin.
[0002] An aircraft cabin can be an anxiety-provoking environment for some passengers, particularly during certain phases of flight, in particular takeoff or landing. Such anxiety can have multiple origins, such as, for example, a bad flight experience in the past, a psychological state of the passenger contradictory between a desire to always control everything and a situation in which the passenger must rely on another person, such as an aircraft pilot. It can also be a direct consequence of other phobias, such as claustrophobia, agoraphobia or acrophobia.
[0003] There is therefore a need to be able to assess the psychological state of a passenger so that assistance can be provided in the event of a problem, in particular by aircraft crew.
[0004] It has been shown that an anatomical behavior of the human body is indicative of a level of stress, anxiety and / or anguish. For this purpose, there are technologies for assessing a state of stress, anxiety and / or anguish of a person with sensors.
[0005] The documents “Greene, S.; Thapliyal, H.; Caban-Holt, AA Survey of Affective Computing for Stress Detection: Evaluating technologies in stress detection for better health. lEEEConsum. Electron. Mag. 2016, 5, 44-5” or “Frontiersin.org, Stress Monitoring and Recent Advancements in Wearable Biosensors, Bioengineering and Biotechnology” describe state-of-the-art systems for assessing a person’s anxiety level.
[0006] Existing technologies, however, require a physical interface with the person, which makes them impossible to deploy in means of transport in which passengers, whose state of stress, anxiety and / or distress may need to be assessed, are required to travel.
[0007] The invention aims to effectively remedy this drawback by proposing a system for detecting a psychological state of a passenger comprising: - at least one detection sensor capable of detecting at least one physiological parameter of a passenger, in particular a physiological parameter representative of a state of stress, anxiety and / or distress of the passenger, and - a processing module configured to carry out an acquisition of data from the detection sensor relating to the physiological parameter of the passenger and to determine a level of stress, anxiety and / or anguish of the passenger based on the acquired data.
[0008] The invention thus allows flight personnel to detect possible stress, possible anxiety and / or distress of a passenger during transport, in particular a flight, so as to be able to intervene to provide assistance by offering services which will improve their comfort.
[0009] According to one embodiment of the invention, the processing module comprises acquisition means capable of acquiring a series of data emitted by the detection sensor, in particular a point cloud, notably a three-dimensional point cloud, representative of the physiological parameter.
[0010] According to one embodiment of the invention, the processing module comprises conversion means capable of transforming the series of data transmitted, in particular the point cloud, into a time series, in particular into a multivariable time series of input data.
[0011] According to one embodiment of the invention, the processing module comprises transformation means capable of applying non-linear transformations to the time series.
[0012] According to one embodiment of the invention, the processing module comprises analysis means capable of carrying out at least one analysis of data obtained by the transformation means.
[0013] According to one embodiment of the invention, the processing module comprises determination means capable of evaluating, in particular from the analysis of the data carried out by the analysis means, a level of stress, anxiety and / or anguish, in particular according to a scale of stress, anxiety and / or anguish level.
[0014] According to one embodiment of the invention, the detection sensor is a contactless sensor.
[0015] According to one embodiment of the invention, the processing module is configured to analyze, in particular in real time, an amplitude and / or a frequency of a movement of a part of the passenger's body detected by the detection sensor.
[0016] According to one embodiment of the invention, the detection sensor is intended to be oriented towards the feet, knees and / or hands of a passenger to detect movements of the feet, knees and / or hands of the passenger.
[0017] According to one embodiment of the invention, the sensor is configured to activate when a movement is detected having a frequency and / or an amplitude greater than a defined threshold.
[0018] According to one embodiment of the invention, the system for detecting a psychological state comprises a human-machine interface capable of displaying the level of stress, anxiety and / or anguish of the passenger evaluated by the processing module.
[0019] According to one embodiment of the invention, the human-machine interface consists of a mobile digital tablet and / or a fixed screen intended to be installed inside an aircraft cabin.
[0020] According to one embodiment of the invention, the processing module is capable of establishing communication with the human-machine interface, in particular via a wireless link.
[0021] According to one embodiment of the invention, the detection sensor is selected, individually or in combination, from: - a camera, - a camera simultaneously providing an image and a depth map characterizing the distance of an object from the camera, - a sensor for measuring the propagation of an object in an environment, - a light beam remote sensing sensor, - a dynamic vision sensor, - a piezoelectric sensor.
[0022] The present invention will be better understood and other characteristics and advantages will become apparent upon reading the detailed description which follows, comprising embodiments given by way of illustration with reference to the appended figures, as non-limiting examples, which may serve to complete the understanding of the present invention and the description of its embodiment and, where appropriate, contribute to its definition, in which: [Fig.l] [Fig.l] is a schematic representation of a system for detecting a psychological state of a passenger according to the invention; and [Fig.2] [Fig.2] illustrates a mode of operation of the system for detecting a psychological state of a passenger according to the invention.
[0023] It should be noted that, in the figures, the structural and / or functional elements common to the different embodiments have the same references. Thus, unless otherwise stated, such elements have identical structural, dimensional and material properties.
[0024] [Fig.l] shows a schematic representation of a system for detecting a psychological state 10 of a passenger comprising at least one sensor 11 for detecting at least one physiological parameter of a passenger representative of a state of stress, anxiety and / or anguish.
[0025] The physiological parameter may be a movement of a part of the passenger's body, in particular the feet, knees or hands, sweating, a rhythm heart rate, blood pressure and / or any other physiological parameter of the passenger likely to change when the latter passes from a non-anxious, calm, peaceful state to a state of stress, anxiety and / or anguish.
[0026] It is possible to use several detection sensors to detect or detect several physiological parameters of the same passenger. For the sake of redundancy, several detection sensors, in particular two detection sensors, may also detect the same physiological parameter.
[0027] According to the invention, a processing module 12 is configured to carry out an acquisition of data from the detection sensor 11, preferably without contact, relating to the physiological parameter of the passenger and to determine a level of stress, anxiety and / or anguish of the passenger as a function of the acquired data.
[0028] The detection sensor 11 and the processing module 12 constitute an assembly 13 intended to be installed at the level of a seat, in particular of an aircraft or any other means of transport.
[0029] According to one embodiment, a unit 13 may be provided at each seat. The processing module 12 will then be said to be "individualized".
[0030] Alternatively, at least one detection sensor 11 may be provided per seat and a processing module 12 may acquire data from detection sensors 11 of several seats, in particular a row of seats. The processing module 12 will then be said to be "centralized".
[0031] The processing module 12 is capable of being in communication with a human-machine interface 15 capable of displaying the level of stress, anxiety and / or anguish of the passenger determined by the processing module 12.
[0032] The human-machine interface 15 may consist of a mobile digital tablet or a fixed screen, for example capable of being installed inside an aircraft cabin and intended to be made available to flight personnel. It is also possible for the human-machine interface 15 to consist of a connected watch or more generally any portable digital device suitable for displaying data, in particular for flight personnel.
[0033] The processing module 12 is capable of establishing communication with the human-machine interface 15, in particular via a wireless link 16. The processing module 12 can thus send the determined level of stress, anxiety and / or anguish to the human-machine interface 15.
[0034] The wireless connection 16 may, for example, be a WIFI, Bluetooth (registered trademark), infrared or any other type of wireless connection suitable for the application.
[0035] Alternatively or additionally, communication between the processing module 12 and the human-machine interface 15 may be carried out via a link wired 17.
[0036] Advantageously, the detection sensor 11 is a contactless sensor capable of detecting a movement of a part of the passenger's body, such as the feet, knees and / or hands. The detection sensor 11 is oriented towards the part of the passenger's body whose movement is to be detected. In a contactless configuration, the detection sensor 11 thus has no physical interface with the passenger.
[0037] In the embodiment of [Fig.2] illustrating a mode of operation of the psychological state detection system 10 according to the invention, the detection sensor 11 is intended to be oriented towards a part of the body of a passenger 18, advantageously the feet of the passenger 18, to detect movements of the latter, in particular the feet of the passenger 18.
[0038] For this purpose, the detection sensor 11 is preferably arranged on a surface 20 facing the passenger 18. Such a surface 20 may be a back of an airplane seat or a wall of a monument in an airplane cabin arranged in front of the passenger 18. In particular, the detection sensor 11 is arranged in the lower part of the surface facing the passenger 18.
[0039] The detection sensor 11 may, for example, be arranged on the side of a lower edge of a tablet 21. Alternatively, the detection sensor 11 may also be arranged on a lower face of a seat base.
[0040] Preferably, the detection sensor 11 is selected, individually or in combination, from: - a camera, in particular of the RGB type, acronym for "Red Green Blue" in English, - a camera simultaneously providing an image and a depth map characterizing the distance of an object relative to the camera, in particular of the RGB-D type, acronym for "Red Green Blue-Depth" in English, - a sensor for measuring the propagation of an object in an environment, in particular of the ToF type, acronym for "Time of Flight" in English, - a dynamic vision sensor, notably of the DVS type, acronym for "Dynamic Vision Sensor" in English, - a light beam remote sensing sensor, notably of the LIDARS type, acronym for "Laser Imaging Detection and Ranging" in English.
[0041] Alternatively, it is also possible to use a piezoelectric sensor, in particular of the pressure sheet type, an inductive sensor or a capacitive sensor, arranged on or inside a floor on which the passenger is positioned, in particular the floor of the aircraft, to detect movements of the passenger's feet.
[0042] According to a particular embodiment, the detection sensor 11 is configured to activate when a movement having a frequency and / or an amplitude su is detected. above a defined threshold. This makes it possible to limit the electrical consumption of the detection sensor 11.
[0043] As illustrated by [Fig.2], the processing module 12 comprises acquisition means 23, intended to acquire at least one series of data emitted by the detection sensor 11, in particular a point cloud, in particular a three-dimensional point cloud. The series of data emitted, in particular the point cloud, is representative of the physiological parameter detected. The series of data emitted, in particular the point cloud, represents, for example, a change over time in the spatial coordinates of the passenger's feet.
[0044] The processing module 12 may also comprise conversion means 24, intended to transform the series of data transmitted, in particular the point cloud, into a time series, in particular into a multivariable time series of input data X *-XM, in particular with M dimensions.
[0045] The processing module 12 may comprise transformation means 25, intended to apply non-linear transformations to the time series, in particular the multivariable time series of input data X*-XM.
[0046] The processing module 12 may comprise analysis means 26, intended to carry out at least one analysis of the data, in particular a statistical analysis of the data, in particular the data obtained after application of the non-linear transformations by the processing module 12. Alternatively, analysis means 26 are intended to carry out several analyses of the data.
[0047] The statistics are distributed over a number of classes corresponding to different levels of stress, anxiety and / or possible anguish N_anx.
[0048] The processing module 12 may also comprise determination means 27, intended to evaluate, in particular from the analysis of the data carried out by the analysis means 26, specifically from the statistical analyses carried out by the analysis means 26, a level of stress, anxiety and / or anguish N_anx, in particular according to a scale of level of stress, anxiety and / or anguish.
[0049] For example, - a level 0 corresponds to a psychological state reflecting an absence of stress, anxiety and / or anguish; - a level 1 corresponds to a psychological state reflecting stress, anxiety and / or low anguish; - a level 2 corresponds to a psychological state reflecting moderate stress, anxiety and / or anguish; and - a level 3 corresponds to a psychological state reflecting strong stress, anxiety and / or anguish.
[0050] Of course, the scale of stress, anxiety and / or anguish levels may take takes into account a number of K levels greater than or less than 4 levels of stress, anxiety and / or anguish (level 0 being included in the number of levels of stress, anxiety and / or anguish).
[0051] In the case where the physiological parameter detected is the movement of the feet, the processing module 12 is configured to analyze in real time an amplitude and / or a frequency of the movements of the feet of the passenger 18, the amplitude and / or the frequency being proportional to the level of stress, anxiety and / or anguish.
[0052] The analysis may relate to an upward movement of the feet of the passenger 18, also called "feet tapping" in English, and / or a lateral movement of the feet of the passenger 18, also called "feet shaking" in English.
[0053] Furthermore, according to a complementary or alternative embodiment, the analysis of the data may be based on the implementation of artificial intelligence comprising a dynamic neural network, in particular of the LSTM type for "Long Short-Term Memory" in English.
[0054] Artificial intelligence can be based on data collected after laboratory experiments, during which people were asked to vibrate their feet in different ways, at different frequencies and amplitudes, and / or by collecting information and physiological parameters from observations of people subjected to conditions of stress, anxiety and / or distress at various levels.
[0055] The processing module 12 may, for example, take the form of a microcontroller, in particular comprising a microprocessor and a memory, or a computer. The processing module 12 may, for example, also be constituted by a digital tablet, in particular a digital tablet integrated into the seat to have access to the entertainment system containing in particular films and music, also called IFE acronym for "InFlight Entertainment" in English.
[0056] The invention may also be implemented in other means of transport, such as buses, trains or boats.
[0057] Of course, the various features, variants and / or embodiments of the present invention may be combined with each other in various combinations to the extent that they are not incompatible or mutually exclusive. Furthermore, the invention is not limited to the embodiments described above and provided solely by way of example. It encompasses various modifications, alternative forms and other variants that may be envisaged by those skilled in the art within the scope of the present invention and in particular all combinations of the various operating modes described above, which may be taken separately or in combination.
Claims
Claims
1. System for detecting a psychological state (10) of a passenger comprising: - at least one detection sensor (11) capable of detecting at least one physiological parameter of the passenger, in particular a physiological parameter representative of a state of stress, anxiety and / or anguish of the passenger, and - a processing module (12) configured to carry out an acquisition of data from the detection sensor (11) relating to the physiological parameter of the passenger and to determine a level of stress, anxiety and / or anguish of the passenger as a function of the acquired data, characterized in that the processing module (12) comprises acquisition means (23) capable of acquiring a series of data emitted by the detection sensor (11) consisting of a three-dimensional point cloud representative of the physiological parameter of the passenger.
2. System for detecting a psychological state (10) according to claim 1, characterized in that the processing module (12) comprises conversion means (24) capable of transforming the series of data emitted, in particular the point cloud, into a time series, in particular into a multivariable time series of input data.
3. System for detecting a psychological state (10) according to claim 2, characterized in that the processing module (12) comprises transformation means (25) capable of applying non-linear transformations to the time series.
4. System for detecting a psychological state (10) according to claim 3, characterized in that the processing module (12) comprises analysis means (26) capable of carrying out at least one analysis of data obtained by the transformation means (25).
5. System for detecting a psychological state (10) according to claim 4, characterized in that the processing module (12) comprises determination means (27) capable of evaluating, in particular from the analysis of the data carried out by the analysis means (26), a level of stress, anxiety and / or anguish (N_anx), in particular according to a scale of stress, anxiety and / or anguish level.
6. A psychological state detection system (10) according to any preceding claim, characterized in that the detection sensor (11) is a contactless sensor.
7. System for detecting a psychological state (10) according to any one of the preceding claims, characterized in that the processing module (12) is configured to analyze, in particular in real time, an amplitude and / or a frequency of a movement of a part of the passenger's body detected by the detection sensor (11).
8. A psychological state detection system (10) according to claim 7, characterized in that the detection sensor (11) is intended to be oriented towards feet, knees and / or hands of a passenger to detect movement of the feet, knees and / or hands of the passenger.
9. System for detecting a psychological state (10) according to claim 7 or 8, characterized in that the detection sensor (11) is configured to activate when a movement having a frequency and / or an amplitude greater than a defined threshold is detected.
10. System for detecting a psychological state (10) according to any one of the preceding claims, characterized in that it comprises a human-machine interface (15) capable of displaying the level of stress, anxiety and / or anguish of the passenger evaluated by the processing module (12).
11. System for detecting a psychological state (10) according to claim 10, characterized in that the human-machine interface (15) consists of a mobile digital tablet and / or a fixed screen intended to be installed inside an aircraft cabin.
12. System for detecting a psychological state (10) according to claim 10 or 11, characterized in that the processing module (12) is capable of establishing communication with the human-machine interface (15), in particular via a wireless link (16).
13. System for detecting a psychological state (10) according to any one of the preceding claims, characterized in that the detection sensor (11) is selected, individually or in combination, from: - a camera, - a camera simultaneously providing an image and a depth map characterizing a distance of an object relative to the camera, - a sensor for measuring the propagation of an object in a medium, - a light beam remote sensing sensor, - a dynamic vision sensor, - a piezoelectric sensor.