Immersive Devices

Abstract

The invention relates to an immersive device (1), characterized in that it comprises an attachment element (10) for attaching said device to the head of a user (2), a system for broadcasting video sequences and an observation system for capturing, broadcasting and / or recording the reactions of the user (2).

Description

[Technical Field]

[0001] The present invention relates to an immersive device.

[0002] More particularly, the present invention relates to an immersive audiovisual headset that can be used as a source of well-being and therapy. [Background technology]

[0003] In the field of virtual reality devices, glasses are known that provide an image for each eye and are equipped with gyro sensors to maintain the orientation of the image regardless of head movement, thereby creating a virtual reality effect by maintaining the same orientation of the image regardless of head tilt.

[0004] The images sent to the right and left eyes can be taken from two slightly different viewing angles that replicate the same distance between two human eyes, so the effect of three-dimensional depth is achieved by projecting these two left / right images directly in front of the user's left and right eyes, respectively.

[0005] In addition, the portion of the video image projected into the glasses is shifted according to the head movement detected by the sensor as the head rotates to one side, i.e. the portion displayed in front of the eye is shifted proportionally to that movement in the opposite direction.

[0006] Vectorized 3D video images can simulate movement using projected images, where the relative placement of image elements is corrected based on perspective as sensors detect the user's movements to replicate real-life viewpoint changes.

[0007] All these methods combined make it possible to generate a virtual reality for the user. Such glasses are known, for example, from U.S. Patent Application Publication No. 2017 / 323,485 or U.S. Patent No. 10,657,718. Instead of glasses, face visors or headsets are known that provide a surface forming a curved screen at a distance from the face onto which images can be projected. In such devices, a 3D effect is achieved thanks to the sufficient distance between the eyes and the closest point on the screen, as specified in International Publication No. 2009 / 066,408 A1. Such virtual reality headsets are mentioned in International Publication No. 2019 / 246,576 or International Publication No. 2020 / 088,102.

[0008] In fact, it has been shown that the perception of depth in human vision is most affected by binocular disparity. In other words, different images are generated by the human vision between the two eyes, and binocular disparity allows for the perception of depth. However, experience has shown that at certain distances beyond 21.7 cm from the human eyes, 2D images projected onto, for example, a spherically curved screen can be interpreted as 3D images by the human brain.

[0009] This projected image can also change depending on the user's position and movement.

[0010] U.S. Patent Application Publication No. 2020 / 139,077 instead describes a tablet on which virtual reality images are displayed.

[0011] There are also devices for recognizing emotions from facial images, and ten emotions can be recognized: joy, calm, sadness, anger, fear, surprise, boredom, contempt, fatigue, and disgust. These are devices that are often used in the areas of marketing and sales to the general public to provide a more personalized customer experience.

[0012] The present invention aims to propose a device specially adapted for medical use, which combines the two functions of virtual reality and emotion recognition by making it possible to adapt in real time the stimuli given in virtual reality to the emotions expressed on the user's face, while being minimally invasive.

[0013] For the device to be used in the context of medical treatment, it is essential that the device be minimally invasive so as not to become a source of anxiety, stress and fatigue for the user.

[0014] Thus, the user's brain is stimulated in an appropriate manner for as long as necessary during the day, thereby combating boredom, sadness, and fear, and slowing the decline of the user's brain's cognitive functions.

[0015] The therapeutic indication targeted by the present invention is that of neurodegenerative diseases, more particularly Alzheimer's disease, Parkinson's disease, or related disorders. [Prior art documents] [Patent documents]

[0016] [Patent Document 1] US Patent Application Publication No. 2017 / 323485 [Patent Document 2] U.S. Patent No. 1,065,718 [Patent Document 3] International Publication No. 2009 / 066408 [Patent Document 4] International Publication No. 2019 / 246576 [Patent Document 5] International Publication No. 2020 / 088102 [Patent Document 6] US Patent Application Publication No. 2020 / 139077 Summary of the Invention [Means for solving the problem]

[0017] The present invention therefore relates to an immersive device, the immersive device comprising: - a fixation element for fixing the device on the user's head; - an emotion recognition system capable of detecting an emotion of a user, the emotion recognition system comprising at least one sensor and a computer that analyzes one or more signals from the sensor to indicate an emotion selected from happiness, calmness, sadness, anger, fear, surprise, boredom, contempt, fatigue, and disgust; - a system for broadcasting video sequences, the video sequences comprising a series of broadcast images, the broadcasting system being adapted to select a video sequence classified for at least one emotion of a user communicated by a computer of the detection system and to broadcast it on a screen; - Observation system to capture, broadcast and / or record user responses; Equipped with.

[0018] Immersive refers to a device that allows a user to separate from their environment and give themselves the impression of being immersed in another environment by appealing to the user's senses: sight and hearing.

[0019] The video sequence broadcasting system used may be somewhat sophisticated and may include multiple sensors to detect the user's position and movements in order to recreate a virtual reality that is responsive to these positions and movements, or, in order to limit the weight and cost of the device, may be a simple video sequence broadcaster that does not take into account the user's movements or position at the time of broadcasting.

[0020] The video may include audio that is broadcast in synchronization with the broadcast image, which may be broadcast through a loudspeaker built into the device or externally.

[0021] Ultimately, the best compromise between weight and performance is sought, depending on the application.

[0022] The videos broadcast can be of three categories: - Relaxation, fun, entertainment, - Recollection, attention, memory, reasoning, mastery of space, - Movement, dialogue and motivation.

[0023] The system for broadcasting video sequences is controlled by a computer program that selects appropriate videos according to certain criteria, such as broadcast frequency, video ratings, or random selection. The selection is made from a list of video sequences stored in the form of computer video files collected in memory.

[0024] The system for broadcasting video sequences is supplied with power via a wired connection, for example by an external source of electrical energy.

[0025] Video, within the meaning of the present invention, means a sequence of broadcast images, for example of at least a few minutes in length, the content of which has been tested to be adapted to one or more human emotions with the aim of generating joy, serenity or stimulating the cognitive functions and concentration of the user's brain.

[0026] Systems for broadcasting video sequences in a virtual reality manner, known to those skilled in the art, can integrate user motion and position sensors. This information is used to adjust the broadcast video to simulate a three-dimensional outdoor scene. This video sequence distribution system can manage any type of video content, from a simple 2D recorded image to an image or sequence recorded and projected over 360°, corresponding to a solid angle of 4 x π steradians.

[0027] For example, medical personnel may monitor a user's ability to react to a broadcasted video through an observation system, in which case we say that the observation system is adapted to broadcast the user's reactions to medical staff.

[0028] The immersive device just presented is characterized by having a visor that serves as a screen and extends from above the top of the forehead to a level facing the chin, and a link between the fixing element and the visor.

[0029] Depending on the various embodiments, one and / or other of the following clauses may be provided:

[0030] The emotion detection system interprets and transmits the detected emotions, possibly weighted, in real time to a video broadcasting system, which can then select videos to broadcast according to the detected emotion or emotions.

[0031] The detectable emotions are one or a combination of the following emotions: joy, calm, sadness, anger, fear, surprise, boredom, contempt, fatigue, and disgust. Each emotion can also be weighted according to an intensity criterion.

[0032] Therefore, the detection system performs processing integration of signals representing the user's emotions, which is well known to those skilled in the art, and communicates this information to the video distribution system to select an appropriate video. Depending on the level of persistence of the emotion, the video already being played may be interrupted by the detection system. Otherwise, the emotion detected at the end of the video is taken into consideration to select the category of the next video to be broadcast.

[0033] The diffusion system records a time-stamped list of detected emotions, along with the intensity and duration of each emotion, which is provided to medical personnel for analysis.

[0034] Thanks to these provisions, for example, a user suffering from Alzheimer's disease can be specifically stimulated by videos according to his emotions and within the framework of a treatment developed by his doctor, with such stimulation intended to induce certain brain functions in order to slow down or even prevent their decay.

[0035] According to one embodiment, the observation system comprises a camera pointed towards the user's face.

[0036] Thus, the visibility of the images broadcast to the user is not impeded.

[0037] According to one embodiment, the fixation element is adjustable.

[0038] Wearing the device can therefore be more comfortable and suitable for all users.

[0039] According to one embodiment, the system for broadcasting video sequences further comprises a video projector.

[0040] Thus, readers can use 2D source video and get a 3D effect provided the screen is positioned approximately 20 cm from the user's eyes.

[0041] According to one embodiment, the video sequence broadcasting system comprises a support that allows reversibly supporting a video projector.

[0042] This limits the invasive aspect inherent in this type of device. Hygiene is also improved by avoiding contact with the face.

[0043] Finally, this support allows for very easy modification of the video broadcasting system in case of malfunctions or technical improvements at the projector level.

[0044] According to one embodiment, the screen is part of the visor, curved so that in the use position it resides at a distance from the face and occupies the user's field of view.

[0045] This limitation of contact points between the device and the user's face limits the invasive aspect inherent in this type of device.

[0046] From a hygiene standpoint, this also reduces the risk of viral and bacterial contamination.

[0047] The device is therefore suitable for physically and / or psychologically vulnerable people.

[0048] According to one embodiment, a support adapted for a video projector is fixed on the part of said device that is intended to be above the user's head in the use position.

[0049] Therefore, the heat emitted by the projector escapes above the user's head, and the center of gravity of the device is therefore closer to the axis of the user's body in a standing or sitting position, thus limiting the invasive aspect inherent to this type of device.

[0050] According to one embodiment, the immersive device is equipped with a flap at its bottom.

[0051] According to one embodiment, the immersive device is a therapeutic or well-being device.

[0052] According to one embodiment, the device is adapted to appeal to the user's senses, namely sight and hearing, to separate the user from his or her environment and give the user the impression of being immersed in another environment.

[0053] According to one embodiment, each of the video sequences comprises a sequence of broadcast images whose content has been tested to be adapted to one or more human emotions with the aim of generating joy, serenity or stimulating the cognitive functions and concentration of the user's brain.

[0054] According to one embodiment, the immersive device has no contact points with the face in the use position.

[0055] According to one embodiment, the rigid link flares outward in a direction leading from the fastening element towards the visor.

[0056] According to one embodiment, the visor has a peripheral periphery that is remote from the user's face in the use position.

[0057] According to another aspect, a system is provided that includes a control station and at least one or more immersive devices.

[0058] This enhances the robustness of the device and makes it easier to handle.

[0059] According to one embodiment, the immersive device is used to provide well-being and / or as a therapeutic adjunct or supplement.

[0060] "Therapeutic" means a device used as a treatment or as an adjunct to the delivery of a treatment. A therapeutic immersive device contributes to the well-being of the user receiving the treatment.

[0061] "Well-being" means a pleasant feeling.

[0062] Embodiments of the invention will now be described with reference to the drawings, which are briefly described below. [Brief explanation of the drawings]

[0063] [Figure 1] FIG. 1 illustrates a side view of a user equipped with a device for treating Alzheimer's disease, according to one embodiment. [Figure 2] 10 is a three-dimensional view from a side perspective facing a user equipped with a device for treating Alzheimer's disease according to the same embodiment. FIG. [Figure 3] FIG. 10 is a three-dimensional view from a side-rear perspective of a user equipped with a device for treating Alzheimer's disease according to the same embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0064] In the drawings, the same reference numbers indicate the same or similar objects.

[0065] The detailed description presents one embodiment of an immersive device.

[0066] The immersive device 1 is depicted in the figure in a use position on a user 2 .

[0067] The device consists of three main parts: - fixing elements 10, - Byza 20, a link 30 between the fastening element 10 and the visor 20; It has.

[0068] An optional fourth section 60 covers the user's ears and can broadcast audio for the broadcast video. Another option is to use speakers.

[0069] The fastening element 10 is made of, for example, PVC. In the example shown, the fastening element forms a harness with multiple tight bands on the user's skull. The fastening element comprises two parts, as will be described in more detail below. The fastening element 10 comprises a first part 12 that is positioned on top of the user's skull. This first part comprises a straight strip 12 made of PVC or fabric, the length of which is adjustable to adjust the width and height of the immersive device 1. This adjustable straight strip 12 extends from an assembly point near one temple of the wearer to an assembly point near the opposite temple. These two points are assembly points 50 at which the ends of the different parts 30, 60 of the immersive device 1 are fixed.

[0070] The right assembly point 50 is located near the right temple of the user 2. The left assembly point is located near the left temple of the user 2. As a variant, any type of suitable adjustment system can be used.

[0071] The fixation element 10 comprises a second part 14 that is positioned on the back of the head of the user 2. This second part 14 is made up of two rigid strips 16 that are connected by a clamping wheel 18 that is coupled to a mechanism 19 that allows a supportive grip on the lower part of the skull of the user 2. The support is below the two assembly points 50 thanks to the downward orientation of the two rigid strips 14 when the device is in the use position.

[0072] A clamping wheel 18 and mechanism 19 connect the two rigid strips 16, and manual rotational action is converted by the clamping wheel 18 into translational movement by the mechanism 19. Reversing the direction of rotation of the clamping wheel 18 reverses the direction of translational movement applied by the mechanism 19 to the two rigid strips 16. Thus, the tightness of the second portion 14 can be adjusted across the width and depth of the head of the user 2. Alternatively, any other suitable clamping device can be used.

[0073] The fourth part 60 includes audio headphones on each of the left and right assembly points 50, which are positioned to cover the ears of the user 2 when the immersive device 1 is in the use position on the head of the user 2. The audio headphones are connected to a video broadcasting system and are capable of broadcasting audio associated with the video.

[0074] The two symmetrical assembly points 50 allow the link 30 to fix the visor 20 at a certain distance from the face of the user 2 when the immersive device 1 is in the use position. The link 30 is made of, for example, PVC. As can be seen in FIGS. 1 and 3 , the link 30 is oriented so as to deviate laterally from the median vertical plane of the user's head. The link 30 therefore has a conical geometry that widens forward from the head of the user 2. The visor 20 acts as a screen. The visor is made of, for example, polycarbonate. Thanks to polycarbonate, the inventors obtain a visor that has a very smooth surface, is highly resistant to impacts, does not pose any health risks due to the absence of contact with certain chemicals, and can be transparent or opaque, for example white. The visor is therefore lighter and easier to manufacture than a spherical lens.

[0075] In the use position, the visor 20 extends from above the top of the user's 2 forehead to a level facing the chin, forming a portion of a sphere that is generally equidistant from the face of the user 2, for example, approximately 20 cm. As can be seen in FIG. 1 , the portion of the sphere having an extent of less than half the sphere extends toward the rear of the head to behind the vertical plane of the eyes. Thus, in the use position, the visor 20 has a peripheral outer surface that is remote from the user's face. The user's entire field of vision is obstructed by the visor 20. However, the solid angle occupied by the visor 20 does not exceed, or barely exceeds, the range of the user's field of vision.

[0076] Depending on the embodiment and the relevant part of the face, there may be between 12 cm and 20 cm between the face of the user 2 and the visor 20. The immersive device 1 therefore has no contact points with the face in the use position.

[0077] The visor 20 includes a video broadcasting system. A projector support 70 allows a projector to be fixed to the visor 20, located facing the forehead, at a level above the eyes of the user 2. The projector is attached to the projector support 70. The video broadcasting system therefore comprises a projector. The visor 20 therefore also includes a projector. The projector is suitable for projecting an image onto the inner surface 21 of the screen. In the embodiment presented, it is an LBS picoprojector ("laser beam splitting") or DLP ("digital light processing") that projects the images, in particular the successive images forming a video. Each image has been processed by a computer using algorithms to correct certain display distortions.

[0078] The LBS picoprojector always provides a sharp image even when projecting at an angle, but there remains the need to correct display distortion due to the curvature of the screen.

[0079] A custom optical system interacts with the light beam emitted by the LBS picoprojector and is responsible for correcting the image to reproduce a clear, undistorted image of the original image on the inner, e.g., spherically curved, surface of the visor 20. Image fidelity means an image perceived by the user 2 as being overall similar to the original recorded image. The video sequence broadcasting system includes a memory or a system for accessing the memory, in which video sequences are stored. These sequences are, for example, previously classified to respond to one or more emotions. In an exemplary embodiment, each video sequence is associated with a rating from a prior evaluation. Additionally or alternatively, the video sequence may be associated with a broadcast history. Thus, a counter associated with a video may be incremented with each new broadcast of that video. The broadcast history may be associated with each given user. This last embodiment requires that the immersive device include a means for identifying the user at the time of use. This identification information may be entered manually, biometrically, or in some other way.

[0080] In addition to systems for video broadcasting, emotion recognition systems make it possible to detect a user's emotions in real time, thanks to sensors connected to a computer that can interpret the received signals into a possibly weighted emotion or weighted emotions. The emotions detected can be selected, for example, from the following list: joy, calm, sadness, anger, fear, surprise, boredom, contempt, fatigue, and disgust.

[0081] The emotion recognition system therefore comprises, as an example of the above-mentioned sensor, a webcam-type camera 22 positioned to capture the face of the user 2. For example, the visor 20 includes this camera 22. This camera 22 is connected to a system for broadcasting video sequences. The emotion recognition system analyzes and extracts in real time a list of weighted emotions based on the images captured by the camera 22.

[0082] Such a system may include other sensors such as perspiration, temperature, skin potential, pulse, pupil detection, etc., whether or not they are interconnected.

[0083] If the weight of one of the emotions exceeds a certain threshold or the broadcasted video sequence ends, the video distribution system selects a category of available video sequences according to the captured emotion.

[0084] To select from the available video sequences those that belong to a category that corresponds to the detected emotion or combination of emotions, several criteria can be used, alone or in combination, such as random selection, how often the video sequence is broadcast, video footage that has not yet been released to this user, or videos with very good ratings.

[0085] After a video belonging to a category corresponding to the detected emotion or combination of emotions is selected, the video is broadcast by a projector onto the inner surface 21 of the visor 20, which serves as a screen, possibly accompanied by recorded audio.

[0086] The video sequences follow one after the other. Pauses and / or final stops can be automatically programmed within this sequence of video sequences.

[0087] In addition, the immersive device includes an observation system adapted to capture the user's reactions. The same sensors or cameras as those of the emotion recognition system can be used for the observation system, thereby saving materials. The measured data can be stored for later analysis. The observation system can be adapted to broadcast the user's reactions to third parties, particularly observers who want to know the user's reactions to the immersive experience. This broadcast can be performed, for example, by wired or wireless communication of information. The captured and recorded data (e.g., a photograph of the user's face) can be displayed on the observer's control screen. Thus, the observer can take action if the observation of the user requires it.

[0088] Thus, according to one exemplary embodiment, a system is used comprising the immersive device 1 presented above and a control station. The control station is accessible to the observer, who thus has access to information related to the use of the device. The control station can thus be used to simultaneously display signals coming from the sensors of the immersive device 1 as well as the multimedia content to be broadcast, if necessary. This data can be displayed in real time, simultaneously with use, or at a later time. The control station can also be used to select or help select the multimedia sequence to be broadcast. If necessary, the control station can be associated with several immersive devices 1 used by different users.

[0089] The power supply of the immersive device 1 can be achieved by a wire (not shown) connected to an external power source. In order to make the immersive device 1 as light as possible, to benefit from long-term autonomy and to avoid sudden interruptions that are detrimental to the treatment, an external wired power source (not shown) is advantageous.

[0090] The immersive device 1 includes a gripping system. The gripping system includes, for example, the following two elements: At the top of the visor 20 there are flat gripping edges 90 on each side of the projector support 70 that align with the rear face of said support 70 . - a visor with a protective and gripping flap 100 facing the chin of the user 2; 20 The casing is fixed onto the edge of the casing.

[0091] Thus, the operator can easily position and remove the immersive device 1 using both hands.

[0092] A reinforcing strip 110 surrounds the visor 20 to protect it from possible impacts during use or handling.

[0093] An opening 120 in the top of the visor 20 at the level where the projector is located allows the heat generated by the operation of the projector to escape.

[0094] The present invention is not limited to the embodiments shown, and other embodiments will no doubt be apparent to those skilled in the art.

[0095] In particular, for larger projectors, the projector support 70 can be placed above the head on the outside of the visor and angled towards the visor, and the projector can be positioned on said projector support 70 to direct its flow onto the inner surface of the visor, so there is ample space to place a larger projector.

[0096] The projector and passive screen can be replaced by an active screen made up of LEDs.

[0097] The PVC and / or polycarbonate used in the presented embodiments can be replaced by innovative materials that make it difficult for bacteria and viruses to attach onto them.

[0098] The opacity of the visor can also be controlled by the video distribution system in order to alternate between the projection of the video sequence and visual access to the external environment, so that at the end of a therapeutic session carried out using said device, the user can access a view of the external reality without having to wait for the immersive device 1 to be detached from them.

[0099] For quick access to the view of the external reality, another technically simpler embodiment comprises a visor 20 provided with a reversible attachment system that allows the user to easily manually detach the visor 20 from the immersive device 1. The reversible attachment system is provided in particular between the visor 20 and the link 30.

[0100] The immersive device 1 may also include a microphone adapted to pick up sounds made by the user. These sounds can be recorded and transmitted to a control station. The control station may include a microphone adapted to pick up sounds made by an observer and to transmit these sounds to the immersive device. Thus, for example, a dialogue can take place between the user and the observer if desired.

[0101] By providing an immersive device with a visor that occupies a portion of the sphere that blocks the user's line of sight and is spaced apart from the face, and a head-mounted harness, the immersive device is minimally invasive so as not to be a source of anxiety, stress, or fatigue for the user. Indeed, no mechanical stress is placed on the face. The system is compatible with users who wear eyeglasses. Therefore, the space between the face and the device can be widely used to install equipment, such as one or more cameras capable of capturing images of the patient's face. Any ambient light that may be present between the face and the periphery of the visor provides sufficient brightness to capture images of the face. This space also allows for airflow circulation for user ventilation. Finally, from a hygiene standpoint, the visor experiences little or no contamination from the user and can then be quickly used by another user, provided the fastening elements are replaced in between, if necessary. [Explanation of symbols]

[0102] 1. Immersive Devices 2 users 10 Fixing elements 12 First part, adjustable straight strip 14 Second part, rigid strip 16 Rigid Strips 18 Clamping Wheel 19 Mechanism 20 Byza 21 Inner 22 Camera 30 Third Part, Link 50 assembly points 60 Fourth Part 70 Projector Support 90 Gripping edge 100 Protective and gripping flaps 110 Reinforced Strip 120 aperture

Claims

1. An immersive device (1), comprising: a fixation element (10) for fixing the device on the head of a user (2); a visor (20) that acts as a passive screen, extending from above the top of the forehead to a level facing the chin, and that is curved so as to be at a distance from the face and occupy the field of view of the user (2) in the use position; a link (30) between the fixing element (10) and the visor (20); an emotion recognition system capable of detecting an emotion of the user, the emotion recognition system comprising: at least one sensor; and a computer that analyzes one or more signals from the sensor to indicate an emotion selected from happiness, calmness, sadness, anger, fear, surprise, boredom, contempt, fatigue, and disgust; a system for broadcasting video sequences, each video sequence comprising a series of broadcast images, the system for broadcasting video sequences being adapted to select video sequences classified for at least one emotion of the user communicated by the computer of the emotion recognition system, and comprising a video projector fixed above the head of the user in a use position for broadcasting the video sequences onto the passive screen; an observation system for capturing, broadcasting, and / or recording the reactions of said users (2); An immersive device (1) comprising:

2. 2. The immersive device (1) of claim 1, wherein the observation system comprises a camera (22) pointed towards the face of the user (2).

3. 10. The immersive device (1) of claim 1, wherein the fixing element is adjustable.

4. 10. The immersive device (1) of claim 1, wherein the system for broadcasting video sequences comprises a support that allows the video projector to be reversibly supported.

5. 10. The immersive device (1) according to claim 1, wherein the device is equipped with a flap (100) at the bottom.

6. The immersive device (1) according to claim 1, which is a therapeutic or wellness device.

7. 10. An immersive device as described in claim 1, adapted to separate the user from his / her environment and give him / her the impression of being immersed in another environment by appealing to the user's senses, namely sight and hearing.

8. 10. The immersive device of claim 1, wherein each of the video sequences comprises a series of broadcast images whose content has been tested to be adapted to one or more human emotions with the aim of generating joy, calmness, or stimulating the cognitive functions and concentration of the user's brain.

9. 10. The immersive device of claim 1, wherein the device has no contact points with the face in the use position.

10. 2. The immersive device of claim 1, wherein the link (30) projects outward in a direction leading from the fixing element (10) towards the visor (20).

11. 10. The immersive device of claim 1, wherein the visor has a peripheral outer surface that is remote from the user's face in a use position.

12. A system comprising a control station and at least one or more immersive devices according to claim 1.

Images