Virtual reality process and associated device

The virtual reality process enhances user comfort by incorporating realistic body transformations in a mirror reflection, detected by sensors and displayed in a headset, achieving relaxation through physiological responses.

FR3133470B1Active Publication Date: 2025-04-18ANDREA GIOACCHINI
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
FR2023002194
Authority / Receiving Office
FR · FR
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-03-09
Filing Date
2023-03-09
Publication Date
2025-04-18
Estimated Expiration
2043-03-09

Smart Images

  • Figure 00000011_0000
    Figure 00000011_0000
  • Figure 00000012_0000
    Figure 00000012_0000
  • Figure 00000013_0000
    Figure 00000013_0000
Patent Text Reader

Abstract

A virtual reality method characterized in that it comprises the following steps: Detection of an initial movement of a user's body limb; Determination of images juxtaposing: The initial movement of the limb, and The reflection (100") of the body, seen in a mirror (400"), according to an appearance reproducing the initial movement of the limb in the mirror; The images comprising a transformation of the body's appearance. Figure for the abstract: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Virtual reality method and associated device

[0001] The invention relates to a virtual reality method.

[0002] Today, there is a need for relaxation to improve people's comfort.

[0003] For this purpose, the invention relates to a virtual reality method characterized in that it comprises a step of determining images juxtaposing: - A reflection (in other words: a graphical representation of the reflection) of a body (in other words: of a representation of a user's body) in a (virtual) mirror, the (user's) body comprising at least one limb and eyes, - and the at least one limb (in other words: the representation of the at least one limb) (seen directly from the eyes, i.e. without going through the mirror), The body (in other words; the representation of the user's body) having an appearance in the images, the images comprising a transformation of the appearance of the body (in other words; of the representation of the body in the images).

[0004] According to one embodiment, the at least one member (in other words: the representation of at least one member) having an appearance (in the images), the transformation of the appearance of the body (in other words: of the representation of the body) comprises (in other words: is) a transformation of the appearance of the at least one member (in other words: the representation of at least one member).

[0005] Furthermore, since the reflection of the body has an appearance (in the image), the transformation of the appearance of the body may comprise (in other words: is) a transformation of the appearance of the reflection of the body.

[0006] Thus, the user's brain interprets the transformations of the body's appearance in the images as more or less real transformations of his body which can have a relaxing effect.

[0007] According to one embodiment, the virtual reality method further comprises a step of detecting a first movement of at least one member (of the user's body) (different from the transformation), the images juxtaposing: - The first movement (in other words: a representation of the first movement) of at least one member (in other words: of the representation of the member), and - The reflection of the body reproducing the first movement (in other words: a representation of the first movement) of the at least one mirrored member,

[0008] Preferably, the first movement and the transformation are simultaneous. Alternatively, the first movement and the transformation occur at different times.

[0009] According to one embodiment, the method of the invention comprises a step of displaying the images, for example in a virtual reality headset.

[0010] According to one embodiment, the body is that of a user.

[0011] The user may have eyes located at a first location, comprising for example a first location or first height (i.e.: relative to the ground), the images, in particular the reflection of the body, being views from the first location, in particular from the first height.

[0012] The at least one member may be a member visible from the eyes (of the body) of the user (if the virtual reality headset were removed). According to one embodiment, the at least one member (in other words; the representation of the at least one member) consists of all the members of the user's body visible from the eyes of the user (if the virtual reality headset were removed).

[0013] The virtual reality headset can be worn by the user.

[0014] According to one embodiment, the method comprises a step of determining positions of parts of the user's body.

[0015] The positions can be received from sensors attached to said parts of the body (of the user).

[0016] Alternatively, the positions may be determined from images acquired by a camera.

[0017] The sensors may be photoelectric sensors capable of determining a position of the sensors by detecting synchronized pulsed infrared laser beams. For example, it is possible to use the system sold under the brand name "HTC Vive".

[0018] Other types of sensors can of course be used, for example sensors determining a position by radio triangulation from at least three radio transmitters.

[0019] The sensors can be placed: - On the user's body handles and / or - The feet of the user's body, and / or - The user's height, and / or - The virtual reality headset.

[0020] The method according to the invention can then comprise a step of determining at least one member (and in particular its dimension) (in other words: the representation of the member) and the reflection (in other words: the representation of the reflection) of the body (in other words: the representation of the body) (and in particular its dimensions), in the images, from the positions.

[0021] Thus the method can comprise: - a step of determining positions of parts of the body (of a user, for example wearing the virtual reality headset where the images are displayed). - a step of determining at least one member (and in particular its dimension) (in other words: the representation of the member) and the reflection (in other words: the representation of the reflection) of the body (in other words: the representation of the body) (and in particular its dimensions), in the images, from the positions.

[0022] The positions can be determined from data received from an electronic module. The electronic module can be a position sensor or a camera, for example.

[0023] The first location (in particular the height from the ground) of the eyes of the user's body can be determined from the positions, for example from a position of the helmet.

[0024] The reflection of the body and in particular its dimensions, and / or the at least one member and in particular its dimensions can be obtained from a table or a function associating, with distances between the positions, the reflection of the body and in particular its dimensions, and / or the at least one member and in particular its dimensions.

[0025] In particular, the first height can be determined from these positions.

[0026] The first movement can be detected from an evolution of these positions.

[0027] According to one embodiment, during the determination step, the image is calculated (in other words: determined), by geometric methods within the reach of those skilled in the art, so that the at least one member and the reflection of the body (as well as the first movement) are, in the images, as being (in other words: seen from a height - the height of the eyes) such that the user would see them, in reality, from the first location (i.e.: the location of the eyes.

[0028] In the images, the reflection of the body may be a reflection of a body of an avatar and the at least one member may be at least one member of the avatar sized from the positions.

[0029] By mirror reproduction of the first movement, it is meant that, in the mirror, the first movement is reflected from the face of a virtual mirror. For example, a hand moving to the right, seen from the palm side, can be reproduced in the mirror by the hand moving to the right, seen from the back of the palm side.

[0030] According to one embodiment, the method comprises a step of triggering the transformation of the appearance by a second movement of the body (of the user).

[0031] For example, the second movement is for example the contacting of the thumb and index finger of a hand of the body (of the user).

[0032] According to one embodiment, the transformation is one of the transformations among: - An increase in the brightness of the body (ie: of the reflection of the body and / or of the at least one limb), for example in a progressive manner, for example an increase in the brightness first of the chest (or a representation of the chest of the user's body), then of the head (or a representation of the head) and the hands (or a representation of the hands) and the feet (or a representation of the feet), then of the entire body (the location of the head, hands and feet can be determined from the positions). - A fade of the body's reflection (i.e. the gradual disappearance of the body in the mirror), i.e. the reflection of the body and / or at least one limb.

[0033] Alternatively, the transformation may be a levitation (or more generally, a movement or displacement) of the body (i.e.: of the reflection of the body and / or of the at least one member), the appearance of a halo of light around the body (i.e.: of the reflection of the body and / or of the at least one member), a transparency effect of the body (i.e.: of the reflection of the body and / or of the at least one member) (where for example the interior of the body becomes visible or represented), or a deformation effect of the body (i.e.: of the reflection of the body and / or of the at least one member).

[0034] For example, when the transformation is an increase in the brightness of the body, the brightness may be represented in a gradient where the intensity of the brightness decreases from a point (which may be the chest, head, hands or feet (in other words: the representation(s) thereof)).

[0035] According to one embodiment, the first movement and / or the reflection of the body in the mirror, and / or the at least one limb are transformed by the transformation. In other words, the first movement and the transformation take place simultaneously.

[0036] According to embodiments (independently or in combination): - The detection of the first movement (and possibly the second movement) is carried out by (or from an image obtained by) a camera worn on the user's head (or body) (alternatively, it is an accelerometer attached to said at least one limb), - The images are projected into a virtual reality headset (which is, for example, absent from the images), - Said at least one member includes a hand, an arm or a leg of the body.

[0037] The images determined by the invention are aimed at the relaxation of the user (in other words: of the user's body), which can be defined as a response of the parasympathetic nervous system, which produces a series of reactions perceived as pleasant in the body, which can be measured. The most common are: - Lowering of the heart rate, which normalizes between 60 and 100 beats per minute. - Reduction of heart rate variation, which normalizes around 30msec between one beat and another. - Decrease in systolic blood pressure, which normalizes with values ​​below 120 mmHg. - Decrease in diastolic blood pressure, which normalizes with values ​​below 80 mmHg. - Reduction in pupil diameter, which normalizes from 2 to 4 mm in bright light to 4 to 8 mm in the dark. - Decrease in respiratory rate, which normalizes to 12 to 16 breaths per minute. - Decreased skin conductance, which normalizes to 1-5 qS. - Reduction in brain wave frequency stabilizes between 7 and 19 Hertz. - Decrease in the following hormones: -corticotropin, which normalizes with values ​​below 20 pg / ml. -ACTH, which normalizes with values ​​below 20 pg / ml. - Cortisol, which normalizes with values ​​of 9-24 qg / dl in the morning and 3-12 qg / dl in the afternoon. - Adrenaline, which normalizes with values ​​below 20 mcg. - Norepinephrine, which normalizes with values ​​below 70 mcg.

[0038] To make the experience more real, other sensory effects - mainly sound, but one day also tactile - can also be determined (and restored) during the image determination stage.

[0039] Another example of transformation can be as follows: a part of the body (where the user is suffering) is colored red (or another color), then gradually the red (or the other color) is replaced by white.

[0040] The method steps according to the invention can be repeated several times.

[0041] The invention also relates to a computer program comprising instructions, executable by a microprocessor or a microcontroller, for implementing the method according to the invention.

[0042] The method according to the invention is for example implemented by an electronic device, for example a virtual reality headset. The invention therefore also relates to an electronic device, for example a virtual reality headset, configured to implement the steps of the method according to the invention.

[0043] The characteristics and advantages of the electronic device and the computer program are identical to those of the method, which is why they are not repeated here.

[0044] It is understood that an element such as the electronic device (for example a virtual reality headset), or another element is “configured to” carry out a step or a operation, by the fact that the element includes means for (in other words “is shaped for” or “is adapted for”) carrying out the step or operation. These are preferably electronic means, for example a computer program, data in memory and / or specialized electronic circuits.

[0045] When a step or operation is performed by such an element, this generally implies that the element comprises means for (in other words "is shaped for" or "is adapted for" or "is configured for") performing the step or operation. This also includes, for example, electronic means, for example a computer program, data in memory and / or specialized electronic circuits, and / or possibly mechanical means.

[0046] Other characteristics and advantages of the present invention will appear more clearly on reading the detailed description which follows, comprising embodiments of the invention given as non-limiting examples and illustrated by the appended drawings, in which.

[0047] [Fig.l] represents an electronic device according to an embodiment of the invention.

[0048] [Fig.2], [Fig.3], [Fig.4][Fig.5], [Fig.7] and [Fig.8] represent images determined according to embodiments of the invention. In certain figures only one image is represented to illustrate the images determined according to the invention.

[0049] [Fig.6] represents the method of the invention, according to an exemplary embodiment, implemented in particular by the electronic device of [Fig.l].

[0050] Detailed description of an exemplary embodiment of the invention

[0051] With reference to [Fig.l], a user having a body 100, a head 130, wears a device 200, for example a virtual reality headset 200, comprising a camera 210 worn by the head 130.

[0052] The user wears, connected to the headset 200, sensors 420 and 430 on his handles, sensors 440 and 450 on his feet, a sensor 460 on his waist, and a sensor 410 on the virtual reality headset 200.

[0053] These sensors may be photoelectric sensors capable of determining a position of the sensors by detecting synchronized pulsed infrared laser beams. For example, it is possible to use the system sold under the brand name "HTC Vive".

[0054] With reference to Figures 1, 2, 3 and 6, in step S10, the headset 200 detects a first movement 300 of the hand 110.

[0055] In step S20, the headset 200 determines an image, [Fig.2], juxtaposing the first movement 300' (in other words: a representation 300' of the first movement 300) of the (representation of the) hand 110' with the reflection 100” of the body 100, seen in a mirror 400, as seen from the position 120 of the user's eyes (in other words: of the body), according to an appearance, reproducing the first movement 300 of the member (or hand) 110 in mirror, by a movement 300' ' of the reflection 110' ' of the hand 110.

[0056] During steps S10 and S20, the headset 200 determines; - The position of the handles of the user's body 100 from the position of the sensors 420 and 430, - The position of the user's body 100 feet from the position of sensors 440 and 450 and a sensor 410 on the virtual reality headset. - The user's body size position 100 from the sensor position 460, - The position of the helmet 200 from the position of the sensor 460.

[0057] According to one embodiment, the helmet 200 detects the movement 300 from the evolution of these positions, in particular from the evolution of the position of the sensor 420.

[0058] [Fig.8], Images 810, 820, 830 give examples of images thus determined by the headset 300 during the movement of an arm.

[0059] For example, from the distance d3 between the sensors 440 or 450 and 410, the headset 200 can deduce the height of the user and the position of the eyes 120, and therefore the dimensions of the limb 110' and the reflection 100” of the body 100 in the mirror 400.

[0060] The reflection 110” body 100 and in particular its dimensions, and or the member 110' and in particular its dimensions can be obtained from a table 900 associating with distances between the positions, for example with the value of d3, a reflection of body and in particular its dimensions, and / or the member and in particular its dimensions.

[0061] According to one embodiment, during the determination step, the image [Fig. 2] is calculated, by geometric methods within the reach of those skilled in the art, so that the limb 110' and the reflection 100” of the body 100, as well as the first movement 300 appear as being such that the user would see them, in reality, from the position of the eyes 120 (for example from the height of the eyes 120).

[0062] In the images, the reflection of the body may be an avatar and the limb may be a limb of the avatar.

[0063] In step S30, [Fig. 3], the appearance of the reflection 100” and the (representation of the) hand 110’ is modified. For example, the reflection 100’ gradually disappears in the mirror 400. The movement of the hand 300 continues, which is represented in the images (by the movements 300’ and 300”).

[0064] Alternatively, the transformation may be an increase in the brightness of the reflection 100” of the body in the mirror 400 and of the limb.

[0065] With reference to [Fig.7], the increase in the brightness of the reflection of the body (or of a part of the body) in the mirror, can be for example progressive, for example by an increase in the brightness first of the chest (image 710), then of the head and hands and feet (image 720), then of the whole body (image 730).

[0066] For example, a hand 110 moving 300 to the right can be seen, in reference 110', from the palm side in the images, as seen from position 120, and in the mirror 400, moving in the same direction 300”, the hand 110' can be seen from the back of the palm side.

[0067] Alternatively, the body 100 may remain stationary.

[0068] For example, the movement, that is to say the hand 110' (which is the representation of the hand 110) during the movement 300' (in other words: during the movement 300 represented by the representation 300' of the movement) and the reflection 100” of the body in the mirror are transformed by the transformation.

[0069] In step S40, the images [Fig.2] and [Fig.3] are displayed to the user by the virtual reality headset 200 (in general, the display of the image [Fig.2] can occur before the determination of the image [Fig.3]).

[0070] For example, the transformation can be triggered by bringing the thumb and index finger of a hand of the user's body 100 into contact.

[0071] The transformation can also be a transparency effect of the reflection 100” and of the hand 110' (in other words: of the representation of the hand 110, by 110') (where for example the interior of the body becomes visible or represented) [Fig.4]. This transformation offers a vision of the interior of the body used to give the illusion that each part of the body is intact and functioning perfectly

[0072] The transformation can also be a levitation of the 100” reflection and the 110' member [Fig.5].

[0073] The virtual reality headset 200 may comprise a computer program comprising instructions, executable by a microprocessor or a microcontroller, for implementing the method according to the invention.

[0074] More generally, the virtual reality headset 200 may comprise electronic means for implementing the method according to the invention, for example a computer program, data in memory and / or specialized electronic circuits.

Claims

Claims

1. A virtual reality method comprising a step of determining (S20) images juxtaposing: - A reflection (100”) of a body (100) in a mirror (400), the body (100) comprising at least one limb and eyes, - and the at least one limb (110'), The body having an appearance in the images, The images comprising a transformation of the appearance of the body (100); characterized in that the transformation is an increase in a brightness of the reflection (100”) of the body (100) in the mirror (400).

2. Virtual reality method according to the preceding claim further comprising a step of detecting (S 10) a first movement (300) of the at least one member (110), the images juxtaposing - The first movement (300) of the at least one member, and - The reflection (100”) of the body (100) reproducing the first movement (300) of the at least one member (110') in a mirror.

3. Virtual reality method according to the preceding claim further comprising a step of triggering the transformation of the appearance by a second movement of the body (100).

4. A virtual reality method according to any preceding claim wherein the increase in brightness is gradual.

5. A virtual reality method according to the preceding claim, the body (100) comprising a chest, a head, hands and feet, wherein the transformation comprises increasing the brightness first of the chest, then of the head, hands and feet, then of an entire reflection of the body and of the at least one limb.

6. A virtual reality method according to any preceding claim wherein the reflection (100”) of the body (100) in the mirror (400) and the at least one limb (110') are transformed by the transformation.

7. Computer program comprising instructions, executable by a microprocessor or a microcontroller, for implementing the

8. method according to any one of claims 1 to 6. Electronic device (110) configured to implement the steps of the method according to any one of claims 1 to 6.