Head mounted display with facial interface for sensing physiological conditions

Abstract

The invention relates to a head-mounted display with a facial interface for sensing physiological conditions. A head mounted display includes a display unit and a facial interface. The display unit displays the graphical content to a user. The face interface is removably coupleable to the display unit and engages a face engagement area of a user's face, thereby supporting the display unit on the user's face. The facial interface includes a physiological sensor for sensing a physiological condition of the user in the facial engagement region.

Description

[0001] This application is a divisional application of the invention patent application with international application number PCT / US2020 / 013443, international application date January 14, 2020, application number 202080009636.6, and invention name: "Head-mounted display with facial interface for sensing physiological conditions", which entered the Chinese national stage on July 16, 2021.

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS

[0003] This patent application claims priority to and the benefit of U.S. Provisional Patent Application No. 62 / 793,466, filed on January 17, 2019. The contents of the foregoing patent application are incorporated herein by reference in their entirety for all purposes. Technical Field

[0004] The present disclosure relates to head mounted displays and, in particular, to sensing physiological conditions therewith. Background Art

[0005] A head mounted display is worn on a user's head and displays graphical content to the user. A typical head mounted display includes a display, a head support, and a facial interface. The display displays the graphical content. The head support is coupled to the display and engages the user's head to support the display. The facial interface is coupled to the display and engages the user's face to support the display. For example, for a head mounted display for displaying graphical content of a computer generated environment, the facial interface may engage the user's face substantially around the user's eyes to block substantially all ambient light from reaching the eyes. The facial interface is typically made of or includes a compliant material (e.g., foam or rubber) that engages and conforms to the shape of the face.

[0006] The user's face can provide a variety of physiological information that can be used in various ways, for example, when delivering graphical content with a head-mounted display. However, the facial interface can hide portions of the face from the view of various physiological sensors and / or can affect physiological conditions that might otherwise provide valuable information. For example, a user can provide a facial expression that, in the absence of facial contact with the facial interface, would take a certain form and be observable, such as a raised eyebrow for a surprised facial expression. Summary of the invention

[0007] Specific implementations of head mounted displays are disclosed herein.

[0008] In a specific implementation, a head mounted display includes a display unit and a facial interface. The display unit displays graphical content to a user. The facial interface is removably coupled to the display unit and engages a facial engagement region of a user's face, thereby supporting the display unit on the user's face. The facial interface includes a physiological sensor for sensing a physiological condition of the user in the facial engagement region.

[0009] In a specific implementation, a facial interface for a head mounted display includes a compliant structure, a physiological sensor, a mechanical connector, and a data connector. The compliant structure engages a facial engagement region of a user's face to support the head mounted display thereon. The physiological sensor is coupled to the compliant structure for measuring a physiological condition of the user in the facial engagement region. The mechanical connector is coupled to the compliant structure and removably coupled to the head mounted display. The data connector is coupled to the physiological sensor and transmits physiological data from the physiological sensor to the head mounted display.

[0010] In a specific implementation, a display system includes a head-mounted display and an electronic device that is physically separate from the head-mounted display. The head-mounted display includes a display unit for displaying graphical content to a user and a facial interface coupled to the display unit. The facial interface is configured to engage a facial engagement area of ​​the user's face to support the display unit on the face. The facial interface includes a physiological sensor for sensing a physiological condition of the user in the facial engagement area. The electronic device communicates with the facial interface. The electronic device includes another sensor for sensing another condition. The head-mounted display forms a determination based on both the physiological condition and the other condition, and performs an operation based on the determination.

[0011] In a specific implementation, a display system includes a head mounted display having a display unit, a facial interface having a physiological sensor, and another physiological sensor. The display unit displays graphical content to a user. The facial interface is coupled to the display unit and is configured to engage a facial engagement region of a user's face to support the display unit thereon. The facial interface includes a physiological sensor for sensing a physiological condition of the user in the facial engagement region. The other physiological sensor senses another physiological condition of the user outside of the facial engagement region. The display system forms a determination based on both the physiological condition and the other physiological condition, and performs an operation based on the determination. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In the drawings, dashed lines generally represent components that are hidden from view or that can be moved between states. Dashed-dot lines generally represent parts of the user that are hidden from view.

[0013] Figure 1 is a side view of a head mounted display worn on a user's head, wherein the dotted lines indicate hidden components and the dashed lines indicate hidden parts of the user.

[0014] Figure 2 For wearing on the head Figure 1 Front view of the head-mounted display.

[0015] Figure 3 A schematic diagram of the electronics for a head-mounted display.

[0016] Figure 4 A diagram of an example hardware configuration for a controller for a head mounted display.

[0017] Figure 5 A front view of a head mounted display and a user showing the user's facial engagement area and the facial interface of the head mounted display.

[0018] Figure 5A For along Figure 5 A cross-sectional view of the head-mounted display taken along line 5A-5A in FIG.

[0019] Figure 5B For along Figure 5 A cross-sectional view of a variation of the head mounted display taken along line 5B-5B in FIG.

[0020] Figure 6 is a schematic diagram of a facial interface with its optional sensors.

[0021] Figure 7 for Figure 1 Rear view of the head-mounted display.

[0022] Figure 8 A front view of the user further illustrating the facial engagement area.

[0023] Fig. 9 A rear view of the head-mounted display with the facial interface in a disengaged configuration (solid line) and a coupled configuration (dashed line).

[0024] Fig.10 A schematic diagram of a head mounted display including mechanical connections, power connections, and data connections.

[0025] Fig.11 A flow chart of a method for performing physiological identification of a user via a head mounted display.

[0026] Fig. 12A A flow chart of a method for identifying a suitable facial interface for a head mounted display for a user.

[0027] Fig. 12B A rear view of a facial interface for evaluating a user's face to identify an appropriate facial interface.

[0028] Fig.13 A flow chart of a method for evaluating placement of a head mounted display.

[0029] Fig.14 A flow chart of a method for changing graphical content via a head mounted display.

[0030] Fig.15 A flow chart of a method for operating a display system is provided. DETAILED DESCRIPTION

[0031] Disclosed herein are head mounted displays and facial interfaces therefor that sense physiological conditions in portions of a user's face that are engaged by the facial interface itself. The facial interface may include one or more sensors and / or portions of sensors. Alternatively or additionally, the facial interface may include a sensing window that allows viewing of those portions of the face engaged by the facial interface with sensors of the head mounted display, such as in a display thereof.

[0032] The head mounted display may also include sensors for sensing physiological conditions of the user in areas not engaged by the facial interface, such as sensors of the head mounted display that view areas surrounded by the facial interface or external to the facial interface. Physiological information from areas engaged by the facial interface may be used in conjunction with physiological information from areas not engaged by the facial interface, for example, to make various determinations and / or provide various outputs in response thereto.

[0033] The facial interface may also be removably or interchangeably coupled to the display. Thus, for example, facial interfaces with different sensing capabilities and / or suitability may be attached to the display, depending on different graphical content and / or different users. In addition, the facial interface may be removable for cleaning or replacement.

[0034] Reference Figure 1 and Figure 2 The head mounted display 100 can be worn on a user's head H and display graphical content thereto, such as graphical content of a computer-generated environment (discussed in further detail below). The head mounted display 100 generally includes a display unit 110, a head support 120, a facial interface 130, and electronics 140. The head mounted display 100 may also be referred to as a display system.

[0035] The display unit 110 includes one or more display screens 112 that display graphical content, and a housing 114 to which the display screens 112 are coupled and which hides various components from view. The housing 114 may also function to block ambient light from reaching the user's eyes E. The display unit 110 may be, for example, a dedicated device for displaying content while worn on a user's head H, as opposed to having a removable display screen (such as a smartphone that may also be used as a handheld device). As such, the display screen 112 may be fixedly coupled to the housing 114, as opposed to being interchangeably coupled to the housing 114.

[0036] The head support 120 is coupled to the display unit 110 and engages the user's head H to support the display unit 110 thereon. The head support 120 may be, for example, a band extending around the sides and rear of the user's head H. The head support 120 may be coupled to the housing 114 of the display unit 110 .

[0037] The facial interface 130 is coupled to the display unit 110 and engages the user's face F to support the display unit 110 thereon. For example, the facial interface 130 can be coupled to a rear end of the display unit 110 proximal to the user, such as to the housing 114 (e.g., a rear surface or an inner end or inner surface), and the head support 120 can be placed in tension around the user's head H, thereby pressing the facial interface 130 generally backward against the user's face F. The facial interface 130 can generally be arranged between the user's face and the display screen 112 (e.g., without the display screen 112 or a portion thereof being located between the facial interface 130 and the user's face). The facial interface 130 can include one or more physiological sensors 132 that detect physiological conditions (e.g., a condition of the user), and can also include one or more tactile output devices 133, which will be discussed in further detail below.

[0038] Electronics 140 are electronic components used to operate head mounted display 100. Electronics 140 may be coupled to display unit 110, for example, contained within housing 114. Some electronics 140 and / or other electronics of the display system may be located remotely from display unit 110, such as another computing device that communicates with display unit 110 and / or facial interface 130. Figure 3 , the electronics 140 may generally include a controller 342, a sensor 344, a communication interface 346, and power electronics 348, among others. The electronics 140 may also be considered to include the display screen 112 of the display unit 110. The controller 342 generally controls the operation of the head mounted display 100, for example, receiving input signals from the sensor 344 and / or the communication interface 346, and sending control signals to the display unit 110 (e.g., to the display screen 112) for outputting graphical content. An exemplary hardware configuration of the controller 342 is described below with reference to Figure 4 The sensor 344 senses a condition of the user (e.g., a physiological condition), a condition of the head mounted display 100 (e.g., a position, orientation, movement), and / or a condition of the environment (e.g., sound, light, image). The sensor 344 may be any suitable type of sensor discussed below with reference to FIG. Figure 6). The communication interface 346 is configured to receive signals from an electronic device 350 that is physically separate from the head-mounted display 100. The power electronics 348 stores and / or supplies power for operating the head-mounted display and may, for example, include one or more batteries. The electronic device 350 may be a user input device (e.g., a user controller), another electronic device associated with the user (e.g., a smart phone or wearable electronic device), or another electronic device not associated with the user (e.g., a server, a smart phone associated with someone else). The electronic device 350 may include a sensor 350a that can sense various other conditions of the user, such as his position or movement. The electronic device 350 may be considered to be part of a display system that includes the head-mounted display 100.

[0039] refer to Figure 4 , the controller 342 can be used to implement the devices, systems and methods disclosed herein. For example, the controller 342 can receive various signals from various electronic components (e.g., sensors 344 and communication interfaces 346), and control the output of the display screen 112 accordingly to display graphical content. In the exemplary hardware configuration, the controller 342 generally includes a processor 442a, a memory 442b, a storage device 442c, a communication interface 442d, and a bus 442e, and the other components of the controller 342 communicate through the bus 442e. The processor 442a can be any suitable processor for executing computer instructions and performing the operations described therein, such as a central processing unit. The memory 442b can be a volatile memory, such as a random access memory (RAM). The storage device 442c can be a non-volatile storage device, such as a hard disk drive (HDD) or a solid state drive (SSD). The storage device 442c can form a computer-readable medium that stores instructions (e.g., code) executed by the processor 442a, for example, operating the head-mounted display 100 in the manner described above and below. The communication interface 442d communicates with other electronic components (eg, the sensor 344, the communication interface 346, and / or the display screen 112) to send and receive various signals (eg, control signals and / or sensor signals) thereto.

[0040] Reference Figure 5 The facial interface 130 is in the facial joint area F engagement The facial interface 130 engages the user's face F. As shown, the facial interface 130 extends around the user's eyes E. The facial interface 130 engages with the face F to block ambient light from reaching the eyes E by extending above, around, and below the user's eyes E. The facial engaging area F engagement The facial interface 130 also generally extends between the outer edge 130a and the inner edge 130b.engagement The user's eyes E may be substantially covered or hidden from view by facial interface 130. Alternatively, facial interface 130 may not extend completely around the user's eyes E, for example, extending above but not below the eyes E, or having a gap in the area of ​​the user's nose N. For example, the facial interface 130 may have a facial interface region F that is substantially covered or hidden from view by facial interface 130. Alternatively, facial interface 130 may not extend completely around the user's eyes E, for example, extending above but not below the eyes E, or having a gap in the area of ​​the user's nose N. engagement May include only the forehead junction area FH engagement (See e.g. Figure 8 ).

[0041] Reference Figure 5A and 5B The facial interface 130 is configured to be compliant so as to comfortably engage and fit the user's face F. The facial interface 130 includes a compliant structure 530a that is disposed in the facial engagement region F. engagement The compliant structure 530a is engaged with the user's face F, and one or more physiological sensors 132 and / or tactile output devices 133 (not shown) are coupled to the compliant structure 530a. The compliant structure 530a forms the overall shape of the facial interface 130 (e.g., as shown in FIG. Figure 5 As shown, extending around the user's eyes E).

[0042] like Figure 5A As shown, the compliant structure 530a may be a continuously formed structure and may be compressed (e.g., such flexure as shown by the dashed lines) toward the housing 114 of the display unit 110. For example, the compliant structure 530a may be formed of an elastomer such as rubber or silicone, in which case the compliant structure 530a may directly engage the user's face F. The physiological sensor 132 is surrounded by (e.g., recessed or embedded in) the compliant structure 530a and is arranged to sense a physiological condition, for example, at an outer surface of the compliant structure 530a or otherwise appropriately close to the user.

[0043] like Figure 5B As shown, a variation of compliant structure 530a' is formed of multiple components, such as a backing layer 530b (e.g., a rigid or flexible sheet formed of a polymer such as plastic) to which a compliant layer 530c (e.g., made of foam, rubber, or other compressible material) is coupled. The compliant layer 530c can be further covered by a flexible cover 530d, such as a woven textile or other material (e.g., a flexible sheet of polymer). The cover 530d can also be connected to a backing layer 530b such as a backing layer 530b (e.g., a rigid or flexible sheet formed of a polymer such as plastic). Figure 5AThe physiological sensor 132 is used together with the compliant structure 530A shown. The physiological sensor 132 is surrounded by the compliant layer 530c (e.g., recessed or embedded therein) and is arranged to sense the physiological condition of the user. For example, as referenced below, the physiological sensor 132 can be a force sensor 632a, which is arranged in close proximity to the cover 530d (e.g., in contact with the cover 530d). In another example, as referenced below, the physiological sensor 132 can be an electrode 632f or another bioelectric signal sensor (e.g., a brain activity sensor 632g, a muscle activity sensor 632h, or a heart rate sensor 632i), in which case the cover 530d can be conductive in the area of ​​the physiological sensor 132. The cover 530d can also be used with the compliant structure 530a.

[0044] refer to Figure 6 The facial interface 130 includes one or more physiological sensors 132 for sensing the facial engagement area F engagement The physiological sensor 132 can be a complete sensor itself that outputs a sensor signal based on the sensed physiological condition. For example, the physiological sensor 132 can be a force sensor that outputs an analog or digital signal based on the force it senses. Alternatively, the physiological sensor 132 can be a component of a sensor system. For example, the physiological sensor 132 can be an electrode for an electroencephalogram (EEG) that is connected to a remote computing device (e.g., the controller 342), which in turn determines the electrical activity of the user's brain.

[0045] The one or more physiological sensors 132 may be configured to sense the facial engagement region F engagement The facial interface 130 may include any of the following physiological conditions, which may include force, temperature, humidity, displacement, capacitance, brain activity (e.g., EEG as described above), muscle activity (e.g., via force sensors and / or electromyography (EMG)), and / or heart rate. Although each of the various types of physiological sensors 132 are depicted as part of the facial interface 130 (e.g., sensors 632a through 632i), it should be understood that the facial interface 130 may include zero, one, or more of each type of physiological sensor 132.

[0046] To measure force, physiological sensor 132 may be a force sensor 632a, such as a spring displacement sensor (e.g., measuring the displacement of a spring of known characteristics), a hydraulic or pneumatic load sensor (e.g., measuring the pressure of a contained fluid), a strain gauge, or a piezoelectric force sensor. Force sensor 632a may directly engage the user's face F, or may be hidden from view, e.g., behind a cover 530d of facial interface 130 (see FIG. 1 ). Figure 5B). In the area of ​​the force sensor 632a, the cover 530d is preferably thin and / or generally incompressible to provide an accurate measurement of the force applied by the facial interface 130 to the user's face F. Alternatively, the cover 530d can be compressible to provide padding between the user's face F and the force sensor 632a (e.g., formed of or otherwise including a compressible material such as foam, silicone, or fabric).

[0047] To measure moisture, the physiological sensor 132 may be a moisture sensor 632b, such as a hygrometer or an infrared moisture sensor. In the case where the moisture sensor 632b is a hygrometer, the moisture sensor 632b is aligned with the face F of the user. engagement Fluid Communication. For example, the moisture sensor 632b can be disposed behind the cover 530d of the facial interface 130, such as behind a fabric or foam material through which moisture can propagate.

[0048] To measure temperature, the physiological sensor 132 may be a temperature sensor 632c, such as a thermocouple, a thermistor, a resistance thermometer, or an infrared temperature sensor. In the case of a thermocouple, a thermistor, or a resistance thermometer, the temperature sensor 632c may be arranged to engage with the facial engagement area F of the user's face F. engagement In direct contact with, or otherwise in thermally conductive relationship with, the user's face F (e.g., behind and electrically conductively coupled to the highly thermally conductive material of the cover 530d). In the case of an infrared temperature sensor, the temperature sensor 632c can directly sense the facial engagement region F of the user's face F. engagement infrared radiation, or through the facial engagement area F of the user's face F engagement The heat is conducted to the intermediate material (eg, cover 530d).

[0049] To measure displacement, the physiological sensor 132 may be a displacement sensor 632d, such as a contact displacement meter. engagement Move, the displacement sensor 632d moves and measures its displacement.

[0050] To measure capacitance, the physiological sensor 132 may be a suitable type of capacitance sensor 632e.

[0051] To measure brain activity (e.g., electroencephalogram or EEG), muscle activity (e.g., electromyogram or EMG), and / or heart rate (e.g., electrocardiogram or ECG), the physiological sensor 132 may be a suitable bioelectric signal sensor. In one example, the bioelectric signal sensor is an electrode 632f. It should be noted that the electrode 632f may take different forms depending on the physiological condition being sensed (e.g., physically different to sense different bioelectric activities (e.g., bioelectric signals), such as brain activity, muscle activity, or heart activity). The electrode 632f may be incorporated into the cover 530d, for example, with conductive fibers woven into the fabric of the cover 530d. Alternatively, the electrode 632f may be formed of another material and arranged to directly contact the facial engagement region F of the user's face F. engagement .

[0052] In place of the electrode 632f, the physiological sensor 132 may be a brain activity sensor 632g (e.g., an EEG sensor) that contacts the face F to measure brain activity, a muscle activity sensor 632h (e.g., an EMG sensor) that contacts the face F to measure muscle activity, or a heart rate sensor 632i that contacts or observes the face F to measure heart rate.

[0053] Reference Figure 7 The facial interface 130 may include a window 736 through which the facial engagement region F may be optically observed. engagement For example, the window 736 may be formed in the cover 530d, and one of the sensors 344 coupled to the display unit 110 observes the facial engagement area F behind it. engagement To sense the user's condition (e.g., a camera to measure the user's facial movement, an optical heart rate sensor with a light emitter and detector, or an infrared sensor).

[0054] refer to Figure 8 , the facial joint area F of the user's face F may be engagement One or more physiological sensors 132 are provided in one or more suitable locations in the face F of the user for measuring physiological conditions associated therewith (e.g., force, humidity, temperature, displacement, brain activity, muscle activity, or heart activity). For example, one or more of the physiological sensors 132 may be arranged in the face joint region F of the user's face F. engagement The forehead junction area FH engagement , temple junction area T engagement and / or cheek junction area C engagement The force sensor 632a can be arranged in an area where pressure needs to be measured, for example, to detect specific facial expressions or to assess comfort, such as in the forehead joint area FH engagement , temple junction area T engagementor cheek junction area C engagement The brain activity sensor 632g can be positioned where brain activity can be measured, such as in the forehead joint area FH engagement The muscle activity sensor 632h can be arranged where facial movement can be measured, for example to assess facial expressions, such as in the forehead joint area FH engagement , temple junction area T engagement and / or cheek junction area C engagement The heart rate sensor 632i may be arranged where the heart rate can be optically sensed, such as in the temple joint area T engagement or where the heart rate can be measured electrically, such as in the forehead joint area FH engagement middle.

[0055] Reference Figure 9-10 The facial interface 130 can be removably coupled to the display unit 110. The head mounted display 100 forms a mechanical connection 902 at one or more locations, one or more power connections 904 and one or more data connections 906 between the facial interface 130 and the display unit 110.

[0056] The mechanical connection 902 mechanically couples the facial interface 130 to the display unit 110 so that the facial interface 130 and the display unit 110 can be supported from one another, such as for the facial interface 130 to support the display unit 110 on the face F of the user. The mechanical connection 902 can be formed magnetically (e.g., a permanent magnet and a corresponding permanent magnet or suction cup), for example, by hook and loop fasteners, interference fit (e.g., a front end of the facial interface 130 fits tightly within or around the display unit 110), a protrusion that passively engages a corresponding slot or groove, a mechanism (e.g., a latch), or a combination thereof. The mechanical connection 902 can be formed at one or more locations, for example, with facial interface mechanical connectors 930a distributed around the facial interface 130 (e.g., coupled to the compliant structure 530a) and display unit mechanical connectors 910a distributed around the display unit 110 at corresponding locations (e.g., coupled to the housing 114).

[0057] The power connection 904 transfers power between the display unit 110 and the facial interface 130, such as to the facial interface 130 to be powered by the display unit 110 (e.g., a physiological sensor 132 of the facial interface 130 that is powered by the display unit 110). The power connection 904 can be formed in any suitable manner, such as conductively (e.g., a fixed contact engaged by a spring contact, or a plug and a corresponding socket) or wirelessly (e.g., with a corresponding inductive coil). The power connection 904 can be formed at one or more locations, such as a facial interface power connector 930b on the facial interface 130 and a display unit power connector 910b on the display unit 110 at a corresponding location. The facial interface power connector 930b is coupled to one or more physiological sensors 132 to provide power thereto. The display unit power connector 910b is directly or indirectly coupled to the power electronics 348 to transfer power therefrom.

[0058] Data connection 906 communicates data between display unit 110 and facial interface 130, such as control signals from display unit 110 (e.g., its controller 342) to facial interface 130 (e.g., its physiological sensor 132 and / or haptic output device 133) and / or sensor signals from facial interface 130 (e.g., its physiological sensor 132) to display unit 110 (e.g., its controller 342). Data connection 906 may be formed in any suitable manner, such as conductively (e.g., fixed contacts engaged by spring contacts, or a plug and corresponding socket) or wirelessly (e.g., a wireless transceiver using a suitable protocol such as Bluetooth). Data connection 906 may be formed at one or more locations, such as facial interface data connector 930c on facial interface 130 and display unit data connector 910c on display unit 110 at a corresponding location. The facial interface data connector 930c is coupled directly or indirectly to one or more physiological sensors 132, e.g., to communicate control signals thereto and / or sensor signals therefrom (e.g., to transmit sensed physiological information). The display unit data connector 910c is coupled directly or indirectly to the controller 342, e.g., to communicate control signals therefrom and / or sensor signals thereto (e.g., to receive sensed physiological information).

[0059] Both the power connection 904 and the data connection 906 may be formed by a common connection system, such as a plug and socket system capable of transmitting both power and data. For example, the power connection 904 and the data connection 906 may be formed by a suitable type of universal serial bus (USB) connector (such as USB Type-C).

[0060] The head mounted display 100, and in particular the display unit 110 thereof, can be configured to be interchangeably coupled to different facial interfaces 130. The different facial interfaces 130 can, for example, differ in size and / or shape (e.g., so that the display unit 110 can be used with people having faces F of different sizes). The different facial interfaces 130 can alternatively or additionally differ in the configuration of their physiological sensors 132, for example, by having different types of physiological sensors 132 (e.g., sensors 632a to 632i), different numbers of physiological sensors 132, and / or differently placed physiological sensors 132. By providing different facial interfaces 130 with differently configured physiological sensors 132, different functionalities can be provided. For example, one facial interface 130 can include one or more brain activity sensors 632g and / or one or more electrodes 632f for monitoring brain activity, while another facial interface 130 can include a force sensor 632a. For example, different facial interfaces 130 may be interchangeably coupled to the display unit 110 by forming a mechanical connection 902, a power connection 904, and / or a data connection 906 with the display unit 110 in the same manner as one another. For example, two different facial interfaces 130 form a power connection 904 and / or a data connection 906 with a common type of power connector 910b, 930b and / or data connector 910c, 930c, such as a standardized connector (e.g., USB-C) capable of forming both a power connection 904 and a data connection 906.

[0061] refer to Figure 11-15 , through the facial joint area F engagement The physiological information sensed by one or more physiological sensors 132 in the head mounted display 100 can be used in a variety of different ways, for example, for physiological recognition, assessing user fitness, assessing and / or guiding placement, changing graphical content, and simply outputting physiological information for other purposes, such as personal health monitoring, multi-person health research, or yet to be determined. In addition, in one or more of the various uses of the physiological sensors 132, the head mounted display 100 can further utilize information from the sensors 344 of the electronic device 140, for example, to supplement, confirm and / or negate the use of the face engagement area F engagement The sensor 344 may be, for example, located in the facial joint area F engagement A physiological condition of the user, such as a condition or characteristic of the user's eyes E, is sensed in an area surrounded (eg, surrounded by facial interface 130 ).

[0062] Reference Fig.11, a method 1100 for performing physiological authentication through a head mounted display is provided. In a first operation 1110, a physiological condition is sensed, in a second operation 1120, the physiological condition is evaluated to identify or authenticate a user, and after identifying or authenticating the user, in a third operation 1130, permissions are granted to the user.

[0063] In a first operation 1110, for example, in conjunction with the controller 342, the facial engagement area F engagement The physiological condition may be sensed using one or more sensors in the user's face F, such as using one of the physiological sensors 132. The physiological condition may, for example, include force and / or displacement measurements at various locations (e.g., for determining the shape or facial features of the user's face F) or bioelectric signals suitable for identifying the user.

[0064] The first operation 1110 may further include a sub-operation 1115, in which the face engagement region F engagement The user's physiological condition may be additionally sensed in facial areas other than the eyes (i.e., in areas not engaged by the facial interface 130). For example, one of the sensors 344 (e.g., a camera) of the electronics 140 of the display unit 110 may sense a condition of one or more eyes E of the user.

[0065] In a second operation 1120, the physiological condition sensed in the first operation 1110 is evaluated using a computing device such as the controller 342 to identify or authenticate the user. For example, the physiological condition is compared to previously measured or determined physiological conditions of one or more approved users. If the sensed physiological condition matches or otherwise compares favorably to those previously measured conditions of the user, then the user is considered identified or authenticated.

[0066] The second operation 1120 may further include a sub-operation 1125 in which the facial joint region F is evaluated. engagement For example, the facial joint area F engagement The physiological conditions outside the facial joint area F are compared with the previously measured or determined physiological conditions of one or more approved users. engagement If the physiological conditions inside and outside the body match or otherwise compare favorably with previously measured conditions, the user is considered to have been identified or authenticated.

[0067] In a third operation 1130 , based on the identification or authentication determined in the second operation 1120 , the head mounted display 100 provides one or more permissions to the user, for example, to access different functions (eg, graphic content) of the head mounted display 100 .

[0068] Reference Fig. 12A and12B , a method 1200 for determining a suitable facial interface for a user is provided. In a first operation 1210, a physiological condition of the user is sensed, then in a second operation 1220, the sensed physiological condition is compared with physiological standards of different facial interfaces, and in a third operation 1230, one of the different facial interfaces is identified.

[0069] In a first operation 1210, the user's physiological condition is sensed using the facial interface 130, such as Fig. 12B , includes physiological sensors 132 distributed around (e.g., above, below, and / or along the sides of the user's eyes E). Physiological sensors 132 are of a type suitable for measuring the shape of the user's face F or its features, such as force sensors 632a (e.g., around the facial engagement region F). engagement force distribution) or displacement sensor 632d.

[0070] In a second operation 1220, the physiological condition sensed in the first operation 1210 is evaluated using a computing device such as the controller 342 of the head mounted display 100 to determine facial shape characteristics. For example, facial shape may be broadly characterized based on the physiological condition (e.g., by size and / or ethnicity), or facial shape characteristics may be more discretely characterized (e.g., the size and relative position of individual features such as the user's eyebrows and nose).

[0071] In a third operation 1230, the facial shape feature is compared with corresponding features of different facial interfaces, such as facial interface 130 or other facial interfaces lacking physiological sensors 132, using a computing device, to identify one or more suitable facial interfaces for the user's face F. For example, different facial interfaces 130 having different sizes or shapes may have acceptable ranges of values ​​for the facial shape feature, and if the facial shape feature falls within its acceptable range, a suitable facial interface 130 is identified for the user.

[0072] Reference Fig.13 , a method 1300 for evaluating placement of a head mounted display 100 is provided. In a first operation 1310, a physiological condition is sensed, in a second operation 1320, a position is evaluated, and in a third operation 1330, placement feedback is provided.

[0073] In a first operation 1310, a physiological condition is sensed using a sensor such as one of the physiological sensors 132 suitable for evaluating the placement of the facial interface 130 on the user's face F. For example, the physiological sensor 132 may be one or more of a force sensor 632a or a displacement sensor 632d (e.g., by which the shape or facial features of the face F may be determined), a capacitive sensor 632e, or a suitable bioelectric signal sensor.

[0074] The first operation 1310 may further include a first sub-operation 1315, in which the face engagement area F engagement The user's physiological condition may be additionally sensed in facial areas other than the face (i.e., in areas not engaged by the facial interface 130). For example, one of the sensors 344 of the electronics 140 of the display unit 110 may sense a condition of one or more eyes E of the user (e.g., the position of the eyes E, e.g., using a camera and image recognition).

[0075] In a second operation 1320, the position is evaluated using a computing device such as controller 342 based on the physiological conditions sensed in the first operation 1310. For example, correct contact with the user's face F may be evaluated by comparing the physiological conditions sensed by force sensor 632a, capacitive sensor 632e with such physiological conditions previously sensed when facial interface 130 was correctly placed on the user's face.

[0076] The second operation 1320 may further include a sub-operation 1325 in which the facial joint region F is evaluated. engagement For example, the position of the head mounted display 100 on the user's face F may be further evaluated based on the sensed position of the user's eyes E.

[0077] In a third operation 1330, placement feedback (e.g., a position indication) is provided based on the position evaluation determined in the second operation 1320, for example, as graphical feedback output by the display unit 110, as audio feedback output by the audio output device, or as tactile feedback output by the tactile output device 133, which can be controlled by the computing device. The placement feedback can be binary (e.g., a negative indication if the facial interface 130 is not in the correct position on the user's face F), or can be indicative (e.g., providing instructions to the user on how to move the head mounted display 100 to the correct position).

[0078] Reference Fig.14, a method 1400 for changing graphic content through a head mounted display is provided. In a first operation 1410, a physiological condition is sensed, in a second operation 1420, a user emotional state is evaluated, and in a third operation 1430, the graphic content is changed according to the user emotional state.

[0079] In a first operation 1410, a physiological condition is sensed using a sensor such as one of the physiological sensors 132 suitable for evaluating the user's emotional state. For example, the physiological sensor 132 may be one or more of a bioelectric signal sensor (such as an electrode 632f), a brain activity sensor 632g, a muscle activity sensor 632h, and / or a heart rate sensor 632i. Increased brain activity, muscle activity, or heart rate may indicate an increased emotional state, while lower brain activity, muscle activity, or heart rate may indicate a calm emotional state. The first operation 1410 may include a sub-operation 1415 in which another physiological condition of a different type is sensed. The physiological condition may be detected at the facial engagement region F engagement Other physiological conditions may be sensed within or outside of the facial interface 130. For example, when a user attempts a natural facial expression (e.g., a smile) that may be suppressed by the facial interface 130, the muscle activity sensor 632h and the force sensor 632a may each sense a physiological condition indicative of the facial expression.

[0080] In a second operation 1420, a computing device such as the controller 342 is used to evaluate the user's emotional state based on the physiological condition sensed in the first operation 1410. For example, brain activity, muscle activity, or heart rate may be compared to a higher threshold (e.g., above which the user is determined to be in an elevated emotional state), to a lower threshold (e.g., below which the user is determined to be in a calm emotional state), to evaluate trends (if increasing or decreasing, determining that the user is moving toward an elevated or calm emotional state), or other criteria (e.g., patterns in bioelectric signals). The second operation 1420 may include a sub-operation 1425 in which another physiological condition is evaluated. For example, an emotional state may be determined based on both the first physiological condition and the second (e.g., other) physiological condition.

[0081] In other examples, force sensor 632a and / or displacement sensor 632d may be used to identify facial expressions indicative of an emotional state of a user (eg, facial expressions indicative of surprise or calmness).

[0082] In a third operation 1430, the graphical content is changed according to the emotional state of the user determined in the second operation 1420. For example, the graphical content can be changed to induce or maintain an elevated emotional state (e.g., by displaying faster moving graphical content) or a calm emotional state (e.g., by displaying less fast moving graphical content). The graphical content can also vary according to the nature of the software program that delivers the graphical content. For example, for a software program that is intended to induce a high emotional state, the graphical content can be provided in a manner that is intended to change the user's emotional state away from a calm emotional state. For a software program that is intended to relax the user, the graphical content can be provided in a manner that is intended to change the user's emotional state away from an elevated emotional state.

[0083] Reference Fig.15 , a method 1500 is provided for determining the user's facial engagement region F based on the user's facial engagement region F. engagement The head mounted display is operated based on the physiological condition sensed in the first operation 1510 and another condition. The physiological condition is sensed in the second operation 1520, another condition is sensed, a determination is made based on both the physiological condition and the another condition in the third operation 1530, and an operation is performed based on the determination in the fourth operation 1540.

[0084] In a first operation 1510, a sensor such as the physiological sensor 132 is used to detect the facial joint area F of the user's face F. engagement The physiological condition can be sensed in the physiological sensor 132. The physiological sensor 132 can be any of the sensor types described above (eg, 632a to 632i), and the physiological condition can be any of the physiological conditions described above.

[0085] In the second operation 1520, another condition is sensed using another sensor. The other sensor may be another sensor of the head mounted display 100, such as the sensor 344. In this case, the sensor 344 may sense the facial engagement area F. engagement Another sensor may be another physiological condition of the user in another facial area other than the position of the eyes or another condition (e.g., movement of the head mounted display). Alternatively, the other sensor may be a sensor of the electronic device 350, wherein the other condition may be movement of the electronic device 350 (e.g., indicating movement of the user).

[0086] In the third operation 1530, a determination is made based on both the physiological condition sensed in the first operation 1510 and the other condition sensed in the second operation 1520. The determination is made by a computing device such as the controller 342. The determination requires both the physiological condition and the other condition as input. In one example, the determination may be that the head mounted display is not in place, which may be determined based on the physiological condition of unevenly distributed forces and other conditions that the user's eye E is offset relative to the display unit 110. In another example, the determination may be that the user is highly active, which may be determined based on both the physiological condition of high brain activity and other conditions of high movement of the electronic device 350.

[0087] In a fourth operation 1540, further operations are performed based on the determination made in the third operation 1530. Various examples of further operations include providing binary or indicative position feedback (as described above) or changing graphical content (e.g., a rapidly changing graphic showing that the user is highly active).

[0088] The physical environment refers to the physical world that people can sense and / or interact with without the help of electronic systems. A physical environment, such as a physical park, includes physical objects, such as physical trees, physical buildings, and physical people. People can directly sense and / or interact with the physical environment, such as through vision, touch, hearing, taste, and smell.

[0089] In contrast, a computer generated reality (CGR) environment refers to a fully or partially simulated environment that people sense and / or interact with via electronic systems. In CGR, a subset of a person's physical movements, or representations thereof, are tracked, and in response, one or more features of one or more virtual objects simulated in the CGR environment are adjusted in a manner that complies with at least one law of physics. For example, a CGR system may detect a person's head turns, and in response, adjust the graphical content and sound field presented to the person in a manner similar to the way such views and sounds change in a physical environment. In some cases (e.g., for accessibility reasons), adjustments to features of virtual objects in a CGR environment may be made in response to representations of physical movements (e.g., voice commands).

[0090] A person may sense and / or interact with a CGR object using any of their senses, including vision, hearing, touch, taste, and smell. For example, a person may sense and / or interact with an audio object that creates a 3D or spatial audio environment that provides a perception of a point audio source in 3D space. As another example, an audio object may enable audio transparency that selectively introduces ambient sounds from the physical environment with or without computer-generated audio. In some CGR environments, a person may sense and / or interact only with an audio object.

[0091] Examples of CGR include virtual reality and mixed reality.

[0092] A virtual reality (VR) environment refers to a simulated environment designed to be based entirely on computer-generated sensory input for one or more senses. A VR environment includes a plurality of virtual objects that a person can sense and / or interact with. For example, trees, buildings, and computer-generated images representing avatars of people are examples of virtual objects. A person can sense and / or interact with virtual objects in a VR environment through a simulation of the person's presence within the computer-generated environment and / or through a simulation of a subset of the person's physical movement within the computer-generated environment.

[0093] In contrast to VR environments, which are designed to be based entirely on computer-generated sensory input, a mixed reality (MR) environment refers to a simulated environment designed to include sensory input from the physical environment, or representations thereof, in addition to computer-generated sensory input (e.g., virtual objects). On the virtuality continuum, a mixed reality environment is anything between a fully physical environment at one end and a virtual reality environment at the other end, but not including both ends.

[0094] In some MR environments, computer-generated sensory input can respond to changes in sensory input from the physical environment. In addition, some electronic systems used to render the MR environment can track position and / or orientation relative to the physical environment to enable virtual objects to interact with real objects (i.e., physical items from the physical environment or representations thereof). For example, the system can cause movement so that virtual trees appear stationary relative to the physical ground.

[0095] Examples of mixed reality include augmented reality and augmented virtuality.

[0096] An augmented reality (AR) environment refers to a simulated environment in which one or more virtual objects are superimposed on a physical environment or a representation thereof. For example, an electronic system for presenting an AR environment may have a transparent or translucent display through which a person can directly view the physical environment. The system may be configured to present virtual objects on a transparent or translucent display so that a person uses the system to perceive virtual objects superimposed on a physical environment. Alternatively, the system may have an opaque display and one or more imaging sensors that capture images or videos of a physical environment that are representations of the physical environment. The system combines the image or video with the virtual object and presents the composition on an opaque display. People use the system to indirectly view the physical environment via an image or video of the physical environment and perceive virtual objects superimposed on the physical environment. As used herein, a video of a physical environment displayed on an opaque display is referred to as a "transparent video," meaning that the system uses one or more image sensors to capture images of the physical environment and uses those images when presenting an AR environment on an opaque display. Further alternatively, the system may have a projection system that projects virtual objects into a physical environment, for example as a hologram or on a physical surface, so that a person using the system perceives the virtual objects superimposed on the physical environment.

[0097] An augmented reality environment also refers to a simulated environment in which a representation of a physical environment is transformed by computer-generated sensory information. For example, in providing a pass-through video, the system may transform one or more sensor images to apply a selected perspective (e.g., a viewpoint) that is different from the perspective captured by the imaging sensor. For another example, a representation of a physical environment may be transformed by graphically modifying (e.g., enlarging) portions thereof so that the modified portions may be representative but not true versions of the original captured images. For another example, a representation of a physical environment may be transformed by graphically eliminating portions thereof or blurring portions thereof.

[0098] An augmented virtual (AV) environment refers to a simulated environment in which a virtual or computer-generated environment is combined with one or more sensory inputs from a physical environment. The sensory input may be a representation of one or more characteristics of the physical environment. For example, an AV park may have virtual trees and virtual buildings, but the faces of people are realistically reproduced from images taken of physical people. For another example, a virtual object may take the shape or color of a physical object imaged by one or more imaging sensors. For another example, a virtual object may take a shadow that conforms to the positioning of the sun in the physical environment.

[0099] There are many different types of electronic systems that enable people to sense and / or interact with various CGR environments. Examples include head-mounted systems, projection-based systems, head-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays formed as lenses designed to be placed on people's eyes (e.g., similar to contact lenses), headphones / earpieces, speaker arrays, input systems (e.g., wearable or handheld controllers with or without tactile feedback), smart phones, tablets, and desktop / laptop computers. A head-mounted system can have one or more speakers and an integrated opaque display. Alternatively, a head-mounted system can be configured to accept an external opaque display (e.g., a smart phone). A head-mounted system can incorporate one or more imaging sensors for capturing images or videos of a physical environment, and / or one or more microphones for capturing audio of a physical environment. Instead of an opaque display, a head-mounted system can have a transparent or translucent display. A transparent or translucent display can have a medium through which light representing an image is directed to a person's eyes. The display can utilize digital light projection, OLED, LED, uLED, silicon-based liquid crystal, laser scanning light source, or any combination of these technologies. The medium can be an optical waveguide, a hologram medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, a transparent or translucent display can be configured to selectively become opaque. A projection-based system can employ retinal projection technology that projects a graphic image onto a person's retina. The projection system can also be configured to project a virtual object into a physical environment, such as a hologram or onto a physical surface.

[0100] As described above, one aspect of the present technology is to collect and use data available from various sources, including sensing the physiological condition of a user. The present disclosure contemplates that, in some instances, these collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, twitter IDs, home addresses, data or records related to the user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying information or personal information.

[0101] The present disclosure recognizes that the use of such personal information data in the present technology can be used to benefit the user. For example, the personal information data can be used to identify and change graphical content for the user, among other uses. In addition, the present disclosure also anticipates other uses of the personal information data that benefit the user. For example, health and fitness data can be used to provide insights into the user's overall health or can be used as positive feedback to individuals using technology to pursue health goals.

[0102] This disclosure envisions that entities responsible for collecting, analyzing, disclosing, transmitting, storing or otherwise using such personal information data will comply with established privacy policies and / or privacy practices. Specifically, such entities should implement and adhere to privacy policies and practices that are recognized as meeting or exceeding industry or government requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable purposes of the entity and not shared or sold outside of these legitimate uses. In addition, such collection / sharing should be performed after receiving informed consent from the user. In addition, such entities should consider taking any necessary steps to defend and secure access to such personal information data and ensure that others who have access to personal information data comply with their privacy policies and processes. In addition, such entities may subject themselves to third-party assessments to demonstrate their compliance with widely accepted privacy policies and practices. In addition, policies and practices should be adjusted to specific types of personal information data collected and / or accessed, and to applicable laws and standards including specific considerations of jurisdiction. For example, in the United States, the collection or access of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA), while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy practices should be maintained in each country for different types of personal data.

[0103] Regardless of the foregoing, the present disclosure also contemplates implementation schemes in which users selectively block the use or access of personal information data. That is, the present disclosure contemplates that hardware elements and / or software elements may be provided to prevent or block access to such personal information data. For example, in the case of changing content or authenticating users, the technology of the present invention may be configured to allow users to choose to "opt in" or "opt out" at any time during or after registration for a service to participate in the collection of personal information data. In another example, a user may choose not to provide various physiological data for changing graphic content or other purposes (such as health research). In yet another example, a user may choose to limit the time for sensing physiological data (e.g., only during identity verification). In addition to providing "opt-in" and "opt-out" options, the present disclosure contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then the user may be reminded again just before the personal information data is accessed by the application.

[0104] In addition, it is an object of the present disclosure that personal information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use. Risks can be minimized by limiting data collection and deleting data once it is no longer needed. In addition, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be facilitated by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than at the address level), controlling how data is stored (e.g., aggregating data between users), and / or other methods when appropriate.

[0105] Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure also contemplates that various embodiments may also be implemented without access to such personal information data. That is, various embodiments of the present technology will not fail to function properly due to the lack of all or a portion of such personal information data. For example, graphical content may be altered based on non-personal information data or an absolute minimum amount of personal information, such as content requested by a device associated with a user, other non-personal information, or publicly available information.

Claims

1. A head mounted display, comprising: A display unit, the display unit is used to display graphic content to a user; a facial interface configured to engage a facial engagement area of ​​the user's face; a sensor coupled to the facial interface and configured to generate a signal based on a facial shape feature of the user; as well as A controller is configured to identify a suitable facial interface for the user based on the facial shape feature of the user, wherein the facial shape feature of the user has a value within an acceptable range of values ​​for the suitable facial interface.

2. The head mounted display of claim 1, wherein the sensor is a force sensor and the signal corresponds to a distribution of forces around the facial engagement area.

3. The head mounted display of claim 2, wherein a plurality of sensors are distributed above and below the user's eyes.

4. The head mounted display of claim 2, wherein a plurality of sensors are distributed along a side of the user's eye.

5. The head mounted display of claim 1, wherein the value of the facial shape feature is based on a size of the face of the user.

6. The head mounted display of claim 1, wherein the value of the facial shape feature is based on relative positions of features of the face of the user.

7. The head mounted display of claim 6, wherein the features of the face of the user include eyebrows and a nose.

8. The head mounted display of claim 1, wherein the controller is configured to: comparing the facial shape features of the user with corresponding features of different facial interfaces, and A suitable facial interface is identified from the different facial interfaces.

9. The head mounted display of claim 8, wherein the different facial interface lacks the sensor.

10. A head mounted display, comprising: A display unit, the display unit is used to display graphic content to a user; a facial interface configured to engage a facial engagement area of ​​the user's face; a sensor coupled to the facial interface and configured to generate a signal indicative of a position of the facial interface relative to the face of the user; as well as A controller, the controller being configured to: evaluating the position of the facial interface relative to the face of the user based on the signal, and Based on the evaluation, feedback is provided to the user regarding the position of the facial interface relative to the face of the user.

11. The head mounted display of claim 10, wherein the display unit is configured to provide the feedback as a graphical feedback output.

12. The head mounted display of claim 10, wherein the audio output device is configured to provide the feedback as an audio feedback output.

13. The head mounted display of claim 10, wherein the haptic device is configured to provide the feedback as a haptic feedback output.

14. The head mounted display of claim 10, wherein the feedback provides instructions to the user to move the head mounted display relative to the face of the user.

15. The head mounted display of claim 10, wherein the feedback provides a negative indication to the user based on the position of the facial interface relative to the face of the user.

16. A head mounted display comprising: A display unit, the display unit is used to display graphic content to a user; a facial interface configured to engage a facial engagement area of ​​the user's face; a first sensor coupled to the facial interface and configured to generate a first signal indicative of a first physiological condition in the facial engagement region; a second sensor coupled to the facial interface and configured to generate a second signal indicative of a second physiological condition outside of the facial engagement region; as well as A controller, the controller being configured to: evaluating a position of the facial interface relative to the face of the user based on the first signal and the second signal, and Based on the evaluation, feedback is provided to the user regarding the position of the facial interface relative to the face of the user.

17. The head mounted display of claim 16, wherein the first physiological condition corresponds to a shape of the face of the user, and the second physiological condition corresponds to a position of the eyes of the user.

18. The head mounted display of claim 17, wherein the controller is configured to: evaluating contact between the face of the user and the facial interface based on the shape of the face of the user, and The positioning of the facial interface relative to the face of the user is evaluated based on the position of the user's eyes.

19. The head mounted display of claim 16, wherein the controller is configured to compare the first physiological condition to a corresponding physiological condition sensed at a previous time, wherein the facial interface was correctly positioned relative to the face of the user at the previous time.

20. The head mounted display of claim 16, wherein the first sensor comprises one or more of a force sensor, a displacement sensor, a capacitive sensor, or a bioelectric signal sensor, and the second sensor comprises a camera.

21. The head mounted display of claim 16, wherein the controller is configured to control one or more of an audio output device or a haptic device to provide the feedback to the user.

22. The head mounted display of claim 16, wherein the controller is configured to control the display unit to provide the feedback to the user as a graphical feedback output.

23. A head mounted display, comprising: A display unit, the display unit is used to display graphic content to a user; a facial interface configured to engage a facial engagement region of the user's face, the facial interface including a physiological sensor for sensing a physiological condition of the user; as well as A controller, the controller being configured to: identifying an emotional state of the user based on comparing the physiological condition to a threshold, and The graphical content displayed by the display unit is changed according to the emotional state of the user.

24. The head mounted display of claim 23, wherein the graphical content is changed to induce or maintain a heightened emotional state by displaying graphical content that moves faster than initial graphical content displayed by the display unit.

25. The head mounted display of claim 23, wherein the graphical content is changed to induce or maintain a calm emotional state by displaying graphical content that moves less rapidly than initial graphical content displayed by the display unit.

26. The head mounted display of claim 23, wherein the physiological sensor is configured to sense the physiological condition of the user within the facial engagement region.

27. The head mounted display of claim 26, further comprising an additional physiological sensor for sensing additional physiological conditions of the user outside of the facial engagement area, wherein the controller is configured to identify the emotional state of the user based on the physiological condition and the additional physiological condition.

28. The head mounted display of claim 27, wherein the additional physiological condition is a facial expression attempted by the user.

29. A head-mounted display according to claim 23, wherein the controller is configured to identify the emotional state of the user by comparing the physiological condition of the user to an upper threshold, and wherein the controller is configured to identify that the user is in an elevated emotional state when the physiological condition is above the upper threshold.

30. The head mounted display of claim 29, wherein the physiological condition of the user is a value representing brain activity of the user, muscle activity of the user, or heart rate of the user, and wherein the value is compared to the higher threshold.

31. A head-mounted display according to claim 23, wherein the controller is configured to identify the emotional state of the user by comparing the physiological condition of the user with a lower threshold, and wherein the controller is configured to identify that the user is in a calm emotional state when the physiological condition is below the lower threshold.

32. A head mounted display according to claim 31, wherein the physiological condition of the user is a value representing the user's brain activity, the user's muscle activity, or the user's heart rate, and wherein the value is compared to the lower threshold.

Images