Control method of head-mounted display device, head-mounted display device and storage medium

Abstract

The invention discloses a control method of head-mounted display equipment, the head-mounted display equipment and a storage medium. The method comprises the following steps: acquiring physical sign parameters of a user detected by the head-mounted display device; determining emotion information of the user according to the physical sign parameters; and when the emotion information includes that the user has the negative emotion, controlling the head-mounted display device to operate so as to relax the emotion of the user. The invention aims to reduce the negative emotion of the user in the process of using the head-mounted display device.

Description

Technical Field

[0001] The present invention relates to the technical field of head-mounted display devices, and in particular to a control method for a head-mounted display device, a head-mounted display device and a storage medium. Background Art

[0002] Head-mounted display devices (such as virtual reality devices, etc.) are currently widely used in different scenarios to provide users with an immersive experience. However, when users watch videos with head-mounted display devices that contain scenes such as disasters, violence, and terror, it is easy to have a strong negative impact on users and cause negative emotions in users. Summary of the invention

[0003] The main purpose of the present invention is to provide a control method for a head-mounted display device, a head-mounted display device and a storage medium, aiming to reduce the negative emotions of a user when using the head-mounted display device.

[0004] To achieve the above object, the present invention provides a method for controlling a head mounted display device, the method comprising the following steps:

[0005] Obtain the physical sign parameters of the user detected by the head mounted display device;

[0006] Determining the emotion information of the user according to the physical sign parameters;

[0007] When the emotion information includes that the user has negative emotions, the head mounted display device is controlled to operate to relax the user's emotions.

[0008] Optionally, when the emotion information includes that the user has negative emotions, the step of controlling the head mounted display device to operate to relax the user's emotions includes:

[0009] When the emotion information includes that the user has negative emotions, the head mounted display device is controlled to operate according to the severity of the negative emotions of the user.

[0010] Optionally, the step of controlling the operation of the head mounted display device according to the severity level of the user's negative emotion includes:

[0011] When the severity level is the first level, controlling the head mounted display device to output prompt information on a display interface;

[0012] When the severity level is the second level, controlling the head mounted display device to play sound information with a relaxing function;

[0013] When the severity level is the third level, controlling the head mounted display device to display image information having a relaxation function;

[0014] The third level is heavier than the second level, and the second level is heavier than the first level.

[0015] Optionally, the step of obtaining the physical sign parameters of the user detected by the head mounted display device includes:

[0016] Acquire a first vital sign parameter detected by a first detection module on the head mounted display device, and acquire a second vital sign parameter detected by a second detection module on the head mounted display device;

[0017] The physical sign parameters include the first physical sign parameter and the second physical sign parameter, the first detection module corresponds to the ear setting of the user, and the second detection module corresponds to the forehead setting of the user.

[0018] Optionally, the first vital sign parameter includes blood oxygen, and the step of obtaining the first vital sign parameter detected by the first detection module on the head mounted display device includes:

[0019] Controlling the first detection module to emit red light and infrared light alternately toward a first preset area of ​​the ear;

[0020] Acquire a first electrical signal corresponding to the red light and a second electrical signal corresponding to the infrared light detected by the first detection module;

[0021] The blood oxygen is determined according to a ratio of the first electrical signal to the second electrical signal.

[0022] Optionally, the first vital sign parameter includes a heart rate, and the step of obtaining the first vital sign parameter detected by a first detection module on the head mounted display device includes:

[0023] Controlling the first detection module to emit infrared light toward a second preset area of ​​the ear;

[0024] Acquire a third electrical signal corresponding to the infrared light detected by the first detection module;

[0025] The heart rate is determined according to the AC signal in the third electrical signal.

[0026] Optionally, the second vital sign parameter includes body temperature, and the step of obtaining the second vital sign parameter detected by the second detection module on the head mounted display device includes:

[0027] Obtaining a divided voltage of a thermistor in the second detection module;

[0028] The body temperature is determined based on the partial pressure.

[0029] Optionally, the step of obtaining the divided voltage of the thermistor in the second detection module includes:

[0030] Obtaining a power supply voltage of the thermistor and a resistance value of the thermistor;

[0031] A voltage division calculated according to the power supply voltage and the resistance value;

[0032] The power supply voltage is obtained by actually measuring the output voltage of the DC regulated power supply of the thermistor during a single board test of the second detection module before it leaves the factory.

[0033] In addition, in order to achieve the above-mentioned purpose, the present application also proposes a head-mounted display device, the head-mounted display device comprising:

[0034] Vital sign detection module;

[0035] A control device, wherein the vital sign detection module is connected to the control device, and the control device comprises: a memory, a processor, and a control program for a head-mounted display device stored in the memory and executable on the processor, wherein the control program for the head-mounted display device implements the steps of the control method for the head-mounted display device as described in any one of the above items when executed by the processor.

[0036] In addition, in order to achieve the above-mentioned purpose, the present application also proposes a storage medium, on which a control program of a head-mounted display device is stored. When the control program of the head-mounted display device is executed by a processor, the steps of the control method of the head-mounted display device as described in any of the above items are implemented.

[0037] The present invention proposes a control method for a head-mounted display device. The method determines the user's emotional information based on the head-mounted display device detecting the user's vital sign parameters. When it is determined that the user has negative emotions based on the emotional information, the head-mounted display device is operated and regulated to relax the user's emotions, thereby reducing the user's negative emotions during the use of the head-mounted display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 A schematic diagram of the hardware structure involved in the operation of a head mounted display device according to an embodiment of the present invention;

[0039] Figure 2 A schematic diagram of a flow chart of an embodiment of a method for controlling a head mounted display device of the present invention;

[0040] Figure 3 A schematic diagram of a flow chart of another embodiment of a method for controlling a head mounted display device of the present invention;

[0041] Figure 4 A flowchart of another embodiment of a method for controlling a head mounted display device according to the present invention;

[0042] Figure 5Schematic diagram of the circuit structure of the second detection module involved in the control method of the head mounted display device of the present invention.

[0043] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0044] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0045] An embodiment of the present invention provides a head mounted display device. In this embodiment, the head mounted display device is a virtual reality device. In other embodiments, the head mounted display device is also an enhanced display device.

[0046] In the embodiment of the present invention, refer to Figure 1 The head mounted display device includes a control device 100, a vital sign detection module 200 and a display device 300. Both the vital sign detection module 200 and the display device 300 are connected to the control device 100.

[0047] The display device 300 is a device for displaying images, where the images may include virtual reality images or augmented reality images, etc.

[0048] The vital sign detection module 200 is used to detect the vital sign parameters of the user wearing the head mounted display device, such as blood oxygen and / or heart rate and / or body temperature. The vital sign detection module 200 may include a submodule and more than one submodule respectively arranged at different positions on the head mounted display device. The vital sign detection module 200 can detect the vital sign parameters by contacting with the user's skin and / or by being spaced from the user's skin and realizing the vital sign parameter detection based on signal transmission and reception.

[0049] In this embodiment, the vital sign detection module 200 includes a first detection module and a second detection module. The first detection module is set corresponding to the user's ear, and the second detection module is set corresponding to the user's head. Both the first detection module and the second detection module are connected to the control device 100.

[0050] In this embodiment, the first detection module is used to detect parameters such as the user's blood oxygen and / or heart rate, and the second detection module is used to detect parameters such as the user's body temperature. In this embodiment, the first detection module is an infrared sensor, and the second detection module is a thermal sensor. In other embodiments, the first detection module and the second detection module may both be infrared sensors.

[0051] In the embodiment of the present invention, refer to Figure 1The control device 100 includes: a processor 1001, such as a CPU, a memory 1002, and a timer 1003. Among them, these components are connected and communicated through a communication bus. The memory 1002 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1002 can also be a storage device independent of the aforementioned processor 1001.

[0052] Those skilled in the art will understand that Figure 1 The device structure shown in the figure does not constitute a limitation of the device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0053] like Figure 1 As shown, the memory 1002 as a computer storage medium may include a control program for the head mounted display device.

[0054] exist Figure 1 In the device shown, the processor 1001 can be used to call the control program of the head-mounted display device stored in the memory 1002, and execute the relevant steps of the control method of the head-mounted display device in the following embodiments.

[0055] An embodiment of the present invention further provides a control method for a head mounted display device, which is applied to the above head mounted display device.

[0056] Reference Figure 2 , an embodiment of a control method of a head mounted display device of the present application is proposed. In this embodiment, the control method of the head mounted display device includes:

[0057] Step S10, obtaining the physical sign parameters of the user detected by the head mounted display device;

[0058] The user here is the person currently wearing the head mounted display device.

[0059] The physical sign parameters are specifically characteristic parameters of the physiological activity state of the human body that can be used to characterize the user's emotions. The physical sign parameters include one or more parameters such as heart rate, blood oxygen, body temperature, blood flow, and pulse.

[0060] The vital sign parameters are specifically detected by a vital sign detection module on the head mounted display device in a contact and / or non-contact manner with the user.

[0061] When the head mounted display device is in the display state, step S10 may be performed. Alternatively, when the head mounted display device is in the display state, image data currently displayed by the head mounted display device may be identified, and when the image data includes preset image features that may cause negative emotions in the user, step S10 may be performed.

[0062] Step S20, determining the user's emotional information according to the physical sign parameters;

[0063] The emotion information includes the emotion type and / or whether negative emotions exist and / or the severity of negative emotions.

[0064] Different physical sign parameters correspond to different emotional information. Based on this, a correspondence between physical sign parameters and emotional information can be established in advance. The correspondence can include a mapping relationship, a calculation formula or a machine learning model, and the emotional information corresponding to the current physical sign parameter can be determined based on the correspondence.

[0065] In one implementation, a pre-set mapping table representing the correspondence between the physical sign parameters and the emotional information may be queried through the physical sign parameters, and the emotional information may be determined based on the result obtained by table lookup and matching.

[0066] In another implementation, different emotional information is represented by different characteristic values, and a relationship between the physical sign parameters and the characteristic values ​​is preset. The characteristic values ​​are calculated based on the current characteristic parameters being substituted into the relationship, and the emotional information corresponding to the characteristic values ​​is used as the emotional information of the current user.

[0067] In another implementation, a large amount of emotional state information and corresponding user emotions of users in the process of using the head-mounted display device can be collected in advance as data samples, and a preset machine learning model can be trained according to the data samples, and the trained preset machine learning model can be used as a prediction model. The characteristic parameters currently detected are input into the prediction model, and the result output by the prediction model is used as the user's emotional information.

[0068] Step S30: When the emotion information includes that the user has negative emotions, control the head mounted display device to operate to relax the user's emotions.

[0069] The head-mounted display device can relax the user's emotions in at least one of the following ways: outputting sound information with a relaxing function, stopping playing the current picture, displaying a picture with a relaxing function, outputting prompt information on the current display interface, performing operations to massage the user's head, etc.

[0070] A control method for a head-mounted display device is proposed in an embodiment of the present invention. The method determines the user's emotional information based on the head-mounted display device detecting the user's physical sign parameters. When it is determined that the user has negative emotions based on the emotional information, the head-mounted display device is operated and regulated to relax the user's emotions, thereby reducing the user's negative emotions during the use of the head-mounted display device.

[0071] Further, based on the above embodiment, another embodiment of the control method of the head mounted display device of the present application is proposed. In this embodiment, referring to Figure 3, the step S30 comprises:

[0072] Step S31: When the emotion information includes that the user has negative emotions, the head mounted display device is controlled to operate according to the severity of the user's negative emotions.

[0073] Different severity levels of negative emotions correspond to different head-mounted display devices' operating operations for relaxing the user's emotions. The heavier the severity level, the more severe the corresponding operating operation. The types of negative emotions and / or the types of videos currently played by the head-mounted display device may have different corresponding relationships between the severity level and the operating operation of the head-mounted display device. Based on this, the emotion information may also include the type of negative emotion. The target corresponding relationship between the severity level and the operating operation may be obtained according to the type of negative emotion, and the operating operation of the head-mounted display device corresponding to the current severity level may be determined based on the target corresponding relationship.

[0074] Negative emotions are divided into at least two severity levels in advance according to their severity, for example, 2, 3, 4 or more levels. Preset operating operations of different head-mounted devices are set for each severity level according to the intensity required for emotional relaxation. Based on this, the preset operating operation corresponding to the current severity level is used as the target operating operation of the current head-mounted display device, and the head-mounted display device is controlled to execute the target operating operation.

[0075] In this embodiment, when the severity level is the first level, the head mounted display device is controlled to output prompt information on the display interface; when the severity level is the second level, the head mounted display device is controlled to play sound information with a relaxation function; when the severity level is the third level, the head mounted display device is controlled to display image information with a relaxation function. The third level is heavier than the second level, and the second level is heavier than the first level.

[0076] When the severity level of negative emotions is the first level, when the head mounted display device outputs the prompt information on the display interface, the display interface maintains playing the current image data. In this embodiment, the prompt information output by the display interface may be information for suggesting a rest, such as "it is recommended that the user take a proper rest". In other embodiments, the prompt information output by the display interface may also be information that prompts the user to be in a negative emotional state, and so on.

[0077] When the severity level of negative emotions is the second level, the head-mounted display device can play pre-set fixed sound information (such as soothing music, etc.), or it can play sound information determined according to the actual operation of the head-mounted display device. For example, the target sound information with relaxation function can be determined based on the type of image data currently displayed by the head-mounted display device and / or the type of sound currently played, and the head-mounted display device can be controlled to play the target sound information.

[0078] When the severity level of negative emotions is the third level, the head mounted display device pauses displaying the current image data and displays video data with a relaxation function, where the video data may be pre-set fixed video data (e.g., natural scenery video, etc.), or may be video data determined according to the actual operation of the head mounted display device, for example, the video data with a relaxation function may be determined according to the type of image data currently displayed by the head mounted display device and / or the scene type of the current environment, and the head mounted display device may be controlled to output the target video data. In this embodiment, the image information includes video data or a single frame image.

[0079] When the severity level of the negative emotion is the third level, the head mounted display device can be controlled to display image information with a relaxing function and the head mounted display device can be controlled to play sound information with a relaxing function.

[0080] In this embodiment, different operating operations are used to relax the user's emotions according to the different severity levels of the current negative emotions of the head mounted display device, thereby further ensuring that the user's negative emotions are effectively reduced.

[0081] Further, based on any of the above embodiments, another embodiment of the control method of the head mounted display device of the present application is proposed. In this embodiment, referring to Figure 4 , the step S10 comprises:

[0082] Step S11, obtaining a first vital sign parameter detected by a first detection module on the head mounted display device, and obtaining a second vital sign parameter detected by a second detection module on the head mounted display device;

[0083] The physical sign parameters include the first physical sign parameter and the second physical sign parameter, the first detection module corresponds to the ear setting of the user, and the second detection module corresponds to the forehead setting of the user.

[0084] The first vital sign parameter includes blood oxygen and / or heart rate and / or blood flow and / or pulse, etc. The second vital sign parameter includes body temperature, etc. In this embodiment, the first vital sign parameter includes blood oxygen and heart rate, and the second vital sign parameter includes body temperature. Combining blood oxygen, heart rate and body temperature to determine the user's emotional information is conducive to improving the accuracy of the emotional information.

[0085] In this embodiment, the first detection module is an infrared sensor that uses photoplethysmography (PPG) technology to detect human physiological parameters. The second detection module is a thermistor temperature sensor.

[0086] The first detection module is specifically arranged on a first wearing part of the head mounted display device that matches with the ear of the user, and the second detection module is specifically arranged on a second wearing part of the head mounted display device that matches with the forehead of the user.

[0087] In this embodiment, the first detection module detects the first vital sign parameter in a non-contact manner, and the second detection module detects the second vital sign parameter in a contact manner. In other embodiments, the first detection module may also detect the first vital sign parameter in a contact manner, and the second detection module may also detect the second vital sign parameter in a non-contact manner.

[0088] In this embodiment, since the human carotid artery blood flow system runs vertically along the ear canal area, and there is also a capillary system passing through the antitragus and the earlobe, the first detection module can accurately detect the physical sign parameters related to the human emotion. In addition, the blood vessels in the forehead of the human body are evenly distributed, the blood circulation is vigorous, and the subcutaneous tissue is thin, so it is easy to obtain accurate physical sign parameters. Therefore, the physical sign parameters representing the user's emotions are detected by the first detection module of the ear and the second detection module of the forehead, which is conducive to improving the accuracy of the emotional information obtained subsequently, and can further improve the accuracy of the operation control of the head-mounted display device, thereby further reducing the negative emotions of the user during the use of the head-mounted display device.

[0089] Furthermore, in the present embodiment, the first vital sign parameter includes blood oxygen, and the step of obtaining the first vital sign parameter detected by the first detection module on the head mounted display device includes: controlling the first detection module to alternately emit red light and infrared light toward a first preset area of ​​the ear; obtaining a first electrical signal corresponding to the red light and a second electrical signal corresponding to the infrared light detected by the first detection module; and determining the blood oxygen based on the ratio of the first electrical signal to the second electrical signal.

[0090] Blood oxygen refers specifically to the oxygen content dissolved in the blood, mainly including oxyhemoglobin (HbO2) and deoxyhemoglobin (Hb). Since HbO2 and Hb absorb light of different wavelengths to different degrees, HbO2 has a higher absorption coefficient for infrared light with a wavelength of 800-1000nm, while Hb has a higher absorption coefficient for red light with a wavelength of 600-800nm. Therefore, red light (wavelength 600-800nm) and infrared light (wavelength 800-1000nm) can be used to detect the PPG signals of HbO2 and Hb respectively, and then the corresponding ratio is obtained according to the preset rules to obtain the blood oxygen value.

[0091] Among them, red light and infrared light are emitted toward the same position, and the first detection module includes a first light source for emitting infrared light, a second light source for emitting red light, and a photosensitive diode. The first light source and the second light source can be controlled to alternately illuminate the first preset area by time-division multiplexing. The photosensitive diode in the first detection module receives the light reflected from the first preset area and converts it into an electrical signal, and generates a voltage proportional to the intensity of the received light through an amplifier. The light signal reflected from the red light forms a first voltage, and the light signal emitted from the infrared light forms a second voltage. The ratio of the two spectra absorbed by the blood vessels is calculated based on the first voltage and the second voltage, and the blood oxygen can be obtained by looking up the ratio table.

[0092] In this embodiment, the above method is helpful to accurately measure the user's blood oxygen, thereby improving the accuracy of emotional information and effectively reducing the user's negative emotions when using the head-mounted display device.

[0093] Furthermore, in the present embodiment, the first vital sign parameter includes heart rate, and the step of obtaining the first vital sign parameter detected by the first detection module on the head mounted display device includes: controlling the first detection module to emit infrared light toward a second preset area of ​​the ear; obtaining a third electrical signal corresponding to the infrared light detected by the first detection module; and determining the heart rate based on the AC signal in the third electrical signal.

[0094] The second preset area is an area on the ear that includes an artery. Here, the second preset area and the first preset area are two different areas that are spaced apart.

[0095] The working principle of the first detection module for detecting heart rate is that when infrared light passes through skin tissue and is reflected back to the photosensor in the first detection module, the light intensity is attenuated to a certain extent. The absorption of light by muscles, bones, veins and other tissues is basically stable, while the blood in the arteries is flowing and the absorption of light is variable. Therefore, the first detection module can convert changes in blood flow into changes in light intensity, and finally output a changing third electrical signal.

[0096] The first detection module measures the intensity of reflected light through a photodiode. Based on the principle that the absorption of light by arteries changes while the absorption of light by other tissues remains basically unchanged, the light intensity reflected back from the arteries in the second preset area is converted into an AC signal by the photodiode in the first detection module, while the light intensity reflected back from other tissues in the second preset area is converted into a DC signal. The fundamental frequency of the AC component in the waveform changes with the heart rate and is superimposed on the DC baseline. By extracting the AC signal, the heart rate monitoring data can be obtained.

[0097] In this embodiment, the first detection module uses infrared light to detect the heart rate signal corresponding to the ear, which has better penetration depth and higher signal-to-noise ratio. In addition, the ear moves less during human movement. The heart rate obtained based on this detection can be more stable and accurate, effectively improving the accuracy of the determined emotional information, thereby further reducing the user's negative emotions during the use of the head-mounted display device.

[0098] Furthermore, in this embodiment, the second vital sign parameter includes body temperature, and the step of obtaining the second vital sign parameter detected by the second detection module on the head mounted display device includes: obtaining the partial pressure of the thermistor in the second detection module; and determining the body temperature based on the partial pressure.

[0099] The resistance of the thermistor changes with temperature, and the voltage divider of the thermistor changes with the resistance. Specifically, the higher the temperature, the smaller the resistance of the thermistor; conversely, the lower the temperature, the larger the thermistor structure.

[0100] The voltage division of the thermistor can be directly detected or calculated by a preset algorithm model. After obtaining the voltage division of the thermistor, based on the pre-established correspondence between the voltage division and the temperature, the temperature corresponding to the current voltage division is determined as the current body temperature of the user. The supply voltage here can be a preset fixed value or a parameter value actually detected.

[0101] In this embodiment, the temperature change of the forehead will cause the voltage division of the thermistor to change sensitively. Determining the user's body temperature based on the voltage division of the thermistor is beneficial to improving the accuracy of emotional information, so as to further reduce the user's negative emotions when using the head-mounted display device.

[0102] Furthermore, the step of obtaining the voltage division of the thermistor in the second detection module includes: obtaining the power supply voltage and the resistance value of the thermistor; and calculating the voltage division based on the power supply voltage and the resistance value; wherein the power supply voltage is obtained by measuring the output voltage of the DC regulated power supply of the thermistor during the single board test of the second detection module before leaving the factory.

[0103] Specifically, a quantitative relationship between the power supply voltage, resistance value and voltage division is established based on the circuit connection relationship in the circuit where the thermistor in the second detection module is located, and the voltage division can be obtained by power supply voltage and tissue calculation based on the quantitative relationship.

[0104] In this embodiment, if Figure 5As shown, the second detection module includes a first resistor R1, a second resistor R2 and a thermistor Rt. The second resistor R2 is connected in parallel with the thermistor Rt and then connected in series with the first resistor R1. The power supply corresponding to the second detection module is an LDO type DC regulated power supply. The corresponding relationship between the power supply constant voltage and the divided voltage of the thermistor Rt can be established according to the output voltage of the DC regulated power supply, the connection relationship between the first resistor R1, the second resistor R2 and the thermistor Rt, for example, Vtemp=Vntc×(1+Rt×R2 / (R1×(Rt+R2))), wherein Vtemp is the divided voltage of the thermistor and Vntc is the power supply voltage.

[0105] After the second detection module completes the patch, a single board electrical signal test needs to be performed. During the test, the voltage value of the DC regulated power supply powered by the thermistor is detected as the power supply voltage here.

[0106] When the thermistor is powered by a DC regulated power supply, the output voltage has a fluctuation range, especially the LDO type DC regulated power supply, which will cause deviations in temperature detection. In this embodiment, the actual output voltage of the DC regulated power supply is detected by a single-board electrical signal test before the product leaves the factory to construct a voltage division calculation model, thereby effectively reducing the detection error introduced by the output voltage fluctuation of the DC regulated power supply, which is beneficial to improving the accuracy of body temperature detection, thereby further reducing the user's negative emotions during the use of the head-mounted display device.

[0107] In addition, an embodiment of the present invention further provides a storage medium, on which a control program for a head-mounted display device is stored. When the control program for the head-mounted display device is executed by a processor, the relevant steps of any embodiment of the control method for the head-mounted display device are implemented.

[0108] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0109] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0110] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, including a number of instructions for a terminal device (which can be a mobile phone, computer, server, head-mounted display device, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0111] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for controlling a head mounted display device, characterized in that: The control method of the head mounted display device comprises the following steps: Obtain the physical sign parameters of the user detected by the head mounted display device; Determining the emotion information of the user according to the physical sign parameters; When the emotion information includes that the user has negative emotions, the head mounted display device is controlled to operate to relax the user's emotions.

2. The control method of the head mounted display device according to claim 1, characterized in that: When the emotion information includes that the user has negative emotions, the step of controlling the head mounted display device to operate to relax the user's emotions comprises: When the emotion information includes that the user has negative emotions, the head mounted display device is controlled to operate according to the severity of the negative emotions of the user.

3. The control method of the head mounted display device according to claim 2, characterized in that: The step of controlling the operation of the head mounted display device according to the severity of the user's negative emotions comprises: When the severity level is the first level, controlling the head mounted display device to output prompt information on a display interface; When the severity level is the second level, controlling the head mounted display device to play sound information with a relaxing function; When the severity level is the third level, controlling the head mounted display device to display image information having a relaxation function; The third level is heavier than the second level, and the second level is heavier than the first level.

4. The control method of a head mounted display device according to any one of claims 1 to 3, characterized in that: The step of obtaining the physical sign parameters of the user detected by the head mounted display device comprises: Acquire a first vital sign parameter detected by a first detection module on the head mounted display device, and acquire a second vital sign parameter detected by a second detection module on the head mounted display device; The physical sign parameters include the first physical sign parameter and the second physical sign parameter, the first detection module corresponds to the ear setting of the user, and the second detection module corresponds to the forehead setting of the user.

5. The control method of the head mounted display device according to claim 4, characterized in that: The first vital sign parameter includes blood oxygen, and the step of obtaining the first vital sign parameter detected by the first detection module on the head mounted display device includes: Controlling the first detection module to emit red light and infrared light alternately toward a first preset area of ​​the ear; Acquire a first electrical signal corresponding to the red light and a second electrical signal corresponding to the infrared light detected by the first detection module; The blood oxygen is determined according to a ratio of the first electrical signal to the second electrical signal.

6. The control method of the head mounted display device according to claim 4, characterized in that: The first vital sign parameter includes heart rate, and the step of obtaining the first vital sign parameter detected by the first detection module on the head mounted display device includes: Controlling the first detection module to emit infrared light toward a second preset area of ​​the ear; Acquire a third electrical signal corresponding to the infrared light detected by the first detection module; The heart rate is determined according to the AC signal in the third electrical signal.

7. The control method of the head mounted display device according to claim 4, characterized in that: The second vital sign parameter includes body temperature, and the step of obtaining the second vital sign parameter detected by the second detection module on the head mounted display device includes: Obtaining a divided voltage of a thermistor in the second detection module; The body temperature is determined based on the partial pressure.

8. The method for controlling a head mounted display device according to claim 7, wherein: The step of obtaining the divided voltage of the thermistor in the second detection module comprises: Obtaining a power supply voltage of the thermistor and a resistance value of the thermistor; A voltage division calculated according to the power supply voltage and the resistance value; The power supply voltage is obtained by actually measuring the output voltage of the DC regulated power supply of the thermistor during a single board test of the second detection module before it leaves the factory.

9. A head mounted display device, characterized in that: The head mounted display device comprises: Vital sign detection module; A control device, wherein the vital sign detection module is connected to the control device, and the control device comprises: a memory, a processor, and a control program for a head-mounted display device stored in the memory and executable on the processor, wherein the control program for the head-mounted display device implements the steps of a method for controlling a head-mounted display device as described in any one of claims 1 to 8 when executed by the processor.

10. A storage medium, characterized in that: The storage medium stores a control program for a head-mounted display device, and when the control program for the head-mounted display device is executed by a processor, the steps of the method for controlling a head-mounted display device according to any one of claims 1 to 8 are implemented.

Images