Head-mounted display device and control method therefor, and storage medium

Abstract

Disclosed in the present application are a head-mounted display device and a control method therefor, and a storage medium. The head-mounted display device comprises a first display module and a second display module, the first display module being at least seen by a wearer, and the second display module being at least seen by a non-wearer. The control method for the head-mounted display device comprises: acquiring a display mode of the head-mounted display device; and, on the basis of the display mode, controlling the display state of the first display module and / or the second display module, the type of the display mode at least comprising: a first display mode when a user is not wearing the head-mounted display device and a second display mode when the user has worn same. In this way, on the basis of additionally providing a display outer screen (i.e., the second display module) to the head-mounted display device, controlling the display state of the first display module and / or the second display module on the basis of the acquired display mode can enrich the human-computer interaction-based display effect of head-mounted display devices, thereby improving user experience.

Description

Head-mounted display device, control method thereof and storage medium TECHNICAL FIELD

[0001] The present application relates to the field of human-computer interaction control, and particularly relates to a head-mounted display device, a control method thereof and a storage medium. BACKGROUND

[0002] In recent years, in order to improve the display effect of a display device, virtual reality (VR), augmented reality (AR) and mixed reality (MR) technologies can be introduced into the display device to improve the immersive experience of a user.

[0003] In actual applications, the display device is often a head-mounted display (HMD), that is, an optical signal is sent to the eyes of a wearer through the head-mounted display device, and different effects such as VR, AR and MR can be achieved. Since a user needs to wear the head-mounted display device to view the display screen and make related settings, the user experience is affected.

[0004] SUMMARY

[0005] Therefore, the present application provides a head-mounted display device, a control method thereof and a storage medium, which aim to improve the display effect of the head-mounted display device.

[0006] The technical scheme of the present application is implemented as follows:

[0007] In a first aspect, the present application provides a control method of a head-mounted display device, the head-mounted display device comprising a first display component and a second display component, the first display component being at least visible to a wearer, and the second display component being at least visible to a non-wearer, and the method comprising:

[0008] obtaining a display mode of the head-mounted display device;

[0009] controlling a display state of the first display component and / or the second display component based on the display mode;

[0010] wherein the type of the display mode at least comprises a first display mode when the user is not wearing and a second display mode when the user is wearing.

[0011] In the above scheme, the obtaining of the display mode of the head-mounted display device comprises:

[0012] obtaining a detection result indicating whether the head-mounted display device is worn;

[0013] determining, based on the detection result, that the head-mounted display device is not worn, determining that the display mode is the first display mode; or

[0014] determining, based on the detection result, that the head-mounted display device is worn, determining that the display mode is the second display mode.

[0015] In the above scheme, the display state of the first display component and / or the second display component is controlled based on the display mode, including:

[0016] In the first display mode, the second display component is controlled to be in a wallpaper display state or a parameter display state or a query display state or a picture transmission display state, and / or the first display component is controlled to be in an off-screen display state.

[0017] In the above scheme, the head-mounted display device supports establishing a communication connection with an aircraft, and the display state of the first display component and / or the second display component is controlled based on the display mode, including:

[0018] When the head-mounted display device is in a communication connection with the aircraft, the second display component is controlled to be in a picture transmission display state.

[0019] When the head-mounted display device is disconnected from the communication connection with the aircraft, the second display component is controlled to be in a wallpaper display state or a parameter display state or a query display state, and / or the first display component is controlled to be in an off-screen display state.

[0020] In the above scheme, the second display component is controlled to be in a picture transmission display state, including:

[0021] The second display component is controlled to display a shooting picture transmitted by the aircraft, or the second display component is controlled to display a picture of a forward direction view angle of the aircraft.

[0022] In the above scheme, the second display component is controlled to be in a wallpaper display state, including:

[0023] The second display component is controlled to display a pre-configured picture, an animated picture or a video.

[0024] In the above scheme, the second display component is controlled to be in a parameter display state, including:

[0025] The second display component is controlled to display at least one of a power, a communication state, a position, an execution mechanism state, environmental information of the head-mounted display device and / or an associated external device.

[0026] In the above scheme, the second display component is controlled to be in a query display state, including:

[0027] Control the second display component to display the stored historical image data.

[0028] In the above scheme, controlling the display state of the first display component and / or the second display component based on the display mode includes:

[0029] In the second display mode, the first display component is controlled to be in a screen-on display state, and the second display component is controlled to be in a set display state. The set display state includes one of the following: wallpaper display state, parameter display state, and associated display state of the display screen associated with the first display component.

[0030] In the above scheme, the head-mounted display device supports establishing a communication connection with the aircraft, and the method further includes:

[0031] Receive the captured images transmitted by the aircraft;

[0032] In the second display mode, the first display component is controlled to display a real-time image, which is the image corresponding to the user's current viewing angle and is a portion of the captured image. The second display component is also controlled to display an image from the perspective of the aircraft's forward direction.

[0033] In the above scheme, the first display component is in a screen-on display state, and the method further includes:

[0034] Based on human-computer interaction commands, configure the display parameters of the wallpaper display state, the parameter display state, and / or the associated display state.

[0035] In the above scheme, the first display component is in a screen-on display state, and the method further includes:

[0036] Based on human-computer interaction commands, switch the current display state of the second display component.

[0037] In the above solution, the head-mounted display device includes: a main processor, a converter, and a slave processor. The main processor is connected to the converter and the slave processor. The converter is configured to transmit the display information output by the main processor to the first display component for display after a first conversion process. The slave processor is connected to the second display component. When the second display component is in the associated display state, the method further includes:

[0038] The converter transmits the display information to the slave processor after the second conversion processing, and the slave processor drives the second display component to display a display screen synchronized with the first display component.

[0039] In the scheme, the head-mounted display device supports establishing a communication connection with the aircraft, and the method further comprises:

[0040] Based on the human-computer interaction instruction, a navigation mode for searching for the aircraft is started;

[0041] At least based on the second display component, a navigation screen corresponding to the navigation mode is displayed.

[0042] In the scheme, the head-mounted display device further comprises a control component for switching the display state, and the method further comprises:

[0043] In response to the first switching instruction input by the control component, the second display component is controlled to be synchronously displayed with the first display component.

[0044] In the scheme, the head-mounted display device further comprises an image acquisition component for acquiring an environment image, and the method further comprises:

[0045] In response to the second switching instruction input by the control component, the first display component and / or the second display component is controlled to display image information of the environment image.

[0046] In the scheme, the head-mounted display device further comprises a frame component carrying the first display component and the second display component, and a wearing component for a user to wear, the wearing component is arranged on the frame component, the first display component comprises a left light engine component and a right light engine component located inside two frames of the frame component, and the left light engine component and the right light engine component adopt an optical folding type optical path structure.

[0047] In the scheme, the head-mounted display device further comprises a display adjustment component connected to the first display component, and the method further comprises:

[0048] Based on the display adjustment component, the pupil distance and / or the refractive power of the first display component are adjusted.

[0049] In the scheme, the wearing component comprises a temple component and / or a head component which are detachably connected to the frame component.

[0050] In the scheme, the head-mounted display device further comprises:

[0051] An antenna component arranged on the frame component, the antenna component has a folded first state and an open second state.

[0052] In the scheme, the frame component is provided with a control component for switching the display state.

[0053] In the scheme, the head-mounted display device further comprises a human body detection sensor arranged on the frame assembly and configured to detect whether the head-mounted display device is worn.

[0054] In the scheme, the head-mounted display device further comprises a motion detection sensor arranged on the frame assembly and configured to detect a motion parameter of the head-mounted display device.

[0055] In a second aspect, the embodiments of the present application provide a head-mounted display device, comprising:

[0056] a housing, wherein the housing comprises a frame assembly and a wearing assembly arranged on the frame assembly;

[0057] a first display assembly, wherein the first display assembly comprises a left light engine assembly and a right light engine assembly arranged inside two frames of the frame assembly;

[0058] a second display assembly, wherein the second display assembly comprises an outer screen display arranged outside at least one of the two frames;

[0059] In the scheme, the left light engine assembly and the right light engine assembly adopt an optical folding light path structure.

[0060] In the scheme, the head-mounted display device further comprises:

[0061] a display adjustment assembly connected to the first display assembly and configured to adjust a pupil distance and / or a refractive power of the first display assembly.

[0062] In the scheme, air inlets and air outlets are arranged on the frame assembly, and the head-mounted display device further comprises:

[0063] a cooling fan arranged in the frame assembly and configured to drive air to flow into the frame assembly through the air inlets and flow out of the frame assembly through the air outlets to cool the frame assembly.

[0064] In the scheme, the wearing assembly comprises a temple assembly and / or a head assembly detachably connected to the frame assembly.

[0065] In the scheme, the temple assembly is hinged to the frame assembly through a connecting member, and / or the head assembly further comprises a tightness adjustment assembly configured to adjust a size of the head assembly.

[0066] In the scheme, the wearing assembly further comprises an unlocking component configured to unlock the temple assembly and / or the head assembly, and the unlocking component is arranged on the frame assembly or the wearing assembly.

[0067] In the scheme, the head-mounted display device further comprises:

[0068] an antenna assembly disposed on the frame assembly, the antenna assembly having a folded first state and an unfolded second state.

[0069] In the above solution, the number of the antenna assemblies is multiple, and the multiple antenna assemblies are disposed on the frame assembly in a spaced manner.

[0070] In the above solution, the frame assembly is provided with a control assembly for switching the display state.

[0071] In the above solution, the control assembly comprises:

[0072] a switching button disposed on the frame assembly; and / or,

[0073] a touchpad disposed on the frame assembly.

[0074] In the above solution, the head-mounted display device further comprises:

[0075] an image acquisition assembly disposed on the frame assembly and configured to acquire an environmental image.

[0076] In the above solution, the head-mounted display device further comprises:

[0077] a human body detection sensor disposed on the frame assembly and configured to detect whether the head-mounted display device is worn.

[0078] In the above solution, the head-mounted display device further comprises:

[0079] a motion detection sensor disposed on the frame assembly and configured to detect a motion parameter of the head-mounted display device.

[0080] In a third aspect, the embodiments of the present application provide a head-mounted display device as described in the second aspect, and the head-mounted display device further comprises a processor and a memory for storing a computer program capable of running on the processor, wherein the processor is configured to run the computer program to perform the steps of the method in the first aspect of the embodiments of the present application.

[0081] In a fourth aspect, the embodiments of the present application provide a computer storage medium, and the computer storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the method in the first aspect of the embodiments of the present application.

[0082] The technical scheme provided in the embodiments of the present application, the head-mounted display device comprises a first display component and a second display component, the first display component is at least seen by a wearer, and the second display component is at least seen by a non-wearer, and the control method of the head-mounted display device comprises the following steps: acquiring a display mode of the head-mounted display device; controlling a display state of the first display component and / or the second display component based on the display mode; wherein the type of the display mode at least comprises a first display mode when a user is not wearing and a second display mode when the user is wearing. In this way, based on the basis of adding the external display screen (i.e. the second display component) to the head-mounted display device, the display state of the first display component and / or the second display component is controlled based on the acquired display mode, the display effect of the head-mounted display device based on human-computer interaction can be enriched, and then the user experience is improved. BRIEF DESCRIPTION OF DRAWINGS

[0083] Fig. 1 is a flow diagram of the control method of the head-mounted display device according to an embodiment of the present application;

[0084] Fig. 2 is a structural schematic diagram of the head-mounted display device according to an embodiment of the present application;

[0085] Fig. 3 is a structural schematic diagram of the head-mounted display device according to another embodiment of the present application;

[0086] Fig. 4 is a structural schematic diagram of the head-mounted display device according to still another embodiment of the present application;

[0087] Fig. 5 is a structural schematic diagram of the head-mounted display device according to still another embodiment of the present application;

[0088] Fig. 6 is a structural schematic diagram of the head-mounted display device in a folded state according to an embodiment of the present application;

[0089] Fig. 7 is a structural schematic diagram of the head-mounted display device according to an application embodiment of the present application;

[0090] Fig. 8 is a structural schematic diagram of the head-mounted display device provided with a focusing ring according to an application embodiment of the present application;

[0091] Fig. 9 is a structural schematic diagram of the head-mounted display device provided with a damper according to an application embodiment of the present application;

[0092] Fig. 10 is a schematic diagram of the display control principle of the head-mounted display device according to an application embodiment of the present application;

[0093] Figs. 11A to 11D are interface schematic diagrams of the parameter display state of the second display component according to an application embodiment of the present application;

[0094] Figs. 12A to 12D are schematic diagrams of parameter setting on the wallpaper display state of the second display component according to an application embodiment of the present application;

[0095] FIG. 13A and FIG. 13B are schematic diagrams of display interfaces of a navigation screen supported by a second display assembly for searching for an aircraft according to an embodiment of the present application.

[0096] Legend of reference signs:

[0097] 100, housing; 101, frame assembly; 102, wearing assembly;

[0098] 200, first display assembly; 201, left light engine assembly; 202, right light engine assembly;

[0099] 300, outer screen display;

[0100] 1011, interpupillary distance adjustment knob; 1012, air inlet; 1013, air outlet;

[0101] 1014, switching button; 1015, front camera;

[0102] 1021, temple assembly; 1022, head-wearing assembly;

[0103] 1023, quick release button; 10221, tightness adjustment assembly;

[0104] 400, antenna assembly; 500, touchpad; 501, lamp ring.

[0105] 1, front shell assembly; 2, rear shell assembly; 3, face shield;

[0106] 4, left light engine module; 5, right light engine module; 6, loudspeaker assembly;

[0107] 7, optical support; 8, main board; 9, heat dissipation module;

[0108] 10, magnetometer small plate; 11, front screen driving small plate; 12, front camera module;

[0109] 13, front screen assembly; 14, lamp ring touch module; 15, left temple assembly;

[0110] 16, right temple assembly; 17, left front leg assembly; 18, left rotation shaft;

[0111] 19, right front leg assembly; 20, right rotation shaft; 21, focusing ring;

[0112] 22, scale dial; 23, damper. DETAILED DESCRIPTION

[0113] The present application will be further described in detail below with reference to the accompanying drawings and embodiments.

[0114] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description herein is for describing particular embodiments only and is not intended to be limiting of the application.

[0115] The embodiments of the present application provide a control method of a head-mounted display device, the head-mounted display device comprising a housing, a first display assembly and a second display assembly, wherein the first display assembly and the second display assembly are arranged on the housing, the first display assembly is at least visible to a wearer, and the second display assembly is at least visible to the wearer. Exemplarily, the first display assembly is located on a first surface of an inner side of the housing, and the second display assembly is located on a second surface of an outer side of the housing.

[0116] It should be noted that the head-mounted display device can be a display device supporting AR, VR or MR technology, wherein the AR technology is to simulate and imitate entity information of a physical world by using computer image technology, i.e., to change the real world into a virtual world; the VR technology is to produce a virtual object that does not exist in the physical world by means of computer graphics technology and visualization technology, and to accurately "place" the virtual object in the physical world, i.e., to change the virtual world into a part of the real world; and the MR technology is to establish an interactive relationship between the virtual world and the real world, i.e., to form a mixed world of virtual and real interaction. The head-mounted display device has the first display assembly for inner screen display and the second display assembly for outer screen display, in other words, the first display assembly is used for a user wearing the head-mounted display device to view, and the second display assembly is used for other users not wearing the head-mounted display device to view.

[0117] As shown in FIG. 1, the control method comprises:

[0118] Step 101: acquiring a display mode of the head-mounted display device.

[0119] Step 102: controlling a display state of the first display assembly and / or the second display assembly based on the display mode; wherein a type of the display mode at least comprises a first display mode when a user does not wear and a second display mode when the user wears.

[0120] It can be understood that the method of the embodiments of the present application can be based on the obtained display mode to control the display state of the first display component and / or the second display component on the basis of adding a display outer screen (i.e., the second display component) to the head-mounted display device, so as to enrich the display effect of the head-mounted display device based on human-computer interaction, and further improve the user experience. For example, the user can display the basic parameters of the head-mounted display device, the positioning information of the associated device, and the like based on the second display component in the case where the head-mounted display device is not worn, so as to meet the user's convenient query demand and improve the user experience.

[0121] Exemplarily, the display mode of the head-mounted display device is obtained by:

[0122] obtaining a detection result indicating whether the head-mounted display device is worn;

[0123] determining that the display mode is the first display mode based on the detection result that the head-mounted display device is not worn, or determining that the display mode is the second display mode based on the detection result that the head-mounted display device is worn.

[0124] Exemplarily, the head-mounted display device can obtain the detection result of whether the head-mounted display device is worn based on a sensor, which can be a contact sensor (for example, a detection sensor based on elastic triggering) or a non-contact sensor (for example, an optical sensor or an electromagnetic sensor), and the embodiments of the present application do not limit this. If the head-mounted display device is worn by the user, a first detection signal can be generated by the sensor to indicate this, and if the head-mounted display device is not worn by the user, a second detection signal can be generated by the sensor to indicate this. In this way, the head-mounted display device can automatically obtain the detection result, and automatically determine the display mode to be the first display mode or the second display mode based on the detection result, so as to realize automatic switching control of the display mode.

[0125] Exemplarily, the display state of the first display component and / or the second display component is controlled based on the display mode, including:

[0126] In the first display mode, the second display component is controlled to be in a wallpaper display state or a parameter display state or a query display state or a video transmission display state, and / or the first display component is controlled to be in an off-screen display state.

[0127] Here, the head-mounted display device can determine that in the first display mode, the first display component can be controlled to be in the screen-off display state, thereby effectively reducing the power consumption of the first display component; and the second display component can be controlled to be in the wallpaper display state or the parameter display state or the query display state or the image transmission display state. In this way, the wallpaper display or the parameter display or the query display or the image transmission display of the second display component enriches the display effect of the head-mounted display device in the non-wearing scenario.

[0128] In an application example, the head-mounted display device supports and establishes a communication connection with an aircraft, and the display state of the first display component and / or the second display component is controlled based on the display mode, including:

[0129] When the head-mounted display device is in a communication connection with the aircraft, the second display component is controlled to be in the image transmission display state.

[0130] When the head-mounted display device is disconnected from the communication connection with the aircraft, the second display component is controlled to be in the wallpaper display state or the parameter display state or the query display state, and / or the first display component is controlled to be in the screen-off display state.

[0131] It can be understood that the head-mounted display device can also switch the display state of the first display component and / or the second display component based on the communication connection state with the aircraft. For example, when the head-mounted display device is in a communication connection with the aircraft, the second display component is controlled to be in the image transmission display state, so that a non-wearer can see the picture collected by the aircraft through the second display component, which can enhance the experience of the non-wearer. The first display component can be in the screen-off display state or the display state of displaying the picture collected by the aircraft in real time, which is not limited in the embodiments of the present application. When the head-mounted display device is disconnected from the communication connection with the aircraft, the second display component can be controlled to be in the wallpaper display state, the parameter display state or the query display state, and the first display component can be controlled to be in the screen-off display state. In this way, the display energy consumption of the first display component can be reduced, the personalized display of the second display component and / or the personalized query requirement can be met, and the user experience can be enhanced.

[0132] Exemplarily, the second display component is controlled to be in the image transmission display state, including:

[0133] The second display component is controlled to display the shooting picture transmitted by the aircraft, or the second display component is controlled to display the picture of the forward direction view angle of the aircraft.

[0134] It should be noted that, whether the head-mounted display device is worn or not, the head-mounted display device can control the second display component to be in the picture transmission display state when it is detected that the head-mounted display device is in communication connection with the aircraft, that is, the head-mounted display device can control the second display component to display the shooting picture transmitted by the aircraft or control the second display component to display the picture of the forward direction view angle of the aircraft, so that the non-wearer can check the shooting picture transmitted by the aircraft or the picture of the forward direction view angle of the aircraft based on the second display component (i.e., the external screen) in real time, thereby enriching the viewing experience of the head-mounted display device in the non-wearing scenario.

[0135] Exemplarily, the control of the second display component to be in the wallpaper display state comprises:

[0136] The second display component is controlled to display a pre-configured picture, animation or video.

[0137] Here, when the head-mounted display device controls the second display component to be in the wallpaper display state, the second display component can be controlled to display a pre-configured picture, animation or video, so that personalized wallpaper display of the external screen of the head-mounted display device in the non-wearing scenario can be realized.

[0138] Exemplarily, the control of the second display component to be in the parameter display state comprises:

[0139] The second display component is controlled to display at least one of the power, communication state, position, actuator state and environmental information of the head-mounted display device and / or associated external device.

[0140] Here, when the head-mounted display device controls the second display component to be in the parameter display state, the second display component can be controlled to display at least one of the power, communication state, position, actuator state and environmental information of the head-mounted display device and / or associated external device, so that personalized parameter display of the external screen of the head-mounted display device in the non-wearing scenario can be realized. The associated external device can include, but is not limited to, a control terminal, a remote controller, a controlled terminal (e.g., a drone), etc. The power is used to indicate the power state of the energy storage device on the device, the communication state is used to indicate the normal state of the communication interface of the device, the position is used to indicate the current position of the device, the actuator state is used to indicate the current state of the actuator on the device, and the environmental information is used to indicate the attribute information of the external environment, for example, the flight height limit of the current environment. In this way, the user can quickly obtain relevant parameter information without the condition of wearing the head-mounted display device, thereby improving the user experience. For example, the pilot can quickly check the parameter information of the aircraft, the flight glasses, the remote controller, etc. without wearing the flight glasses.

[0141] Exemplarily, the control of the second display component in the query display state comprises:

[0142] The second display component is controlled to display the stored historical image data.

[0143] Here, in the scenario where the head-mounted display device is not worn, the non-wearing user can control the second display component to display the historical image data stored by the head-mounted display device based on the human-computer interaction operation, for example, the historical shooting pictures or shooting videos can be quickly viewed, thereby enriching the viewing experience of the user in the non-wearing scenario.

[0144] Exemplarily, the control of the display state of the first display component and / or the second display component based on the display mode comprises:

[0145] In the second display mode, the first display component is controlled to be in the screen-on display state, and the second display component is controlled to be in a set display state, the set display state comprising one of the following: a wallpaper display state, a parameter display state, and a display state associated with the display picture of the first display component.

[0146] It can be understood that if the head-mounted display device is determined to be in the second display mode, the first display component is controlled to be in the screen-on display state, thereby providing the corresponding display picture for the user, and the second display component is controlled to be in a set display state, the set display state comprising one of the following: a wallpaper display state, a parameter display state, and an associated display state associated with the display picture of the first display component. In this way, the display effect of the head-mounted display device can be enriched based on the cooperation of the first display component and the second display component. The associated display state associated with the display picture of the first display component comprises: an associated display state of the same view angle picture as the first display component and an associated display state of a different view angle picture as the first display component.

[0147] Exemplarily, the head-mounted display device supports the establishment of a communication connection with the aircraft, and the method further comprises:

[0148] The shooting picture transmitted by the aircraft is received;

[0149] In the second display mode, the first display component is controlled to display a real-time picture, the real-time picture being a picture corresponding to the current viewing angle of the user, the real-time picture being a part of the shooting picture, and the second display component is controlled to display a picture of the forward direction viewing angle of the aircraft.

[0150] It can be understood that when the head-mounted display device is in a communication connection state with the aircraft, in the second display mode, the first display component can be controlled to display a picture corresponding to a wearer-selected view angle, and the second display component displays a picture of a view angle in a forward direction of the aircraft. In this way, the wearer (i.e., the pilot) can view the picture taken by the aircraft in real time based on the first display component, and at the same time, the coach or instructor (i.e., a user other than the wearer) can provide real-time guidance to the pilot based on the picture of the view angle in the forward direction of the aircraft displayed by the second display component, thereby improving the safety of the pilot's operation and obtaining professional operation guidance suggestions.

[0151] Exemplarily, the first display component is in a screen-on display state, and the method further includes:

[0152] Based on the human-computer interaction instruction, the display parameters of the wallpaper display state, the parameter display state, and / or the association display state are configured.

[0153] Here, after the user wears the head-mounted display device, the relevant display parameters of the second display component can be configured based on the human-computer interaction instruction when the first display component is in a screen-on display state, that is, the display parameters of the second display component in the wallpaper display state, the parameter display state, and / or the association display state can be configured. In this way, the personalized configuration of the second display component (i.e., the display outer screen) can be achieved.

[0154] It should be noted that the human-computer interaction instruction includes but is not limited to a key-based input instruction, a remote control output instruction, and a body sense detection (e.g., head movement, eye movement, etc.) generated instruction, which is not limited in the embodiments of the present application.

[0155] Exemplarily, the first display component is in a screen-on display state, and the method further includes:

[0156] Based on the human-computer interaction instruction, the current display state of the second display component is switched.

[0157] Here, after the user wears the head-mounted display device, the current display state of the second display component can be dynamically switched based on the human-computer interaction instruction when the first display component is in a screen-on display state. For example, based on the demand, the second display component can be switched to a synchronous display state to realize outer screen sharing of the inner screen display picture, thereby facilitating other users in addition to the wearer to view the inner screen display picture.

[0158] Exemplarily, the head-mounted display device comprises a main processor, a converter and a slave processor, the main processor is connected with the converter and the slave processor, the converter is configured to deliver display information output by the main processor to the first display component for display after first conversion processing, the slave processor is connected with the second display component, and when the second display component is in the associated display state, the method further comprises:

[0159] the converter delivers the display information to the slave processor for the second display component to display a display picture synchronized with the first display component after second conversion processing.

[0160] Here, the display information output by the main processor can be delivered to the first display component by the converter for display by the first display component facing a user wearing the head-mounted display device; in addition, the display information is delivered to the slave processor by the converter for the second display component to display facing other users after second conversion processing, thereby realizing synchronized display of the first display component and the second display component.

[0161] Exemplarily, the head-mounted display device supports establishing a communication connection with an aircraft, and the method further comprises:

[0162] starting a navigation mode for searching for the aircraft based on a human-computer interaction instruction;

[0163] displaying a navigation picture corresponding to the navigation mode based on at least the second display component.

[0164] In an application example, a user can search for an aircraft based on a head-mounted display device, for example, in a scenario where the head-mounted display device is not worn, a navigation mode can be started by a control terminal, a remote controller, a key or the like, and a navigation picture corresponding to the navigation mode is displayed by the second display component, thereby facilitating the user to quickly search for the aircraft. In addition, in a scenario where the user wears the head-mounted display device, the navigation picture can be displayed by the first display component and the second display component synchronously based on a human-computer interaction instruction, thereby improving the convenience of searching for the aircraft.

[0165] Exemplarily, the head-mounted display device further comprises a control component for switching a display state, and the method further comprises:

[0166] in response to a first switching instruction input by the control component, controlling the second display component to display a picture synchronously with the first display component.

[0167] It can be understood that, based on the control component arranged on the housing of the head-mounted display device, the user switches the display state based on the control component, for example, inputs a first switching instruction based on the control component, controls the first display component and the second display component of the head-mounted display device to synchronously display the picture, and thus realizes the user to share the inner screen picture on the outer screen as needed.

[0168] Exemplarily, the head-mounted display device further comprises an image acquisition component for acquiring an environmental image, and the method further comprises:

[0169] In response to a second switching instruction input by the control component, the first display component and / or the second display component displays image information of the environmental image.

[0170] Here, the housing of the head-mounted display device can also be provided with an image acquisition component, for example, a camera, which can acquire image information in front of the user, and the user can input a second switching instruction based on the control component, so that the first display component and / or the second display component displays the image information, so that the user can know the external environment state based on at least the image information displayed by the first display component when wearing the head-mounted display device, and facilitate the user to move substantially when wearing the head-mounted display device.

[0171] Exemplarily, the head-mounted display device further comprises a frame component carrying the first display component and the second display component, and a wearing component for a user to wear, the wearing component is arranged on the frame component, the first display component comprises a left light engine component and a right light engine component located inside two frames of the frame component, and the left light engine component and the right light engine component adopt an optical folding type optical path structure.

[0172] In the embodiment of the application, by arranging the left light engine component and the right light engine component inside the frame component, and adopting the optical folding type optical path structure for the left light engine component and the right light engine component, the total length of the optical system for inner screen display in the head-mounted display device, i.e. the TTL (Total Track Length, lens total length) thickness, can be effectively reduced, which is beneficial to realize the compact design of the head-mounted display device and reduce the overall volume of the device.

[0173] Exemplarily, the head-mounted display device further comprises a display adjustment component connected to the first display component, and the method further comprises:

[0174] Adjusting the interpupillary distance and / or the diopter of the first display component based on the display adjustment component.

[0175] Here, in order to be compatible with different user groups, the head-mounted display device can also adjust the interpupillary distance and / or the diopter of the first display assembly based on a display adjustment assembly. Exemplarily, the display adjustment assembly supports interpupillary distance adjustment and diopter adjustment, wherein the interpupillary distance range is 58-72 mm, and the diopter adjustment range is -7D~+3D, which can cover user groups from teenagers to the elderly.

[0176] Exemplarily, the wearing assembly includes a temple assembly and / or a head assembly that are detachably connected with the frame assembly.

[0177] It can be understood that the user can fix the head-mounted display device on the head based on the temple assembly, or fix the head-mounted display device on the head based on the head assembly, and based on the detachable connection, the user can switch according to personal preferences.

[0178] Exemplarily, the head-mounted display device further includes:

[0179] An antenna assembly is arranged on the frame assembly, and the antenna assembly has a folded first state and an unfolded second state.

[0180] Here, in order to facilitate the carrying and use of the head-mounted display device, the antenna assembly has a folded first state and an unfolded second state. When the head-mounted display device needs to be used, the antenna assembly can be unfolded, and then a wireless communication connection between the head-mounted display device and an external associated device is established. When the head-mounted display device does not need to be worn, the antenna assembly can be folded, so that the head-mounted display device occupies a small space and is convenient to carry.

[0181] Exemplarily, a control assembly for switching the display state is arranged on the frame assembly.

[0182] Here, the user can switch the display state of the head-mounted display device based on the control assembly, and the control assembly can include a switching button and / or a touchpad arranged on the frame assembly.

[0183] Exemplarily, the head-mounted display device further includes a human body detection sensor arranged on the frame assembly and configured to detect whether the head-mounted display device is worn. In this way, the head-mounted display device can detect whether it is worn based on the human body detection sensor, and then automatically determine the display mode of the head-mounted display device. The human body detection sensor can be a contact sensor or a non-contact sensor, and the embodiments of the present application do not limit the same.

[0184] Exemplarily, the head-mounted display device further includes a motion detection sensor arranged on the frame assembly and configured to detect a motion parameter of the head-mounted display device.

[0185] Here, the motion detection sensor can detect a motion parameter of the head-mounted display device, for example, the motion parameter can be a human motion parameter collected based on a gyroscope, and then a human-computer interaction instruction for human-computer interaction is generated based on the motion parameter.

[0186] In an example embodiment, the head-mounted display device further includes a housing 100, a first display assembly 200, and a second display assembly. The housing 100 includes a frame assembly 101 and a wearing assembly 102 for a user to wear, and the wearing assembly 102 is arranged on the frame assembly 101. The first display assembly 200 includes a left light engine assembly 201 and a right light engine assembly 202 arranged inside two temples of the frame assembly 101. The second display assembly includes an external screen display arranged outside at least one of the two temples. The left light engine assembly 201 and the right light engine assembly 202 adopt an optical folding light path structure.

[0187] In the embodiment, the second display assembly is arranged outside the frame assembly 101, which can enrich the display effect of the head-mounted display device. In addition, the left light engine assembly and the right light engine assembly are arranged inside the frame assembly, and the left light engine assembly and the right light engine assembly both adopt the optical folding light path structure, which can effectively reduce the total length of the optical system of the internal screen display in the head-mounted display device, i.e., the TTL (Total Track Length) thickness, and is conducive to realizing the compact design of the head-mounted display device and reducing the overall volume of the device.

[0188] In an example, the left light engine assembly 201 and the right light engine assembly 202 can adopt a Pancake (ultra-short focus optical folding light path) structure. The Pancake optical scheme can significantly shorten the straight-line distance from the screen to the eye while ensuring virtual image magnification, thereby reducing the volume of the light engine part. This design not only greatly reduces the thickness of the VR glasses, but also effectively reduces the structural cost. Specifically, the Pancake optical scheme can further shorten the thickness of the light engine through multiple return light paths. For example, the Pancake light engine module can not only bring higher definition, smaller distortion, and chromatic aberration, but also further shorten the thickness after multiple returns. In this way, the Pancake scheme can provide a good overall viewing experience and realize the lightweight design of the head-mounted display device.

[0189] As shown in FIG. 3, the second display assembly can include an external screen display arranged outside at least one of the two temples, for example, the external screen display 300 arranged outside the right temple as shown in FIG. 3.

[0190] Exemplarily, the head-mounted display device further comprises a display adjustment assembly connected to the first display assembly, configured to adjust the interpupillary distance and / or the diopter of the first display assembly.

[0191] As shown in FIG. 3, the mirror frame assembly 101 is provided with an interpupillary distance adjustment knob 1011, based on which a user can adjust the interpupillary distance between the left light engine assembly and the right light engine assembly. Exemplarily, the interpupillary distance range can be 58-72 mm to meet the interpupillary distance requirements of different people.

[0192] Exemplarily, as shown in FIG. 3, the mirror frame assembly 101 is provided with an air inlet 1012 and an air outlet 1013, and the head-mounted display device further comprises a cooling fan located in the mirror frame assembly, configured to drive air flow into the mirror frame assembly through the air inlet 1012 and out of the mirror frame assembly through the air outlet 1013 to cool the inside of the mirror frame assembly.

[0193] Exemplarily, as shown in FIG. 4, the wearing assembly 102 comprises a mirror leg assembly 1021 and / or a head-wearing assembly 1022 detachably connected to the mirror frame assembly 101.

[0194] Exemplarily, the mirror leg assembly 1021 is hinged to the mirror frame assembly 101 via a connecting piece, and / or the head-wearing assembly 1022 further comprises a tightness adjustment assembly 10221 configured to adjust the size.

[0195] It can be understood that a user can fix the head-mounted display device to both ears via the mirror leg assembly 1021 to achieve wearing, or a user can fix the head-mounted display device to the head via the head-wearing assembly 1022 to achieve wearing. The mirror leg assembly 1021 can be hinged to the mirror frame assembly 101 to facilitate adjustment of the angle of the mirror leg assembly 101 and to achieve folding of the mirror leg assembly 1021 (as shown in FIG. 6). The head-wearing assembly 1022 can adjust the size via the tightness adjustment assembly 10221 to meet the wearing requirements of different users.

[0196] Exemplarily, the wearing assembly further comprises an unlocking component configured to unlock the mirror leg assembly and / or the head-wearing assembly, the unlocking component being arranged on the mirror frame assembly or the wearing assembly.

[0197] Exemplarily, as shown in FIG. 2, the wearing assembly 102 is provided with a quick release button 1023 for unlocking. When the switching operation is needed, the quick release button 1023 can be pressed to unlock the connection between the frame assembly 101 and the leg assembly 1021, and then the head assembly 1022 can be connected to the frame assembly 101, so as to realize the switching operation of the leg assembly 1021 and the head assembly 1022. Similarly, based on the quick release button 1023, the connection between the head assembly 1022 and the frame assembly 101 can also be unlocked, so as to facilitate the subsequent switching of the leg assembly 1021, and then the switching based on the user demand is realized, so as to meet the changing demand of the wearing mode of the user.

[0198] Exemplarily, as shown in FIGS. 2 to 4, the head-mounted display device further comprises an antenna assembly 400 arranged on the frame assembly 101, and the antenna assembly 400 has a folded first state and an opened second state.

[0199] Here, the antenna assembly 400 can receive and send signals based on a wireless manner, and when the head-mounted display device is working, the antenna assembly 400 is opened to facilitate the receiving and sending of signals.

[0200] Exemplarily, the number of the antenna assemblies 400 is multiple, and the multiple antenna assemblies 400 are arranged on the frame assembly 101 in a spaced manner. As shown in FIG. 3, four antenna assemblies 400 are arranged at four top corners of the frame assembly 101, and FIG. 5 shows a schematic view in which the four antenna assemblies 400 are all in the opened second state. When the head-mounted display device is not working, the antenna assembly 400 can be in the folded first state, as shown in FIG. 3.

[0201] It should be noted that by arranging multiple antenna assemblies 400, one or more of them can be selected to be opened to enhance the communication capability of the head-mounted display device. For example, the antenna assembly 400 with the maximum signal strength can be selected to be opened, which is beneficial to enhancing the wireless communication capability of the head-mounted display device.

[0202] Exemplarily, the frame assembly is provided with a control assembly for switching the display state.

[0203] As shown in FIG. 2, the control assembly comprises a switching button 1014 arranged on the frame assembly 101, and the user can input an interaction instruction based on the switching button 1014 to switch the display state of the head-mounted display device.

[0204] Exemplarily, the control assembly can further comprise a touchpad arranged on the frame assembly.

[0205] Exemplarily, the left side of the frame in FIG. 3 is provided with a touchpad 500, and a light ring 501 for interactive display can also be provided on the left side of the frame, which can serve as an interactive indication to a user outside the wearer. In this way, in a scenario where the user is not wearing the device, input operations can be performed based on the touchpad 500, and the light ring 501 can display signals of the input operations, thereby realizing switching of the display state, for example, controlling the display state of the second display component.

[0206] Exemplarily, the head-mounted display device further includes an image acquisition component disposed on the frame component, configured to acquire an environmental image.

[0207] As shown in FIG. 3, the image acquisition component is a front camera 1015 that can be disposed on the frame component. The front camera 1015 can acquire image information in front of the user. The user can input a second switching instruction based on the control component, so that the first display component and / or the second display component displays the image information, thereby facilitating the user to know the external environment state based on the image information displayed by the first display component when wearing the head-mounted display device, and facilitating the user to move substantially when wearing the head-mounted display device.

[0208] Exemplarily, the head-mounted display device further includes a human body detection sensor disposed on the frame component, configured to detect whether the head-mounted display device is worn. In this way, the head-mounted display device can automatically determine the display mode of the head-mounted display device based on whether the human body detection sensor is worn. The human body detection sensor can be a contact sensor or a non-contact sensor, which is not limited in the embodiments of the present application.

[0209] Exemplarily, the head-mounted display device further includes a motion detection sensor disposed on the frame component, configured to detect a motion parameter of the head-mounted display device. The motion detection sensor can detect a motion parameter of the head-mounted display device, for example, a motion parameter of human motion based on a gyroscope, and generate a human-computer interaction instruction for human-computer interaction based on the motion parameter.

[0210] Exemplarily, in the embodiments, the head-mounted display device of the embodiments of the present application further includes a processor and a memory for storing a computer program capable of running on the processor, wherein the processor is configured to execute the computer program to perform the control method of the embodiments of the present application, thereby enriching the display effect of the head-mounted display device based on human-computer interaction and improving the user experience.

[0211] Exemplarily, the processor can be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), Field Programmable Gate Arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors (Microprocessors), or other electronic elements, for executing the foregoing methods.

[0212] It can be understood that the memory can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a ferromagnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM). The magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example but not limitation, many forms of RAM can be used, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), sync link dynamic random access memory (SLDRAM), and direct rambus random access memory (DRRAM).The memory described in the embodiments of the present application is intended to include, but not limited to, these and any other suitable types of memory.

[0213] In the example embodiments, the embodiments of the present application further provide a computer storage medium, which can be specifically a computer readable storage medium, for example, a memory including a computer program stored therein, the computer program being executable by a processor of a head-mounted display device to complete the steps described in the method of the embodiments of the present application. The computer readable storage medium can be a ROM, a PROM, an EPROM, an EEPROM, a Flash Memory, a magnetic surface memory, an optical disc, or a CD-ROM memory, etc.

[0214] In the example embodiments, the embodiments of the present application further provide a computer program product including a computer program, the computer program being executable by a processor of a head-mounted display device to complete the steps described in the method of the embodiments of the present application.

[0215] It should be noted that "first", "second", etc. are used to distinguish similar objects, and do not necessarily describe a specific order or sequence.

[0216] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0217] The head-mounted display device and the control method thereof according to the embodiments of the present application will be described below in conjunction with application examples.

[0218] Fig. 7 shows an exploded structural schematic diagram of the head-mounted display device of the present application. As shown in Fig. 7, the head-mounted display device comprises a front shell assembly 1, a rear shell assembly 2, and a face shield 3. The front shell assembly 1 and the rear shell assembly 2 are assembled to form a frame assembly, and the area between the front shell assembly 1 and the rear shell assembly 2 forms a containing space. The face shield 3 is embedded on the rear shell assembly 2, which is in contact with the user's face when worn, reducing the pressure on the face and improving comfort. The containing space can be provided with a left light engine module 4 (i.e. the aforementioned left light engine assembly 201), a right light engine module 5 (i.e. the aforementioned right light engine assembly 202), a speaker assembly 6, an optical support 7, a mainboard 8, a heat dissipation module 9, a magnetometer small plate 10, a front screen driving small plate 11, and a front camera module 12. The mainboard 8 serves as the master control of the head-mounted display device, the speaker assembly 6 serves as the voice output assembly, the optical support 7 is used to fix the related optical devices, the heat dissipation module 9 is used to pass the airflow entering through the air inlet, and the heat generated by the internal heating related devices is blown out through the air outlet through air cooling, so as to repeat the process, so that the internal temperature of the head-mounted display device is stable, and the influence on the related devices is avoided. The magnetometer small plate 10 can be used as a human body detection sensor to detect whether the head-mounted display device is worn. The front screen driving small plate 11 can drive the second display assembly for the outer screen display to work, and the front camera module 12 can collect the image of the external environment, so that the user wearing can see the external image based on the first display assembly, which is convenient for the user wearing to move greatly.

[0219] Exemplarily, a front screen assembly 13 serving as a second display assembly is arranged on one side of the frame of the front shell assembly 1, which can work in a wallpaper display state, a parameter display state, or a synchronous display state synchronizing with the display screen of the first display assembly. A lamp ring touch module 14 (corresponding to the aforementioned touchpad 500 and lamp ring 501) can be arranged on one side of the frame of the front shell assembly 1, which can be used as a human-computer interaction input unit to facilitate the user to input human-computer interaction instructions, and then adjust the display state of the first display assembly and / or the second display assembly.

[0220] The wearing assembly of the head-mounted display device adopts the structure of a temple assembly, which comprises a left temple assembly 15 and a right temple assembly 16. The left temple assembly 15 is installed on the frame assembly through a left front leg assembly 17 and a left rotating shaft 18, and the right temple assembly 16 is installed on the frame assembly through a right front leg assembly 19 and a right rotating shaft 20. In addition, four foldable and unfoldable antenna assemblies 400 are arranged on the frame assembly.

[0221] When the user wears the head-mounted display device, the content is viewed through the optical engine, at this time, if you want to share the scene at that time to others, you can click the switch button to switch the content to the outer screen, so as to realize three screen display at the same time, that is, through the left optical engine module 4 and the right optical engine module 5 located inside the frame assembly and the front screen assembly 13 located outside the frame assembly to display synchronously.

[0222] Exemplarily, as shown in FIG. 8, a focusing ring 21 for diopter adjustment can also be arranged on the frame assembly, the focusing ring 21 can have a scale dial 22, and the diopter adjustment can be made based on the focusing ring 21.

[0223] Exemplarily, as shown in FIG. 9, a damper 23 can be arranged on the frame assembly, the damper 23 can cooperate with the pupil distance adjustment knob to hold the stepless pupil distance adjustment and the left and right optical engine adjustment, and the adjustment control at any position can be realized.

[0224] In an application embodiment, as shown in FIG. 10, the head-mounted display device includes a main processor, a slave processor and a converter, wherein the main processor can output a BT1120 video signal to the converter, the converter can be an FPGA, the FPGA converts the BT1120 video signal into a Mipi video signal and outputs the Mipi video signal to a first display screen (corresponding to the left optical engine assembly) and a second display screen (corresponding to the right optical engine assembly) of the inner screen of the glasses; in addition, the FPGA also copies the input signal, and outputs a BT656 video signal to the slave processor after scaling, cropping, format conversion and other transformations, and the slave processor drives the third display screen (corresponding to the front screen assembly) of the front screen of the glasses to display, so that the effect of three screen display at the same time of the inner and outer screens can be realized.

[0225] Next, the head-mounted display device is taken as the flight glasses to exemplarily illustrate the control method of the application embodiment.

[0226] In the application embodiment, since the front screen assembly for external display is additionally arranged on the flight glasses, the display function can be additionally arranged based on the front screen assembly when the flight glasses are in an unworn state.

[0227] In an application example, the flight glasses determine that the display mode is the first display mode if it is determined based on the human body detection sensor that the flight glasses are not worn, in the first display mode, the first display assembly is controlled to be in an off-screen display state, and the second display assembly is controlled to be in a wallpaper display state or a parameter display state.

[0228] Exemplarily, FIG. 11A shows a schematic diagram of an interface in a parameter display state, which can display parameters of the aerial vehicle, for example, lost coordinates and time of disconnection. FIG. 11B shows a schematic diagram of an interface in another parameter display state, which can display information such as aerial vehicle power, flight glasses power, motion remote control power, flight height limit, etc. FIG. 11C shows a schematic diagram of an interface in still another parameter display state, which can display fault information of gimbal jamming in addition to the information displayed in FIG. 11B. FIG. 11D shows a schematic diagram of an interface in yet another parameter display state, which can display environmental attribute information such as whether the aerial vehicle is in a flight restricted area in addition to the information such as aerial vehicle power, flight glasses power, motion remote control power, flight height limit, etc.

[0229] Exemplarily, FIGS. 12A-12D show schematic diagrams of parameter setting in a wallpaper display state of the second display component. For example, when the first display component is in a bright screen display state, the user can configure display parameters of the wallpaper display state based on human-computer interaction instructions. For example, the user can select the outer screen in the setting interface and select outer screen DIY in the option corresponding to the outer screen, enter the outer screen DIY menu, and then select any one of setting picture, setting animation, and setting video, thereby realizing pre-configuration of pictures, animations, or videos in the wallpaper display state, and achieving personalized display effect of the outer screen DIY.

[0230] Exemplarily, the outer screen also supports display function of a navigation picture for searching the aerial vehicle. For example, after the user starts the navigation mode for searching the aerial vehicle based on human-computer interaction instructions, the navigation picture corresponding to the navigation mode can be displayed on the outer screen (i.e., the front screen component). The navigation picture can be the interface shown in FIG. 13A or FIG. 13B. In this way, the user can quickly search for the aerial vehicle that is disconnected or has a fault without wearing the flight glasses, thereby greatly improving the convenience of the user.

[0231] The above merely provides a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical range disclosed in the present application, which shall be covered in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A control method of a head-mounted display device, the head-mounted display device comprising a first display component and a second display component, the first display component being at least visible to a wearer, and the second display component being at least visible to a non-wearer, the method comprising: obtaining a display mode of the head-mounted display device; controlling a display state of the first display component and / or the second display component based on the display mode; wherein a type of the display mode comprises at least a first display mode when the user is not wearing and a second display mode when the user is wearing. The obtaining of the display mode of the head-mounted display device comprises: obtaining a detection result indicating whether the head-mounted display device is being worn; determining that the display mode is the first display mode based on the detection result indicating that the head-mounted display device is not being worn; or determining that the display mode is the second display mode based on the detection result indicating that the head-mounted display device is being worn. The controlling of the display state of the first display component and / or the second display component based on the display mode comprises: in the first display mode, controlling the second display component to be in a wallpaper display state or a parameter display state or a query display state or a video transmission display state, and / or controlling the first display component to be in an off-screen display state. The head-mounted display device supports a communication connection with an aircraft, and the controlling of the display state of the first display component and / or the second display component based on the display mode comprises: when the head-mounted display device is in the communication connection with the aircraft, controlling the second display component to be in the video transmission display state; and when the head-mounted display device is disconnected from the communication connection with the aircraft, controlling the second display component to be in the wallpaper display state or the parameter display state or the query display state, and / or controlling the first display component to be in the off-screen display state.

2. The method of claim 1, wherein, The controlling of the second display component to be in the video transmission display state comprises: controlling the second display component to display a captured image transmitted by the aircraft, or controlling the second display component to display an image of a forward direction of view of the aircraft. The controlling of the second display component to be in the wallpaper display state comprises: controlling the second display component to display a pre-configured picture, an animated picture, or a video. The controlling of the second display component to be in the parameter display state comprises: controlling the second display component to display at least one of a power level, a communication state, a position, an execution mechanism state, and environmental information of the head-mounted display device and / or an associated external device. The controlling of the second display component to be in the query display state comprises: controlling the second display component to display stored historical image data.

3. The method of claim 1, wherein, The controlling of the display state of the first display component and / or the second display component based on the display mode comprises: ​ 4. The method of claim 3, wherein, ​ ​ ​ 5. The method of claim 4, wherein, ​ ​ 6. The method of claim 3, wherein, ​ ​ 7. The method of claim 3, wherein, ​ ​ 8. The method of claim 3, wherein, ​ ​ 9. The method of claim 1, wherein, ​ In the second display mode, the first display component is controlled to be in a screen-on display state, and the second display component is controlled to be in a set display state, the set display state including one of a wallpaper display state, a parameter display state, and an associated display state associated with a display screen of the first display component.

10. The method of claim 1, wherein, The head-mounted display device supports a communication connection with an aircraft, and the method further includes: receiving a captured image transmitted by the aircraft; in the second display mode, controlling the first display component to display a real-time image, the real-time image being an image corresponding to a current viewing angle of a user, the real-time image being a partial image of the captured image, and controlling the second display component to display an image of a forward direction viewing angle of the aircraft.

11. The method of claim 9, wherein, The first display component is in a screen-on display state, and the method further includes: configuring display parameters of the wallpaper display state, the parameter display state, and / or the associated display state based on a human-computer interaction instruction.

12. The method of claim 9, wherein, The first display component is in a screen-on display state, and the method further includes: switching a current display state of the second display component based on a human-computer interaction instruction.

13. The method of claim 9, wherein, The head-mounted display device includes a main processor, a converter, and a slave processor, the main processor being connected to the converter and the slave processor, the converter being configured to transmit display information output by the main processor to the first display component for display after first conversion processing, the slave processor being connected to the second display component, and when the second display component is in the associated display state, the method further includes: the converter transmits display information to the slave processor for display after second conversion processing, and the slave processor drives the second display component to display a display image synchronized with the first display component.

14. The method of claim 1, wherein, The head-mounted display device supports a communication connection with an aircraft, and the method further includes: starting a navigation mode for searching for the aircraft based on a human-computer interaction instruction; displaying a navigation image corresponding to the navigation mode based at least on the second display component.

15. The method of claim 1, wherein, The head-mounted display device further includes a control component for switching display states, and the method further includes: in response to a first switching instruction input by the control component, controlling the second display component to display synchronously with the first display component.

16. The method of claim 14, wherein, The head-mounted display device further includes an image acquisition component for acquiring an environment image, and the method further includes: in response to a second switching instruction input by the control component, controlling the first display component and / or the second display component to display image information of the environment image.

17. The method of claim 1, wherein, The head-mounted display device further includes a frame component carrying the first display component and the second display component, and a wearing component for a user to wear, the wearing component being arranged on the frame component, the first display component including a left light engine component and a right light engine component arranged inside two frames of the frame component, and the left light engine component and the right light engine component adopting an optical folding type optical path structure.

18. The method of claim 17, the head-mounted display device further comprising: a display adjustment component connected to the first display component, and the method further includes: adjusting a pupil distance and / or a refractive power of the first display component based on the display adjustment component.

19. The method of claim 17, wherein, The wearing assembly comprises a temple assembly and / or a headgear assembly which are detachably connected with the frame assembly.

20. The method of claim 17, wherein, The head-mounted display device further comprises: An antenna assembly arranged on the frame assembly, the antenna assembly having a folded first state and an unfolded second state.

21. The method of claim 17, wherein, A control assembly arranged on the frame assembly for switching the display state.

22. The method of claim 17, wherein, The head-mounted display device further comprises:

23. The method of claim 17, wherein, A human body detection sensor arranged on the frame assembly for detecting whether the head-mounted display device is worn. The head-mounted display device further comprises: A motion detection sensor arranged on the frame assembly for detecting motion parameters of the head-mounted display device.

24. A head-mounted display device, comprising: A housing comprising a frame assembly and a wearing assembly arranged on the frame assembly; A first display assembly comprising a left light engine assembly and a right light engine assembly arranged inside two frames of the frame assembly; 25. The head-mounted display device of claim 24, wherein, A second display assembly comprising an external screen display arranged outside at least one of the two frames; The left light engine assembly and the right light engine assembly adopt an optical folded light path structure.

26. The head-mounted display device of claim 24, wherein, The head-mounted display device further comprises: A display adjustment assembly connected with the first display assembly for adjusting the interpupillary distance and / or the refractive power of the first display assembly.

27. The head-mounted display device of claim 24, wherein, The frame assembly is provided with an air inlet and an air outlet, and the head-mounted display device further comprises: A cooling fan arranged in the frame assembly for driving air flow into the frame assembly through the air inlet and out of the frame assembly through the air outlet to cool the inside of the frame assembly. The wearing assembly comprises a temple assembly and / or a headgear assembly which are detachably connected with the frame assembly.

29. The head-mounted display device of claim 27, wherein, 28. The head-mounted display device according to claim 27, wherein 30. The head-mounted display device of claim 24, wherein, The temple assembly is hinged to the frame assembly via a connecting piece, and / or the headgear assembly further comprises a tightness adjustment assembly for adjusting the size. The wearing assembly further comprises an unlocking component for unlocking the temple assembly and / or the headgear assembly, the unlocking component being arranged on the frame assembly or the wearing assembly.

31. The head-mounted display device of claim 30, wherein, The head-mounted display device further comprises:

32. The head-mounted display device of claim 24, wherein, An antenna assembly arranged on the frame assembly, the antenna assembly having a folded first state and an unfolded second state.

33. The head-mounted display device of claim 32, wherein, The number of the antenna assemblies is multiple, and the multiple antenna assemblies are arranged on the frame assembly at intervals. The frame assembly is provided with a control assembly for switching the display state. The control assembly comprises: A switching button arranged on the frame assembly; and / or 34. The head-mounted display device of claim 24, wherein, A touchpad arranged on the frame assembly; and / or A light ring arranged on the frame assembly.

35. The head-mounted display device of claim 24, wherein, The head-mounted display device further comprises: An image acquisition assembly arranged on the frame assembly for acquiring environmental images.

36. The head-mounted display device of claim 24, wherein, The head-mounted display device further comprises: A human body detection sensor arranged on the frame assembly for detecting whether the head-mounted display device is worn. The head-mounted display device further comprises: A motion detection sensor arranged on the frame assembly for detecting motion parameters of the head-mounted display 37. A head-mounted display device as in any of claims 24-36, wherein, The head-mounted display device further comprises a processor and a memory for storing a computer program executable on the processor, wherein The processor is configured to execute the computer program to implement the steps of the method according to any one of claims 1 to 16.

38. A computer storage medium having stored thereon a computer program, wherein, The computer program, when executed by the processor, implements the steps of the method according to any one of claims 1 to 16.

Images