Display mode switching method and device, near-to-eye display equipment and storage medium

Abstract

The invention provides a display mode switching method and device, near-to-eye display equipment and a computer readable storage medium. The method comprises the following steps: firstly, acquiring a gesture in a screen projection display area of near-eye display equipment; if the gesture is the preset gesture, acquiring a change trend of the gesture; according to the change trend of the gesture, the near-to-eye display device is controlled to complete switching of display modes, and the display modes comprise an AR display mode and a VR display mode. According to the method, a user does not need to quit the current application program and does not need to spend time in searching a mode switching entrance, switching between display modes such as AR and VR can be conveniently and rapidly achieved, and the user experience degree is improved.

Description

Technical Field

[0001] The present application relates to the technical field of near-eye display devices, and in particular to a display mode switching method, device, near-eye display device and computer-readable storage medium. Background Art

[0002] Near-eye display devices generally include AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, AR helmets, etc. Among them, AR glasses are functional glasses that combine virtuality and reality, providing more help and convenience for people in life and work. For example, wearing AR glasses can be used for AR map navigation, AR security inspection, AR training, etc. VR glasses are functional glasses that integrate simulation technology, multimedia technology, sensor technology and other technologies to put people in a virtual world. They bring people different experiences in watching movies, games, virtual shopping and other aspects.

[0003] At present, when switching between AR and VR display modes on near-eye display devices, users often need to exit the current application first, and then find the mode switching entrance to complete the display mode switching. Obviously, this switching method is complicated and inconvenient to operate. At the same time, if the switching entrance is relatively hidden, users still need to spend a certain amount of time to find the switching entrance, which greatly reduces the user experience. Summary of the invention

[0004] The present application provides a display mode switching method, apparatus, near-eye display device and computer-readable storage medium, which can conveniently and quickly realize switching between display modes such as AR and VR.

[0005] To achieve the above-mentioned purpose, the present application provides a display mode switching method, which includes: obtaining a gesture in the projection display area of ​​a near-eye display device; if the gesture is a preset gesture, obtaining the changing trend of the gesture; and according to the changing trend of the gesture, controlling the near-eye display device to complete the switching of the display mode, wherein the display mode includes an AR display mode and a VR display mode.

[0006] Optionally, before acquiring the gesture within the projection display area of ​​the near-eye display device, the method further includes: acquiring a mode switching trigger signal generated by a mode switching operation; and executing the step of acquiring the gesture within the projection display area of ​​the near-eye display device according to the mode switching trigger signal.

[0007] Optionally, the preset gesture includes an opening and closing gesture formed by fingers; and controlling the near-eye display device to complete the switching of the display mode according to the changing trend of the gesture includes: if the changing trend of the opening and closing gesture is a first changing trend, controlling the near-eye display device to switch from the AR display mode to the VR display mode; if the changing trend of the opening and closing gesture is a second changing trend, controlling the near-eye display device to switch from the VR display mode to the AR display mode; wherein the first changing trend includes one of a zoom-in trend and a zoom-out trend, and the second changing trend includes the other of the zoom-in trend and the zoom-out trend.

[0008] Optionally, the first change trend is the magnification trend, and if the change trend of the opening and closing gesture is the first change trend, controlling the near-eye display device to switch from the AR display mode to the VR display mode, including: enlarging the VR display area according to the magnification trend of the opening and closing gesture; and if the inter-finger distance between the ends of the thumb and index finger in the opening and closing gesture is greater than a first preset threshold, or the proportion of the VR display area in the projection display area is greater than a second preset threshold, then displaying the VR picture in full screen to complete the switch from the AR display mode to the VR display mode.

[0009] Optionally, the second change trend is the shrinking trend, and if the change trend of the opening and closing gesture is the second change trend, controlling the near-eye display device to switch from the VR display mode to the AR display mode includes: shrinking the VR display area according to the shrinking trend of the opening and closing gesture, and increasing the AR display area, wherein the AR display area is the area within the projection display area except the VR display area; and if the inter-finger distance between the ends of the thumb and index finger in the opening and closing gesture is less than a third preset threshold, or the proportion of the VR display area to the projection display area is less than a fourth preset threshold, displaying the AR picture in full screen to complete the switching from the VR display mode to the AR display mode.

[0010] Optionally, the display mode also includes a coexistence display mode of AR and VR; controlling the near-eye display device to complete the switching of the display mode according to the changing trend of the gesture includes: adjusting the screen-occupying ratio of the AR display area and the VR display area according to the changing trend of the gesture; and in the process of adjusting the screen-occupying ratio of the AR display area and the VR display area, if a mode switching stop signal is detected, simultaneously displaying the AR image and the VR image in the projection display area to complete the switching from the VR display mode or the AR display mode to the coexistence display mode.

[0011] Optionally, the display mode also includes a normal glasses mode, and the preset gesture also includes a pointing gesture; controlling the near-eye display device to complete the switching of the display mode according to the changing trend of the gesture includes: determining whether the changing trend of the pointing gesture matches a preset graphic; and if the changing trend of the pointing gesture matches the preset graphic, controlling the near-eye display device to close the AR screen and / or the VR screen to switch to the normal glasses mode.

[0012] To achieve the above-mentioned purpose, the present application also provides a display mode switching device for a near-eye display device, wherein the display mode switching device includes: an acquisition module, used to obtain gestures within the projection display area of ​​the near-eye display device; a trend acquisition module, used to obtain the changing trend of the gesture if the gesture is a preset gesture; and a switching module, used to control the near-eye display device to complete the switching of the display mode according to the changing trend of the gesture, wherein the display mode includes an AR display mode and a VR display mode.

[0013] In addition, to achieve the above-mentioned purpose, the present application also provides a near-eye display device, which includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and implement the steps of any one of the display mode switching methods provided in the embodiments of the present application when executing the computer program.

[0014] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor implements the steps of the display mode switching method provided in any one of the embodiments of the present application.

[0015] The embodiments of the present application disclose a display mode switching method, device, near-eye display device, and computer-readable storage medium. The method first obtains a gesture in the projection display area of ​​the near-eye display device; if the gesture is a preset gesture, the change trend of the gesture is obtained; and then, according to the change trend of the gesture, the near-eye display device is controlled to complete the switching of the display mode, wherein the display mode includes an AR display mode and a VR display mode. The method does not require the user to exit the current application, nor does it take time to find a switching entry, that is, it can easily and quickly realize the switching between display modes such as AR and VR, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 is a schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0018] Figure 2 is another schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0019] Figure 3 is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0020] Figure 4 is a schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0021] Figure 5 is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0022] Figure 6 This is a schematic diagram of a scenario of a display mode switching method provided by an embodiment of the present application;

[0023] Figure 7 is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0024] Figure 8 This is a schematic diagram of a scenario of a display mode switching method provided by an embodiment of the present application;

[0025] Fig. 9 is a schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0026] Fig.10 is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0027] Fig.11 is a schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0028] Fig.12 is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application;

[0029] Fig.13 is a schematic block diagram of a display mode switching device provided in an embodiment of the present application;

[0030] Fig.14 It is a schematic block diagram of a near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0032] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions. In addition, although the functional modules are divided in the device schematic, in some cases, the module division can be different from that in the device schematic.

[0033] The term "and / or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0034] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0035] At present, near-eye display devices AR glasses will be equipped with VR display mode, and near-eye display devices VR glasses will also be equipped with AR display mode. In this way, a pair of near-eye display devices can allow users to experience both AR display mode and VR display mode. However, when switching between AR and VR display modes, existing near-eye display devices often need to exit the current application first, then find the "menu bar", find the "scene" switching entrance in the "menu bar", enter the "scene" switching entrance, and select the display mode to be switched. Only in this way can the display mode switch be completed. Obviously, this switching method is complicated and inconvenient to operate. At the same time, if the switching entrance is relatively hidden, users will need to spend a certain amount of time to find the switching entrance, which greatly reduces the user experience.

[0036] The following display mode switching method provided in the embodiment of the present application can conveniently and quickly realize the switching between display modes such as AR and VR, thereby improving the user experience. The specific scheme is as follows.

[0037] See also Figure 1 , Figure 1is a schematic diagram of a display mode switching method provided by an embodiment of the present application. The method is applied to a near-eye display device, which may include AR glasses, VR glasses, etc. Figure 1 As shown, the display mode switching method includes steps S11 to S13.

[0038] S11: Acquire a gesture within a projection display area of ​​a near-eye display device.

[0039] When mode switching is required, the user can make corresponding gestures in the projection display area, and the near-eye display device will collect the gestures in the projection display area of ​​the near-eye display device through devices such as cameras.

[0040] In one embodiment, if Figure 2 As shown, Figure 2 It is a schematic diagram of a display mode switching method provided by an embodiment of the present application. Before step S11, it also includes step S14.

[0041] Step S14: Acquire a mode switching trigger signal generated by the mode switching operation.

[0042] When the user needs to switch the display mode, the user can perform a mode switching operation to generate a mode switching trigger signal.

[0043] In one embodiment, a mode switching module is provided on the near-eye display device. When the user operates the mode switching module, the near-eye display device is triggered to generate a mode switching trigger signal. Specifically, step S14 specifically includes: detecting whether the user operates the mode switching module; and if it is detected that the user operates the mode switching module, generating a mode switching trigger signal.

[0044] Furthermore, in one embodiment, the mode switching module may be a button device. When the user presses the button device, the near-eye display device detects that the user operates the mode switching module, and then generates a mode switching trigger signal.

[0045] Furthermore, in another embodiment, the mode switching module may be a sensing trigger device. When the user places a finger on the sensing trigger device, the sensing trigger device may sense the touch operation of the finger, and the near-eye display device may generate a mode switching trigger signal according to the user's touch operation.

[0046] It is understandable that the type of mode switching module is not limited to the above-mentioned button device, sensor trigger device, etc., as long as it can trigger the near-eye display device to generate a mode switching trigger signal, no specific limitation is made here.

[0047] In addition, the mode switching module can be placed on the glasses leg of the near-eye display device, or on the glasses frame, and there is no restriction on the setting position of the mode switching module.

[0048] After obtaining the mode switching trigger signal, step S11 will obtain the gestures in the projection display area of ​​the near-eye display device according to the mode switching trigger signal, that is, respond to the mode switching trigger signal and obtain the gestures in the projection display area based on the mode switching trigger signal.

[0049] Step S12: If the gesture is a preset gesture, obtaining a change trend of the gesture.

[0050] Preset gestures are pre-stored in the near-eye display device. Of course, the preset gestures can also be stored in the server. The near-eye display device is connected to the server in communication. When the preset gesture is needed, the preset gesture is obtained from the server. After the gesture in the projection display area is collected, it is determined whether the collected gesture matches the preset gesture; if the collected gesture matches the preset gesture, the change trend of the gesture is obtained.

[0051] In one embodiment, the preset gesture is an opening and closing gesture formed by fingers. The opening and closing gesture may be a pinching gesture in which the thumb and index finger are in contact, that is, the distance between the ends of the thumb and index finger is zero. For example, the opening and closing gesture is a gesture in which the thumb and index finger are extended and the ends of the two fingers are in contact, while the other three fingers are retracted in the palm. Of course, in the opening and closing gesture, the distance between the ends of the thumb and index finger may not be zero. For another example, the opening and closing gesture is a gesture in which the thumb and index finger are extended and the distance between the ends of the two fingers is large, so that the thumb and index finger form an open arc shape, while the other three fingers are retracted in the palm.

[0052] It should be noted that the above opening and closing gesture is only an example, and there are many forms of opening and closing gestures. For example, in the above opening and closing gesture, the other three fingers do not need to be contracted in the palm, and can be naturally stretched out during the opening and closing gesture of the thumb and index finger. In addition, the preset gesture can also be other gestures, as long as the display mode switching method provided by the present application can be implemented, and no specific limitation is made here.

[0053] In this embodiment, the change trend of the gesture includes the movement trajectory of the finger. For example, when the gesture is an opening and closing gesture in which the ends of the thumb and the index finger are in contact, the thumb and the index finger move away from each other, and the movement trajectory of the thumb and the index finger can be understood as an enlargement trend, that is, the change trend of the gesture is an enlargement trend, and the near-eye display device switches the display mode according to the enlargement trend, such as switching from the AR display mode to the VR display mode.

[0054] For another example, when the gesture is an opening and closing gesture with a large distance between the ends of the thumb and index finger, the thumb and index finger move relatively close to each other, and the movement trajectory of the thumb and index finger can be understood as a shrinking trend, that is, the changing trend of the gesture is a shrinking trend. The near-eye display device implements the switching of the display mode according to the shrinking trend, such as switching from the VR display mode to the AR display mode.

[0055] In this way, the user only needs to make some gestures to complete the display mode switching, which simplifies the steps of display mode switching and brings a better experience to the user.

[0056] Step S13: According to the changing trend of the gesture, controlling the near-eye display device to complete the switching of the display mode, wherein the display mode includes an AR display mode and a VR display mode.

[0057] In one embodiment, the change trend of the gesture includes the sliding distance of the gesture, or includes the sliding distance and sliding direction of the gesture; step S13 specifically controls the near-eye display device to complete the switching of the display mode according to the sliding distance of the gesture. For example, when the sliding distance of the gesture is greater than the preset distance in the first direction, the near-eye display device is controlled to switch from the AR display mode to the VR display mode; when the sliding distance of the gesture is greater than the preset distance in the second direction, the near-eye display device is controlled to switch from the VR display mode to the AR display mode. Among them, the first direction and the second direction are two opposite directions, and the preset distance can be set according to specific needs.

[0058] Further, in one embodiment, if Figure 3 As shown, Figure 3 1 is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application. In this embodiment, the preset gesture is an opening and closing gesture formed by fingers. Step S13 specifically includes steps S131 and S132.

[0059] S131: If the change trend of the opening and closing gesture is a first change trend, controlling the near-eye display device to switch from the AR display mode to the VR display mode, wherein the first change trend includes one of a zoom-in trend and a zoom-out trend.

[0060] S132: If the changing trend of the opening and closing gesture is a second changing trend, controlling the near-eye display device to switch from the VR display mode to the AR display mode, wherein the second changing trend includes the other of the zoom-in trend and the zoom-out trend.

[0061] exist Figure 3In the illustrated embodiment, for example, the first change trend is a magnification trend, and the second change trend is a reduction trend. When the user needs to switch from the AR display mode to the VR display mode, the user can make an opening and closing gesture with the thumb and index finger touching in the projection display area of ​​the near-eye display device, and then move the thumb and index finger away from each other to form an enlarged motion trajectory, that is, the thumb and index finger slide away from each other to gradually increase the distance between the thumb and index finger. Then, the near-eye display device will determine that the change trend of the opening and closing gesture is a magnification trend, and then switch the current AR display mode to the VR display mode.

[0062] For another example, when the user needs to switch from VR display mode to AR display mode, the user can make an opening and closing gesture with a large distance between the ends of the thumb and index finger in the projection display area of ​​the near-eye display device, and then move the thumb and index finger relatively close to form a shrinking motion trajectory, that is, the thumb and index finger slide relatively close to gradually reduce the distance between the thumb and index finger. The near-eye display device will determine that the changing trend of the opening and closing gesture is a shrinking trend, and then switch the current VR display mode to the AR display mode.

[0063] It is understandable that in other embodiments, the first change trend may also be a shrinking trend, and the second change trend may also be an enlarging trend. As long as the near-eye display device can complete the corresponding display mode switching according to the changing trend of the gesture, no specific limitation is made here.

[0064] The display mode switching method disclosed in the embodiment of the present application first obtains the gesture in the projection display area; when the gesture is a preset gesture, obtains the change trend of the gesture; and then controls the near-eye display device to complete the switching between display modes such as AR and VR according to the change trend of the gesture. This method does not require the user to exit the current application, nor does it require time to find the switching entry, that is, it can easily and quickly realize the switching between display modes such as AR and VR, thereby improving the user experience.

[0065] See also Figure 4 , Figure 4 is a schematic diagram of a display mode switching method provided by an embodiment of the present application. The method is applied to a near-eye display device, which may include an AR near-eye display device, a VR near-eye display device, etc. Figure 4 As shown, the display mode switching method includes steps S21 to S24.

[0066] Step S21: Acquire gestures within the projection display area of ​​the near-eye display device.

[0067] Step S22: If the gesture is a preset gesture, obtaining a change trend of the gesture, wherein the preset gesture includes an opening and closing gesture formed by fingers.

[0068] Step S23: If the change trend of the opening and closing gesture is a first change trend, control the near-eye display device to switch from the AR display mode to the VR display mode, wherein the first change trend includes one of a zoom-in trend and a zoom-out trend.

[0069] Specifically, Figure 5 As shown, Figure 5 It is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application. When the first change trend is an enlargement trend, the step S23 specifically includes step S231 and step S232.

[0070] Step S231: Enlarging the VR display area according to the enlargement trend of the opening and closing gesture.

[0071] like Figure 6 As shown, Figure 6 A schematic diagram of a scenario of a display mode switching method in an embodiment of the present application. Figure 6 In the figure, the dotted box is the projection display area of ​​the near-eye display device, and the gray solid rectangle is the VR display area. When the user's thumb and index finger move relatively away from each other, the near-eye display device gradually enlarges the VR display area according to the enlarged motion trajectory between the thumb and index finger.

[0072] It can be understood that when the projection display area of ​​the near-eye display device remains fixed, when the VR display area increases, the remaining AR display area for displaying the AR screen will gradually decrease.

[0073] In one embodiment, the VR display area is enlarged according to the enlargement trend of the opening and closing gesture. Specifically, the VR picture is displayed starting from the center point of the projection display area, and the VR picture is gradually enlarged toward the surrounding areas, that is, the VR display area is gradually enlarged toward the surrounding areas starting from the center point of the projection display area.

[0074] Among them, the above-mentioned display of AR screen can be understood as displaying the content to be displayed in AR display mode; the above-mentioned display of VR screen can be understood as displaying the content to be displayed in VR display mode.

[0075] It should be noted that the starting point of the above-mentioned VR display area is not limited to the center point of the projection display area, but can also be other points. For example, the VR display area can be gradually enlarged around the position of the user's thumb or index finger as the starting point.

[0076] Step S232: If the distance between the ends of the thumb and index finger in the opening and closing gesture is greater than the first preset threshold, or the proportion of the VR display area to the projection display area is greater than the second preset threshold, the VR picture is displayed in full screen to complete the switch from AR display mode to VR display mode.

[0077] In one embodiment, the distance between the ends of the thumb and index finger in the opening and closing gesture can be detected, and it can be determined whether the distance between the fingers is greater than a first preset threshold. If it is determined that the distance between the fingers is greater than the first preset threshold, the near-eye display device is triggered to display the VR image in full screen, thereby completing the switch from the AR display mode to the VR display mode.

[0078] It should be noted that the first preset threshold may be a threshold pre-set by the manufacturer for the user based on various parameters of the projection of the near-eye display device and information such as hand size, or it may be a threshold set by the user according to prompt information when the user uses the near-eye display device for the first time, and no specific restrictions are made here.

[0079] In another embodiment, the full-screen display of the VR image can also be triggered by the screen-occupancy ratio of the VR display area. Specifically, it is determined whether the ratio of the VR display area to the projection display area is greater than a second preset threshold. If the ratio of the VR display area to the projection display area is greater than the second preset threshold, the near-eye display device is triggered to display the VR image in full screen to complete the switch from the AR display mode to the VR display mode.

[0080] exist Figure 5 In the process of switching from the AR display mode to the VR display mode shown, the user controls the near-eye display device to dynamically enlarge the VR display area by moving the thumb and index finger relatively apart, thereby entering the VR display mode under the condition of full-screen display of the VR image, that is, completing the switching from the AR display mode to the VR display mode. In this process, the interaction between the user and the near-eye display device is increased, thereby improving the fun of the near-eye display device in the process of switching the display modes.

[0081] Step S24: If the changing trend of the opening and closing gesture is the second changing trend, control the near-eye display device to switch from the VR display mode to the AR display mode, wherein the second changing trend includes the other of the zoom-in trend and the zoom-out trend.

[0082] Specifically, Figure 7 As shown, Figure 7 Detailed schematic diagram of a display mode switching method in an embodiment of the present application. When the second change trend is a shrinking trend, step S24 specifically includes step S241 and step S242.

[0083] Step S241: reducing the VR display area according to the shrinking trend of the opening and closing gesture, and increasing the AR display area, wherein the AR display area is the area within the projection display area excluding the VR display area.

[0084] like Figure 8 As shown, Figure 8A schematic diagram of a scenario of a display mode switching method in an embodiment of the present application. Figure 8 The middle dotted box is the projection display area of ​​the near-eye display device, and the gray solid rectangle is the VR display area. When the user's thumb and index finger move relatively close to each other, the near-eye display device gradually shrinks the VR display area according to the shrinking movement trajectory between the thumb and index finger, and at the same time, displays the AR screen in the area other than the VR display area in the projection display area, that is, increases the AR display area.

[0085] In one embodiment, the VR display area is reduced according to the shrinking trend of the opening and closing gesture. Specifically, the VR screen is gradually reduced from the surroundings toward the center point with the center point of the projection display area as the end point, that is, the VR display area is gradually reduced from the surroundings toward the end point with the center point of the projection display area as the end point.

[0086] It should be noted that the end point of the above-mentioned VR display area is not limited to the center point of the projection display area, but can also be other points. For example, the VR display area can be gradually reduced from the surrounding areas toward the end point with the position of the user's thumb or index finger as the end point.

[0087] Step S242: If the distance between the ends of the thumb and index finger in the opening and closing gesture is less than the third preset threshold, or the proportion of the VR display area to the projection display area is less than the fourth preset threshold, the AR picture is displayed in full screen to complete the switch from VR display mode to AR display mode.

[0088] In one embodiment, the distance between the ends of the thumb and index finger in the opening and closing gesture can be detected, and it can be determined whether the distance between the fingers is less than a third preset threshold. If it is determined that the distance between the fingers is less than the third preset threshold, the near-eye display device is triggered to display the AR screen in full screen, thereby completing the switch from the VR display mode to the AR display mode.

[0089] It should be noted that the third preset threshold can be zero, that is, after detecting that the ends of the thumb and index finger are in contact in the opening and closing gesture, the near-eye display device is triggered to display the AR screen in full screen. The third preset threshold may also be non-zero. For example, the third preset threshold may be 0.5. When it is detected that the distance between the ends of the thumb and index finger in the opening and closing gesture is less than 0.5, the near-eye display device is triggered to display the AR screen in full screen. The specific value of the third preset threshold is not limited here.

[0090] In another embodiment, the full-screen display of the AR picture can also be triggered by the screen-occupancy ratio of the VR display area. Specifically, it is determined whether the ratio of the VR display area to the projection display area is less than a fourth preset threshold. If the ratio of the VR display area to the projection display area is less than the fourth preset threshold, the near-eye display device is triggered to display the AR picture in full screen to complete the switch from the VR display mode to the AR display mode.

[0091] exist Figure 7 In the process of switching from the VR display mode to the AR display mode shown in the figure, the user controls the near-eye display device to dynamically reduce the VR display area by moving the thumb and index finger relatively close to each other, thereby entering the AR display mode while satisfying the condition of full-screen display of the AR image, that is, completing the switching from the VR display mode to the AR display mode. In this process, the interaction between the user and the near-eye display device is increased, thereby improving the fun of the near-eye display device in the process of switching the display mode.

[0092] It should be noted that technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific content and explanation of individual method steps in the display mode switching method described above can refer to the corresponding process in the aforementioned display mode switching method embodiment, and will not be repeated here.

[0093] The display mode switching method disclosed in the embodiment of the present application obtains a gesture in the projection display area. If the gesture is a preset gesture, the change trend of the gesture is obtained, and the VR display area is gradually reduced or enlarged according to the change trend of the gesture, so that the VR screen or AR screen is displayed in full screen when the full-screen display conditions are met, so as to complete the switching between the AR display mode and the VR display mode. This method can complete the switching between display modes through the change trend of the gesture. Compared with the existing switching methods, this method is more convenient and quick. At the same time, it can also increase the interaction between the user and the near-eye display device, and increase the fun of the mode switching process.

[0094] See also Fig. 9 , Fig. 9 is a schematic diagram of a display mode switching method provided by an embodiment of the present application. The method is applied to a near-eye display device, which may include an AR near-eye display device, a VR near-eye display device, etc. Fig. 9 As shown, the display mode switching method includes steps S31 to S34.

[0095] Step S31: Acquire a mode switching trigger signal generated by a mode switching operation.

[0096] In one embodiment, a mode switching module is provided on the near-eye display device. When a user operates the mode switching module, the near-eye display device is triggered to generate a mode switching trigger signal.

[0097] Furthermore, in one embodiment, the mode switching module may be a button device or a sensor trigger device. When the user presses the button device or places a finger on the sensor trigger device, the near-eye display device detects that the user operates the mode switching module, and then generates a mode switching trigger signal.

[0098] Step S32: Acquire a gesture within the projection display area of ​​the near-eye display device according to the mode switching trigger signal.

[0099] Step S33: If the gesture is a preset gesture, obtaining a change trend of the gesture.

[0100] In this embodiment, the preset gesture is an opening and closing gesture formed by fingers. The opening and closing gesture can be a gesture in which the thumb and index finger are in contact, or a gesture in which the distance between the ends of the thumb and index finger is large.

[0101] In this embodiment, the changing trend of the gesture includes the movement trajectory of the fingers. For example, when the gesture is an opening and closing gesture in which the ends of the thumb and index finger are in contact, the thumb and index finger move relatively away from each other, and the movement trajectory of the thumb and index finger can be understood as an enlargement trend, that is, the changing trend of the gesture is an enlargement trend. For another example, when the gesture is an opening and closing gesture in which the distance between the ends of the thumb and index finger is large, the thumb and index finger move relatively close to each other, and the movement trajectory of the thumb and index finger can be understood as a reduction trend, that is, the changing trend of the gesture is a reduction trend. In other words, the changing trend of the gesture includes an enlargement trend and a reduction trend.

[0102] Step S34: According to the changing trend of the gesture, controlling the near-eye display device to complete the switching of the display mode, wherein the display mode includes an AR display mode, a VR display mode, and a coexistence display mode of AR and VR.

[0103] Specifically, Fig.10 As shown, Fig.10 1 is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application. The step S34 specifically includes step S341 and step S342.

[0104] Step S341: adjusting the screen ratio of the AR display area and the VR display area according to the change trend of the gesture.

[0105] When the gesture changes in a magnifying trend, the near-eye display device gradually magnifies the VR display area according to the magnifying trend, and the proportion of the VR display area to the projection display area continues to increase, that is, the VR display area to screen ratio continues to increase. It can be understood that when the projection display area of ​​the near-eye display device is fixed, when the VR display area increases, the remaining AR display area for displaying the AR screen will gradually decrease. Therefore, the proportion of the AR display area to the projection display area continues to decrease, that is, the AR display area to screen ratio continues to decrease.

[0106] Similarly, when the gesture changes in a shrinking trend, the near-eye display device gradually shrinks the VR display area according to the shrinking trend, and the proportion of the VR display area to the projection display area continues to decrease, that is, the VR display area screen ratio continues to decrease. In this case, the AR display area will gradually increase, so the AR display area will account for an increasing proportion of the projection display area, that is, the AR display area screen ratio continues to increase.

[0107] Step S342: During the process of adjusting the screen ratio of the AR display area and the VR display area, if a mode switching stop signal is detected, the AR image and the VR image are simultaneously displayed in the projection display area to complete the switching from the VR display mode or the AR display mode to the coexistence display mode.

[0108] When the changing trend of the gesture is an enlargement trend, in the process of adjusting the screen ratio of the AR display area and the VR display area according to the changing trend of the gesture, if the distance between the ends of the thumb and index finger in the opening and closing gesture is greater than the first preset threshold, or the proportion of the VR display area to the projection display area is greater than the second preset threshold, the condition for full-screen display of the VR picture is met. At this time, the VR picture is displayed in full screen, and the near-eye display device switches to the VR display mode.

[0109] If the near-eye display device detects a mode switching stop signal before the conditions for full-screen display of the VR image are met, the AR image and the VR image are displayed simultaneously in the projection display area to complete the switch from the AR display mode to the coexistence display mode of AR and VR.

[0110] For example, a sensing trigger device is provided on the glasses leg of the near-eye display device, and the near-eye display device is currently in the AR display mode. When the user needs to switch modes, the user's left hand touches the sensing trigger device, and the right hand makes an opening and closing gesture in which the ends of the thumb and index finger touch each other in the projection display area, and the thumb and index finger move relatively away from each other, so that the change trend of the gesture shows an enlargement trend. In this way, the near-eye display device will gradually enlarge the VR display area according to the enlargement trend, and reduce the AR display area at the same time. When the near-eye display device detects that the conditions for full-screen display of the VR picture are met, the VR picture is displayed in full screen, and the near-eye display device switches to the VR display mode. If the user's left hand leaves the sensing trigger device before the conditions for full-screen display of the VR picture are met, the near-eye display device will detect the mode switching stop signal. At this time, the VR picture will be displayed according to the size of the VR display area at the moment when the mode switching stop signal is detected, and at the same time, the AR picture will be displayed according to the size of the AR display area at the moment when the mode switching stop signal is detected, that is, the switch from the AR display mode to the coexistence display mode of AR and VR is completed.

[0111] When the trend of the gesture change is a shrinking trend, in the process of adjusting the screen ratio of the AR display area and the VR display area according to the trend of the gesture change, if the distance between the ends of the thumb and index finger in the opening and closing gesture is less than the third preset threshold, or the proportion of the VR display area to the projection display area is less than the fourth preset threshold, the condition for displaying the AR picture in full screen is met. At this time, the AR picture is displayed in full screen, and the near-eye display device switches to the AR display mode.

[0112] If the near-eye display device detects a mode switching stop signal before the conditions for full-screen display of the AR image are met, the AR image and the VR image are displayed simultaneously in the projection display area to complete the switch from the VR display mode to the coexistence display mode of AR and VR.

[0113] For example, a button device is provided on the glasses leg of a near-eye display device, and the near-eye display device is currently in VR display mode. When the user needs to switch modes, the user's left hand presses the button device, and the right hand makes an opening and closing gesture with the ends of the thumb and index finger at a large distance in the projection display area, and moves the thumb and index finger relatively close to each other, so that the change trend of the gesture shows a shrinking trend. In this way, the near-eye display device will gradually shrink the VR display area according to the shrinking trend, and enlarge the AR display area at the same time. When the near-eye display device detects that the conditions for full-screen display of the AR picture are met, it will display the AR picture in full screen, and the near-eye display device will switch to the AR display mode.

[0114] If the user's left hand presses the button device again before the conditions for full-screen display of the AR image are met, the near-eye display device will detect the mode switching stop signal. At this time, the VR image will be displayed according to the size of the VR display area at the moment when the mode switching stop signal is detected. At the same time, the AR image will be displayed according to the size of the AR display area at the moment when the mode switching stop signal is detected, thereby completing the switch from the VR display mode to the coexistence display mode of AR and VR.

[0115] It should be noted that technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific content and explanation of individual method steps in the display mode switching method described above can refer to the corresponding process in the aforementioned display mode switching method embodiment, and will not be repeated here.

[0116] The display mode switching method disclosed in the embodiment of the present application, when a mode switching trigger signal is obtained, collects gestures in the projection display area, and if the gesture is a preset gesture, obtains the change trend of the gesture, and controls the near-eye display device to complete the switching between the AR display mode, the VR display mode, and the coexistence display mode of AR and VR according to the change trend of the gesture. This switching method is more convenient and quick. At the same time, when the user switches to the coexistence display mode of AR and VR, the size of the AR screen and the VR screen can be adjusted as needed, making the near-eye display device more intelligent and personalized.

[0117] See also Fig.11 , Fig.11 is a schematic diagram of a display mode switching method provided by an embodiment of the present application. The method is applied to a near-eye display device, which may include an AR near-eye display device, a VR near-eye display device, etc. Fig.11 As shown, the display mode switching method includes steps S41 to S44.

[0118] Step S41: Acquire a mode switching trigger signal generated by a mode switching operation.

[0119] Step S42: Acquire a gesture within the projection display area of ​​the near-eye display device according to the mode switching trigger signal.

[0120] Step S43: If the gesture is a preset gesture, obtain the change trend of the gesture, wherein the preset gesture includes a pointing gesture.

[0121] In this embodiment, the pointing gesture is a gesture in which one finger is extended and the other four fingers are retracted in the palm, for example, the index finger is extended and the other four fingers are retracted in the palm. It should be noted that the specific shape of the pointing gesture is not limited to the above shape, for example, the other four fingers can be half retracted in the palm, etc., and no specific limitation is made here.

[0122] Step S44: according to the changing trend of the gesture, controlling the near-eye display device to complete the switching of the display mode, wherein the display mode includes AR display mode, VR display mode and ordinary glasses mode.

[0123] Specifically, Fig.12 As shown, Fig.12 4 is a specific schematic diagram of a display mode switching method provided by an embodiment of the present application. The step S44 specifically includes step S441 and step S442.

[0124] Step S441: Determine whether the change trend of the pointing gesture matches a preset graph.

[0125] The changing trend of the gesture may include the movement trajectory of the finger. For example, the preset graphic may be in the shape of the letter "C". When the user makes a pointing gesture, the index finger moves in the air to draw a graphic of the letter "C". The near-eye display device determines whether it matches the preset graphic "C" based on the changing trend of the pointing gesture. If it matches, step S442 is executed.

[0126] Step S442: If the changing trend of the pointing gesture matches the preset graph, the near-eye display device is controlled to turn off the AR screen and / or the VR screen to switch to the normal glasses mode.

[0127] When the near-eye display device determines that the changing trend of the pointing gesture matches the preset graph, it indicates that the user wants to turn off the AR screen and the VR screen. At this time, the near-eye display device turns off the AR screen and / or the VR screen, the projection display area disappears, and the near-eye display device switches to normal glasses mode.

[0128] It should be noted that, those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific content and explanation of the individual method steps in the display mode switching method described above can refer to the corresponding process in the aforementioned display mode switching method embodiment. For example, in step S44, the process of controlling the near-eye display device to complete the switching of modes such as AR display mode and VR display mode according to the changing trend of the gesture can refer to the corresponding process in the aforementioned display mode switching method embodiment, which will not be repeated here.

[0129] The display mode switching method disclosed in the embodiment of the present application, when a mode switching trigger signal is obtained, collects gestures in the projection display area, and if the gesture is a preset gesture, obtains the change trend of the gesture, and controls the near-eye display device to complete the switching between AR display mode, VR display mode, and ordinary glasses mode according to the change trend of the gesture. This switching method is more convenient and quick. At the same time, it is also possible to draw a preset graphic according to the pointing gesture to close the AR screen and / or VR screen, thereby switching to the ordinary glasses mode, so that the near-eye display device can not only provide AR or VR functions for users, but also can be used as ordinary glasses, increasing the practicality of the near-eye display device.

[0130] See also Fig.13 , Fig.13 is a schematic block diagram of a display mode switching device provided in an embodiment of the present application. The display mode switching device 500 can be configured in a near-eye display device, which can be AR glasses, VR glasses, etc. The display mode switching device 500 is used to perform the steps of the aforementioned display mode switching method.

[0131] like Fig.13As shown, the display mode switching device 500 includes: a collection module 501 , a trend acquisition module 502 and a switching module 503 .

[0132] The acquisition module 501 is used to obtain gestures in the projection display area of ​​the near-eye display device.

[0133] The trend acquisition module 502 is used to acquire the change trend of the gesture if the gesture is a preset gesture.

[0134] The switching module 503 is used to control the near-eye display device to switch the display mode according to the change trend of the gesture, wherein the display mode includes an AR display mode and a VR display mode.

[0135] In one embodiment, the display mode switching device 500 also includes a signal acquisition module, which is used to acquire a mode switching trigger signal generated by a mode switching operation; and according to the mode switching trigger signal, send a signal to the acquisition module 501, so that the acquisition module 501 executes the step of acquiring gestures within the projection display area of ​​the near-eye display device.

[0136] In one embodiment, the near-eye display device is provided with a mode switching module; the signal acquisition module is specifically used to: detect whether the user operates the mode switching module; if it is detected that the user operates the mode switching module, generate a mode switching trigger signal.

[0137] In one embodiment, the preset gesture includes an opening and closing gesture formed by fingers; the switching module 503 is specifically used to: if the changing trend of the opening and closing gesture is a first changing trend, control the near-eye display device to switch from the AR display mode to the VR display mode; if the changing trend of the opening and closing gesture is a second changing trend, control the near-eye display device to switch from the VR display mode to the AR display mode; wherein the first changing trend includes one of a zoom-in trend and a zoom-out trend, and the second changing trend includes the other of the zoom-in trend and the zoom-out trend.

[0138] Further, in one embodiment, the first change trend is the magnification trend, and the switching module 503 is used to control the near-eye display device to switch from the AR display mode to the VR display mode if the change trend of the opening and closing gesture is the first change trend. Specifically, it is used to: enlarge the VR display area according to the magnification trend of the opening and closing gesture; and if the inter-finger distance between the ends of the thumb and index finger in the opening and closing gesture is greater than a first preset threshold, or the proportion of the VR display area to the projection display area is greater than a second preset threshold, then display the VR picture in full screen to complete the switch from the AR display mode to the VR display mode.

[0139] Furthermore, in one embodiment, the second change trend is the shrinking trend, and the switching module 503 is used to control the near-eye display device to switch from the VR display mode to the AR display mode if the change trend of the opening and closing gesture is the second change trend. Specifically, it is used to: shrink the VR display area according to the shrinking trend of the opening and closing gesture, and increase the AR display area, wherein the AR display area is the area in the projection display area except the VR display area; and if the inter-finger distance between the ends of the thumb and index finger in the opening and closing gesture is less than the third preset threshold, or the proportion of the VR display area in the projection display area is less than the fourth preset threshold, display the AR picture in full screen to complete the switching from the VR display mode to the AR display mode.

[0140] In one embodiment, the display mode also includes a coexistence display mode of AR and VR; the switching module 503 is specifically used to: adjust the screen ratio of the AR display area and the VR display area according to the changing trend of the gesture; and in the process of adjusting the screen ratio of the AR display area and the VR display area, if a mode switching stop signal is detected, the AR screen and the VR screen are displayed simultaneously in the projection display area to complete the switching from the VR display mode or the AR display mode to the coexistence display mode.

[0141] In one embodiment, the display mode also includes a normal glasses mode, and the preset gesture also includes a pointing gesture; the switching module 503 is specifically used to: determine whether the changing trend of the pointing gesture matches the preset graphic; and if the changing trend of the pointing gesture matches the preset graphic, control the near-eye display device to close the AR screen and / or VR screen to switch to the normal glasses mode.

[0142] It should be noted that technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the display mode switching device and each module of the near-eye display device described above can refer to the corresponding process in the aforementioned display mode switching method embodiment, and will not be repeated here.

[0143] Exemplarily, the display mode switching method and device described above may be implemented in the form of a computer program, and the computer program may be implemented in a computer program such as Fig.14 The near-eye display device 600 is shown to operate.

[0144] See also Fig.14 , Fig.14 600 is a schematic block diagram of a near-eye display device provided in an embodiment of the present application. The near-eye display device 600 may be AR glasses, VR glasses, etc.

[0145] like Fig.14As shown, the near-eye display device 600 includes a processor 601 and a memory 602 connected via a system bus, wherein the memory 602 may include a volatile storage medium, a non-volatile storage medium, and an internal memory.

[0146] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor 601 can execute any display mode switching method.

[0147] The processor 601 is used to provide computing and control capabilities to support the operation of the entire near-eye display device 600.

[0148] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor 601, the processor 601 can execute any display mode switching method.

[0149] Those skilled in the art will understand that the structure of the near-eye display device 600 is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation of the near-eye display device 600 to which the scheme of the present application is applied. The specific near-eye display device 600 may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0150] It should be understood that the processor 601 may be a central processing unit (CPU), and the processor 601 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0151] In some embodiments, the processor 601 is used to run a computer program stored in a memory to implement the following steps: obtaining a gesture within a projection display area of ​​a near-eye display device; if the gesture is a preset gesture, obtaining a change trend of the gesture; and according to the change trend of the gesture, controlling the near-eye display device to complete the switching of the display mode, wherein the display mode includes an AR display mode and a VR display mode.

[0152] In some embodiments, the processor 601 is further used to: obtain a mode switching trigger signal generated by a mode switching operation; and execute the step of obtaining a gesture within the projection display area of ​​the near-eye display device according to the mode switching trigger signal.

[0153] In some embodiments, the preset gesture includes an opening and closing gesture formed by fingers; the processor 601 is specifically used to: if the changing trend of the opening and closing gesture is a first changing trend, control the near-eye display device to switch from the AR display mode to the VR display mode; if the changing trend of the opening and closing gesture is a second changing trend, control the near-eye display device to switch from the VR display mode to the AR display mode; wherein the first changing trend includes one of a zoom-in trend and a zoom-out trend, and the second changing trend includes the other of the zoom-in trend and the zoom-out trend.

[0154] In some embodiments, the first change trend is the enlargement trend, and the processor 601 is specifically used to: enlarge the VR display area according to the enlargement trend of the opening and closing gesture; and if the distance between the ends of the thumb and index finger in the opening and closing gesture is greater than a first preset threshold, or the proportion of the VR display area to the projection display area is greater than a second preset threshold, then display the VR picture in full screen to complete the switch from the AR display mode to the VR display mode.

[0155] In some embodiments, the second change trend is the shrinking trend, and the processor 601 is specifically used to: shrink the VR display area according to the shrinking trend of the opening and closing gesture, and increase the AR display area, wherein the AR display area is the area within the projection display area except the VR display area; and if the inter-finger distance between the ends of the thumb and index finger in the opening and closing gesture is less than a third preset threshold, or the proportion of the VR display area in the projection display area is less than a fourth preset threshold, then display the AR picture in full screen to complete the switch from the VR display mode to the AR display mode.

[0156] In some embodiments, the display mode also includes a coexistence display mode of AR and VR; the processor 601 is specifically used to: adjust the screen ratio of the AR display area and the VR display area according to the changing trend of the gesture; and in the process of adjusting the screen ratio of the AR display area and the VR display area, if a mode switching stop signal is detected, simultaneously display the AR image and the VR image in the projection display area to complete the switching from the VR display mode or the AR display mode to the coexistence display mode.

[0157] In some embodiments, the display mode also includes a normal glasses mode, and the preset gesture also includes a pointing gesture; the processor 601 is specifically used to: determine whether the changing trend of the pointing gesture matches the preset graphic; and if the changing trend of the pointing gesture matches the preset graphic, control the near-eye display device to close the AR screen and / or VR screen to switch to the normal glasses mode.

[0158] In some embodiments, the near-eye display device is provided with a mode switching module; the processor 601 is specifically used to: detect whether the user operates the mode switching module; if it is detected that the user operates the mode switching module, generate a mode switching trigger signal.

[0159] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions, and when the program instructions are executed, any one of the display mode switching methods provided in the embodiments of the present application is implemented.

[0160] The computer-readable storage medium may be an internal storage unit of the near-eye display device described in the aforementioned embodiment, such as the memory of the near-eye display device. The computer-readable storage medium may also be an external storage device of the near-eye display device, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the near-eye display device.

[0161] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like.

[0162] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A display mode switching method, characterized in that: The display mode switching method is applied to a near-eye display device, and the method comprises: Get the gestures in the projection display area of ​​the near-eye display device; If the gesture is a preset gesture, obtaining a change trend of the gesture; and According to the changing trend of the gesture, the near-eye display device is controlled to complete the switching of the display mode, wherein the display mode includes an AR display mode and a VR display mode.

2. The mode switching method according to claim 1, characterized in that: Before acquiring the gesture in the projection display area of ​​the near-eye display device, the method further includes: Acquiring a mode switching trigger signal generated by a mode switching operation; and According to the mode switching trigger signal, the step of acquiring the gesture within the projection display area of ​​the near-eye display device is performed.

3. The mode switching method according to claim 1, characterized in that: The preset gesture includes an opening and closing gesture formed by a finger; and controlling the near-eye display device to switch the display mode according to the change trend of the gesture includes: If the change trend of the opening and closing gesture is the first change trend, controlling the near-eye display device to switch from the AR display mode to the VR display mode; If the change trend of the opening and closing gesture is the second change trend, controlling the near-eye display device to switch from the VR display mode to the AR display mode; The first change trend includes one of an enlargement trend and a reduction trend, and the second change trend includes the other of the enlargement trend and the reduction trend.

4. The mode switching method according to claim 3, characterized in that: The first change trend is the magnification trend, and if the change trend of the opening and closing gesture is the first change trend, controlling the near-eye display device to switch from the AR display mode to the VR display mode includes: Enlarging the VR display area according to the enlargement trend of the opening and closing gesture; and If the distance between the ends of the thumb and index finger in the opening and closing gesture is greater than a first preset threshold, or the proportion of the VR display area to the projection display area is greater than a second preset threshold, the VR image is displayed in full screen to complete the switch from AR display mode to VR display mode.

5. The mode switching method according to claim 3, characterized in that: The second change trend is the shrinking trend, and if the change trend of the opening and closing gesture is the second change trend, controlling the near-eye display device to switch from the VR display mode to the AR display mode includes: Reducing the VR display area according to the shrinking trend of the opening and closing gesture, and increasing the AR display area, wherein the AR display area is the area within the projection display area excluding the VR display area; and If the distance between the ends of the thumb and index finger in the opening and closing gesture is less than the third preset threshold, or the proportion of the VR display area to the projection display area is less than the fourth preset threshold, the AR picture is displayed in full screen to complete the switch from VR display mode to AR display mode.

6. The mode switching method according to claim 1, characterized in that: The display mode also includes a coexistence display mode of AR and VR; and controlling the near-eye display device to switch the display mode according to the change trend of the gesture includes: According to the changing trend of the gesture, adjusting the screen ratio of the AR display area and the VR display area; and During the process of adjusting the screen ratio of the AR display area and the VR display area, if a mode switching stop signal is detected, the AR image and the VR image are simultaneously displayed in the projection display area to complete the switching from the VR display mode or the AR display mode to the coexistence display mode.

7. The mode switching method according to claim 1, characterized in that: The display mode further includes a normal glasses mode, and the preset gesture further includes a pointing gesture; and controlling the near-eye display device to switch the display mode according to the change trend of the gesture includes: Determining whether a change trend of the pointing gesture matches a preset graph; and If the changing trend of the pointing gesture matches the preset graph, the near-eye display device is controlled to turn off the AR screen and / or the VR screen to switch to the normal glasses mode.

8. A display mode switching device, characterized in that: include: A collection module, used to obtain gestures in the projection display area of ​​the near-eye display device; A trend acquisition module, used for acquiring a change trend of the gesture if the gesture is a preset gesture; as well as A switching module is used to control the near-eye display device to complete the switching of the display mode according to the changing trend of the gesture, wherein the display mode includes an AR display mode and a VR display mode.

9. A near-eye display device, characterized in that: include: A memory and a processor; wherein the memory is connected to the processor and is used to store a program; the processor is used to implement the steps of the display mode switching method as described in any one of claims 1 to 7 by running the program stored in the memory.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the steps of the display mode switching method according to any one of claims 1 to 7.

Images