Interaction method and device of near-to-eye display equipment, equipment and storage medium
By obtaining the device posture in the near-eye display device and displaying the application management interface under the preset posture, the problem that the device cannot easily switch multiple applications is solved, and more efficient application interaction is achieved.
Patent Information
- Application Number
- CN202411179452.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2024-12-20
AI Technical Summary
Near-eye display devices cannot easily switch multiple running applications, resulting in poor interactivity.
By obtaining the device posture, the application management interface is displayed only within the preset attitude range, including the application identifier of the currently running application, and the corresponding application interface is displayed or hidden according to the operation instructions.
It improves the convenience of switching applications and improves the user's interactive experience of near-eye display devices.
Smart Images

Figure CN119166016A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of interface interaction technology, and in particular to an interaction method, device, equipment and storage medium for a near-eye display device. Background Art
[0002] Currently, when users use near-eye display devices to run corresponding applications, the interface interaction method provided by the near-eye display devices is generally limited to starting and closing applications. It is easy for the near-eye display device to be unable to switch between multiple currently running applications, resulting in poor convenience in switching applications with the near-eye display device. Summary of the invention
[0003] The main purpose of the present application is to provide an interactive method, apparatus, device and storage medium for a near-eye display device, aiming to solve the technical problem of poor convenience in switching applications of the near-eye display device due to the inability of the near-eye display device to switch between multiple currently running applications.
[0004] In a first aspect, the present application provides an interaction method of a near-eye display device, comprising:
[0005] Get the current device posture of the near-eye display device;
[0006] When the current device posture is within the preset posture range, the application management interface is displayed; the application management interface includes the application identifier of the application currently running on the near-eye display device;
[0007] When an operation instruction for the application identifier is detected, the application interface corresponding to the application program is displayed or hidden.
[0008] In a second aspect, the present application provides an interactive device for a near-eye display device, the interactive device comprising:
[0009] A posture acquisition module, used to obtain the current device posture of the near-eye display device;
[0010] An interface display module, configured to display an application management interface when the current device posture is within a preset posture range; the application management interface includes an application identifier corresponding to an application currently running on the near-eye display device;
[0011] The interaction module is used to display or hide the application interface corresponding to the application program when an operation instruction for the application identifier is detected.
[0012] In a third aspect, the present application provides a near-eye display device, the near-eye display device comprising a memory and a processor;
[0013] The memory is used to store computer programs;
[0014] The processor is used to execute the computer program and implement the steps of the interaction method of the near-eye display device as described above when executing the computer program.
[0015] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the interaction method of the near-eye display device as described above are implemented.
[0016] The present application provides an interaction method, apparatus, device and storage medium for a near-eye display device. The interaction method includes: obtaining the current device posture of the near-eye display device; when the current device posture is within a preset posture range, displaying an application management interface; the application management interface includes an application identifier of an application currently running on the near-eye display device; when an operation instruction for the application identifier is detected, displaying or hiding an application interface corresponding to the application.
[0017] When the near-eye display device displays the application management interface, the near-eye display device can display or hide the application interface corresponding to the application through the operation instruction of the application identifier of the application in the application management interface. Accordingly, the application management interface can include the application identifiers of multiple applications, and the near-eye display device can switch the application interfaces corresponding to the multiple applications through the application management interface, which is conducive to improving the convenience of switching applications by the near-eye display device. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0019] Figure 1 It is a flowchart of an interaction method of a near-eye display device provided in an embodiment of the present application;
[0020] Figure 2 is a schematic diagram of an application management interface involved in an embodiment of the present application;
[0021] Figure 3 is a schematic diagram of an application management interface involved in another embodiment of the present application;
[0022] Figure 4 is a schematic block diagram of an interaction device of a near-eye display device provided in an embodiment of the present application;
[0023] Figure 5It is a schematic block diagram of a near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0024] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0025] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.
[0026] The embodiments of the present application provide an interaction method, device, equipment and storage medium of a near-eye display device. The interaction method of the near-eye display device can be applied to a near-eye display device. The near-eye display device may include augmented reality (AR) glasses, mixed reality (MR) glasses, AR helmets, MR helmets, etc., which are not limited here.
[0027] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.
[0028] See also Figure 1 , Figure 1 It is a flow chart of an interactive method for a near-eye display device provided in an embodiment of the present application. It should be noted that the interactive method for a near-eye display device provided in an embodiment of the present application can be used in a near-eye display device, which is not limited here.
[0029] like Figure 1 As shown, the interaction method of the near-eye display device includes steps S101 to S103.
[0030] S101. Obtain a current device posture of a near-eye display device.
[0031] Exemplarily, the current device posture may include the current position of the near-eye display device and the current direction of the near-eye display device. For example, the near-eye display device may be provided with an inertial measurement unit. The near-eye display device may determine the current device posture through the posture data collected by the inertial measurement unit. Of course, it is not limited to this. For example, the near-eye display device may be provided with at least one of the devices for collecting posture data, such as a gyroscope, an accelerometer, a magnetometer, etc., to determine the current device posture. For another example, the near-eye display device may determine the current device posture based on the environmental image collected by the visual sensor, which is not limited here.
[0032] In some embodiments, when a user wears a near-eye display device to use the near-eye display device, the current device posture of the near-eye display device can change in response to a change in the user's head posture. For example, when the user lowers his head, the current device posture of the near-eye display device can move downward in response to the user's head-lowering action. When the user raises his head, the current device posture of the near-eye display device can move upward in response to the user's head-raising action. When the user shakes his head left and right, the current device posture of the near-eye display device can move left and right in response to the user's head-shaking action left and right. Of course, this is not limited to this and is not limited here.
[0033] For example, when a change in the current device posture is detected, the near-eye display device can determine whether the user needs to switch the application currently running on the near-eye display device based on the current device posture for subsequent interaction with the near-eye display device.
[0034] In this way, when the current device posture of the near-eye display device is acquired, the current device posture can be used for subsequent interaction with the near-eye display device.
[0035] S102. When the current device posture is within a preset posture range, an application management interface is displayed; the application management interface includes an application identifier of an application currently running on the near-eye display device.
[0036] In some embodiments, when the current device posture is within a preset posture range, the near-eye display device may determine that the user needs to switch the currently running application, and the near-eye display device may display an application management interface.
[0037] For example, the application management interface is available for user interaction. For example, the application management interface includes an application identifier of an application currently running on the near-eye display device, which is available for user interaction. The near-eye display device can subsequently switch the currently running application in response to the user's interaction information on the application management interface, such as operation information on the application identifier included in the application management interface.
[0038] In some embodiments, the preset posture range may include a posture range corresponding to when the angle between the current device posture and the reference device posture corresponding to the near-eye display device is 30 degrees to 50 degrees, a posture range corresponding to when the angle between the current device posture and the reference device posture corresponding to the near-eye display device is 15 degrees to 25 degrees, etc. The preset posture range may be pre-set or may be set by the user, which is not limited here.
[0039] Take the current device posture of the near-eye display device corresponding to when the user wearing the near-eye display device looks up and straight ahead as the reference device posture, and the preset posture range as the posture range corresponding to the angle between the current device posture and the reference device posture corresponding to the near-eye display device is 30 to 50 degrees. If the current device posture of the near-eye display device moves upward by 30 to 50 degrees or downward by 30 to 50 degrees from the reference device posture, the near-eye display device can determine that the current device posture is within the preset posture range. Of course, it is not limited to this. When the angle between the current device posture and the reference device posture is greater than or equal to 30 degrees and less than or equal to 50 degrees, the near-eye display device can determine that the current device posture is within the preset posture range.
[0040] In some embodiments, the reference device posture corresponding to the near-eye display device can be changed. For example, when the near-eye display device maintains the same current device posture for a duration greater than or equal to a preset duration threshold, the near-eye display device can determine the device posture as the reference device posture, so as to determine whether the current device posture of the subsequent near-eye display device is changed to be within the preset posture range based on the reference device posture.
[0041] Take the preset posture range including the posture range corresponding to the angle between the current device posture and the reference device posture corresponding to the near-eye display device of 30 degrees to 50 degrees as an example. When the user wears the near-eye display device, if the duration of the user lying flat is greater than or equal to the preset duration threshold, the near-eye display device can determine the current device posture of the near-eye display device corresponding to the user lying flat as the reference device posture. Accordingly, in the case of determining the reference device posture, if the near-eye display device detects that the angle between the current device posture and the reference device posture is 45 degrees, the near-eye display device can determine that the current device posture is within the preset posture range.
[0042] Based on this, when it is determined that the current device posture is within the preset posture range, the near-eye display device can display the application management interface for the user to interact with the application identifier included in the application management interface, thereby switching the application currently running on the near-eye display device.
[0043] Of course, it is not limited to this, the preset posture range can be pre-set or set by the user, which is not limited here. The number of application identifiers included in the application management interface can include one or more, which is not limited here.
[0044] In some embodiments, when the current device posture is not within a preset posture range, the near-eye display device may determine that the user does not need to switch the currently running application, and the near-eye display device may not display the application management interface.
[0045] In this way, by displaying the application management interface when the current device posture is within the preset posture range, the application management interface includes the application identifier of the application currently running on the near-eye display device for user interaction, which is conducive to improving the convenience of interaction with the application.
[0046] Exemplarily, the application identifier includes an application icon. For example, the application icon of the application program corresponds to the application program one by one. The application icon can be used to indicate the corresponding application program.
[0047] In some implementations, the positions of the application icons of the multiple application programs on the application management interface are determined based on at least one of the running order, running priority, and running frequency among the multiple application programs.
[0048] When displaying the application management interface, if the near-eye display device currently runs multiple applications, the near-eye display device can determine the positions of the application icons of the multiple applications in the application management interface based on at least one of the running order, running priority, and running frequency among the multiple applications.
[0049] For example, the near-eye display device can detect the user's operation frequency on multiple preset areas in the application display interface.
[0050] For example, the multiple preset areas include a first preset area and a second preset area, and the operating frequency corresponding to the first preset area is higher than the operating frequency corresponding to the second preset area.
[0051] If the multiple applications currently running on the near-eye display device include application 1 and application 2, and the running order of application 1 precedes the running order of application 2, the near-eye display device can set application icon 1 of application 1 in the first preset area, and set application icon 2 of application 2 in the second preset area, so as to determine the positions of the application icons of application 1 and application 2 in the application management interface. For example, in the case where the running order of application 1 precedes the running order of application 2, the application interface currently viewed by the user is, for example, the application interface corresponding to application 2. When the near-eye display device detects that the current device posture is within the preset posture range, it can determine that the user needs to switch the user interface corresponding to application 2 to the user interface corresponding to application 1. Based on this, by setting application icon 1 in the first preset area, the convenience of interaction with application icon 1 can be improved, thereby improving the user's interactive experience with the near-eye display device.
[0052] If the multiple applications currently running on the near-eye display device include application 3 and application 4, and the running priority of application 3 is higher than the running priority of application 4, the near-eye display device can set application icon 3 of application 3 in the first preset area, and set application icon 4 of application 4 in the second preset area, so as to determine the positions of the application icons of application 3 and application 4 respectively in the application management interface. For example, when the running priority of application 3 is higher than the running priority of application 4, the possibility that the user needs to view the application interface corresponding to application 3 first when switching applications is higher than the possibility of viewing the application interface corresponding to application 4. Based on this, by setting application icon 3 in the first preset area, the convenience of interaction with application icon 3 can be improved, thereby improving the convenience of switching the application interface corresponding to application 3, and further improving the user's interactive experience with the near-eye display device.
[0053] If the multiple applications currently running on the near-eye display device include application 5 and application 6, and the running frequency of application 5 is higher than that of application 6, the near-eye display device may set application icon 5 of application 5 in the first preset area, and set application icon 6 of application 6 in the second preset area, so as to determine the positions of the application icons of application 5 and application 6 in the application management interface. For example, when the running frequency of application 5 is higher than that of application 6, the possibility that the user needs to view the application interface corresponding to application 5 first when switching applications is higher than the possibility of viewing the application interface corresponding to application 6. Based on this, by setting application icon 5 in the first preset area, the convenience of interaction with application icon 5 can be improved, thereby improving the convenience of switching the application interface corresponding to application 5, and further improving the user's interactive experience with the near-eye display device.
[0054] Of course, it is not limited to this. The near-eye display device can also determine the positions of the application icons of the multiple applications in the application management interface by combining at least two of the running order, running priority, and running frequency among the multiple applications.
[0055] For example, the weights of the operation order, operation priority and operation frequency for determining the position of the application icon may be different. In the case where application icon 1, application icon 3 and application icon 5 are arranged in the first preset area, the near-eye display device may determine the weights of the positions of the application icons corresponding to application icon 1, application icon 3 and application icon 5 according to at least two of the operation order, operation priority and operation frequency corresponding to application icon 1, application icon 3 and application icon 5, thereby determining the arrangement order of application icon 1, application icon 3 and application icon 5 in the first preset area, which is not limited here.
[0056] In some implementations, the application icons are displayed in the application management interface according to the positions of the application icons.
[0057] For example, when the near-eye display device determines the positions of application icons of multiple application programs in the application management interface, the near-eye display device can display the application icons according to the positions of the application icons in the application management interface. When the corresponding application icons are displayed at the corresponding positions of the application management interface, the user can view the application icons in the application management interface, and the application icons can be used for corresponding interaction by the user.
[0058] In this way, by determining the positions of application icons of multiple applications in the application management interface based on at least one of the running order, running priority, and running frequency among the multiple applications, the near-eye display device can display the corresponding application icons in the application management interface based on the positions of the application icons, which is beneficial to improving the user's convenience in interacting with the application icons, and thus is beneficial to improving the convenience of switching the application interface corresponding to the application by the near-eye display device.
[0059] In some embodiments, when the total number corresponding to multiple application icons is greater than or equal to a preset number threshold, a first preset number of application icons of a first display size is displayed on the application management interface, and a second preset number of application icons of a second display size is displayed on the application management interface; the second display size is smaller than the first display size, the second preset number is smaller than the first preset number, and the first preset number is smaller than the preset number threshold.
[0060] For example, the interface size corresponding to the application management interface is limited. When the total number of application icons is greater than or equal to a preset number threshold, the near-eye display device cannot display all application icons on the same page corresponding to the application management interface. Figure 2 As shown, the near-eye display device can display a first preset number of application icons of a first display size in the application management interface, and display a second preset number of application icons of a second display size in the application management interface. The second display size is smaller than the first display size, the second preset number is smaller than the first preset number, and the first preset number is smaller than the preset number threshold. The preset number threshold can be set according to the interface size corresponding to the application management interface, or according to the area size of the preset area included in the application management interface, or can be pre-set or set by the user, which is not limited here.
[0061] The application icon of the second display size can be used to indicate the switching direction of the pages of the application management interface. For example, the application icon of the second display size can be located on one of the upper side, lower side, left side, and right side of the application icon of the first display size. In the case where the application icon of the second display size is located on the upper side of the application icon of the first display size, the switching direction of the application management interface can be from top to bottom. In the case where the application icon of the second display size is located on the lower side of the application icon of the first display size, the switching direction of the application management interface can be from bottom to top, and so on. By switching the pages of the application management interface, the user can view other application icons except the first preset number of application icons of the first display size.
[0062] Accordingly, when the page of the application management interface is switched, the display size of the application icon may change, and the positional relationship between application icons of different display sizes may change. Take the application management interface as an example, where application icons 1 to 6 are displayed on page 1. The display size of application icons 1 to 4 on page 1 is the first display size, the display size of application icons 5 to 6 on page 1 is the second display size, and application icons 1 to 4 are located on the upper side of application icons 5 to 6. When the page of the application management interface is switched from page 1 to page 2, page 2 may display application icons 3 to 8. Among them, the display size of application icons 3 to 4 on page 2 is the second display size, the display size of application icons 5 to 8 on page 2 is the first display size, and application icons 3 to 4 are located on the upper side of application icons 5 to 8. Of course, it is not limited to this, and no limitation is made here.
[0063] In this way, by displaying application icons of different display sizes on the application management interface, the user can be prompted with the page switching method of the application management interface, which is conducive to improving the convenience of page switching of the application management interface. Accordingly, by switching the pages of the application management interface, the user can more conveniently determine the application icon that needs to be interacted with from multiple application icons, which is conducive to improving the convenience of interaction with the application icons, and thus is conducive to improving the convenience of switching between application programs.
[0064] Exemplarily, the application identifier includes an application thumbnail. For example, the application thumbnail of the application program corresponds to the application program one by one. The application thumbnail can be used to indicate a thumbnail of an application interface corresponding to the corresponding application program.
[0065] In some implementations, application thumbnails of multiple application programs are displayed in a dispersed manner in the application management interface.
[0066] like Figure 3 As shown, the application management interface needs to display the application thumbnails of multiple applications, such as application thumbnails Figure 1 And application abbreviation Figure 2 When near-eye display devices can shrink applications Figure 1 And application abbreviation Figure 2 The plurality of application thumbnails are displayed separately in different preset areas of the application management interface. When the plurality of application thumbnails are displayed separately in the application management interface, the user can intuitively view the application thumbnails available for interaction, which is conducive to improving the convenience of interaction with the application thumbnails.
[0067] In some implementations, application thumbnails of multiple application programs are displayed in an overlapping manner in the application management interface.
[0068] like Figure 3 As shown, the application management interface needs to display the application thumbnails of multiple applications, such as application thumbnails Figure 3 And application abbreviation Figure 4 When the near-eye display device is used, the application thumbnails may be stacked and displayed based on the consideration of saving the occupied position range of the application management interface by the application thumbnails. Figure 3 And application abbreviation Figure 4 . Accordingly, the near-eye display device can display switching prompt information for the application thumbnails within the occupied position range corresponding to the application management interface of the multiple application thumbnails displayed in a stacked manner. The switching prompt information can be used to prompt the currently displayed application thumbnails among the multiple application thumbnails to be switched according to a preset switching direction. For example, the switching prompt information can be located on one of the upper side, lower side, left side, and right side of the multiple application thumbnails displayed in a stacked manner within the occupied position range corresponding to the application management interface, and is not limited here.
[0069] In this way, by displaying multiple application thumbnails in a dispersed manner and / or displaying multiple application thumbnails in a stacked manner on the application management interface, it is helpful to improve the display flexibility of the application thumbnails.
[0070] Exemplarily, after displaying the application management interface, the near-eye display device may perform corresponding operations in response to corresponding instructions for the application identifier.
[0071] In some implementations, in response to an instruction to move the application identifier, the position of the application identifier in the application management interface is changed.
[0072] For example, when a user needs to change the position of an application logo in an application management interface, the user can input a movement instruction for the application logo to the near-eye display device. The movement instruction can be determined based on the user's voice information, gesture information, touch information, etc., which is not limited here. When the near-eye display device detects the movement instruction for the application logo, it can change the position of the application logo in the application management interface according to the movement direction indicated by the movement instruction.
[0073] For example, when the moving direction indicated by the moving instruction is upward, the near-eye display device may move the application identifier upward to change the position of the application identifier in the application management interface. For another example, when the moving direction indicated by the moving instruction is leftward, the near-eye display device may move the application identifier leftward to change the position of the application identifier in the application management interface. Similarly, the near-eye display device may change the position of the application identifier in the application management interface in response to the moving instruction for the application identifier.
[0074] In this way, by responding to the movement instruction of the application identifier and changing the position of the application identifier in the application management interface, it is helpful to improve the convenience of the near-eye display device in changing the position of the application identifier.
[0075] In some implementations, in response to an instruction to select an application identifier, a display size of the application identifier on the application management interface is increased.
[0076] For example, when a user needs to select an application identifier, the user can input a selection instruction for the application identifier to the near-eye display device. The selection instruction can be determined based on the user's voice information, gesture information, touch information, etc., which is not limited here. When the near-eye display device detects the selection instruction for the application identifier, it can increase the display size of the application identifier in the application management interface to highlight the difference between the currently selected application identifier and the unselected application identifier.
[0077] like Figure 2 As shown, when the near-eye display device detects a selection instruction for application identifier 1, the near-eye display device can increase the display size of the application identifier in the application management interface. For example, the display size of application identifier 1 is increased from the first display size to the third display size. The third display size can be pre-set or set by the user, which is not limited here. By analogy, the near-eye display device can increase the display size of the application identifier in the application management interface in response to the selection instruction for the application identifier.
[0078] In this way, by responding to the selection instruction of the application logo and increasing the display size of the application logo in the application management interface, the user can intuitively view the currently selected application logo, so that the user can determine whether to interact with the application logo, which is conducive to improving the convenience of interaction of the near-eye display device with the application logo.
[0079] S103: When an operation instruction for the application identifier is detected, display or hide the application interface corresponding to the application program.
[0080] For example, the user can operate the application identifier to input an operation instruction for the application identifier to the near-eye display device. The operation instruction can be determined based on the user's voice information, gesture information, touch information, eye movement information, etc., which is not limited here.
[0081] When the near-eye display device detects an operation instruction for an application identifier, it can determine that the user needs to switch the application corresponding to the application identifier. For example, when the user needs to view the application interface corresponding to the application, the user operates the application identifier of the application to instruct the near-eye display device to display the application interface corresponding to the application. For another example, when the user does not need to continue to view the application interface corresponding to the application, the user operates the application identifier of the application to instruct the near-eye display device to hide the application interface corresponding to the application.
[0082] In some implementations, when the application interface is in a displayed state, the application interface is hidden in response to an operation instruction on the application identifier.
[0083] For example, when the application interface is in a display state, if the near-eye display device detects an operation instruction for the application identifier, the near-eye display device can determine that the user does not need to continue viewing the application interface. Based on this, the near-eye display device can hide the application interface.
[0084] In some implementations, when the application interface is in a hidden state, the application interface is displayed in response to an operation instruction on the application identifier.
[0085] For example, when the application interface is in a hidden state, if the near-eye display device detects an operation instruction for the application identifier, the near-eye display device can determine that the user needs to view the application interface. Based on this, the near-eye display device can display the application interface.
[0086] Based on this, by displaying or hiding the application interface corresponding to the application when an operation instruction for the application identifier is detected, the near-eye display device can switch the application by switching the display state of the application interface of the application to a display state or a hidden state.
[0087] For example, the applications currently running on the near-eye display device include application 1 and application 2.
[0088] For example, application interface 1 corresponding to application 1 is in a display state. Since application interface 2 corresponding to application 2 is blocked by application interface 1, application interface 2 is in a hidden state. If the near-eye display device detects an operation instruction for application identifier 1 of application 1, the near-eye display device can hide application interface 1, and accordingly, application interface 2 blocked by application interface 1 can be switched to a display state, thereby switching application 1 to application 2.
[0089] For another example, application interface 1 corresponding to application 1 is in a hidden state. Application interface 2 corresponding to application 2 is in a displayed state. If the near-eye display device detects an operation instruction for application identifier 1 of application 1, the near-eye display device can display application interface 1. Accordingly, application interface 2 can be switched to a hidden state because it is blocked by application interface 1, thereby switching application 2 to application 1.
[0090] In this way, by displaying or hiding the application interface corresponding to the application when an operation instruction for the application identifier is detected, switching between different applications can be achieved with the help of the application identifier included in the application management interface, which is conducive to improving the convenience of switching applications.
[0091] The above-mentioned embodiment provides an interaction method for a near-eye display device, the interaction method comprising: obtaining the current device posture of the near-eye display device; when the current device posture is within a preset posture range, displaying an application management interface; the application management interface includes an application identifier of an application currently running on the near-eye display device; when an operation instruction for the application identifier is detected, displaying or hiding an application interface corresponding to the application.
[0092] When the near-eye display device displays the application management interface, the near-eye display device can display or hide the application interface corresponding to the application through the operation instruction of the application identifier of the application in the application management interface. Accordingly, the application management interface can include the application identifiers of multiple applications, and the near-eye display device can switch the application interfaces corresponding to the multiple applications through the application management interface, which is conducive to improving the convenience of switching applications by the near-eye display device.
[0093] See also Figure 4 , Figure 4 1 is a schematic block diagram of an interaction device of a near-eye display device provided in an embodiment of the present application. The interaction device can be configured in a near-eye display device to execute the aforementioned interaction method of the near-eye display device. The near-eye display device may include AR glasses, MR glasses, AR helmets, MR helmets, etc., which are not limited here.
[0094] like Figure 4 As shown, the interaction device includes a posture acquisition module 110 , an interface display module 120 and an interaction module 130 .
[0095] The posture acquisition module 110 is used to acquire the current device posture of the near-eye display device.
[0096] The interface display module 120 is used to display an application management interface when the current device posture is within a preset posture range; the application management interface includes an application identifier corresponding to the application currently running on the near-eye display device.
[0097] The interaction module 130 is used to display or hide the application interface corresponding to the application program when an operation instruction for the application identifier is detected.
[0098] Exemplarily, the interaction module 130 includes a first switching submodule and a second switching submodule.
[0099] The first switching submodule is used to hide the application interface in response to an operation instruction on the application identifier when the application interface is in a display state.
[0100] The second switching submodule is used to display the application interface in response to an operation instruction on the application identifier when the application interface is in a hidden state.
[0101] Exemplarily, the application identifier includes an application icon.
[0102] The interaction device includes a position determination submodule.
[0103] The position determination submodule is used to determine the position of the application icons of the multiple application programs on the application management interface according to at least one of the running order, running priority and running frequency among the multiple application programs.
[0104] The interface display module 120 includes a first display submodule.
[0105] The first display submodule is used to display the application icon in the application management interface according to the position of the application icon.
[0106] Exemplarily, the application identifier includes an application icon.
[0107] The interface display module 120 includes a second display submodule.
[0108] A second display submodule is used to display a first preset number of application icons of a first display size on the application management interface, and to display a second preset number of application icons of a second display size on the application management interface when the total number corresponding to multiple application icons is greater than or equal to a preset number threshold; the second display size is smaller than the first display size, the second preset number is smaller than the first preset number, and the first preset number is smaller than the preset number threshold.
[0109] Exemplarily, the application identifier includes an application thumbnail.
[0110] The interface display module 120 includes a third display submodule and a fourth display submodule.
[0111] The third display submodule is used to disperse and display the application thumbnails of each of the plurality of application programs in the application management interface.
[0112] The fourth display submodule is used to display the application thumbnails of the plurality of application programs in a stacked manner in the application management interface.
[0113] Exemplarily, the interaction device further includes a position change submodule.
[0114] The position changing submodule is used to change the position of the application identifier in the application management interface in response to a moving instruction for the application identifier.
[0115] Exemplarily, the interaction device further includes a size changing submodule.
[0116] The size changing submodule is used to increase the display size of the application logo in the application management interface in response to a selection instruction for the application logo.
[0117] It should be noted that technicians in the relevant field can clearly understand that for the convenience and simplicity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0118] The method of the present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.
[0119] Exemplarily, the above method and apparatus may be implemented in the form of a computer program, which may be run on a near-eye display device to interact with the near-eye display device. Exemplarily, the near-eye display device may include AR glasses, MR glasses, AR helmets, MR helmets, etc., which are not limited here.
[0120] See also Figure 5 , Figure 5It is a schematic block diagram of the structure of a near-eye display device provided in an embodiment of the present application.
[0121] like Figure 5 As shown, the near-eye display device includes a memory and a processor. The memory and the processor may be connected via a system bus, and the memory may include a storage medium and an internal memory.
[0122] The storage medium may store an operating system and a computer program. When the computer program is executed, the processor may execute any interaction method of a near-eye display device.
[0123] The processor is used to provide computing and control capabilities to support the operation of the entire near-eye display device.
[0124] The internal memory provides an environment for the operation of the computer program in the storage medium. When the computer program is executed by the processor, the processor can execute any interaction method of the near-eye display device.
[0125] Those skilled in the art will understand that Figure 5 The structure shown in the figure is merely a block diagram of a portion of the structure related to the scheme of the present application, and does not constitute a limitation on the near-eye display device to which the scheme of the present application is applied. The specific near-eye display device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0126] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0127] In one embodiment, the processor is used to execute a computer program and implement the following steps when executing the computer program:
[0128] Get the current device posture of the near-eye display device;
[0129] When the current device posture is within a preset posture range, an application management interface is displayed; the application management interface includes an application identifier of the application currently running on the near-eye display device;
[0130] When an operation instruction for the application identifier is detected, the application interface corresponding to the application program is displayed or hidden.
[0131] It should be noted that technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific working process of the interaction of the near-eye display device described above can refer to the corresponding process in the aforementioned embodiment of the interaction method of the near-eye display device, and will not be repeated here.
[0132] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The method implemented when the computer program is executed by a processor can refer to the various embodiments of the interaction method of the near-eye display device of the present application.
[0133] The computer-readable storage medium may be an internal storage unit of the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the near-eye display device. The computer-readable storage medium may also be an external storage device of the near-eye display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the near-eye display device.
[0134] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.
[0135] It should also be understood that the term "and / or" used in the specification of this application and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.
[0136] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.
Claims
1. An interactive method for a near-eye display device, characterized in that: include: Get the current device posture of the near-eye display device; When the current device posture is within a preset posture range, displaying an application management interface; The application management interface includes an application identifier of an application currently running on the near-eye display device; When an operation instruction for the application identifier is detected, the application interface corresponding to the application program is displayed or hidden.
2. The interactive method according to claim 1, characterized in that: When an operation instruction for the application identifier is detected, displaying or hiding an application interface corresponding to the application program includes: When the application interface is in a display state, in response to an operation instruction on the application identifier, hiding the application interface; or, When the application interface is in a hidden state, the application interface is displayed in response to an operation instruction on the application identifier.
3. The interactive method according to claim 1, characterized in that: The application identification includes an application icon; Before displaying the application management interface, the interaction method further includes: Determining positions of application icons of the multiple application programs on the application management interface according to at least one of an operation order, an operation priority, and an operation frequency among the multiple application programs; The display application management interface includes: The application icon is displayed in the application management interface according to the position of the application icon.
4. The interactive method according to claim 1, characterized in that: The application identification includes an application icon; The display application management interface includes: When the total number of the multiple application icons is greater than or equal to a preset number threshold, a first preset number of application icons of a first display size are displayed on the application management interface, and a second preset number of application icons of a second display size are displayed on the application management interface; The second display size is smaller than the first display size, the second preset number is smaller than the first preset number, and the first preset number is smaller than the preset number threshold.
5. The interactive method according to claim 1, characterized in that: The application identification includes an application thumbnail; The display application management interface includes: Dispersedly displaying application thumbnails of respective multiple application programs in the application management interface; and / or, The application thumbnails of the plurality of application programs are stacked and displayed in the application management interface.
6. The interactive method according to any one of claims 1 to 5, characterized in that: After displaying the application management interface, the interaction method further includes: In response to the move instruction for the application identifier, the position of the application identifier in the application management interface is changed.
7. The interactive method according to any one of claims 1 to 5, characterized in that: After displaying the application management interface, the interaction method further includes: In response to a selection instruction for the application identifier, a display size of the application identifier in the application management interface is increased.
8. An interactive device for a near-eye display device, characterized in that: The interactive device comprises: A posture acquisition module, used to obtain the current device posture of the near-eye display device; An interface display module, configured to display an application management interface when the current device posture is within a preset posture range; the application management interface includes an application identifier corresponding to an application currently running on the near-eye display device; The interaction module is used to display or hide the application interface corresponding to the application program when an operation instruction for the application identifier is detected.
9. A near-eye display device, characterized in that: The near-eye display device includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the steps of the interaction method of the near-eye display device according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the interaction method of the near-eye display device according to any one of claims 1 to 7 are implemented.
