Interaction method of near-to-eye display equipment, near-to-eye display equipment and storage medium

Through the integrated touch device and processor on the near -eye display device, the user's operating information is obtained and the display content is determined, the problem of low delay and convenience during the equipment interaction process is solved, and a more efficient interactive experience is achieved.

CN119367756APending Publication Date: 2025-01-28ZHUHAI MOJIE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411345593.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-25
Publication Date
2025-01-28

AI Technical Summary

Technical Problem

Existing near-eye display devices are prone to display delays during the interaction process, and are less convenient to use, so external devices are required to interact.

Method used

Provide an interactive method of a near -eye display device, use a touch device to obtain the user's operating information, and determine the display content based on the operating information and the location information of the interactive object. The device includes touch devices, memory and processors, which can interact without external devices.

Benefits of technology

The display delay of the near -eye display device in the interactive process has enhanced the convenience of the equipment and enriched the use scenario.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119367756A_ABST
    Figure CN119367756A_ABST
Patent Text Reader

Abstract

The invention provides an interaction method of a near-to-eye display device, the near-to-eye display device and a storage medium, the method comprises the following steps: in response to a starting instruction of a target game, displaying a first game picture corresponding to the target game, the first game picture comprising at least one to-be-interacted object; in the process of displaying the first game picture, obtaining operation information of a user through the touch device; and according to the operation information and the position information of the to-be-interacted object in the first game picture, determining the display content of the near-to-eye display equipment. The display delay of the near-to-eye display device in the interaction process can be reduced, and the use convenience of the near-to-eye display device is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of human-computer interaction, and in particular to an interaction method of a near-eye display device, a near-eye display device, and a storage medium. Background Art

[0002] Nowadays, near-eye display devices are gradually entering people's daily lives. Users can play games or learn through near-eye display devices. However, when users play games through near-eye display devices, some solutions interact with the game screen displayed by the near-eye display device by recognizing the user's gestures. These solutions need to analyze and calculate a large number of complex gesture commands in a short period of time, which may easily lead to problems such as display delays during the interaction process. In other solutions, the game screen displayed by the near-eye display device is interacted with through external devices. These solutions require the configuration and carrying of external devices, resulting in low convenience of use of near-eye display devices. Summary of the invention

[0003] The present application provides an interaction method of a near-eye display device, a near-eye display device and a storage medium, aiming to reduce the display delay of the near-eye display device during the interaction process and improve the ease of use of the near-eye display device.

[0004] In a first aspect, the present application provides an interaction method of a near-eye display device, wherein the near-eye display device is provided with a touch device, and the interaction method of the near-eye display device comprises the following steps:

[0005] In response to a start instruction of a target game, displaying a first game screen corresponding to the target game, wherein the first game screen includes at least one object to be interacted with;

[0006] In the process of displaying the first game screen, obtaining user operation information through the touch control device;

[0007] The display content of the near-eye display device is determined according to the operation information and the position information of the object to be interacted with in the first game screen.

[0008] In a second aspect, the present application further provides a near-eye display device, the near-eye display device comprising a touch device, a memory, and a processor;

[0009] The touch control device is used to obtain user operation information;

[0010] The memory is used to store computer programs;

[0011] The processor is used to execute the computer program and implement the steps of the interaction method of the near-eye display device provided in the first aspect when executing the computer program.

[0012] In a third aspect, the present application further provides a storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the interaction method of the near-eye display device as described above are implemented.

[0013] The present application provides an interaction method for a near-eye display device, a near-eye display device and a storage medium. When the near-eye display device displays a first game screen, a user wearing the near-eye display device can use a touch device on the near-eye display device to operate the game. There is no need for the near-eye display device to analyze and calculate a large number of gesture instructions in a short period of time, and there is no need to connect the near-eye display device to an external device, thereby reducing the display delay of the near-eye display device during the interaction process and improving the ease of use of the near-eye display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0015] Figure 1 A schematic diagram of a flow chart of an interaction method of a near-eye display device provided in an embodiment of the present application;

[0016] Figure 2a A schematic diagram of a first game screen provided by an embodiment of the present application;

[0017] Figure 2b A schematic diagram of a first game screen provided by another embodiment of the present application;

[0018] Figure 3 A schematic block diagram of the structure of a near-eye display device provided in one embodiment of the present application;

[0019] Figure 4 A schematic diagram of a near-eye display device provided in one embodiment of the present application.

[0020] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0022] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0023] The embodiment of the present application provides an interaction method of a near-eye display device, a near-eye display device, and a storage medium. The interaction method of the near-eye display device can be applied to a near-eye display device, which can be a device that provides one of the following technologies, wherein the provided technology includes augmented reality technology (AR), virtual reality technology (VR), and mixed reality technology (MR). Specifically, the near-eye display device includes but is not limited to AR glasses, VR glasses, MR glasses, AR helmets, VR helmets, and MR helmets, etc., which are not limited here.

[0024] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0025] Please refer to Figure 1 , Figure 1 A flowchart of an interaction method for a near-eye display device provided in an embodiment of the present application.

[0026] like Figure 1 As shown, the interaction method of the near-eye display device includes steps S101 to S103.

[0027] Step S101: In response to a start instruction of a target game, a first game screen corresponding to the target game is displayed, wherein the first game screen includes at least one object to be interacted with.

[0028] Exemplarily, the target game includes a music game or other game that requires clicks for interaction. Specifically, the first game screen corresponding to the target game includes at least one object to be interacted with, and when the object to be interacted with moves in the first game screen and moves to the target position, the user needs to make a corresponding interactive gesture to achieve interaction with the target game; in other embodiments, during the movement of the object to be interacted with in the first game screen, the near-eye display device also plays corresponding game music to enhance the user's gaming immersion, wherein the played game music corresponds to the object to be interacted with in the first game screen. For example, the played game music has drum sounds or rebeats at the moment when the object to be interacted with moves to the target position, so that the first game screen matches the music, thereby enhancing the user's gaming interaction experience.

[0029] It should be understood that the movement rate of the objects to be interacted with displayed on the first game screen increases with the game time of the target game, and / or the number of objects to be interacted with displayed on the first game screen increases with the game time of the target game, so as to achieve the effect of gradually increasing the difficulty of the target game, thereby enhancing the user's game interaction experience.

[0030] It should be noted that the first game screen is a non-static screen, that is, the object to be interacted with will move in the first game screen, and when it moves to the target position, if the user operates through the touch device, it can be determined that the user has successfully interacted with the object to be interacted with, or other interaction rules can be used to determine whether the user has successfully interacted with the object to be interacted with in the first game screen, which is not limited here.

[0031] Step S102: While displaying the first game screen, obtaining user operation information through the touch device.

[0032] Exemplarily, during the process of the near-eye display device displaying a first game screen, a user wearing the near-eye display device operates the touch device on the near-eye display device based on the first game screen, so that the near-eye display device obtains the user's operation information through the touch device, wherein the user's operation information includes click or slide operations, so that the near-eye display device adjusts the display content and feeds back to the user according to the user's operation information, thereby realizing the interaction between the user and the near-eye display device.

[0033] In the specific implementation process, the near-eye display device is AR glasses, and the touch device is a touch bar installed on the temples of the AR glasses, so that the AR glasses can determine the user's operation information by obtaining the user's operation on the touch bar, and the user can also interact with the AR glasses for games through the touch bar, which improves the convenience and timeliness of the interaction between the user and the AR glasses and enriches the usage scenarios of the AR glasses.

[0034] Step S103: Determine the display content of the near-eye display device according to the operation information and the position information of the object to be interacted with in the first game screen.

[0035] Exemplarily, after obtaining the user's operation information through the touch device, the display content that needs to be displayed by the near-eye display device is determined according to the operation information and the position information of the object to be interacted with in the first game screen.

[0036] Specifically, the operation time of the operation information is determined according to the operation information, and the position information of the object to be interacted with on the first game screen at the operation time is determined, so as to determine the display content according to the position information of the object to be interacted with and the operation information corresponding to the operation time.

[0037] The user's operation information is obtained by a touch device arranged on the near-eye display device, so that when playing small games using the near-eye display device, there is no need for an external control device, which improves the convenience of using the near-eye display device, reduces the display delay during the interaction with the near-eye display device, and enriches the usage scenarios of the near-eye display device.

[0038] In some embodiments, the operation information includes a click operation, and determining the display content of the near-eye display device based on the operation information and the position information of the object to be interacted with in the first game screen includes: determining the display content of the near-eye display device based on the moment of the click operation and the position information of the object to be interacted with in the first game screen; and / or determining the display content of the near-eye display device based on the number of click operations within a preset time length and the position information of multiple objects to be interacted with in the first game screen within the preset time length.

[0039] Exemplarily, a user wearing a near-eye display device clicks the touch device so that the touch device obtains operation information of the click operation, determines the moment of the click operation, determines the display content of the near-eye display device based on the game screen corresponding to the moment of the click operation, and determines the position information of the object to be interacted with in the click operation and the game screen.

[0040] In other embodiments, a click operation is obtained through a touch device, and the number of click operations within a preset time length is determined, and the position information of multiple objects to be interacted with in the first game screen within the preset time length is determined to determine the display content of the near-eye display device. Specifically, the position information of multiple objects to be interacted with in the first game screen includes the position information corresponding to each moment of the objects to be interacted with in the preset time length, or position movement information, etc., which is not limited here.

[0041] In some embodiments, the display content of the near-eye display device is determined based on the moment of the click operation and the position information of the object to be interacted with in the first game screen, including: if at the moment of the click operation, there is at least one object to be interacted with located at the target click position of the first game screen, determining the first display content used to indicate a successful click; if at the moment of the click operation, all the objects to be interacted with in the first game screen are located outside the target click position, determining the second display content used to indicate a failed click.

[0042] Exemplarily, the moment of the click operation is the moment when the user clicks the touch device. If at this moment, there is at least one object to be interacted with located at the target click position of the first game screen, then the first display content indicating a successful click is determined and displayed, wherein the first display content of a successful click includes but is not limited to other multimedia information such as animations or images indicating a successful click. In other embodiments, sound effects can also be played synchronously when displaying the first display content of a successful click, so that the user can perceive the successful click, thereby enabling interaction between the user and the near-eye display device.

[0043] Exemplarily, if at the moment of the click operation, all the objects to be interacted with in the first game screen are outside the target click position, then the second display content used to indicate the failure of the click is determined and displayed. It should be understood that sound effects can also be played synchronously when displaying the second display content to enhance user perception. It should be understood that the sound effects played when displaying the first display content are different from the sound effects played when displaying the second display content, and can be set according to actual conditions and are not limited here.

[0044] See also Figure 2a and Figure 2b , Figure 2a A schematic diagram of a first game screen provided by an embodiment of the present application; Figure 2b A schematic diagram of a first game screen provided in another embodiment of the present application.

[0045] In a specific embodiment, Figure 2a As shown, the target click position is the position of the preset straight line. At the time of the click operation, if there is a pattern corresponding to the object to be interacted that intersects with the preset straight line, it is determined that there is an object to be interacted at the target click position. Conversely, if at the time of the click operation, the patterns corresponding to all the objects to be interacted are separated from the preset straight line, it is determined that all the objects to be interacted are located outside the target click position; or Figure 2b As shown, the target click position is a preset position in the first game screen. It should be understood that the moving trajectory of the pattern corresponding to the interactive object can be adjusted according to the target click position. Figure 2a As shown in , the moving trajectory of the pattern corresponding to the object to be interacted is a straight line. If the target click position is Figure 2b As shown, the moving track of the pattern corresponding to the object to be interacted with can be a curve, which is not limited here.

[0046] In some embodiments, the display content of the near-eye display device is determined based on the number of click operations within a preset time length and the position information of multiple objects to be interacted with in the first game screen within the preset time length, including: if the absolute value of the difference between the number of click operations and the number of objects to be interacted with that pass the target click position in the first game screen within the preset time length is less than or equal to a preset difference threshold, determining the third display content for indicating that the current level is passed; if the absolute value of the difference between the number of click operations and the number of objects to be interacted with that pass the target click position in the first game screen within the preset time length is greater than the preset difference threshold, determining the fourth display content for indicating that the current level is not passed.

[0047] It should be understood that during the game process of the target game, the pattern corresponding to the object to be interacted with will move and may or may not pass through the target click position. Whether the user has passed the current level can be determined based on the number of objects to be interacted with that pass the target click position within the preset time length and the number of click operations within the preset time length.

[0048] Specifically, if within a preset time period, the absolute value difference between the number of click operations and the number of objects to be interacted with that pass the target click position in the first game screen is less than or equal to a preset difference threshold, then the third display content indicating that the current level has been passed is determined, and after the current level is completed, the first game screen is changed to the third display content for display; otherwise, the fourth display content indicating that the current level has not been passed is determined, and after the current level is completed, the first game screen is changed to the fourth display content.

[0049] In other embodiments, within the preset time period, whether the click is successful is determined based on the moment of the click operation and the position information of the object to be interacted with in the first game screen at that moment. For the specific determination process, please refer to the previous embodiment, which will not be repeated here.

[0050] In the specific implementation process, the current level can also be scored according to the click completion degree, and the scoring information can be displayed after the current level is completed. For example, at the moment of the click operation, the click completion degree of the object to be interacted with is determined based on the intersection area or position of the pattern corresponding to the object to be interacted with and the target click position. The click completion degree of the object to be interacted with can also be determined according to other methods, which are not limited here.

[0051] In other embodiments, the first game screen is a static screen, and the first game screen includes multiple objects to be interacted with, and the number of click operations is obtained within a preset time length. If the absolute value of the difference between the number of click operations obtained and the number of objects to be interacted with in the first game screen is less than or equal to the preset difference threshold, the third display content indicating that the current level has been passed is determined, and if the absolute value of the difference between the number of click operations obtained and the number of objects to be interacted with in the first game screen is greater than the preset difference threshold, the fourth display content indicating that the current level has not been passed is determined. It should be understood that the rules for determining whether to pass the current level can be determined according to actual needs, and are not limited here.

[0052] In some embodiments, after the near-eye display device displays the fourth display content, the method further includes: adjusting at least one of the preset duration, the preset difference threshold, the number of the objects to be interacted with in the first game screen, and the movement speed of the objects to be interacted with in the first game screen to obtain a second game screen; in response to an instruction to restart the game, displaying the second game screen; in the process of displaying the second game screen, obtaining user operation information through the touch device; determining the display content of the near-eye display device based on the operation information obtained in the process of displaying the second game screen and the position information of the objects to be interacted with in the second game screen.

[0053] Exemplarily, after the near-eye display device displays the fourth display content, at least one of the preset time length, the preset difference threshold, the number of objects to be interacted with in the first game screen, and the movement speed of the objects to be interacted with in the first game screen is adjusted to obtain a second game screen to reduce the level difficulty.

[0054] Specifically, the preset duration is reduced, the preset difference threshold is increased, the number of objects to be interacted with in the first game screen is reduced, and the moving speed of the objects to be interacted with in the first game screen is reduced to reduce the level difficulty.

[0055] Exemplarily, after adjusting at least one of the above-mentioned game level parameters, a second game screen is obtained, and in response to an instruction to re-play the game, the second game screen is displayed to the user; thereby, in the process of displaying the second game screen, the user's operation information is obtained through the touch device, so as to determine the display content of the near-eye display device based on the operation information obtained in the process of displaying the second game screen and the position information of the object to be interacted with in the second game screen.

[0056] It should be understood that by adjusting the game level parameters to reduce the difficulty of the game level, the difficulty of the level when the user enters the level again is lower than the difficulty of the first time entering the level, so as to improve the user's gaming experience.

[0057] In some embodiments, the objects to be interacted with include a first type of objects to be interacted with and a second type of objects to be interacted with; determining the display content of the near-eye display device based on the moment of the click operation and the position information of the objects to be interacted with in the first game screen includes: if the click operation is a single click, and at the moment of the click operation, the first type of object to be interacted with is located at the target click position in the first game screen, determining the first display content used to indicate a successful click; if the click operation is a double click, and at the moment of the click operation, the second type of object to be interacted with is located at the target click position in the first game screen, determining the first display content used to indicate a successful click.

[0058] Exemplarily, the objects to be interacted with include at least a first type of objects to be interacted with and a second type of objects to be interacted with, and different types of objects to be interacted with use different click operation rules to determine whether the click is successful. Specifically, the first type of objects to be interacted with corresponds to a single click operation (single click), and the second type of objects to be interacted with corresponds to a double click operation (double click); that is, a single click operation can trigger a successful click on the first type of objects to be interacted with, but will trigger a failed click on the second type of objects to be interacted with. Similarly, a double click operation can trigger a successful click on the second type of objects to be interacted with, but will trigger a failed click on the first type of objects to be interacted with. It should be noted that the time interval between the two click operations is short, or in the time period corresponding to the moment when the pattern corresponding to the second type of objects to be interacted enters the target click position to the moment when it completely leaves the target click position, two click operations must be completed to trigger a successful click, and then the corresponding display content is determined based on whether the click is successful.

[0059] Exemplarily, the pattern corresponding to the first type of object to be interacted with is different from the pattern corresponding to the second type of object to be interacted with. For example, the pattern corresponding to the first type of object to be interacted with is a single circle, and the pattern corresponding to the second type of object to be interacted with is a double circle; or the pattern corresponding to the first type of object to be interacted with is a circle, and the pattern corresponding to the second type of object to be interacted with is a rectangle; the pattern corresponding to the first type of object to be interacted with and the pattern corresponding to the second type of object to be interacted with can be set according to actual usage requirements and are not limited here.

[0060] In other embodiments, the objects to be interacted with may also include a third type of objects to be interacted with, the trigger rule corresponding to the third type of objects to be interacted with is three or more click operations, and the patterns corresponding to the third type of objects to be interacted with include but are not limited to circles, rectangles, irregular shapes, etc., which are not limited here.

[0061] By providing various types of objects to be interacted with, users can interact with the objects to be interacted with in various ways, thereby improving the user's gaming experience.

[0062] In some embodiments, the operation information includes a sliding operation, and determining the display content of the near-eye display device based on the operation information and the position information of the object to be interacted with in the first game screen includes: if the operation information includes a first sliding trajectory, adjusting the game progress of the target game according to the first sliding trajectory, and determining the display content of the near-eye display device according to the adjusted game progress; if the operation information includes a second sliding trajectory, exiting the target game according to the second sliding trajectory, and determining a screen containing multiple preset games as the display content of the near-eye display device.

[0063] Exemplarily, during the process of displaying the first game screen, if the first sliding track is obtained through the touch device, the game progress of the target game is adjusted, and the display content is determined according to the adjusted game progress to display the first game screen corresponding to the adjusted game progress.

[0064] In a specific implementation process, adjusting the game progress of the target game includes but is not limited to adjusting the level progress of the current level of the target game, or adjusting the level of the target game so that the user can adjust the current level or select a level to play from multiple levels in the target game.

[0065] Exemplarily, during the process of displaying the first game screen, if the second sliding trajectory is obtained through the touch device, the target game is exited, and the displayed first game screen is changed to a screen containing multiple preset games, so that the user can select a game, thereby enriching the usage scenarios of the near-eye display device.

[0066] In some embodiments, the near-eye display device includes AR glasses, and the touch device is provided on at least one temple of the AR glasses to obtain user operation information; wherein, the angle between the first sliding trajectory and the straight line where the temple of the AR glasses is located is less than or equal to a preset angle, and the angle between the second sliding trajectory and the straight line where the temple of the AR glasses is located is greater than the preset angle.

[0067] Exemplarily, taking the near-eye display device as AR glasses, a touch device is provided on at least one temple of the AR glasses to obtain user operation information, and the angle between the first sliding trajectory and the straight line where the temple of the AR glasses is located is less than or equal to a preset angle, while the angle between the second sliding trajectory and the straight line where the temple of the AR glasses is located is greater than the preset angle.

[0068] Specifically, the preset angle is 45°. After the sliding track is acquired through the touch device, the angle between the sliding track and the straight line where the temple is located is determined. If the angle between the sliding track and the straight line where the temple is located is less than or equal to 45°, the sliding track is the first sliding track; if the angle between the sliding track and the straight line where the temple is located is greater than 45°, the sliding track is the second sliding track. It should be noted that the preset angle can be set according to the user's usage habits and specific usage scenarios, and this application is not limited thereto.

[0069] In a specific implementation process, the touch device is a touch pad, which is arranged on at least one temple of the AR glasses to obtain the user's operation information when the user touches the touch pad on the temple of the AR glasses. For example, when the user's finger slides on the touch pad, the user's sliding trajectory can be obtained through the touch pad to control the display content of the near-eye display device according to the sliding trajectory.

[0070] The user's sliding trajectory is obtained through the touch device to control the near-eye display device according to the determined sliding trajectory, thereby improving the interaction convenience between the user and the near-eye display device.

[0071] The above-mentioned embodiment provides an interactive method for a near-eye display device. When the near-eye display device displays a first game screen, a user wearing the near-eye display device can use a touch device on the near-eye display device to perform interactive operations on the game without connecting the near-eye display device to an external device, thereby improving the ease of use of the near-eye display device and reducing the display delay of the near-eye display device during the interactive process.

[0072] See also Figure 3 , Figure 3 A schematic block diagram of the structure of a near-eye display device provided in one embodiment of the present application.

[0073] like Figure 3 As shown, the near-eye display device includes a touch device, a memory and a processor. The touch device is used to obtain user operation information; the memory is used to store computer programs; the processor is used to execute the computer program and implement any embodiment of the interaction method of the near-eye display device provided above when executing the computer program.

[0074] Those skilled in the art will understand that Figure 3 The structure shown in the figure is merely a block diagram of a portion of the structure related to the scheme of the present application, and does not constitute a limitation on the near-eye display device to which the scheme of the present application is applied. The specific near-eye display device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0075] See also Figure 4 , Figure 4A schematic diagram of a near-eye display device provided in one embodiment of the present application.

[0076] like Figure 4 As shown, in a specific implementation, the near-eye display device is an AR glasses 100, and the touch device 110 is arranged on the temples of the AR glasses 100 to obtain the user's operation information.

[0077] In other embodiments, the near-eye display device may also be a head-mounted display device such as an AR helmet, a VR helmet, and an MR helmet. This application does not limit the specific type of display device the near-eye display device is.

[0078] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0079] In one embodiment, the processor is used to run a computer program stored in the memory to implement the following steps:

[0080] In response to a start instruction of a target game, displaying a first game screen corresponding to the target game, wherein the first game screen includes at least one object to be interacted with;

[0081] In the process of displaying the first game screen, obtaining user operation information through the touch control device;

[0082] The display content of the near-eye display device is determined according to the operation information and the position information of the object to be interacted with in the first game screen.

[0083] In one embodiment, when the processor determines the display content of the near-eye display device according to the operation information and the position information of the object to be interacted in the first game screen, it is used to implement:

[0084] Determining the display content of the near-eye display device according to the time of the click operation and the position information of the object to be interacted with in the first game screen; and / or

[0085] The display content of the near-eye display device is determined according to the number of click operations within a preset time length and the position information of the multiple objects to be interacted with in the first game screen within the preset time length.

[0086] In one embodiment, when the processor determines the display content of the near-eye display device according to the time of the click operation and the position information of the object to be interacted in the first game screen, it is used to implement:

[0087] If at the moment of the click operation, at least one of the objects to be interacted with is located at the target click position of the first game screen, determining first display content for indicating a successful click;

[0088] If, at the moment of the click operation, all the objects to be interacted with in the first game screen are located outside the target click position, a second display content for indicating a click failure is determined.

[0089] In one embodiment, when the processor determines the display content of the near-eye display device according to the number of click operations within a preset time length and the position information of the multiple objects to be interacted with in the first game screen within the preset time length, it is used to implement:

[0090] If within the preset time period, the absolute value of the difference between the number of click operations and the number of objects to be interacted with that pass the target click position in the first game screen is less than or equal to a preset difference threshold, determining a third display content for indicating that the current level is passed;

[0091] If within the preset time length, the absolute value of the difference between the number of click operations and the number of objects to be interacted with that pass the target click position in the first game screen is greater than the preset difference threshold, the fourth display content is determined to indicate that the current level has not been passed.

[0092] In one embodiment, after displaying the fourth display content, the processor is further configured to implement:

[0093] Adjust at least one of the length of the preset time, the preset difference threshold, the number of the objects to be interacted with in the first game screen, and the moving speed of the objects to be interacted with in the first game screen to obtain a second game screen;

[0094] In response to an instruction to restart the game, displaying the second game screen;

[0095] In the process of displaying the second game screen, obtaining user operation information through the touch control device;

[0096] The display content of the near-eye display device is determined according to the operation information obtained during the display of the second game screen and the position information of the object to be interacted with in the second game screen.

[0097] In one embodiment, when the processor determines the display content of the near-eye display device according to the time of the click operation and the position information of the object to be interacted in the first game screen, it is used to implement:

[0098] If the click operation is a single click, and at the time of the click operation, the first type of to-be-interacted object is located at a target click position in the first game screen, determining first display content for indicating a successful click;

[0099] If the click operation is a double-click, and at the time of the click operation there is the second type of object to be interacted with located at the target click position in the first game screen, a first display content for indicating a successful click is determined.

[0100] In one embodiment, when the processor determines the display content of the near-eye display device according to the operation information and the position information of the object to be interacted in the first game screen, it is used to implement:

[0101] If the operation information includes a first sliding track, adjusting the game progress of the target game according to the first sliding track, and determining the display content of the near-eye display device according to the adjusted game progress;

[0102] If the operation information includes a second sliding trajectory, the target game is exited according to the second sliding trajectory, and a screen containing multiple preset games is determined as the display content of the near-eye display device.

[0103] It should be noted that technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific working process of the near-eye display device described above can refer to the corresponding processes in the various embodiments of the interaction method of the aforementioned near-eye display device, and will not be repeated here.

[0104] An embodiment of the present application further provides a storage medium having a computer program stored thereon. The computer program includes program instructions. The method implemented when the program instructions are executed can refer to the various embodiments of the interaction method of the near-eye display device of the present application.

[0105] The storage medium may be an internal storage unit of the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the near-eye display device. The storage medium may also be an external storage device of the near-eye display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the near-eye display device.

[0106] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0107] It should also be understood that the term "and / or" used in the specification of this application and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.

[0108] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. An interactive method for a near-eye display device, characterized in that: The near-eye display device is provided with a touch device, and the interaction method of the near-eye display device includes: In response to a start instruction of a target game, displaying a first game screen corresponding to the target game, wherein the first game screen includes at least one object to be interacted with; In the process of displaying the first game screen, obtaining user operation information through the touch control device; The display content of the near-eye display device is determined according to the operation information and the position information of the object to be interacted with in the first game screen.

2. The interaction method of the near-eye display device according to claim 1, characterized in that: The operation information includes a click operation, and determining the display content of the near-eye display device according to the operation information and the position information of the object to be interacted with in the first game screen includes: Determining the display content of the near-eye display device according to the time of the click operation and the position information of the object to be interacted with in the first game screen; and / or The display content of the near-eye display device is determined according to the number of click operations within a preset time length and the position information of the multiple objects to be interacted with in the first game screen within the preset time length.

3. The interaction method of the near-eye display device according to claim 2, characterized in that: The determining, according to the time of the click operation and the position information of the object to be interacted with in the first game screen, the display content of the near-eye display device includes: If at the moment of the click operation, at least one of the objects to be interacted with is located at the target click position of the first game screen, determining first display content for indicating a successful click; If, at the moment of the click operation, all the objects to be interacted with in the first game screen are located outside the target click position, a second display content for indicating a click failure is determined.

4. The interaction method of the near-eye display device according to claim 2, characterized in that: The determining, according to the number of click operations within a preset time period and the position information of the plurality of objects to be interacted with in the first game screen within the preset time period, the display content of the near-eye display device comprises: If within the preset time period, the absolute value of the difference between the number of click operations and the number of objects to be interacted with that pass the target click position in the first game screen is less than or equal to a preset difference threshold, determining a third display content for indicating that the current level is passed; If within the preset time length, the absolute value of the difference between the number of click operations and the number of objects to be interacted with that pass the target click position in the first game screen is greater than the preset difference threshold, the fourth display content is determined to indicate that the current level has not been passed.

5. The interaction method of the near-eye display device according to claim 4, characterized in that: After the near-eye display device displays the fourth display content, the method further includes: Adjust at least one of the preset duration, the preset difference threshold, the number of the objects to be interacted with in the first game screen, and the moving speed of the objects to be interacted with in the first game screen to obtain a second game screen; In response to an instruction to restart the game, displaying the second game screen; In the process of displaying the second game screen, obtaining user operation information through the touch control device; The display content of the near-eye display device is determined according to the operation information obtained during the display of the second game screen and the position information of the object to be interacted with in the second game screen.

6. The interaction method of the near-eye display device according to claim 2, characterized in that: The objects to be interacted with include first-type objects to be interacted with and second-type objects to be interacted with; and determining the display content of the near-eye display device according to the time of the click operation and the position information of the objects to be interacted with in the first game screen includes: If the click operation is a single click, and at the time of the click operation, the first type of to-be-interacted object is located at a target click position in the first game screen, determining first display content for indicating a successful click; If the click operation is a double-click, and at the time of the click operation there is the second type of object to be interacted with located at the target click position in the first game screen, a first display content for indicating a successful click is determined.

7. The interaction method of a near-eye display device according to any one of claims 1 to 6, characterized in that: The determining, according to the operation information and the position information of the object to be interacted with in the first game screen, the display content of the near-eye display device includes: If the operation information includes a first sliding track, adjusting the game progress of the target game according to the first sliding track, and determining the display content of the near-eye display device according to the adjusted game progress; If the operation information includes a second sliding trajectory, the target game is exited according to the second sliding trajectory, and a screen containing multiple preset games is determined as the display content of the near-eye display device.

8. The interaction method of the near-eye display device according to claim 7, characterized in that: The near-eye display device includes AR glasses, and the touch device is provided on at least one temple of the AR glasses to obtain user operation information; wherein, the angle between the first sliding trajectory and the straight line where the temple of the AR glasses is located is less than or equal to a preset angle, and the angle between the second sliding trajectory and the straight line where the temple of the AR glasses is located is greater than the preset angle.

9. A near-eye display device, characterized in that: The near-eye display device includes a touch device, a memory and a processor; The touch control device is used to obtain user operation information; The memory is used to store computer programs; The processor is used to execute the computer program and implement the steps of the interaction method of the near-eye display device according to any one of claims 1 to 8 when executing the computer program.

10. A storage medium, characterized in that: The storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the interaction method of the near-eye display device according to any one of claims 1 to 8 are implemented.