Screen projection display method and device, near-to-eye display equipment and storage medium

Abstract

The embodiment of the invention discloses a projection screen display method and device, near-to-eye display equipment and a computer readable storage medium. The method comprises the steps that a first gesture located in a first projection screen display area of the near-to-eye display equipment is obtained; if the first gesture is matched with a first preset gesture, a first movement track of the first gesture is obtained, the first movement track is a gesture track in the first direction, and the first direction is the direction away from the first projection screen display area; and finally, a second projection screen display area is generated according to the first motion trail, so that screen splitting operation is completed, a user can perform multi-thread operation in the two projection screen display areas, complex operations such as exiting and switching are not needed, the operation efficiency of the screen splitting function is improved, and the user experience degree is improved.

Description

Technical Field

[0001] The present application relates to the technical field of near-eye display devices, and in particular to a projection display method, device, near-eye display device and computer-readable storage medium. Background Art

[0002] Near-eye display devices generally include AR (Augmented Reality) glasses and VR (Virtual Reality) glasses. AR glasses are functional glasses that combine virtuality with reality, providing more help and convenience for people in life and work. For example, wearing AR glasses can be used for AR map navigation, AR security inspection, AR training, etc. VR glasses are functional glasses that integrate simulation technology, multimedia technology, sensor technology and other technologies to put people in a virtual world. They bring people different experiences in watching movies, games, virtual shopping and other aspects.

[0003] However, when users need to use multiple threads, for example, when they are currently doing entertainment activities and need to temporarily handle some work matters, existing near-eye display devices require users to exit the current entertainment activities and then handle work matters in the projection display area, which cannot meet the user's multi-threaded use needs. Moreover, when users handle multiple tasks, switching back and forth is also a waste of time and the operation is cumbersome, which reduces the user experience. Summary of the invention

[0004] The present application provides a screen projection display method, apparatus, near-eye display device and computer-readable storage medium, aiming to realize the split-screen function of the near-eye display device, meet the user's needs for multi-threaded use of the near-eye display device, and improve the user experience.

[0005] To achieve the above-mentioned objectives, the present application provides a projection display method, which is applied to a near-eye display device, and the method includes: obtaining a first gesture located in a first projection display area of ​​the near-eye display device; if the first gesture matches a first preset gesture, obtaining a first motion trajectory of the first gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area; and generating a second projection display area according to the first motion trajectory.

[0006] Optionally, generating a second projection display area according to the first motion trajectory includes: generating a second projection display area in the first direction; and increasing the second projection display area along the first direction according to the first motion trajectory.

[0007] Optionally, before obtaining the first gesture located in the first projection display area of ​​the near-eye display device, it also includes: obtaining a second gesture located in the first projection display area; if the second gesture matches a second preset gesture, controlling the near-eye display device to turn on a projection adjustment function; and after the near-eye display device turns on the projection adjustment function, executing the step of obtaining the first gesture located in the first projection display area of ​​the near-eye display device.

[0008] Optionally, after generating the second projection display area according to the first motion trajectory, the method also includes: if a second gesture located in the first projection display area and matching the second preset gesture is detected again, controlling the near-eye display device to turn on the projection adjustment function; obtaining a third gesture located in the second projection display area; if the third gesture matches the third preset gesture, obtaining a second motion trajectory of the third gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area; and shrinking the second projection display area along the second direction according to the second motion trajectory.

[0009] Optionally, after generating the second projection display area according to the first motion trajectory, the method also includes: if a second gesture located in the first projection display area and matching the second preset gesture is detected again, controlling the near-eye display device to turn on the projection adjustment function; obtaining a fourth gesture located in the second projection display area; if the fourth gesture matches the fourth preset gesture, obtaining a third motion trajectory of the fourth gesture, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction; and adjusting the angle between the second projection display area and the first projection display area along the third direction according to the third motion trajectory.

[0010] Optionally, after controlling the near-eye display device to turn on the screen projection adjustment function, the method further includes: if it is detected that the second gesture has changed and does not match the second preset gesture, or the second gesture moves out of the first projection display area, controlling the near-eye display device to turn off the screen projection adjustment function.

[0011] Optionally, the second preset gesture includes a second forward preset gesture and a second reverse preset gesture, wherein the second forward preset gesture is a second preset gesture with the palm facing the user, and the second reverse preset gesture is a second preset gesture with the back of the hand facing the user; before generating the second projection display area according to the first motion trajectory, it also includes: determining the matching relationship between the second gesture and the second forward preset gesture and the second reverse preset gesture; obtaining a split-screen display mode corresponding to the matching relationship, wherein the split-screen display mode includes a second projection display area having the same or different display mode as the first projection display area, and the display mode includes an AR display mode and a VR display mode; generating the second projection display area according to the first motion trajectory includes: generating the second projection display area according to the first motion trajectory and the split-screen display mode corresponding to the matching relationship.

[0012] Optionally, after generating the second projection display area according to the first motion trajectory, the method also includes: obtaining a third gesture located in the second projection display area; if the third gesture matches a third preset gesture, obtaining a second motion trajectory of the third gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area; and shrinking the second projection display area along the second direction according to the second motion trajectory.

[0013] Optionally, after generating the second projection display area according to the first motion trajectory, the method also includes: obtaining a fourth gesture located in the second projection display area; if the fourth gesture matches a fourth preset gesture, obtaining a third motion trajectory of the fourth gesture, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction; and adjusting the angle between the second projection display area and the first projection display area along the third direction according to the third motion trajectory.

[0014] To achieve the above-mentioned objectives, the present application also provides a projection display device, which is applied to a near-eye display device, and the projection display device includes: a first acquisition module, used to acquire a first gesture located in a first projection display area of ​​the near-eye display device; a trajectory acquisition module, used to acquire a first motion trajectory of the first gesture if the first gesture matches a first preset gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area; and a generation module is used to generate a second projection display area according to the first motion trajectory.

[0015] In addition, to achieve the above-mentioned purpose, the present application also provides a near-eye display device, which includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and implement any one of the projection display methods provided in the embodiments of the present application when executing the computer program.

[0016] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor enables the processor to implement any one of the screen projection display methods provided in the embodiments of the present application.

[0017] The embodiments of the present application disclose a projection display method, apparatus, near-eye display device and computer-readable storage medium. The method first obtains a first gesture in a first projection display area of ​​the near-eye display device; if the first gesture matches a first preset gesture, a first motion trajectory of the first gesture is obtained, and the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area; finally, a second projection display area is generated according to the first motion trajectory, thereby completing the split-screen operation. In this way, the user can perform multi-threaded operations in the two projection display areas without complicated exit, switching and other operations, thereby improving the operating efficiency of the split-screen function and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 is a schematic diagram of a screen projection display method provided in an embodiment of the present application;

[0020] Figure 2 This is a schematic diagram of a scenario of a screen projection display method in an embodiment of the present application;

[0021] Figure 3 This is a schematic diagram of a scenario of a screen projection display method in an embodiment of the present application;

[0022] Figure 4 is another schematic diagram of a screen projection display method provided in an embodiment of the present application;

[0023] Figure 5 This is a scene diagram of a screen projection display method in one embodiment of the present application.

[0024] Figure 6This is a schematic diagram of a scenario of a screen projection display method in an embodiment of the present application;

[0025] Figure 7 is another schematic diagram of a screen projection display method provided in an embodiment of the present application;

[0026] Figure 8 This is a schematic diagram of a scenario of a screen projection display method in an embodiment of the present application;

[0027] Fig. 9 This is a schematic diagram of a scenario of a screen projection display method in an embodiment of the present application;

[0028] Fig.10 is another schematic diagram of a screen projection display method provided in an embodiment of the present application;

[0029] Fig.11 is another schematic diagram of a screen projection display method provided in an embodiment of the present application;

[0030] Fig.12 is another schematic diagram of a screen projection display method provided in an embodiment of the present application;

[0031] Fig.13 is a schematic block diagram of a screen projection display device provided in an embodiment of the present application;

[0032] Fig.14 It is a schematic block diagram of a near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0034] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions. In addition, although the functional modules are divided in the device schematic, in some cases, the module division can be different from that in the device schematic.

[0035] The term "and / or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0036] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0037] See also Figure 1 , Figure 1 : is a schematic diagram of a screen projection display method provided in an embodiment of the present application. The method is applied to a near-eye display device. The near-eye display device can be an AR glasses, or a VR glasses, or an AR glasses or VR glasses having both an AR display mode and a VR display mode, etc., without specific limitation here.

[0038] like Figure 1 As shown, the screen projection display method includes steps S11 to S13.

[0039] Step S11: Acquire a first gesture located in a first projection display area of ​​the near-eye display device.

[0040] When a user uses a near-eye display device, no matter the near-eye display device is an AR glasses or a VR glasses, it has a projection display area, which is referred to as a first projection display area. When the user needs to split the screen, the user can make a first gesture on the first projection display area so that the near-eye display device can obtain the first gesture through a camera or other device, and then complete the subsequent split-screen operation.

[0041] In one embodiment, the screen projection adjustment function of the near-eye display device can be triggered by a gesture, thereby completing the split-screen operation. For example, before step S11, steps S14 and S15 are also included, and the specific steps are as follows:

[0042] Step S14: Acquire a second gesture located in the first projection display area.

[0043] In this embodiment, the second gesture may be a gesture made by the user's left hand, and the first gesture may be a gesture made by the user's right hand. The user extends his left hand to make the second gesture in the first projection display area to trigger the projection adjustment function, and then uses his right hand to make the first gesture in the first projection display area so that the near-eye display device acquires the first gesture.

[0044] Step S15: If the second gesture matches the second preset gesture, control the near-eye display device to enable the screen projection adjustment function.

[0045] In one embodiment, the second preset gesture may be a fully stretched out palm. For example, a gesture with five fingers stretched out and close together. Another example is a gesture with five fingers stretched out and a certain gap between some or all of the fingers. Of course, the second preset gesture may also be a gesture of other shapes. For example, the second preset gesture may also be an "OK" gesture, that is, a gesture with the thumb and index finger pinched together and the other three fingers stretched out. The specific shape of the second preset gesture is not limited here.

[0046] In this embodiment, after acquiring the second gesture, it is necessary to determine whether the second gesture matches the second preset gesture. If it is determined that the second gesture matches the second preset gesture, the near-eye display device is controlled to start the projection adjustment function. In this way, the projection adjustment function can be triggered by the user only needing to make a gesture matching the second preset gesture, which is simple to operate and also increases the interaction between the user and the near-eye display device, thereby increasing the fun of the near-eye display device.

[0047] In one embodiment, the second preset gesture may be pre-stored in the near-eye display device, so that when gesture matching judgment is required, the second preset gesture can be read from the internal memory of the near-eye display device for matching judgment.

[0048] In another embodiment, the second preset gesture may be pre-stored in other devices other than the near-eye display device, such as a server equipped for the near-eye display device, a mobile phone connected to the near-eye display device, a tablet computer, and other devices. In this way, when gesture matching judgment is required, the near-eye display device needs to obtain the second preset gesture from an external device such as a server, and then perform gesture matching judgment.

[0049] In one embodiment, after the near-eye display device turns on the projection adjustment function, the near-eye display device can detect the second gesture in the first projection display area in real time or at a preset interval. If the second gesture cannot be detected, it means that the user has moved the second gesture out of the first projection display area. At this time, the near-eye display device will be controlled to turn off the projection adjustment function, that is, the user cannot continue to adjust the projection display area.

[0050] If the second gesture is detected, it is further determined whether the second gesture has changed. Specifically, the second gesture currently acquired can be compared with the second gesture acquired last time to determine whether the current second gesture has changed. It is understandable that there are many other ways to determine whether the second gesture has changed, not limited to the above methods.

[0051] If the current second gesture has changed, it is further determined whether the current second gesture matches the second preset gesture. If the current second gesture does not match the second preset gesture, the near-eye display device is controlled to turn off the projection adjustment function. If the current second gesture has not changed, or the current second gesture has changed and matches the second preset gesture, the projection adjustment function continues to be turned on, that is, the user can adjust the projection display area.

[0052] Step S12: If the first gesture matches the first preset gesture, obtain a first motion trajectory of the first gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area.

[0053] After the first gesture is acquired, it is determined whether the first gesture matches the first preset gesture. If it is determined that the first gesture does not match the first preset gesture, an example diagram of the first preset gesture may be displayed for the user's reference so that the user can make the correct first gesture according to the example diagram. If it is determined that the first gesture matches the first preset gesture, a first motion trajectory of the first gesture is acquired.

[0054] In one embodiment, the first preset gesture may be pre-stored in a near-eye display device, or may be pre-stored in a device other than the near-eye display device, and the storage location of the first preset gesture is not limited herein.

[0055] In one embodiment, the first preset gesture may be a static gesture. For example, the first preset gesture may be a pointing gesture of the index finger, that is, a gesture in which the index finger is extended and the other four fingers are contracted in the palm.

[0056] When the first preset gesture is a static gesture, the first motion trajectory of the first gesture can be understood as: while the user's hand keeps the first gesture almost unchanged, the entire hand gradually slides from the first projection display area toward the direction away from the first projection display area (i.e., the first direction) formed by the motion trajectory.

[0057] For example, Figure 2 As shown, Figure 2 This is a schematic diagram of a scenario of a screen projection display method in one embodiment of the present application. Figure 2 In the scene shown, the dotted box on the left is the first projection display area, the gray area within the first projection display area is the display interface of an application, and the dotted box on the right is the second projection display area to be generated. The user's right hand makes a pointing gesture with the index finger and slides along the first direction indicated by the solid arrow to form a first motion trajectory shown by the dotted line.

[0058] In another embodiment, the first preset gesture may be a dynamic gesture, for example, the first preset gesture is a dynamic pinching gesture in which the thumb and index finger are extended, the other three fingers are retracted in the palm, and the thumb and index finger move relatively close to each other.

[0059] When the first preset gesture is a dynamic gesture, the user can first complete the action of the first gesture, and then slide in the first direction to form a first motion trajectory. For example, when the first gesture is a dynamic pinch gesture in which the thumb and index finger move relatively close to each other, the user can first almost fix the position of the hand in the first projection display area, and then move the thumb and index finger relatively close until they touch each other, thereby completing the dynamic pinch gesture. Then, the user keeps the pinch gesture in which the thumb and index finger touch each other unchanged, and slides in the first direction to form the first motion trajectory.

[0060] Of course, the user can also slide the entire hand in the first direction to form a first motion track while completing the first gesture. For example, when the first gesture is a dynamic pinch gesture in which the thumb and index finger move relatively close to each other, the user can move the thumb and index finger closer together in the first projection display area while sliding the hand in the first gesture in a direction away from the first projection display area (i.e., the first direction) to form the first motion track.

[0061] For example, Figure 3 As shown, Figure 3 This is a schematic diagram of a scenario of a screen projection display method in one embodiment of the present application. Figure 3 In the scene shown, the dotted box located at the bottom is the first projection display area, and the dotted box located at the top is the second projection display area to be generated. The user's right hand makes a dynamic pinch gesture while sliding along the first direction indicated by the solid arrow to form the first motion trajectory shown by the dotted line.

[0062] Step S13: Generate a second projection display area according to the first motion trajectory.

[0063] After acquiring the first motion trajectory, a second projection display area is generated in the first direction, thereby realizing the split-screen operation. Figure 2 and Figure 3 As shown, in Figure 2 In the , the user realizes the generation of a second projection display area in the horizontal direction. Figure 3 In the embodiment, the user realizes the generation of a second projection display area in the vertical direction, wherein the horizontal direction and the vertical direction are the horizontal direction and the vertical direction within the plane where the first projection display area is located.

[0064] It should be noted that the first direction is not limited to Figure 2 and Figure 3The horizontal direction and vertical direction shown may also be other directions, for example, directions other than the horizontal direction and the vertical direction in the plane where the first projection display area is located. It is understandable that when the first direction is in the plane where the first projection display area is located, the first projection display area is coplanar with the second projection display area.

[0065] Of course, the first direction may not be within the plane where the first projection display area is located. In this case, the first projection display area and the second projection display area are in different planes.

[0066] In this embodiment, the user can generate a second projection display area in the desired direction according to their needs, thereby realizing split-screen operation and using the near-eye display device in multiple threads. For example, playing a video in the first projection display area and processing some work matters in the second projection display area increase the usability of the near-eye display device. At the same time, the steps of the split-screen operation are also simple, which brings great convenience to the user.

[0067] In one embodiment, the near-eye display device needs to measure the movement distance corresponding to the first movement trajectory. If it is determined that the movement distance corresponding to the first movement trajectory is greater than the preset movement distance, a second projection display area is generated according to the first movement trajectory; if it is determined that the movement distance corresponding to the first movement trajectory is less than or equal to the preset movement distance, the second projection display area is not generated, and a prompt dialog box may pop up at this time to prompt the user to extend the movement distance of the first movement trajectory. In this way, the user can avoid generating the second projection display area due to misoperation.

[0068] In one embodiment, the near-eye display device can directly generate a second projection display area in the first direction according to the first motion trajectory of the user. Of course, in order to increase the fun of the near-eye display device and increase the user's participation, when generating the second projection display area according to the first motion trajectory, the second projection display area can be gradually generated.

[0069] Specifically, generating the second projection display area according to the first motion trajectory specifically includes: generating the second projection display area in the first direction; and increasing the second projection display area along the first direction according to the first motion trajectory. First, a point of the second projection display area is generated in the first direction, and then the second projection display area is gradually increased along the first direction as the first motion trajectory is extended until the entire second projection display area is fully displayed. In this way, the user can experience the interactive fun between the near-eye display device.

[0070] It should be noted that the second projection display area can be the same size as the first projection display area, or it can be a different size. The size of the second projection display area can be a pre-set size, or it can be a size adjusted by the user according to needs. For example, when the near-eye display device is gradually generating the second projection display area, if the user feels that the current size of the second projection display area is sufficient for use, the projection adjustment function can be turned off. For example, the second gesture can be moved out of the first projection display area. In this way, the near-eye display device will turn off the projection adjustment function. At this time, the size of the displayed second projection display area is the size when the projection adjustment function is turned off.

[0071] In addition, the display modes of the first projection display area and the second projection display area may be the same or different, wherein the display mode includes an AR display mode and a VR display mode. For example, the display mode of the second projection display area may be pre-set to be the same as the display mode of the first projection display area. In this way, when the display mode of the first projection display area is an AR display mode, the display mode of the generated second projection display area is also an AR display mode.

[0072] Similarly, the display mode of the second projection display area can be pre-set to be different from the display mode of the first projection display area. In this way, when the display mode of the first projection display area is the AR display mode, the display mode of the generated second projection display area is the VR display mode.

[0073] The screen projection display method disclosed in the embodiment of the present application first obtains a first gesture located in a first projection display area; if the first gesture matches a first preset gesture, obtains a first motion trajectory of the first gesture, the first motion trajectory being a gesture trajectory along a first direction, and the first direction being a direction away from the first projection display area; finally, a second projection display area is generated according to the first motion trajectory, thereby completing a split-screen operation, so that the user can perform multi-threaded operations in the two projection display areas without having to perform complicated exit, switching and other operations, thereby improving the user experience.

[0074] See also Figure 4 , Figure 4 : is a schematic diagram of a screen projection display method provided in an embodiment of the present application. The method is applied to a near-eye display device. The near-eye display device can be an AR glasses, or a VR glasses, or an AR glasses or VR glasses having both an AR display mode and a VR display mode, etc., without specific limitation here.

[0075] like Figure 4 As shown, the screen projection display method includes steps S21 to S29.

[0076] Step S21: Acquire a second gesture located in a first projection display area of ​​the near-eye display device.

[0077] Step S22: If the second gesture matches the second preset gesture, control the near-eye display device to enable the screen projection adjustment function.

[0078] Step S23: After the near-eye display device turns on the screen projection adjustment function, a first gesture located in the first screen projection display area is obtained.

[0079] Step S24: If the first gesture matches the first preset gesture, obtain a first motion trajectory of the first gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area.

[0080] Step S25: Generate a second projection display area according to the first motion trajectory.

[0081] After acquiring the first motion trajectory, a second projection display area is generated in the first direction, thereby realizing split-screen operation.

[0082] Step S26: If a second gesture located in the first projection display area and matching the second preset gesture is detected again, the near-eye display device is controlled to turn on the projection adjustment function.

[0083] After the split-screen operation is realized, that is, the second projection display area is generated, if the user needs to restore to a single-screen display (that is, only display the first projection display area) or reduce the second projection display area, a second gesture matching the second preset gesture can be made in the first projection display area. In this way, the near-eye display device can detect the second gesture that meets the conditions for triggering the projection adjustment function again, and trigger the near-eye display device to turn on the projection adjustment function.

[0084] Step S27: Acquire a third gesture located in the second projection display area.

[0085] After triggering the screen projection adjustment function again, the user can make a third gesture in the second screen projection display area.

[0086] Step S28: If the third gesture matches the third preset gesture, obtain a second motion trajectory of the third gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area.

[0087] After the third gesture is obtained, it is determined whether the third gesture matches the third preset gesture. If it is determined that the third gesture does not match the third preset gesture, an example diagram of the third preset gesture may be displayed for the user's reference so that the user can make the correct third gesture according to the example diagram. If it is determined that the third gesture matches the third preset gesture, the second motion trajectory of the third gesture is obtained.

[0088] In one embodiment, the third preset gesture may be the same as the first preset gesture, which makes it easier for users to remember the gesture and less likely to cause confusion or misremembering. At the same time, it also simplifies the complexity of the operation to a certain extent, making the near-eye display device more practical and operable.

[0089] Of course, the third preset gesture may also be different from the first preset gesture. Players who like manipulation can better experience the fun of manipulating the near-eye display device. Here, there is no restriction on the specific form of the third preset gesture, as long as the functional requirements of the third preset gesture can be met.

[0090] In one embodiment, the third preset gesture may be pre-stored in the near-eye display device, or may be pre-stored in a device other than the near-eye display device, and the storage location of the third preset gesture is not limited herein.

[0091] In one embodiment, the third preset gesture may be a static gesture. For example, the third preset gesture may be a pointing gesture of an index finger.

[0092] When the third preset gesture is a static gesture, the second motion trajectory of the third gesture can be understood as: while the user's hand keeps the third gesture almost unchanged, the entire hand gradually slides from the second projection display area toward the first projection display area (i.e., the second direction) to form the motion trajectory.

[0093] For example, Figure 5 As shown, Figure 5 This is a schematic diagram of a scenario of a screen projection display method in one embodiment of the present application. Figure 5 In the scene shown, the user's right hand makes a pointing gesture with the index finger, and slides along the second direction indicated by the solid arrow to form a second motion trajectory shown by the dotted line.

[0094] In another embodiment, the third preset gesture may be a dynamic gesture, for example, the third preset gesture is a dynamic pinching gesture in which the thumb and index finger are extended, the other three fingers are retracted in the palm, and the thumb and index finger move relatively close to each other.

[0095] When the third preset gesture is a dynamic gesture, the user can first complete the action of the third gesture, and then slide in the second direction to form a second motion trajectory. For example, when the third gesture is a dynamic pinch gesture in which the thumb and index finger move relatively close to each other, the user can first almost fix the position of the hand in the second projection display area, and then move the thumb and index finger relatively close until they touch each other, thereby completing the dynamic pinch gesture. Then, the user keeps the pinch gesture in which the thumb and index finger touch each other unchanged, and slides in the second direction to form a second motion trajectory.

[0096] Of course, the user can also slide the entire hand in the second direction to form a second motion track while completing the third gesture. For example, when the third gesture is a dynamic pinch gesture in which the thumb and index finger move closer to each other, the user can move the thumb and index finger closer to each other in the second projection display area while gradually sliding the hand where the third gesture is located toward the direction of the first projection display area (i.e., the second direction) to form the second motion track.

[0097] For example, Figure 6 As shown, Figure 6 This is a schematic diagram of a scenario of a screen projection display method in one embodiment of the present application. Figure 6 In the scene shown, the user's right hand makes a dynamic pinch gesture while gradually sliding along the second direction indicated by the solid arrow to form a second motion trajectory shown by the dotted line.

[0098] Step S29: shrinking the second projection display area along the second direction according to the second motion trajectory.

[0099] After acquiring the second motion trajectory, the second projection display area is reduced in the second direction according to the second motion trajectory. If the user needs to restore to a single-screen display, the user can control the length of the second motion trajectory until the second projection display area completely disappears, thereby restoring to a single-screen display, i.e. completing the split-screen restoration operation.

[0100] For example, Figure 5 As shown, when the user's third gesture gradually slides toward the first projection display area, the right longitudinal edge of the second projection display area gradually approaches the first projection display area in the direction of the dotted arrow to shrink the second projection display area until the second projection display area completely disappears, thereby realizing the split-screen restoration operation.

[0101] For example, Figure 6As shown, when the user's third gesture gradually slides toward the first projection display area, the upper horizontal edge of the second projection display area gradually approaches the first projection display area in the direction of the dotted arrow to shrink the second projection display area until the second projection display area completely disappears, thereby realizing the split-screen restoration operation.

[0102] Understandably, Figure 5 and Figure 6 The change mode of the second projection display area shown is only one of many change modes, and other change modes are also possible. Figure 5 In the scenario shown, as the user's third gesture gradually slides toward the first projection display area, the right longitudinal edge of the second projection display area gradually approaches the first projection display area in the direction of the dotted arrow, and at the same time, the upper and lower lateral edges of the second projection display area gradually shrink toward the center of the second projection display area.

[0103] If the user only needs to shrink the second projection display area, then in the process of shrinking the second projection display area according to the second motion trajectory, if the second projection display area has been shrunk to the desired size, the second gesture located in the first projection display area can be moved out, thereby triggering the closing of the projection adjustment function. At this time, the size of the second projection display area is the size required by the user.

[0104] After generating the second projection display area in step S25, in addition to performing split-screen restoration or split-screen reduction operations on the second projection display area (such as the method shown in steps S26 to S29), the angle of the second projection display area can also be adjusted according to user needs, so that the second projection display area can display the picture to the user at a better angle.

[0105] Specifically, in another embodiment, Figure 7 As shown, Figure 7 It is a schematic diagram of a screen projection display method provided in an embodiment of the present application. After step S25, it also includes steps S210 to S213.

[0106] Step S210: If a second gesture located in the first projection display area and matching the second preset gesture is detected again, the near-eye display device is controlled to turn on the projection adjustment function.

[0107] After the split screen operation is realized, that is, the second projection display area is generated, if the user needs to adjust the angle of the second projection display area, the user can make a second gesture matching the second preset gesture in the first projection display area. In this way, the near-eye display device can detect the second gesture that meets the conditions for triggering the projection adjustment function again, and trigger the near-eye display device to turn on the projection adjustment function.

[0108] Step S211: Acquire a fourth gesture located in the second projection display area.

[0109] After turning on the screen projection adjustment function again, the user can make a fourth gesture in the second screen projection display area.

[0110] Step S212: If the fourth gesture matches the fourth preset gesture, a third motion trajectory of the fourth gesture is obtained, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction.

[0111] After the fourth gesture is obtained, it is determined whether the fourth gesture matches the fourth preset gesture. If it is determined that the fourth gesture does not match the fourth preset gesture, an example diagram of the fourth preset gesture may be displayed for the user's reference so that the user can make the correct fourth gesture according to the example diagram. If it is determined that the fourth gesture matches the fourth preset gesture, the third motion trajectory of the fourth gesture is obtained.

[0112] In one embodiment, the fourth preset gesture may be pre-stored in the near-eye display device, or may be pre-stored in a device other than the near-eye display device, and the storage location of the fourth preset gesture is not limited herein.

[0113] In one embodiment, the fourth preset gesture may be the same as the first preset gesture, which makes it easier for users to remember the gesture and less likely to cause confusion or misremembering. At the same time, it also simplifies the complexity of the operation to a certain extent, making the near-eye display device more practical and operable.

[0114] Of course, the fourth preset gesture may also be different from the first preset gesture. Players who like manipulation can better experience the fun of manipulating the near-eye display device. Here, there is no restriction on the specific form of the fourth preset gesture, as long as the functional requirements of the fourth preset gesture can be met.

[0115] In one embodiment, the fourth preset gesture may be a static gesture. For example, the fourth preset gesture may be a pointing gesture of an index finger.

[0116] When the fourth preset gesture is a static gesture, the third motion trajectory of the fourth gesture may be understood as a gesture formed by gradually moving the entire hand along the third direction while the user's hand keeps the fourth gesture almost unchanged.

[0117] For example, Figure 8 As shown, Figure 8 This is a schematic diagram of a scenario of a screen projection display method in one embodiment of the present application. Figure 8In the scene shown, the user's right hand makes a pointing gesture with the index finger, and slides along the third direction indicated by the solid arrow to form a third motion trajectory indicated by the dotted line.

[0118] In another embodiment, the fourth preset gesture may be a dynamic gesture, for example, the fourth preset gesture is a dynamic pinching gesture in which the thumb and index finger are extended, the other three fingers are retracted in the palm, and the thumb and index finger move relatively close to each other.

[0119] When the fourth preset gesture is a dynamic gesture, the user can first complete the fourth gesture and then slide in the third direction to form a third motion track. Of course, the user can also slide the entire hand in the third direction to form the third motion track while completing the fourth gesture.

[0120] For example, Fig. 9 As shown, Fig. 9 This is a schematic diagram of a scenario of a screen projection display method in one embodiment of the present application. Fig. 9 In the scene shown, the user's right hand makes a dynamic pinch gesture while gradually sliding along the third direction indicated by the arrow to form a third motion trajectory shown by the dotted line.

[0121] Step S213: along the third direction, adjust the angle between the second projection display area and the first projection display area according to the third motion trajectory.

[0122] After obtaining the third motion trajectory, the angle between the second projection display area and the first projection display area is gradually adjusted along the third direction according to the third motion trajectory to complete the split screen angle adjustment operation, so that the second projection display area can display the picture at an angle that satisfies the user. Figure 8 and Fig. 9 An example of split screen angle adjustment is shown.

[0123] It is understandable that when the user needs to restore the second projection display area to be displayed on the same plane as the first projection display area, the method steps of steps S210 to S213 can also be used to achieve restoration.

[0124] It should be noted that technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific working process of some steps of the screen projection display method described above can refer to the corresponding process in the aforementioned screen projection display method embodiment, and will not be repeated here.

[0125] The projection display method disclosed in the embodiment of the present application, after triggering the near-eye display device to start the projection adjustment function, generates a second projection display area according to the first motion trajectory of the first gesture to achieve split-screen operation and meet the user's multi-threaded operation needs. When the user needs to restore to a single-screen display, the second projection display area is gradually reduced according to the second motion trajectory of the third gesture until it disappears, thereby achieving the restoration operation of the split screen; when the user needs to adjust the angle between the second projection display area and the first projection display area, the angle between the second projection display area and the first projection display area can be gradually adjusted according to the third motion trajectory of the fourth gesture, so that the second projection display area can display the picture at an angle that satisfies the user. The projection display method disclosed in this embodiment can complete split-screen operation, split-screen restoration operation, split-screen angle adjustment operation, etc. through gesture operation. The operation process is simple, which increases the usability and practicality of the near-eye display device.

[0126] See also Fig.10 , Fig.10 : is a schematic diagram of a screen projection display method provided in an embodiment of the present application. The method is applied to a near-eye display device. The near-eye display device can be an AR glasses, or a VR glasses, or an AR glasses or VR glasses having both an AR display mode and a VR display mode, etc., without specific limitation here.

[0127] like Fig.10 As shown, the screen projection display method includes steps S31 to S37.

[0128] Step S31: Acquire a second gesture located in a first projection display area of ​​the near-eye display device.

[0129] Step S32: If the second gesture matches the second preset gesture, control the near-eye display device to start the screen projection adjustment function, wherein the second preset gesture includes a second forward preset gesture and a second reverse preset gesture, the second forward preset gesture is the second preset gesture with the palm facing the user, and the second reverse preset gesture is the second preset gesture with the back of the hand facing the user.

[0130] The second preset gesture may be pre-stored in the near-eye display device, or may be pre-stored in a device other than the near-eye display device, and no specific limitation is made herein.

[0131] In one embodiment, the second preset gesture may be a fully stretched palm, for example, a gesture with five fingers straight and close together, then the second forward preset gesture is a palm with the palm facing the user, and the second reverse preset gesture is a palm with the back of the hand facing the user.

[0132] Step S33: After the near-eye display device turns on the screen projection adjustment function, a first gesture located in the first screen projection display area is obtained.

[0133] Step S34: If the first gesture matches the first preset gesture, obtain a first motion trajectory of the first gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area.

[0134] Step S35: determining a matching relationship between the second gesture and the second forward preset gesture and the second reverse preset gesture.

[0135] In this embodiment, it is determined whether the second gesture matches the second forward preset gesture or the second reverse preset gesture, and a matching relationship is generated.

[0136] Step S36: Obtain a split-screen display mode corresponding to the matching relationship, wherein the split-screen display mode includes a second projection display area having the same or different display mode as the first projection display area, and the display mode includes an AR display mode and a VR display mode.

[0137] In this embodiment, the corresponding relationship between the matching relationship and the split-screen display mode is preset. For example, if the matching relationship is a relationship between the second gesture and the second forward preset gesture, the corresponding split-screen display mode is that the second projection display area and the first projection display area have the same display mode; similarly, if the matching relationship is a relationship between the second gesture and the second reverse preset gesture, the corresponding split-screen display mode is that the second projection display area and the first projection display area have different display modes.

[0138] Of course, the correspondence between the above-mentioned matching relationship and the split-screen display mode is merely an example and can be interchanged. For example, if the matching relationship is a relationship between the second gesture and the second forward preset gesture, then the corresponding split-screen display mode is that the second projection display area and the first projection display area have different display modes; similarly, if the matching relationship is a relationship between the second gesture and the second reverse preset gesture, then the corresponding split-screen display mode is that the second projection display area and the first projection display area have the same display mode.

[0139] Step S37: Generate a second projection display area according to the first motion trajectory and the split-screen display mode corresponding to the matching relationship.

[0140] While generating the second projection display area according to the first motion trajectory, the second projection display area is displayed according to the split-screen display mode determined in step S36.

[0141] For example, when the first projection display area is in AR display mode, and the split-screen display mode determined according to step S36 is that the second projection display area has a different display mode from the first projection display area, the near-eye display device generates a second projection display area in VR display mode in a first direction, and gradually increases the second projection display area along the first direction according to the first motion trajectory.

[0142] It should be noted that technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific working process of some steps of the screen projection display method described above can refer to the corresponding process in the aforementioned screen projection display method embodiment, and will not be repeated here.

[0143] In addition, step S35 and step S36 are not limited to Fig.10 The process shown is performed after step S34, and can also be performed at other locations. For example, it can be performed before controlling the near-eye display device to start the projection adjustment function, or it can be performed after step S33, as long as it is performed before step S37.

[0144] The projection display method disclosed in the embodiment of the present application determines the matching relationship between the second gesture and the second forward preset gesture and the second reverse preset gesture, and controls the display mode of the second projection display area generated by the near-eye display device according to the split-screen display mode corresponding to the matching relationship, thereby realizing that the first projection display area and the second projection display area have the same or different display modes, thereby meeting the needs of users in different usage scenarios and increasing the practicality and fun of the near-eye display device.

[0145] See also Fig.11 , Fig.11 : is a schematic diagram of a screen projection display method provided in an embodiment of the present application. The method is applied to a near-eye display device. The near-eye display device can be an AR glasses, or a VR glasses, or an AR glasses or VR glasses having both an AR display mode and a VR display mode, etc., without specific limitation here.

[0146] like Fig.11 As shown, the screen projection display method includes steps S41 to S47.

[0147] Step S41: Acquire a first gesture located in a first projection display area of ​​the near-eye display device.

[0148] Step S42: If the first gesture matches the first preset gesture, obtain a first motion trajectory of the first gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area.

[0149] Step S43: Generate a second projection display area according to the first motion trajectory.

[0150] Step S44: Acquire a third gesture located in the second projection display area.

[0151] After the second projection display area is generated in step S43, if the user wants to reduce or restore the second projection display area, the user can make a third gesture in the second projection display area so that the camera and other devices in the near-eye display device can detect the gesture.

[0152] Step S45: If the third gesture matches the third preset gesture, obtain a second motion trajectory of the third gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area.

[0153] After the third gesture is obtained, it is determined whether the third gesture matches the third preset gesture. If it is determined that the third gesture does not match the third preset gesture, an example diagram of the third preset gesture may be displayed for the user's reference so that the user can make the correct third gesture according to the example diagram. If it is determined that the third gesture matches the third preset gesture, the second motion trajectory of the third gesture is obtained.

[0154] Step S46: shrinking the second projection display area along the second direction according to the second motion trajectory.

[0155] After acquiring the second motion trajectory, the second projection screen display area is reduced in the second direction according to the second motion trajectory. If the user needs to restore to a single screen display, the user can control the length of the second motion trajectory until the second projection screen display area completely disappears, thereby restoring to a single screen display, that is, completing the split screen restoration operation.

[0156] If the user only needs to shrink the second projection display area, then in the process of shrinking the second projection display area according to the second motion trajectory, if the second projection display area has been shrunk to the required size, the third gesture located in the second projection display area can be moved out. At this time, the size of the second projection display area is the size required by the user.

[0157] After the second projection display area is generated in step S43, in addition to performing split-screen restoration or split-screen reduction operations on the second projection display area, the angle of the second projection display area can also be adjusted according to user needs, so that the second projection display area can display the picture to the user at a better angle.

[0158] Specifically, in another embodiment, Fig.12 As shown, Fig.12It is a schematic diagram of a screen projection display method provided in an embodiment of the present application. After step S43, it also includes steps S47 to S49.

[0159] Step S47: Acquire a fourth gesture located in the second projection display area.

[0160] After the second projection display area is generated in step S43, if the user wants to adjust the angle of the second projection display area, the user can make a fourth gesture in the second projection display area so that the camera and other devices in the near-eye display device can detect the gesture.

[0161] Step S48: If the fourth gesture matches the fourth preset gesture, a third motion trajectory of the fourth gesture is obtained, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction.

[0162] After the fourth gesture is obtained, it is determined whether the fourth gesture matches the fourth preset gesture. If it is determined that the fourth gesture does not match the fourth preset gesture, an example diagram of the fourth preset gesture may be displayed for the user's reference so that the user can make the correct fourth gesture according to the example diagram. If it is determined that the fourth gesture matches the fourth preset gesture, the third motion trajectory of the fourth gesture is obtained.

[0163] Step S49: along the third direction, adjust the angle between the second projection display area and the first projection display area according to the third motion trajectory.

[0164] After acquiring the third motion trajectory, the angle between the second projection display area and the first projection display area will be gradually adjusted along the third direction according to the third motion trajectory to complete the split-screen angle adjustment operation, so that the second projection display area can display the picture at an angle that satisfies the user.

[0165] It should be noted that, technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific working process of some steps of the screen projection display method described above and the explanation of individual terms, etc., can refer to the corresponding processes in the aforementioned screen projection display method embodiment. For example, the specific explanation and introduction of the third gesture, the fourth gesture, the third preset gesture and the fourth preset gesture in the above steps can refer to the corresponding content of the aforementioned embodiment, and will not be repeated here.

[0166] The projection display method disclosed in the embodiment of the present application can generate a second projection display area according to the first motion trajectory of the first gesture to realize split-screen operation and meet the user's multi-threaded operation needs. When the user needs to restore to a single-screen display, the second projection display area is reduced until it disappears according to the second motion trajectory of the third gesture, thereby realizing the restoration operation of the split screen; when the user needs to adjust the angle between the second projection display area and the first projection display area, the angle between the second projection display area and the first projection display area can be adjusted according to the third motion trajectory of the fourth gesture, so that the second projection display area can display the picture at an angle that satisfies the user. The projection display method disclosed in this embodiment can complete split-screen operation, split-screen restoration operation, split-screen angle adjustment operation, etc. through gesture operation. The operation process is simple, which increases the usability and practicality of the near-eye display device.

[0167] See also Fig.13 , Fig.13 It is a schematic block diagram of a screen projection display device provided in an embodiment of the present application. The screen projection display device 400 can be configured in a near-eye display device to execute the steps of the aforementioned screen projection display method.

[0168] Among them, the near-eye display device can be AR glasses, VR glasses, or AR glasses or VR glasses that have both AR display mode and VR display mode, etc., and no specific limitation is made here.

[0169] like Fig.13 As shown, the screen projection display device 400 includes: a first acquisition module 401, a trajectory acquisition module 402 and a generation module 403.

[0170] The first acquisition module 401 is used to acquire a first gesture located in a first projection display area of ​​the near-eye display device.

[0171] The trajectory acquisition module 402 is used to acquire the first motion trajectory of the first gesture if the first gesture matches the first preset gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area.

[0172] The generation module 403 is used to generate a second projection display area according to the first motion trajectory.

[0173] Specifically, in one embodiment, the generating module 403 is specifically used to generate a second projection display area in the first direction; and to increase the second projection display area along the first direction according to the first motion trajectory.

[0174] In one embodiment, the projection display device 400 further includes a second acquisition module and an opening module. The second acquisition module is used to acquire a second gesture located in the first projection display area. The opening module is used to control the near-eye display device to enable the projection adjustment function if the second gesture matches the second preset gesture. The first acquisition module 401 acquires a first gesture located in the first projection display area of ​​the near-eye display device after the opening module turns on the projection adjustment function.

[0175] In one embodiment, the projection display device 400 also includes a reduction module. In this embodiment, the second acquisition module is also used to send a signal to the activation module if a second gesture located in the first projection display area and matching the second preset gesture is detected again, so that the activation module controls the near-eye display device to activate the projection adjustment function. The first acquisition module 401 is also used to acquire a third gesture located in the second projection display area after the activation module activates the projection adjustment function. The trajectory acquisition module 402 is also used to acquire a second motion trajectory of the third gesture if the third gesture matches the third preset gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area. The reduction module is used to reduce the second projection display area along the second direction according to the second motion trajectory.

[0176] In another embodiment, the projection display device 400 further includes a reduction module. The first acquisition module 401 is further used to acquire a third gesture located in the second projection display area. The trajectory acquisition module 402 is further used to acquire a second motion trajectory of the third gesture if the third gesture matches a third preset gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area. The reduction module is used to reduce the second projection display area along the second direction according to the second motion trajectory.

[0177] In one embodiment, the projection display device 400 also includes an angle adjustment module. In this embodiment, the second acquisition module is also used to send a signal to the activation module if a second gesture located in the first projection display area and matching the second preset gesture is detected again, so that the activation module controls the near-eye display device to activate the projection adjustment function. The first acquisition module 401 is also used to acquire a fourth gesture located in the second projection display area. The trajectory acquisition module 402 is also used to acquire a third motion trajectory of the fourth gesture if the fourth gesture matches the fourth preset gesture, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction. The angle adjustment module is used to adjust the angle between the second projection display area and the first projection display area according to the third motion trajectory along the third direction.

[0178] In another embodiment, the projection display device 400 also includes an angle adjustment module. The first acquisition module 401 is also used to acquire a fourth gesture located in the second projection display area. The trajectory acquisition module 402 is also used to acquire a third motion trajectory of the fourth gesture if the fourth gesture matches the fourth preset gesture, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction. The angle adjustment module is used to adjust the angle between the second projection display area and the first projection display area according to the third motion trajectory along the third direction.

[0179] In one embodiment, the projection display device 400 further includes a closing module. The closing module is used to control the near-eye display device to close the projection adjustment function if it is detected that the second gesture has changed and does not match the second preset gesture, or the second gesture moves out of the first projection display area.

[0180] In one embodiment, the second preset gesture includes a second forward preset gesture and a second reverse preset gesture, wherein the second forward preset gesture is a second preset gesture with the palm facing the user, and the second reverse preset gesture is a second preset gesture with the back of the hand facing the user. The projection display device 400 also includes a determination module and a mode acquisition module. The determination module is used to determine the matching relationship between the second gesture and the second forward preset gesture and the second reverse preset gesture. The mode acquisition module is used to acquire a split-screen display mode corresponding to the matching relationship, wherein the split-screen display mode includes a second projection display area having the same or different display mode as the first projection display area, and the display mode includes an AR display mode and a VR display mode. The generation module 403 is specifically used to generate a second projection display area according to the first motion trajectory and the split-screen display mode corresponding to the matching relationship.

[0181] In one embodiment, the first direction is in the plane where the first projection display area is located, and the first projection display area is coplanar with the second projection display area; the first direction is not in the plane where the first projection display area is located, and the first projection display area is skewed with the second projection display area.

[0182] It should be noted that technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific working processes of the screen projection display device and each module described above can refer to the corresponding processes in the aforementioned screen projection display method embodiment, and will not be repeated here.

[0183] Exemplarily, the above-mentioned screen projection display method and device can be implemented in the form of a computer program, and the computer program can be used in Fig.14 The device is shown running on a near-eye display.

[0184] See also Fig.14 , Fig.14 1 is a schematic block diagram of a near-eye display device provided in an embodiment of the present application. The near-eye display device 500 may be an AR glasses or a VR glasses. The near-eye display device may also be an AR glasses or a VR glasses having both an AR display mode and a VR display mode.

[0185] like Fig.14 As shown, the near-eye display device 500 includes a processor 501 and a memory 502 connected via a system bus, wherein the memory 502 may include a volatile storage medium, a non-volatile storage medium, and an internal memory.

[0186] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, which, when executed, can enable the processor 501 to execute any screen projection display method.

[0187] The processor 501 is used to provide computing and control capabilities to support the operation of the entire near-eye display device 500 .

[0188] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor 501, the processor 501 can execute any screen projection display method.

[0189] It should be understood that the processor 501 may be a central processing unit (CPU), and the processor 501 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0190] In some embodiments, the processor 501 is used to run a computer program stored in the memory 502 to implement the following steps: obtaining a first gesture located in a first projection display area of ​​the near-eye display device; if the first gesture matches a first preset gesture, obtaining a first motion trajectory of the first gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area; and generating a second projection display area according to the first motion trajectory.

[0191] In some embodiments, the processor 501 is specifically configured to generate a second projection display area in the first direction; and to increase the second projection display area along the first direction according to the first motion trajectory.

[0192] In some embodiments, the processor 501 is also used to obtain a second gesture located in the first projection display area; if the second gesture matches a second preset gesture, control the near-eye display device to turn on a projection adjustment function; and after the near-eye display device turns on the projection adjustment function, execute the step of obtaining a first gesture located in the first projection display area of ​​the near-eye display device.

[0193] In some embodiments, the processor 501 is also used to control the near-eye display device to turn on the projection adjustment function if a second gesture located in the first projection display area and matching the second preset gesture is detected again; obtain a third gesture located in the second projection display area; if the third gesture matches the third preset gesture, obtain a second motion trajectory of the third gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area; and along the second direction, shrink the second projection display area according to the second motion trajectory.

[0194] In some embodiments, the processor 501 is also used to control the near-eye display device to turn on the projection adjustment function if a second gesture located in the first projection display area and matching the second preset gesture is detected again; obtain a fourth gesture located in the second projection display area; if the fourth gesture matches the fourth preset gesture, obtain a third motion trajectory of the fourth gesture, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction; and along the third direction, adjust the angle between the second projection display area and the first projection display area according to the third motion trajectory.

[0195] In some embodiments, the processor 501 is also used to control the near-eye display device to turn off the projection adjustment function if it is detected that the second gesture has changed and does not match the second preset gesture, or the second gesture moves out of the first projection display area.

[0196] In some embodiments, the second preset gesture includes a second forward preset gesture and a second reverse preset gesture, wherein the second forward preset gesture is a second preset gesture with the palm facing the user, and the second reverse preset gesture is a second preset gesture with the back of the hand facing the user; the processor 501 is also used to determine the matching relationship between the second gesture and the second forward preset gesture and the second reverse preset gesture; obtain a split-screen display mode corresponding to the matching relationship, wherein the split-screen display mode includes a second projection display area having the same or different display mode as the first projection display area, and the display mode includes an AR display mode and a VR display mode; the processor 501 is specifically used to generate a second projection display area according to the first motion trajectory and the split-screen display mode corresponding to the matching relationship.

[0197] In some embodiments, the processor 501 is also used to obtain a third gesture located in the second projection display area; if the third gesture matches a third preset gesture, obtain a second motion trajectory of the third gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area; and along the second direction, shrink the second projection display area according to the second motion trajectory.

[0198] In some embodiments, the processor 501 is also used to obtain a fourth gesture located in the second projection display area; if the fourth gesture matches a fourth preset gesture, obtain a third motion trajectory of the fourth gesture, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction; and along the third direction, adjust the angle between the second projection display area and the first projection display area according to the third motion trajectory.

[0199] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions, and when the program instructions are executed, any one of the screen projection display methods provided in the embodiments of the present application is implemented.

[0200] The computer-readable storage medium may be an internal storage unit of the device described in the foregoing embodiment, such as a hard disk or memory of the device. The computer-readable storage medium may also be an external storage device of the device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the device.

[0201] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like.

[0202] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A screen projection display method, characterized in that: Applied to a near-eye display device, the method comprises: Acquire a first gesture located in a first projection display area of ​​the near-eye display device; If the first gesture matches the first preset gesture, obtaining a first motion trajectory of the first gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area; and Generate a second projection display area according to the first motion trajectory.

2. The method according to claim 1, characterized in that The generating a second projection display area according to the first motion trajectory includes: Generating a second projection display area in the first direction; and Along the first direction, the second projection display area is increased according to the first motion trajectory.

3. The method according to claim 1, characterized in that Before acquiring the first gesture located in the first projection display area of ​​the near-eye display device, the method further includes: Acquire a second gesture located in the first projection display area; If the second gesture matches the second preset gesture, controlling the near-eye display device to enable a screen projection adjustment function; and After the near-eye display device turns on the screen projection adjustment function, the step of acquiring a first gesture located in a first screen projection display area of ​​the near-eye display device is performed.

4. The method according to claim 3, characterized in that After generating the second projection display area according to the first motion trajectory, the method further includes: If a second gesture located in the first projection display area and matching the second preset gesture is detected again, controlling the near-eye display device to enable the projection adjustment function; Acquire a third gesture located in the second projection display area; If the third gesture matches the third preset gesture, obtaining a second motion trajectory of the third gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area; and Along the second direction, the second projection display area is reduced according to the second motion trajectory.

5. The method according to claim 3, characterized in that: After generating the second projection display area according to the first motion trajectory, the method further includes: If a second gesture located in the first projection display area and matching the second preset gesture is detected again, controlling the near-eye display device to enable the projection adjustment function; Acquire a fourth gesture located in the second projection display area; If the fourth gesture matches a fourth preset gesture, obtaining a third motion trajectory of the fourth gesture, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction; and Along the third direction, adjust the angle between the second projection display area and the first projection display area according to the third motion trajectory.

6. The method according to any one of claims 3 to 5, characterized in that: After controlling the near-eye display device to start the screen projection adjustment function, the method further includes: If it is detected that the second gesture has changed and does not match the second preset gesture, or if the second gesture moves out of the first projection display area, the near-eye display device is controlled to turn off the projection adjustment function.

7. The method according to claim 3, characterized in that The second preset gesture includes a second forward preset gesture and a second reverse preset gesture, wherein the second forward preset gesture is a second preset gesture with the palm facing the user, and the second reverse preset gesture is a second preset gesture with the back of the hand facing the user; Before generating the second projection display area according to the first motion trajectory, the method further includes: Determining a matching relationship between the second gesture and the second forward preset gesture and the second reverse preset gesture; Acquire a split-screen display mode corresponding to the matching relationship, wherein the split-screen display mode includes a second projection display area having the same or different display mode as the first projection display area, and the display mode includes an AR display mode and a VR display mode; The generating a second projection display area according to the first motion trajectory includes: A second projection display area is generated according to the first motion trajectory and the split-screen display mode corresponding to the matching relationship.

8. The method according to claim 1, characterized in that After generating the second projection display area according to the first motion trajectory, the method further includes: Acquire a third gesture located in the second projection display area; If the third gesture matches the third preset gesture, obtaining a second motion trajectory of the third gesture, wherein the second motion trajectory is a gesture trajectory along a second direction, and the second direction is a direction approaching the first projection display area; and Along the second direction, the second projection display area is reduced according to the second motion trajectory.

9. The method according to claim 1, characterized in that: After generating the second projection display area according to the first motion trajectory, the method further includes: Acquire a fourth gesture located in the second projection display area; If the fourth gesture matches a fourth preset gesture, obtaining a third motion trajectory of the fourth gesture, wherein the third motion trajectory is a gesture trajectory along a third direction, and the third direction is a direction other than the first direction and the second direction; and Along the third direction, adjust the angle between the second projection display area and the first projection display area according to the third motion trajectory.

10. A screen projection display device, characterized in that: Applied to a near-eye display device, the device comprises: A first acquisition module, used to acquire a first gesture located in a first projection display area of ​​the near-eye display device; a trajectory acquisition module, configured to acquire a first motion trajectory of the first gesture if the first gesture matches a first preset gesture, wherein the first motion trajectory is a gesture trajectory along a first direction, and the first direction is a direction away from the first projection display area; and A generation module is used to generate a second projection display area according to the first motion trajectory.

11. A near-eye display device, characterized in that: include: A memory and a processor; wherein the memory is connected to the processor and is used to store a program; the processor is used to implement the screen projection display method as described in any one of claims 1 to 9 by running the program stored in the memory.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the screen projection display method as described in any one of claims 1 to 9.

Images