Method for combining ar glasses with zero terminal office work, and ar glasses and virtual machine
By using AR glasses and zero-terminal collaborative work methods, the image retrieval position is determined by the eye's gaze point and the current screen, enabling image retrieval remotely. This solves the problem of frequent window switching in zero-terminal work and improves work efficiency.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- XIAN WANXIANG ELECTRONICS TECH CO LTD
- Filing Date
- 2026-01-21
- Publication Date
- 2026-06-05
AI Technical Summary
In existing technologies, frequently switching between display windows when using zero-terminal office work is cumbersome and affects work efficiency.
By using AR glasses and zero-terminal collaborative work methods, the coordinates of the image retrieval position are determined by the eye's gaze point and the current screen, enabling image retrieval remotely. The target application screen is directly displayed on the AR glasses, and the execution of operation commands is supported.
It simplifies multi-window switching, improves office efficiency, and allows users to conveniently observe and operate multiple application screens on AR glasses.
Smart Images
Figure CN122152111A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of image processing technology, specifically to a method for AR glasses and zero-terminal collaborative office work, as well as AR glasses and virtual machines. Background Technology
[0002] Currently, using zero-terminal office work is a relatively common work mode. During the office process, due to the complexity of tasks, it is often necessary to open multiple application windows for viewing simultaneously, and different windows have different viewing needs. For office workers, frequently switching between display windows is a very tedious task. Summary of the Invention
[0003] The purpose of this disclosure is to overcome the shortcomings of the prior art and provide a method for joint office work with AR glasses and zero terminals, as well as AR glasses and virtual machines. This method for joint office work with AR glasses and zero terminals can improve the work efficiency of office workers.
[0004] According to a first aspect of the present disclosure, a method for joint office work between AR glasses and zero-terminal devices is provided, applied to AR glasses, the method comprising: A joint login request is sent to the cloud server. The joint login request is used to request that the AR glasses be connected to the target virtual machine. The target virtual machine refers to the virtual machine that has already established a connection with the zero terminal. When a user triggers the air capture mode, the system determines the user's gaze point and captures the current image being viewed. Based on the user's eye gaze point position and the current image being viewed by the user, the user's image capture position coordinates are determined; the image capture position coordinates are the coordinate information when the user's eye gaze point is projected onto the current image. The image capture position coordinates are sent to the target virtual machine, so that the target virtual machine can determine the target application corresponding to the image capture position on the current screen based on the image capture position coordinates, and then obtain the display screen corresponding to the target application and send it to the AR glasses; Receive the display screen corresponding to the target application sent by the target virtual machine, and decode and display it.
[0005] In one embodiment, the method further includes: Obtain the user's operation instructions for the display screen corresponding to the target application; Perform corresponding operations on the display screen corresponding to the target application according to the operation instructions.
[0006] In one embodiment, performing corresponding operations on the display screen corresponding to the target application according to the operation instructions includes: Adjust the display position of the screen corresponding to the target application according to the operation instructions; or, Adjust the screen size of the display screen corresponding to the target application according to the operation instructions.
[0007] In one embodiment, before sending the joint login request to the cloud server, the method further includes: Determine whether the zero terminal has established a connection with the target virtual machine on the cloud server; If the zero terminal establishes a connection with the target virtual machine on the cloud server, a joint login request is sent to the cloud server.
[0008] In one embodiment, sending the joint login request to the cloud server includes: In the joint login mode, you log in to the cloud server by entering your account information; or, By scanning the QR code displayed on the zero terminal, a joint login request is sent to the cloud server. When the cloud server receives the joint login request, it returns a login confirmation message to the zero terminal. After receiving the login confirmation information returned by the zero terminal, the AR glasses establish a connection with the target virtual machine in joint login mode.
[0009] In one embodiment, the method for triggering the air capture mode includes at least one of voice control, button control, or gesture control; wherein... The voice control refers to triggering the air capture mode based on the user's input of preset voice commands; The button method refers to triggering the air capture mode by clicking the physical or virtual button on the AR glasses according to a preset method. The gesture control method refers to triggering the air-to-image capture mode based on the preset gestures made by the user within the gesture capture area of the AR glasses.
[0010] According to a second aspect of the present disclosure, a method for joint office work using AR glasses and zero-terminal devices is provided, applied to a virtual machine, the method comprising: The AR glasses receive the image capture position coordinates sent by the AR glasses. The image capture position coordinates are determined by the AR glasses based on the user's eye gaze point position and the current image being viewed by the user. Based on the captured position coordinates, determine the target application corresponding to that coordinate position on the current screen; Obtain the display screen corresponding to the target application; The display screen corresponding to the target application is sent to the AR glasses for decoding and display.
[0011] According to a third aspect of the present disclosure, an AR glasses is provided, the AR glasses comprising: a first transmitting module, a first determining module, a second determining module, a second transmitting module, and a first receiving module; The first sending module is used to send a joint login request to the cloud server. The joint login request is used to request that the AR glasses be connected to the target virtual machine. The target virtual machine refers to a virtual machine that has already established a connection with the zero terminal. The first determining module is used to determine the position of the user's eye gaze point and capture the current image being viewed by the user when the user triggers the air capture mode operation command. The second determining module is used to determine the user's image capture position coordinates based on the user's eye gaze point position and the current image being viewed by the user; the image capture position coordinates are the coordinate information when the user's eye gaze point is projected onto the current image. The second sending module is used to send the image capture position coordinates to the target virtual machine, so that the target virtual machine can determine the target application corresponding to the image capture position on the current screen based on the image capture position coordinates, and then send the display screen corresponding to the target application to the AR glasses; The first receiving module is used to receive the display screen corresponding to the target application sent by the target virtual machine, and decode and display it.
[0012] In one embodiment, the AR glasses further include: a first acquisition module and an operation module; wherein, The first acquisition module is used to acquire the operation instructions taken by the user for the display screen corresponding to the target application; The operation module is used to perform corresponding operations on the display screen corresponding to the target application according to the operation instructions.
[0013] According to a fourth aspect of the embodiments of this disclosure, a virtual machine is provided, comprising a second receiving module, a third determining module, a second acquiring module, and a third sending module; wherein... The second receiving module is used to receive the image capture position coordinates sent by the AR glasses. The image capture position coordinates are determined by the AR glasses based on the user's gaze point position and the current image being viewed by the user. The third determining module is used to determine the target application corresponding to the coordinate position on the current screen based on the captured position coordinates. The second acquisition module is used to acquire the display screen corresponding to the target application; The third sending module is used to send the display screen corresponding to the target application to the AR glasses for decoding and display.
[0014] This disclosure provides a method for joint office work using AR glasses and a zero-terminal. Users can view the screen of a target application within the projection area of the AR glasses and also view the screen displayed on the monitor connected to the zero-terminal through the glasses. This method allows users to observe multiple screens in detail, thereby improving their work efficiency. Attached Figure Description
[0015] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0016] Figure 1 This is a schematic diagram of the basic architecture of an AR glasses system that can work in conjunction with zero terminals, as provided in an embodiment of this disclosure.
[0017] Figure 2 This is a flowchart illustrating a method for joint office work using AR glasses and a zero-terminal device, as provided in an embodiment of this disclosure.
[0018] Figure 3 This is an architecture diagram of a system for joint office work using AR glasses and a zero-terminal device, provided as an embodiment of this disclosure.
[0019] Figure 4 This is a flowchart illustrating a method for joint office work using AR glasses and a zero-terminal device, as provided in an embodiment of this disclosure.
[0020] Figure 5 This is an architectural diagram of an AR glasses provided in an embodiment of the present disclosure.
[0021] Figure 6 This is an architectural diagram of an AR glasses provided in an embodiment of the present disclosure.
[0022] Figure 7 This is an architecture diagram of a virtual machine provided in an embodiment of the present disclosure. Detailed Implementation
[0023] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0024] Figure 1 This is a schematic diagram of the basic architecture of an AR glasses system capable of working in conjunction with zero-terminal devices, provided as an embodiment of this disclosure. Figure 1As shown in the figure, an AR glasses system capable of working in conjunction with zero terminals provided in this disclosure includes: an AR glasses body, a receiver module, and an auxiliary control unit; wherein, The receiver module is located on the AR glasses and is used to receive the encoded image obtained by the transmitter device from the cloud server, decode the image and display it on the AR glasses; it also needs to provide output feedback to the auxiliary control unit.
[0025] After establishing a connection with the transmitting device, the receiving module can acquire the encoded image sent by the transmitting device. This desktop image is collected by the transmitting device from a cloud server. It should be noted that the receiving module and the transmitting device in this disclosure establish a wireless connection, typically using data communication such as 5G.
[0026] The AR glasses themselves are not much different in shape and size from existing glasses. The difference is that AR glasses include: a miniature LED projector, which is used to project the virtual images received and decoded by the receiver module onto the person's eyes through the light waveguide on the lens; and multiple cameras, usually 5 to 10, are also set on the frame, which are used to track the user's hand and eye, and to capture images of the real world.
[0027] The temples of the glasses are equipped with an audio acquisition unit and an audio output unit located near the ears. The audio acquisition unit can capture the user's voice input, and the audio output unit can play the audio.
[0028] The auxiliary control unit can be a neural wristband / bracelet / watch / ring, etc., used to convert the tiny muscle movements on the user's arm into electrical signals, which are then sent to a cloud server for interpretation and used as input to control the screen or audio.
[0029] Figure 2 This is a flowchart illustrating a method for collaborative office work using AR glasses and a zero-terminal device, provided as an embodiment of this disclosure. Figure 2 As shown, this method is applied to AR glasses and includes: Step 201: Send a joint login request to the cloud server. The joint login request is used to request that the AR glasses be connected to the target virtual machine. The target virtual machine refers to the virtual machine that has already established a connection with the zero terminal. In one embodiment, before sending the joint login request to the cloud server, the method further includes: Determine whether the zero terminal has established a connection with the target virtual machine on the cloud server; If the zero terminal establishes a connection with the target virtual machine on the cloud server, a joint login request is sent to the cloud server.
[0030] In this embodiment, the zero terminal establishes a connection with the cloud server through its R-end module; Specifically, after the zero terminal logs into the corresponding virtual machine on the server based on its account and password, it formally establishes a connection with the cloud server. The cloud server continuously collects the desktop image of the current virtual machine through the acquisition module and sends it to the R-end module on the zero terminal. The R-end module decodes the received image and sends it to the monitor for display.
[0031] In one embodiment, sending the joint login request to the cloud server includes: In the joint login mode, you log in to the cloud server by entering your account information; or, By scanning the QR code displayed on the zero terminal, a joint login request is sent to the cloud server. When the cloud server receives the joint login request, it returns a login confirmation message to the zero terminal. After receiving the login confirmation information returned by the zero terminal, the AR glasses establish a connection with the target virtual machine in joint login mode.
[0032] In this embodiment, during the desktop connection between the zero terminal and the cloud server, the AR glasses user initiates a joint login request for the same virtual machine to the cloud server through the R-end module on the AR glasses. Specifically, users can log in to the cloud server via AR glasses in a joint login mode by entering their account and password; alternatively, users can initiate a joint login request for the same virtual machine by scanning a QR code displayed on the zero-terminal device. Upon receiving the login request, the cloud server returns a login confirmation message to the zero-terminal device. Once the user agrees to the joint login via the zero-terminal device, the AR glasses establish a connection with the virtual machine in joint login mode. Either of these methods can achieve the connection between the AR glasses and the zero-terminal device and the same virtual machine. The system architecture is as follows: Figure 3 As shown.
[0033] Step 202: When the user triggers the air capture mode operation command, determine the position of the user's eye gaze point and capture the current image being viewed by the user; In this step, the user wears AR glasses for work. At this time, the AR glasses are just like ordinary glasses. When the user needs to view multiple screens, the air-viewing mode is actively triggered.
[0034] After entering the air-picking mode, the camera in the AR glasses tracks the user's eyes to determine the user's picking position. At the same time, the AR glasses also need to capture the image the user is viewing. In other words, the AR glasses need to determine the user's gaze point and also capture the image displayed on the screen the user is looking at.
[0035] Specifically, for example, if a user stares at a position and remains still, then blinks twice in succession, the current position of the user's eyeball is determined as the image capture position to be obtained.
[0036] In one embodiment, the method for triggering the air capture mode includes at least one of voice control, button control, or gesture control; wherein... The voice control refers to triggering the air capture mode based on the user's input of preset voice commands; The button method refers to triggering the air capture mode by clicking the physical or virtual button on the AR glasses according to a preset method. The gesture control method refers to triggering the air-to-image capture mode based on the preset gestures made by the user within the gesture capture area of the AR glasses.
[0037] In this embodiment, users can trigger the air capture mode through various feasible control methods; for example, voice control, button control, or gesture control. Voice control refers to the user inputting a preset voice command to trigger the air capture mode. Button control refers to the user clicking the physical or virtual button on the AR glasses in a preset manner to trigger the air capture mode. Gesture control refers to the user making a preset gesture within the gesture capture area of the AR glasses to trigger the air capture mode.
[0038] Step 203: Determine the user's image capture position coordinates based on the user's eye gaze point position and the current image being viewed by the user; the image capture position coordinates are the coordinate information when the user's eye gaze point is projected onto the current image. Step 204: Send the image capture position coordinates to the target virtual machine, so that the target virtual machine can determine the target application corresponding to the image capture position on the current screen based on the image capture position coordinates, and then send the display screen corresponding to the target application to the AR glasses; In this step, the AR glasses send the user's image capture position coordinates to the virtual machine with which it has established a connection, i.e., the target virtual machine. After receiving the image capture position coordinates, the target virtual machine determines the target application corresponding to the coordinate position on the current screen. After determining the target application, the virtual machine obtains the display screen of the target application and sends the display screen to the AR glasses.
[0039] Specifically, the application information of the corresponding application is obtained by determining which application window the coordinate position falls within. It should be noted that when multiple windows are displayed in a stacked manner, the application on the topmost layer at that position is identified as the target application.
[0040] Step 205: Receive the display screen corresponding to the target application sent by the target virtual machine, and decode and display it.
[0041] In this step, after the AR glasses receive the display screen of the target application sent by the virtual machine, they decode and display it. At this time, the user can view the target application's screen within the projection area of the AR glasses and also view the display screen on the monitor connected to the terminal through the glasses. This method allows users to observe multiple screens in detail, improving their work efficiency.
[0042] It is understandable that after obtaining an application screen, the user can trigger the air capture operation again to obtain screens of other applications. In this case, multiple application screens can be arranged and displayed in a preset manner. Of course, the user can also adjust the position of each application screen arbitrarily by dragging.
[0043] Optionally, the method further includes: Obtain the user's operation instructions for the display screen corresponding to the target application; Perform corresponding operations on the display screen corresponding to the target application according to the operation instructions.
[0044] In one embodiment, performing corresponding operations on the display screen corresponding to the target application according to the operation instructions includes: Adjust the display position of the screen corresponding to the target application according to the operation instructions; or, Adjust the screen size of the display screen corresponding to the target application according to the operation instructions.
[0045] In this embodiment, the user can control the display position of the application screen on the side of the AR glasses, for example, by dragging the application screen with their finger; they can also zoom in and out of the screen, for example, by zooming in and out with their index finger and thumb to control the size of the screen.
[0046] Figure 4 This is a flowchart illustrating a method for collaborative office work using AR glasses and a zero-terminal device, provided as an embodiment of this disclosure. Figure 4 As shown, this method is applied to a virtual machine and includes: Step 401: Receive the image capture position coordinates sent by the AR glasses. The image capture position coordinates are determined by the AR glasses based on the user's eye gaze point position and the current image being viewed by the user. Step 402: Determine the target application corresponding to the captured position coordinates on the current screen; Step 403: Obtain the display screen corresponding to the target application; Step 404: Send the display screen corresponding to the target application to the AR glasses for decoding and display.
[0047] In this embodiment, the AR glasses send the user's image capture position coordinates to the virtual machine with which it has established a connection, namely the target virtual machine. After receiving the image capture position coordinates, the target virtual machine determines the target application corresponding to the coordinate position on the current screen. After determining the target application, the target virtual machine obtains the display screen of the target application and sends the display screen to the AR glasses for decoding and display.
[0048] This disclosure provides a method for joint office work using AR glasses and a zero-terminal. Users can view the screen of a target application within the projection area of the AR glasses and also view the screen displayed on the monitor connected to the zero-terminal through the glasses. This method allows users to observe multiple screens in detail, thereby improving their work efficiency.
[0049] Figure 5 This is an architectural diagram of an AR glasses embodiment provided in this disclosure. Figure 5 As shown, the AR glasses include: a first sending module 501, a first determining module 502, a second determining module 503, a second sending module 504, and a first receiving module 505; wherein, the first sending module 501 is used to send a joint login request to the cloud server, the joint login request being used to request the AR glasses to connect to a target virtual machine, the target virtual machine referring to a virtual machine that has established a connection with the zero terminal; the first determining module 502 is used to determine the user's gaze point position and capture the current image viewed by the user when it receives an operation command from the user to trigger the air-to-view mode; the second determining module 503 is used to determine the user's gaze point position and capture the current image viewed by the user; the second determining module 503 is used to determine the user's gaze point position and capture the current image viewed by the user; the second determining module 503 is used to determine the user's gaze point position and capture the current image viewed by the user. The user's eye gaze point position and the current screen viewed by the user are used to determine the user's image capture position coordinates; the image capture position coordinates are the coordinate information when the user's eye gaze point is projected onto the current screen; the second sending module 504 is used to send the image capture position coordinates to the target virtual machine, so that the target virtual machine can determine the target application corresponding to the image capture position on the current screen based on the image capture position coordinates, and obtain the display screen corresponding to the target application and send it to the AR glasses; the first receiving module 505 is used to receive the display screen corresponding to the target application sent by the target virtual machine, and decode and display it.
[0050] Figure 6 This is an architectural diagram of an AR glasses embodiment provided in this disclosure. Figure 6As shown, the AR glasses include: a first sending module 601, a first determining module 602, a second determining module 603, a second sending module 604, a first receiving module 605, a first acquiring module 606, and an operation module 607; wherein, the first acquiring module 606 is used to acquire the operation instructions taken by the user for the display screen corresponding to the target application; the operation module 607 is used to perform corresponding operations on the display screen corresponding to the target application according to the operation instructions.
[0051] Figure 7 This is an architecture diagram of a virtual machine provided as an embodiment of this disclosure. (For example...) Figure 7 As shown, the virtual machine includes: a second receiving module 701, a third determining module 702, a second acquiring module 703, and a third sending module 704; wherein, the second receiving module 701 is used to receive the image capture position coordinates sent by the AR glasses, the image capture position coordinates being determined by the AR glasses based on the user's eye gaze point position and the current screen viewed by the user; the third determining module 702 is used to determine the target application corresponding to the image capture position coordinates on the current screen; the second acquiring module 703 is used to acquire the display screen corresponding to the target application; and the third sending module 704 is used to send the display screen corresponding to the target application to the AR glasses for decoding and display.
[0052] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, systems, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0053] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0054] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0055] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0056] Although preferred embodiments of this disclosure have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of this disclosure.
[0057] Obviously, those skilled in the art can make various modifications and variations to this disclosure without departing from its spirit and scope. Therefore, if such modifications and variations fall within the scope of the claims of this disclosure and their equivalents, this disclosure is also intended to include such modifications and variations.
Claims
1. A method for joint office work using AR glasses and zero-terminal devices, characterized in that, Applied to AR glasses, the method includes: A joint login request is sent to the cloud server. The joint login request is used to request that the AR glasses be connected to the target virtual machine. The target virtual machine refers to the virtual machine that has already established a connection with the zero terminal. When a user triggers the air capture mode, the system determines the user's gaze point and captures the current image being viewed. Based on the user's eye gaze point position and the current image being viewed by the user, the user's image capture position coordinates are determined; the image capture position coordinates are the coordinate information when the user's eye gaze point is projected onto the current image. The image capture position coordinates are sent to the target virtual machine, so that the target virtual machine can determine the target application corresponding to the image capture position on the current screen based on the image capture position coordinates, and then obtain the display screen corresponding to the target application and send it to the AR glasses; Receive the display screen corresponding to the target application sent by the target virtual machine, and decode and display it.
2. The method according to claim 1, characterized in that, The method further includes: Obtain the user's operation instructions for the display screen corresponding to the target application; Perform corresponding operations on the display screen corresponding to the target application according to the operation instructions.
3. The method according to claim 2, characterized in that, The step of performing corresponding operations on the display screen corresponding to the target application according to the operation instructions includes: Adjust the display position of the screen corresponding to the target application according to the operation instructions; or, Adjust the screen size of the display screen corresponding to the target application according to the operation instructions.
4. The method according to claim 1, characterized in that, Before sending the joint login request to the cloud server, the method further includes: Determine whether the zero terminal has established a connection with the target virtual machine on the cloud server; If the zero terminal establishes a connection with the target virtual machine on the cloud server, a joint login request is sent to the cloud server.
5. The method according to claim 4, characterized in that, Sending the joint login request to the cloud server includes: In the joint login mode, you log in to the cloud server by entering your account information; or, By scanning the QR code displayed on the zero terminal, a joint login request is sent to the cloud server. When the cloud server receives the joint login request, it returns a login confirmation message to the zero terminal. After receiving the login confirmation information returned by the zero terminal, the AR glasses establish a connection with the target virtual machine in joint login mode.
6. The method according to claim 1, characterized in that, The methods for triggering the air capture mode include at least one of the following: voice control, button control, or gesture control; wherein... The voice control refers to triggering the air capture mode based on the user's input of preset voice commands; The button method refers to triggering the air capture mode by clicking the physical or virtual button on the AR glasses according to a preset method. The gesture control method refers to triggering the air-to-image capture mode based on the preset gestures made by the user within the gesture capture area of the AR glasses.
7. A method for joint office work using AR glasses and zero-terminal devices, characterized in that, Applied to a virtual machine, the method includes: The AR glasses receive the image capture position coordinates sent by the AR glasses. The image capture position coordinates are determined by the AR glasses based on the user's eye gaze point position and the current image being viewed by the user. Based on the captured position coordinates, determine the target application corresponding to that coordinate position on the current screen; Obtain the display screen corresponding to the target application; The display screen corresponding to the target application is sent to the AR glasses for decoding and display.
8. An AR glasses, characterized in that, The AR glasses include: a first transmitting module, a first determining module, a second determining module, a second transmitting module, and a first receiving module; The first sending module is used to send a joint login request to the cloud server. The joint login request is used to request that the AR glasses be connected to the target virtual machine. The target virtual machine refers to a virtual machine that has already established a connection with the zero terminal. The first determining module is used to determine the position of the user's eye gaze point and capture the current image being viewed by the user when the user triggers the air capture mode operation command. The second determining module is used to determine the user's image capture position coordinates based on the user's eye gaze point position and the current image being viewed by the user; the image capture position coordinates are the coordinate information when the user's eye gaze point is projected onto the current image. The second sending module is used to send the image capture position coordinates to the target virtual machine, so that the target virtual machine can determine the target application corresponding to the image capture position on the current screen based on the image capture position coordinates, and then send the display screen corresponding to the target application to the AR glasses; The first receiving module is used to receive the display screen corresponding to the target application sent by the target virtual machine, and decode and display it.
9. The AR glasses according to claim 8, characterized in that, The AR glasses further include: a first acquisition module and an operation module; wherein... The first acquisition module is used to acquire the operation instructions taken by the user for the display screen corresponding to the target application; The operation module is used to perform corresponding operations on the display screen corresponding to the target application according to the operation instructions.
10. A virtual machine, characterized in that, The virtual machine includes: a second receiving module, a third determining module, a second acquiring module, and a third sending module; wherein, The second receiving module is used to receive the image capture position coordinates sent by the AR glasses. The image capture position coordinates are determined by the AR glasses based on the user's gaze point position and the current image being viewed by the user. The third determining module is used to determine the target application corresponding to the coordinate position on the current screen based on the captured position coordinates. The second acquisition module is used to acquire the display screen corresponding to the target application; The third sending module is used to send the display screen corresponding to the target application to the AR glasses for decoding and display.