Interaction processing method, device and equipment of intelligent glasses and storage medium

Abstract

The invention discloses an interactive processing method, device and equipment of intelligent glasses and a storage medium, a real-time hover window is positioned through a central point position of a current view field of a user in the intelligent glasses, and an interactive action on the hover window is realized based on a window interactive instruction sent by external equipment, so that the interactive processing of the intelligent glasses is realized. Under the condition that external equipment control and sight line and interaction are not synchronous, a user does not need to align the cursor ray of the external equipment to the window all the time, the target window can be selected, and the technical problems that an existing focus selection mode is limited in physical interaction, the sight line and interaction are not synchronous, and multi-focus management is difficult are solved.

Description

Technical Field

[0001] The present application relates to the technical field of smart glasses, and in particular to an interactive processing method, device, equipment and storage medium for smart glasses. Background Art

[0002] As an emerging wearable device, augmented reality (AR) glasses are gradually changing the way we interact with digital information. Compared with traditional screen interaction, AR glasses provide an immersive experience that seamlessly integrates virtual information into the user's real world. However, with the increasing application of AR glasses, how to effectively manage and select focus within a limited field of view has become a key technical challenge.

[0003] Limitations of traditional focus selection methods:

[0004] Physical interaction limitations: In an AR environment, traditional physical interaction devices such as mice and keyboards become inappropriate because they cannot provide an interaction method that matches the immersive experience of AR glasses.

[0005] The line of sight is out of sync with the interaction: The user's line of sight is a natural and intuitive way to select focus, but existing AR glasses focus selection methods often rely on external input devices such as touchpads or buttons, which causes the line of sight to be out of sync with the interaction action.

[0006] Difficulty managing multiple focuses: In an AR environment, users may need to focus on multiple virtual objects or information windows at the same time. Traditional focus selection methods make it difficult to efficiently switch between multiple focuses.

[0007] User fatigue: Prolonged use of external input devices for focus selection may cause user hand or eye fatigue.

[0008] Poor environmental adaptability: AR glasses need to work in a variety of different environments and situations, and traditional focus selection methods may not be able to adapt to all environments. Summary of the invention

[0009] The present application provides an interactive processing method, device, equipment and storage medium for smart glasses, which solves the technical problems of physical interaction limitations, asynchrony between line of sight and interaction, and difficulty in multi-focus management in existing focus selection methods.

[0010] In view of this, the first aspect of the present application provides an interactive processing method for smart glasses, the method comprising:

[0011] Step S1, obtaining the current field of view of the user in the smart glasses;

[0012] Step S2, determining a real-time hover window according to the center point position of the current field of view;

[0013] Step S3: In response to the window interaction instruction sent by the external device, execute the window interaction instruction on the real-time hover window.

[0014] Optionally, the step S1 specifically includes:

[0015] Obtaining a first spatial coordinate range set including a plurality of virtual screens in a display terminal of the smart glasses;

[0016] Determining a second spatial coordinate range set of a current window of the user according to a head-motion gyroscope of the smart glasses;

[0017] If the second spatial coordinate range set belongs to the first spatial coordinate range set, the virtual screen corresponding to the current field of view of the user in the smart glasses is determined according to the second spatial coordinate range set.

[0018] Optionally, the step S1 further includes:

[0019] If the second space coordinate range set does not belong to the first space coordinate range set, a no-window reminder is displayed in the display terminal of the smart glasses.

[0020] Optionally, the step S2 specifically includes:

[0021] According to the center point coordinates of the current field of view, determining whether there is an application window corresponding to the center point coordinates in the virtual screen;

[0022] If it exists, the application window is used as a real-time hover window, and the real-time hover window is highlighted;

[0023] If it does not exist, the virtual screen is used as a real-time hover window, and the real-time hover window is highlighted.

[0024] Optionally, the step S3 specifically includes:

[0025] Receive window interaction commands input from external devices;

[0026] According to the type of the window interaction instruction, determining whether the real-time hover window meets a preset interaction condition;

[0027] If satisfied, the window interaction instruction is executed at the center point position in the real-time hover window; otherwise, a reminder that interaction is impossible is displayed in the display terminal of the smart glasses.

[0028] Optionally, after step S3, the following steps are further included:

[0029] When the center point position of the current field of view is not within the range of the real-time hover window, the real-time hover window is reset to a non-hover state.

[0030] Optionally, after determining the second spatial coordinate range set of the user's current window according to the head-motion gyroscope of the smart glasses, the method further includes:

[0031] Get the real-time ray coordinate position of the external device;

[0032] If the real-time ray coordinate position is within the second space coordinate range set, the virtual screen corresponding to the current field of view of the user in the smart glasses is determined according to the real-time ray coordinate position.

[0033] A second aspect of the present application provides an interactive processing device for smart glasses, the device comprising:

[0034] An acquisition unit, used to acquire the current field of view of the user in the smart glasses;

[0035] A determination unit, configured to determine a real-time hover window according to the center point position of the current field of view;

[0036] The response unit is used to respond to the window interaction instruction sent by the external device and execute the window interaction instruction on the real-time hover window.

[0037] A third aspect of the present application provides an interactive processing device for smart glasses, the device comprising a processor and a memory:

[0038] The memory is used to store program code and transmit the program code to the processor;

[0039] The processor is used to execute the steps of the method for interactive processing of smart glasses as described in the first aspect according to the instructions in the program code.

[0040] A fourth aspect of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store program code, and the program code is used to execute the method described in the first aspect above.

[0041] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0042] In the present application, a method, apparatus, device and storage medium for interactive processing of smart glasses are provided. The real-time hover window is located by the center point position of the user's current field of view in the smart glasses, and then the interactive action on the hover window is realized based on the window interaction instruction sent by the external device. In the case of external device control and the line of sight and interaction being out of sync, the target window can be selected without the user always aiming the cursor ray of the external device at the window, which solves the technical problems of physical interaction limitations, line of sight and interaction being out of sync, and multi-focus management difficulties in the existing focus selection method. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 A method flow chart of the interactive processing method of smart glasses in an embodiment of the present application;

[0044] Figure 2 Schematic diagram of the structure of the interactive processing device of the smart glasses in the embodiment of the present application;

[0045] Figure 3 Schematic diagram of the structure of the interactive processing device of the smart glasses in the embodiment of the present application. DETAILED DESCRIPTION

[0046] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0047] The present application designs an interactive processing method, device, equipment and storage medium for smart glasses, which solves the technical problems of physical interaction limitations, asynchrony between line of sight and interaction, and difficulty in multi-focus management in existing focus selection methods.

[0048] For easier understanding, see Figure 1 , Figure 1 is a method flow chart of the interactive processing method of the smart glasses in the embodiment of the present application, such as Figure 1 As shown, specifically:

[0049] Step S1, obtaining the current field of view of the user in the smart glasses;

[0050] Furthermore, step S1 specifically includes:

[0051] Obtaining a first spatial coordinate range set including a plurality of virtual screens in a display terminal of the smart glasses;

[0052] Determine a second spatial coordinate range set of the user's current window according to the head-motion gyroscope of the smart glasses;

[0053] If the second spatial coordinate range set belongs to the first spatial coordinate range set, the virtual screen corresponding to the current field of view of the user in the smart glasses is determined according to the second spatial coordinate range set.

[0054] It should be noted that this step involves determining the field of view that the user sees through the smart glasses. This is usually achieved by analyzing data from a head-motion gyroscope that tracks the user's head movements.

[0055] Example: When a user puts on smart glasses, the gyroscope in the glasses starts to track the user's head movements. When the user turns his head to view different virtual screens, the gyroscope captures these movements and calculates the spatial coordinates of the user's current window.

[0056] Step S2, determining a real-time hover window according to the center point position of the current field of view;

[0057] It should be noted that at the center point of the user's current field of view, the system will determine whether there is an application window and set it as a real-time hover window. Hover window refers to a suspended window.

[0058] Example: When the user's field of view is centered on a virtual mail application window, the system highlights the window to indicate that it is now a real-time hover window, ready to accept user instructions.

[0059] Step S3: In response to the window interaction instruction sent by the external device, execute the window interaction instruction on the real-time hover window.

[0060] It should be noted that the user can send instructions through an external device (such as a remote control, a smart phone, or a gesture recognition device), and the system will respond to the instructions sent by the external device.

[0061] Window interaction instructions include but are not limited to opening, closing, maximizing, minimizing, moving, scaling, rotating, adjusting transparency, changing shape, grouping, locking, saving layout, screenshot, previewing, split screen, level adjustment, searching, editing, scrolling, filtering, sorting, sharing, copying, setting shortcut operations, and switching interaction modes.

[0062] Example: The user sees the mail application window highlighted through smart glasses, and then uses an external gesture recognition device to make an "open" gesture. After the system recognizes the gesture, the mail application window opens.

[0063] Furthermore, step S1 further includes:

[0064] If the second space coordinate range set does not belong to the first space coordinate range set, a no-window reminder is displayed in the display terminal of the smart glasses.

[0065] It should be noted that if the user's window is not within the spatial coordinate range of any virtual screen, the system will remind the user on the display terminal that there is no interactive window.

[0066] Example: When the user looks outside the field of view of the smart glasses, the gyroscope detects that the user's view window is not within the range of any virtual screen, and the smart glasses display a "no window" prompt.

[0067] Furthermore, step S2 specifically includes:

[0068] According to the center point coordinates of the current field of view, determine whether there is an application window corresponding to the center point coordinates in the virtual screen;

[0069] If it exists, the application window will be used as the real-time hover window, and the real-time hover window will be highlighted;

[0070] If it does not exist, the virtual screen is used as the real-time hover window, and the real-time hover window is highlighted.

[0071] It should be noted that when the real-time hover window is determined, the system will highlight it so that the user knows where the current focus is.

[0072] Example: When the user's gaze rests on a web browser window, the system highlights the window border and slightly enlarges it, prompting the user that the window is now active and can accept further interaction.

[0073] Furthermore, step S3 specifically includes:

[0074] Receive window interaction commands input from external devices;

[0075] According to the type of window interaction instruction, determine whether the real-time hover window meets the preset interaction conditions;

[0076] If the conditions are met, the window interaction instruction is executed at the center point of the real-time hover window; otherwise, a reminder that interaction is not possible is displayed on the display terminal of the smart glasses.

[0077] It should be noted that if the command sent by the external device cannot be executed on the current real-time hover window, the system will remind the user that the operation cannot be performed in the current window.

[0078] Example: The user tries to issue a "zoom out" command through an external device, but the currently hovered email application window does not support the zoom out operation, and the smart glasses display a "cannot zoom out" prompt.

[0079] Furthermore, after step S3, the following steps are further included:

[0080] When the center point of the current field of view is not within the range of the real-time hover window, the real-time hover window is reset to a non-hover state.

[0081] It should be noted that when the center point of the user's field of view is no longer aligned with the real-time hover window, the system will automatically reset the state of the window and cancel the highlight display.

[0082] Example: The user's eyes leave the mail application window and turn to another calendar application window. The highlight of the mail application window disappears and the calendar application window starts to be highlighted.

[0083] Furthermore, after determining the second space coordinate range set of the user's current window according to the head motion gyroscope of the smart glasses, the method further includes:

[0084] Get the real-time ray coordinate position of the external device;

[0085] If the real-time ray coordinate position is within the second space coordinate range set, the virtual screen corresponding to the current field of view of the user in the smart glasses is determined according to the real-time ray coordinate position.

[0086] It should be noted that the system will obtain the ray coordinate position provided by the external device to further accurately determine the virtual screen corresponding to the user's current field of view.

[0087] Example: A user uses an external laser pointer device to point to a virtual calendar window in smart glasses. The system determines the virtual screen corresponding to the user's current field of view through the ray coordinate position of the laser pointer and sets it as a real-time hover window.

[0088] See also Figure 2 , Figure 2 Schematic diagram of the structure of the interactive processing device of the smart glasses in the embodiment of the present application. Figure 2 As shown, specifically:

[0089] An acquisition unit 201 is used to acquire the current field of view of the user in the smart glasses;

[0090] A determination unit 202, configured to determine a real-time hover window according to the center point position of the current field of view;

[0091] The responding unit 203 is used to respond to the window interaction instruction sent by the external device and execute the window interaction instruction on the real-time hover window.

[0092] The present application also provides another interactive processing device for smart glasses, such as Figure 3For the sake of convenience, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiments of the present application. The terminal can be any terminal device including a mobile phone, a tablet computer, a personal digital assistant (English full name: Personal Digital Assistant, English abbreviation: PDA), a sales terminal (English full name: Point of Sales, English abbreviation: POS), a car computer, smart glasses, etc. Take the terminal as smart glasses as an example:

[0093] Figure 3 FIG. 1 is a block diagram showing a partial structure of smart glasses related to a terminal provided in an embodiment of the present application. Figure 3 The smart glasses include: a radio frequency (RF) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (WiFi) module 1070, a processor 1080, and a power supply 1090. Those skilled in the art will appreciate that Figure 3 The structure of the smart glasses shown in the figure does not constitute a limitation on the mobile phone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0094] Combine the following Figure 3 A detailed introduction to the various components of smart glasses:

[0095] The RF circuit 1010 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is sent to the processor 1080 for processing; in addition, the uplink data is sent to the base station. Generally, the RF circuit 1010 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (full name: LowNoiseAmplifier, English abbreviation: LNA), a duplexer, etc. In addition, the RF circuit 1010 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to Global System of Mobile communications (Global System of Mobile communication, English abbreviation: GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, English abbreviation: CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (Long Term Evolution, English abbreviation: LTE), e-mail, Short Messaging Service (SMS), etc.

[0096] The memory 1020 can be used to store software programs and modules. The processor 1080 executes various functional applications and data processing of the smart glasses by running the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the smart glasses (such as audio data), etc. In addition, the memory 1020 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0097] The input unit 1030 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the smart glasses. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1031 or near the touch panel 1031 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 1031 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 1080, and can receive and execute the command sent by the processor 1080. In addition, the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1031, the input unit 1030 may further include other input devices 1032. Specifically, the other input devices 1032 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, a neck ring, etc.

[0098] The display unit 1040 can be used to display information input by the user or information provided to the user and various menus of the smart glasses. The display unit 1040 may include a display panel 1041. Optionally, the display panel 1041 may be configured in the form of a liquid crystal display (full name in English: Liquid Crystal Display, English abbreviation: LCD), an organic light-emitting diode (full name in English: Organic Light-Emitting Diode, English abbreviation: OLED), etc. Further, the touch panel 1031 may cover the display panel 1041. When the touch panel 1031 detects a touch operation on or near it, it is transmitted to the processor 1080 to determine the type of touch event. Subsequently, the processor 1080 provides a corresponding visual output on the display panel 1041 according to the type of touch event. Although in Figure 3 In the embodiment, the touch panel 1031 and the display panel 1041 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 1031 and the display panel 1041 can be integrated to realize the input and output functions of the smart glasses.

[0099] The smart glasses may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may automatically wake up the display panel 1041 when the smart glasses are worn. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used to identify the application of the posture of smart glasses (such as looking up, lowering, turning the head), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured in smart glasses, they will not be repeated here.

[0100] The audio circuit 1060, the speaker 1061, and the microphone 1062 can provide an audio interface between the user and the smart glasses. The audio circuit 1060 can transmit the received audio data to the speaker 1061 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1060 and converted into audio data, and then the audio data is output to the processor 1080 for processing, and then sent to, for example, another pair of smart glasses through the RF circuit 1010, or the audio data is output to the memory 1020 for further processing.

[0101] WiFi is a short-range wireless transmission technology. Smart glasses can help users send and receive emails, browse web pages, and access streaming media through WiFi module 1070. It provides users with wireless broadband Internet access. Figure 3 A WiFi module 1070 is shown, but it is understandable that it is not a necessary component of the smart glasses and can be omitted as needed without changing the essence of the invention.

[0102] The processor 1080 is the control center of the smart glasses. It uses various interfaces and lines to connect the various parts of the entire smart glasses. By running or executing the software programs and / or modules stored in the memory 1020, and calling the data stored in the memory 1020, it performs various functions of the smart glasses and processes data, thereby monitoring the smart glasses as a whole. Optionally, the processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1080.

[0103] The smart glasses also include a power source 1090 (such as a battery) for supplying power to each component. Preferably, the power source can be logically connected to the processor 1080 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption management.

[0104] Although not shown, the smart glasses may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0105] In the embodiment of the present application, the processor 1080 included in the terminal also has the following functions:

[0106] Step S1, obtaining the current field of view of the user in the smart glasses;

[0107] Step S2, determining a real-time hover window according to the center point position of the current field of view;

[0108] Step S3: In response to the window interaction instruction sent by the external device, execute the window interaction instruction on the real-time hover window.

[0109] The embodiment of the present application also provides a computer-readable storage medium for storing program code, wherein the program code is used to execute any implementation of the interaction processing method of smart glasses described in the aforementioned embodiments.

[0110] In the embodiments of the present application, a method, apparatus, device and storage medium for interactive processing of smart glasses are provided. The real-time hover window is located by the center point position of the current field of view of the user in the smart glasses, and then the interactive action on the hover window is realized based on the window interaction instruction sent by the external device. In the case of external device control and line of sight and interaction being out of sync, the target window can be selected without the user always aiming the cursor ray of the external device at the window, thereby solving the technical problems of physical interaction limitation, line of sight and interaction being out of sync and multi-focus management difficulty existing in the existing focus selection method.

[0111] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0112] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0113] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0114] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0115] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0116] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0117] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (full name in English: Read-Only Memory, English abbreviation: ROM), random access memory (full name in English: Random Access Memory, English abbreviation: RAM), disk or optical disk and other media that can store program codes.

[0118] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An interactive processing method for smart glasses, characterized in that: include: Step S1, obtaining the current field of view of the user in the smart glasses; Step S2, determining a real-time hover window according to the center point position of the current field of view; Step S3: In response to the window interaction instruction sent by the external device, execute the window interaction instruction on the real-time hover window.

2. The interactive processing method of smart glasses according to claim 1, characterized in that: The step S1 specifically includes: Obtaining a first spatial coordinate range set including a plurality of virtual screens in a display terminal of the smart glasses; Determining a second spatial coordinate range set of a current window of the user according to a head-motion gyroscope of the smart glasses; If the second spatial coordinate range set belongs to the first spatial coordinate range set, the virtual screen corresponding to the current field of view of the user in the smart glasses is determined according to the second spatial coordinate range set.

3. The interactive processing method of smart glasses according to claim 2, characterized in that: The step S1 further comprises: If the second space coordinate range set does not belong to the first space coordinate range set, a no-window reminder is displayed in the display terminal of the smart glasses.

4. The interactive processing method of smart glasses according to claim 2, characterized in that: The step S2 specifically includes: According to the center point coordinates of the current field of view, determining whether there is an application window corresponding to the center point coordinates in the virtual screen; If it exists, the application window is used as a real-time hover window, and the real-time hover window is highlighted; If it does not exist, the virtual screen is used as a real-time hover window, and the real-time hover window is highlighted.

5. The interactive processing method of smart glasses according to claim 1, characterized in that: The step S3 specifically includes: Receive window interaction commands input from external devices; According to the type of the window interaction instruction, determining whether the real-time hover window meets a preset interaction condition; If satisfied, the window interaction instruction is executed at the center point position in the real-time hover window; otherwise, a reminder that interaction is impossible is displayed in the display terminal of the smart glasses.

6. The interactive processing method of smart glasses according to claim 1, characterized in that: After step S3, the following steps are also included: When the center point position of the current field of view is not within the range of the real-time hover window, the real-time hover window is reset to a non-hover state.

7. The interactive processing method of smart glasses according to claim 2, characterized in that: After determining the second spatial coordinate range set of the user's current window according to the head-moving gyroscope of the smart glasses, the method further includes: Get the real-time ray coordinate position of the external device; If the real-time ray coordinate position is within the second space coordinate range set, the virtual screen corresponding to the current field of view of the user in the smart glasses is determined according to the real-time ray coordinate position.

8. An interactive processing device for smart glasses, characterized in that: include: An acquisition unit, used to acquire the current field of view of the user in the smart glasses; A determination unit, configured to determine a real-time hover window according to the center point position of the current field of view; The response unit is used to respond to the window interaction instruction sent by the external device and execute the window interaction instruction on the real-time hover window.

9. An interactive processing device for smart glasses, characterized in that: The device comprises a processor and a memory: The memory is used to store program codes and transmit the program codes to the processor; The processor is used to execute the interactive processing method of the smart glasses according to any one of claims 1 to 7 according to the instructions in the program code.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program codes, and the program codes are used to execute the interactive processing method of the smart glasses according to any one of claims 1 to 7.

Images