Head-motion interaction method, device, equipment and storage medium for smart glasses terminal

Abstract

The present application discloses a head-motion interaction method, device, equipment and storage medium for a smart glasses terminal, which obtains the current field of view center of a user wearing the smart glasses terminal to display a corresponding field of view cursor, and completely drives the field of view cursor to perform a preset number of actions toward a target image by translating and turning the head. The preset operation on the target image is performed according to the preset event corresponding to the action information, freeing the hands and completely relying on head movement to achieve interaction with the application, thereby solving the technical problem that the existing interaction methods of wearable glasses devices currently mainly use touch pads, buttons and the like for interaction, still require the use of both hands to complete the interaction, and rely on external devices, resulting in inconvenient interaction.

Description

Technical Field

[0001] The present application relates to the field of VR or AR technology, and in particular to a head-motion interaction method, device, equipment, and storage medium for a smart glasses terminal. Background Art

[0002] Since humanity entered the Information Age, computing platforms have been constantly evolving. The PC and smartphone platforms have spawned two golden ages in the history of the internet. After years of development, the PC and smartphone industries have reached near-maturity, leaving limited room for growth and performance improvements, and user expectations are dwindling. Smart glasses, featuring advanced near-eye optical displays, will become the next generation of personal computing platforms and displays, offering users a disruptive and innovative experience.

[0003] The existing wearable glasses devices currently mainly use touchpads, buttons and other methods for interaction, which still require the use of both hands to complete the interaction and rely on external devices, resulting in technical problems such as inconvenient interaction. Summary of the Invention

[0004] The present application provides a head-motion interaction method, device, equipment and storage medium for a smart glasses terminal, which solves the technical problem that the interaction methods of existing wearable glasses devices currently mainly use touchpads, buttons, etc. for interaction, still require the use of both hands to complete the interaction, and rely on external devices, resulting in inconvenient interaction.

[0005] In view of this, the first aspect of the present application provides a head-motion interaction method for a smart glasses terminal, the method comprising:

[0006] S1. Obtain the current visual field center of the user wearing the smart glasses terminal;

[0007] S2. Displaying a field of view cursor corresponding to the current field of view center;

[0008] S3, receiving information on a preset number of actions performed by the user by moving the field of view cursor toward the target icon by translating the head within a preset time;

[0009] S4. Execute a preset operation on the target icon according to a preset event corresponding to the action information of the preset number of times.

[0010] Optionally, after step S2, the following steps are further included:

[0011] S5. When the field of view cursor is located within a preset sliding area of ​​the application window, receiving a first head movement cursor trajectory generated by the user turning the head clockwise or counterclockwise;

[0012] S6. When the first head-moving cursor track forms a closed figure, determining a sliding direction of the application window according to the direction in which the user turns his head;

[0013] S7. After the first head-moving cursor trajectory forms a closed figure, if it is detected that the user's head continues to move in the sliding direction, the application window is slid in the sliding direction until it is detected that the user's head moves in the opposite direction of the sliding direction, then the sliding of the application window is stopped and the display of the first head-moving cursor trajectory is stopped.

[0014] Optionally, after step S4, the following steps are further included:

[0015] S8, when the field of view cursor is located within a preset input area of ​​the input box, and within a preset time, the user moves the field of view cursor toward the target icon a preset number of times by moving the head horizontally, and when a preset event corresponding to the action information is a selection event, generating a head-activated writing board;

[0016] S9, when the visual field cursor is located in the area corresponding to the head-moving tablet, receiving a second head-moving cursor trajectory generated by the user moving the head;

[0017] S10. When the visual field cursor leaves the corresponding area of ​​the head-moving tablet, text recognition is performed according to the second head-moving cursor trajectory, and the text recognition result is input into the input box.

[0018] Optionally, after step S2, the following steps are further included:

[0019] S11. When the viewing cursor remains stationary and hovers over an application window or icon for a period greater than a first preset time threshold, the application window or icon is selected;

[0020] S12, dragging the application window or icon to the target position according to the target position determined by the user moving his head;

[0021] S13: When the viewing cursor remains stationary and hovers over the application window or icon for a period greater than a second preset time threshold, cancel the selection of the application window or icon.

[0022] Optionally, the step S11 or S13 further includes:

[0023] When the visual cursor is stationary and hovers over an application window or icon, a countdown prompt is displayed in a preset display area.

[0024] A second aspect of the present application provides a head-motion interaction device for a smart glasses terminal, the device comprising:

[0025] An acquisition unit, configured to acquire the current visual field center of the user wearing the smart glasses terminal;

[0026] A display unit, configured to display a field of view cursor corresponding to the current field of view center;

[0027] The first receiving unit is configured to receive information on a preset number of actions performed by the user by moving the field of view cursor toward a target icon by translating the head within a preset time period;

[0028] The first processing unit is configured to execute a preset operation on the target icon according to a preset event corresponding to the preset number of action information.

[0029] Optionally, it also includes:

[0030] a second receiving unit, configured to receive a first head-movement cursor track generated by the user turning his head clockwise or counterclockwise when the field of view cursor is located in a preset sliding area of ​​the application window;

[0031] a second processing unit, configured to determine a sliding direction of the application window according to a direction in which the user turns his head when the first head-moving cursor track forms a closed figure;

[0032] The third processing unit is used to, after the first head-moving cursor trajectory forms a closed figure, if it is detected that the user's head continues to move in the sliding direction, slide the application window in the sliding direction until it is detected that the user's head moves in the opposite direction of the sliding direction, then stop sliding the application window and stop displaying the first head-moving cursor trajectory.

[0033] Optionally, it also includes:

[0034] A fourth processing unit is configured to generate a head-activated writing board when, when the field of view cursor is located within a preset input area of ​​the input box and, within a preset time, the user performs a preset number of actions by moving the field of view cursor toward a target icon by moving the head horizontally and turning the head a preset number of times, and when a preset event corresponding to the action information is a selection event;

[0035] a third receiving unit, configured to receive a second head-moving cursor trajectory generated by the user moving his head when the field of view cursor is located in the area corresponding to the head-moving tablet;

[0036] The fifth processing unit is configured to perform text recognition according to the second head-moving cursor trajectory when the field of view cursor leaves the corresponding area of ​​the head-moving tablet, and input the text recognition result into the input box.

[0037] A third aspect of the present application provides a head-motion interaction device for a smart glasses terminal, the device comprising a processor and a memory:

[0038] The memory is used to store program code and transmit the program code to the processor;

[0039] The processor is used to execute the steps of the head-motion interaction method for the smart glasses terminal as described in the first aspect according to the instructions in the program code.

[0040] In a fourth aspect, the present application provides a computer-readable storage medium, which is used to store program code, and the program code is used to execute the steps of the head-motion interaction method of the smart glasses terminal described in the first aspect.

[0041] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0042] In the present application, a head-motion interaction method, apparatus, device and storage medium for a smart glasses terminal are provided. By acquiring the current field of view center of the user wearing the smart glasses terminal, a corresponding field of view cursor is displayed. The method is completely based on the user driving the field of view cursor to perform a preset number of actions toward the target image by turning the head horizontally, and the preset operation on the target image is performed according to the preset event corresponding to the action information, freeing the hands and relying entirely on head movement to achieve interaction with the application, thereby solving the technical problem that the existing interaction methods of wearable glasses devices currently mainly use touchpads, buttons, etc. for interaction, still require the use of hands to complete the interaction, and rely on external devices, resulting in inconvenient interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 This is a first method flow chart of a head-motion interaction method for a smart glasses terminal in an embodiment of the present application;

[0044] Figure 2 This is a second method flow chart of a head-motion interaction method for a smart glasses terminal in an embodiment of the present application;

[0045] Figure 3 This is a third method flow chart of a head-motion interaction method for a smart glasses terminal in an embodiment of the present application;

[0046] Figure 4 This is a fourth method flow chart of a head-motion interaction method for a smart glasses terminal in an embodiment of the present application;

[0047] Figure 5 This is a structural diagram of a head-motion interaction device of a smart glasses terminal in an embodiment of the present application;

[0048] Figure 6 This is a structural diagram of a head-motion interaction device of a smart glasses terminal in an embodiment of the present application. DETAILED DESCRIPTION

[0049] In order to help those skilled in the art better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0050] This application designs a head-motion interaction method, device, equipment and storage medium for a smart glasses terminal, which solves the technical problem that the interaction methods of existing wearable glasses devices currently mainly use touchpads, buttons, etc. for interaction, still require the use of both hands to complete the interaction, and rely on external devices, resulting in inconvenient interaction.

[0051] For easier understanding, see Figure 1 , Figure 1 This is a first method flow chart of a head-movement interaction method for a smart glasses terminal in an embodiment of the present application, such as Figure 1 As shown, specifically:

[0052] S1. Obtain the current visual field center of the user wearing the smart glasses terminal;

[0053] It should be noted that the virtual large screen refers to a desktop that is larger than the current field of view. It contains application icons, a navigation bar, and other functional components. The virtual large screen remains stationary relative to the real world. With head-motion interaction mode enabled, you can turn your head in any direction to view different areas of the virtual large screen.

[0054] S2, displaying the field of view cursor according to the current field of view center;

[0055] It should be noted that after the user's current field of view center is determined, a field of view cursor is displayed at the corresponding position, and the field of view cursor is equivalent to a mouse cursor.

[0056] S3. Receive information about a preset number of times that the user moves the cursor toward the target icon by moving the head horizontally within a preset time period;

[0057] It should be noted that, for example, within the preset time of 1 second, if the user moves the field of view cursor through the target icon twice by turning the head horizontally, action information will be generated accordingly.

[0058] The ways to cross the target icon are divided into crossing from top to bottom, crossing from bottom to top, crossing from left to right, and crossing from right to left.

[0059] S4. Execute a preset operation on the target icon according to a preset event corresponding to the action information of a preset number of times.

[0060] It should be noted that different combinations of crossing actions can generate different action information, which will correspond to preset events, for example:

[0061] Upward and downward crossing events 1;

[0062] Left crossing + right crossing event 2;

[0063] Two upward crossing events 3;

[0064] Two underpass events 4;

[0065] Two left-crossing events 5;

[0066] Two right-crossing events 6;

[0067] Events may include but are not limited to single-click, double-click, right-click, select, delete, rename, etc. The specific action information corresponding to which preset event can be customized by the user.

[0068] See also Figure 2 , Figure 2 This is a second method flow chart of a head-movement interaction method for a smart glasses terminal in an embodiment of the present application, such as Figure 2 As shown, specifically:

[0069] After step S2, the following steps are also included:

[0070] S5. When the field of view cursor is located within the preset sliding area of ​​the application window, receiving a first head-moving cursor trajectory generated by the user turning the head clockwise or counterclockwise;

[0071] S6. When the first cursor movement track forms a closed figure, determine the sliding direction of the application window according to the direction in which the user turns his head;

[0072] S7. After the first head movement cursor track forms a closed figure, if it is detected that the user's head continues to move in the sliding direction, the application window is slid in the sliding direction until it is detected that the user's head moves in the opposite direction of the sliding direction, then the sliding of the application window is stopped and the display of the first head movement cursor track is stopped.

[0073] It should be noted that in application windows that need to slide up and down, the common method is to drag the sliding track of the application window with a mouse. In the technical solution of the present application, the user turns his head clockwise or counterclockwise to determine whether to slide up, down, left, or right. When a closed figure, such as a circle, is formed after the user turns his head, the sliding direction is determined. Based on the closed figure, the user continues to move his head in the sliding direction to determine the sliding distance. If the movement is in the opposite direction of the sliding direction, it means that the sliding of the window has stopped.

[0074] See also Figure 3, Figure 3 This is a third method flow chart of a head-movement interaction method for a smart glasses terminal in an embodiment of the present application, such as Figure 3 As shown, specifically:

[0075] After step S4, the following steps are also included:

[0076] S8. When the field of view cursor is located within the preset input area of ​​the input box, and within a preset time, the user moves the field of view cursor toward the target icon a preset number of times by moving the head horizontally, and the preset event corresponding to the action information is a selection event, a head-activated writing board is generated;

[0077] S9, when the visual field cursor is located in the area corresponding to the head-held tablet, receiving a second head-movement cursor trajectory generated by the user moving the head;

[0078] S10: When the visual field cursor leaves the area corresponding to the head-moving tablet, text recognition is performed according to the second head-moving cursor trajectory, and the text recognition result is input into the input box.

[0079] It should be noted that when inputting text information, the field of view cursor can be identified as a preset event corresponding to the action information to select the input box corresponding to the position of the field of view cursor, and the generated head-moving writing board can be displayed, and text can be written by turning the head in the corresponding area of ​​the head-moving writing board.

[0080] See also Figure 4 , Figure 4 This is a fourth method flow chart of a head-motion interaction method for a smart glasses terminal in an embodiment of the present application, such as Figure 4 As shown, specifically:

[0081] After step S2, the following steps are also included:

[0082] S11, when the field of view cursor remains stationary and hovers over the application window or icon for a time period greater than a first preset time threshold, the application window or icon is selected;

[0083] S12, dragging the application window or icon to the target location according to the target location determined by the user moving his head;

[0084] S13: When the time for which the field of view cursor remains stationary and hovers over the application window or icon is greater than a second preset time threshold, cancel the selection state of the application window or icon.

[0085] It should be noted that, if the field of view cursor stays on a certain application window or icon for more than a first preset time of 3 seconds, the current application window or icon is selected.

[0086] By turning your head, you can drag the application icon or window to any position on the virtual large screen.

[0087] When the head is placed in the parking area and remains still for the second preset time of 3 seconds, the selection state is canceled;

[0088] If it is in a non-droppable area, it will return to its original position after 3 seconds or automatically cancel the dragging state when it reaches the drag limit (such as the virtual large screen boundary).

[0089] There can be a countdown prompt window when selecting or deselecting.

[0090] See also Figure 5 , Figure 5 This is a structural diagram of a head-motion interaction device of a smart glasses terminal in an embodiment of the present application. Figure 5 As shown, specifically:

[0091] An acquisition unit 501 is configured to acquire the current visual field center of a user wearing the smart glasses terminal;

[0092] The display unit 502 is used to display a field of view cursor corresponding to the current field of view center;

[0093] The first receiving unit 503 is configured to receive information about a preset number of actions performed by the user by moving the cursor toward the target icon by panning the head within a preset time period;

[0094] The first processing unit 504 is configured to execute a preset operation on the target icon according to a preset event corresponding to the action information of a preset number of times.

[0095] Furthermore, it also includes:

[0096] The second receiving unit 505 is configured to receive a first head movement cursor track generated by the user turning the head clockwise or counterclockwise when the field of view cursor is located in the preset sliding area of ​​the application window;

[0097] The second processing unit 506 is configured to determine a sliding direction of the application window according to a direction in which the user turns his head when the first head-moving cursor track forms a closed figure;

[0098] The third processing unit 507 is used to slide the application window in the sliding direction after the first head movement cursor track forms a closed figure, if it is detected that the user's head continues to move in the sliding direction, until it is detected that the user's head moves in the opposite direction of the sliding direction, then stop sliding the application window and stop displaying the first head movement cursor track.

[0099] Furthermore, it also includes:

[0100] The fourth processing unit 508 is configured to generate a head-activated writing board when, when the field of view cursor is within a preset input area of ​​the input box and, within a preset time, the user moves the field of view cursor toward the target icon a preset number of times by panning the head, and when a preset event corresponding to the action information is a selection event;

[0101] The third receiving unit 509 is configured to receive a second head-moving cursor track generated by the user moving the head when the field of view cursor is located in the area corresponding to the head-moving tablet;

[0102] The fifth processing unit 510 is configured to perform text recognition according to the second head-moving cursor trajectory when the visual field cursor leaves the area corresponding to the head-moving tablet, and input the text recognition result into the input box.

[0103] The embodiment of the present application also provides another head-motion interaction device for a smart glasses terminal, such as Figure 6 For ease of explanation, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the method section of the embodiments of the present application. The terminal can be any terminal device including a mobile phone, a tablet computer, a personal digital assistant (PDA), a point of sales (POS), a car computer, smart glasses, etc. Take the smart glasses as an example:

[0104] Figure 6 The block diagram shows a partial structure of the smart glasses related to the terminal provided by the embodiment of the present application. Figure 6 The smart glasses include: a radio frequency (RF) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (WiFi) module 1070, a processor 1080, and a power supply 1090. Those skilled in the art will appreciate that Figure 6 The structure of the smart glasses shown in the figure does not constitute a limitation on the mobile phone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0105] The following combination Figure 6 A detailed introduction to the various components of smart glasses:

[0106] RF circuitry 1010 can be used to receive and transmit signals during information transmission or calls. Specifically, it receives downlink information from the base station and transmits it to processor 1080 for processing. It also transmits uplink data to the base station. Typically, RF circuitry 1010 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier (LNA), a duplexer, and more. RF circuitry 1010 can also communicate with the network and other devices via wireless communications. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to Global System of Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.

[0107] The memory 1020 can be used to store software programs and modules. The processor 1080 executes the various functional applications and data processing of the smart glasses by running the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created based on the use of the smart glasses (such as audio data), etc. In addition, the memory 1020 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device.

[0108] The input unit 1030 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the smart glasses. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by the user using a finger, stylus, or any other suitable object or accessory on or near the touch panel 1031) and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 1031 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch direction and detects the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 1080. It can also receive commands sent by the processor 1080 and execute them. In addition, the touch panel 1031 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1031, the input unit 1030 may further include other input devices 1032. Specifically, the other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, power keys, etc.), a trackball, a mouse, a joystick, a neck ring, and the like.

[0109] The display unit 1040 can be used to display information input by the user or information provided to the user and various menus of the smart glasses. The display unit 1040 may include a display panel 1041. Optionally, the display panel 1041 may be configured in the form of a liquid crystal display (English full name: Liquid Crystal Display, English abbreviation: LCD), an organic light-emitting diode (English full name: Organic Light-Emitting Diode, English abbreviation: OLED), etc. Further, the touch panel 1031 may cover the display panel 1041. When the touch panel 1031 detects a touch operation on or near it, it is transmitted to the processor 1080 to determine the type of touch event. Subsequently, the processor 1080 provides corresponding visual output on the display panel 1041 according to the type of touch event. Although in Figure 6 In the embodiment, the touch panel 1031 and the display panel 1041 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 1031 and the display panel 1041 can be integrated to realize the input and output functions of the smart glasses.

[0110] The smart glasses may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may automatically wake up the display panel 1041 when the smart glasses are worn. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of smart glasses (such as looking up, lowering, turning the head), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in smart glasses, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be described in detail here.

[0111] Audio circuit 1060, speaker 1061, and microphone 1062 provide an audio interface between the user and the smart glasses. Audio circuit 1060 converts received audio data into electrical signals and transmits them to speaker 1061, which then converts them into sound signals for output. Microphone 1062, on the other hand, converts collected sound signals into electrical signals, which are then received by audio circuit 1060 and converted into audio data. The audio data is then processed by processor 1080 and transmitted via RF circuit 1010 to, for example, another pair of smart glasses, or to memory 1020 for further processing.

[0112] WiFi is a short-range wireless transmission technology. Smart glasses can help users send and receive emails, browse the web, and access streaming media through the WiFi module 1070. It provides users with wireless broadband Internet access. Figure 6 A WiFi module 1070 is shown, but it is understandable that it is not an essential component of the smart glasses and can be omitted as needed without changing the essence of the invention.

[0113] The processor 1080 is the control center of the smart glasses, connecting all components of the smart glasses using various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 1020 and accessing data stored in the memory 1020, it performs various functions of the smart glasses and processes data, thereby providing overall monitoring of the smart glasses. Optionally, the processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor and a modem processor, wherein the application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into the processor 1080.

[0114] The smart glasses also include a power supply 1090 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 1080 through a power management system, thereby managing charging, discharging, and power consumption through the power management system.

[0115] Although not shown, the smart glasses may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0116] In the embodiment of the present application, the processor 1080 included in the terminal further has the following functions:

[0117] S1. Obtain the current visual field center of the user wearing the smart glasses terminal;

[0118] S2, displaying the field of view cursor according to the current field of view center;

[0119] S3. Receive information about a preset number of times that the user moves the cursor toward the target icon by moving the head horizontally within a preset time period;

[0120] S4. Execute a preset operation on the target icon according to a preset event corresponding to the action information of a preset number of times.

[0121] An embodiment of the present application also provides a computer-readable storage medium for storing program code, which is used to execute any implementation of the head-motion interaction method of a smart glasses terminal in the aforementioned embodiments.

[0122] In an embodiment of the present application, a head-motion interaction method, apparatus, device and storage medium for a smart glasses terminal are provided. By acquiring the current field of view center of a user wearing the smart glasses terminal, a corresponding field of view cursor is displayed. The method is completely based on the user driving the field of view cursor to perform a preset number of actions toward a target image by turning the head horizontally, and a preset operation on the target image is performed according to a preset event corresponding to the action information, freeing the hands and relying entirely on head movement to achieve interaction with the application, thereby solving the technical problem that the existing interaction methods of wearable glasses devices currently mainly use touchpads, buttons, etc. for interaction, still require the use of both hands to complete the interaction, and rely on external devices, resulting in inconvenient interaction.

[0123] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0124] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can, for example, be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0125] It should be understood that in this application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0126] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0127] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0128] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0129] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (English full name: Read-Only Memory, English abbreviation: ROM), random access memory (English full name: Random Access Memory, English abbreviation: RAM), disk or optical disk and other media that can store program code.

[0130] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A head-movement interaction method for a smart glasses terminal, characterized in that: include: S1. Obtain the current visual field center of the user wearing the smart glasses terminal; S2, displaying a field of view cursor corresponding to the current field of view center; S3, receiving information on a preset number of actions performed by the user by moving the field of view cursor toward the target icon by translating the head within a preset time; S4, performing a preset operation on the target icon according to a preset event corresponding to the action information of the preset number of times; The step S2 further includes: S5. When the field of view cursor is located in a preset sliding area of ​​the application window, receiving a first head movement cursor track generated by the user turning his head clockwise or counterclockwise; S6. When the first head-moving cursor track forms a closed figure, determining a sliding direction of the application window according to the direction in which the user turns his head; S7. After the first head movement cursor trajectory forms a closed figure, if it is detected that the user's head continues to move in the sliding direction, the application window is slid in the sliding direction until it is detected that the user's head moves in the opposite direction of the sliding direction, then the sliding of the application window is stopped, and the display of the first head movement cursor trajectory is stopped.

2. The head-motion interaction method of the smart glasses terminal according to claim 1, characterized in that: After step S4, the following steps are also included: S8, when the field of view cursor is located in the preset input area of ​​the input box, and within the preset time, the user drives the field of view cursor to the target icon by moving the head horizontally for a preset number of times, and the preset event corresponding to the action information is a selection event, a head-driven writing board is generated; S9, when the visual field cursor is located in the area corresponding to the head-activated writing board, receiving a second head-activated cursor track generated by the user moving his head; S10. When the visual field cursor leaves the area corresponding to the head-moving writing board, text recognition is performed according to the second head-moving cursor trajectory, and the text recognition result is input into the input box.

3. The head-motion interaction method of the smart glasses terminal according to claim 1, characterized in that: The step S2 further includes: S11, when the time for which the field of view cursor remains stationary and hovers over the application window or icon is greater than a first preset time threshold, selecting the application window or icon; S12, dragging the application window or icon to the target position according to the target position determined by the user moving his head; S13: when the time for which the field of view cursor remains stationary and hovers over the application window or icon is greater than a second preset time threshold, cancel the selection state of the application window or icon.

4. The head-movement interaction method of the smart glasses terminal according to claim 3, characterized in that: The step S11 or S13 further includes: When the field of view cursor is stationary and hovers over an application window or icon, a countdown prompt is displayed in a preset display area.

5. A head-motion interaction device for a smart glasses terminal, characterized in that: include: An acquisition unit, used to acquire the current visual field center of the user wearing the smart glasses terminal; A display unit, used for displaying a field of view cursor corresponding to the current field of view center; A first receiving unit is used to receive information about a preset number of actions performed by the user by moving the field of view cursor toward the target icon by translating the head within a preset time; A first processing unit, configured to perform a preset operation on the target icon according to a preset event corresponding to the action information of the preset number of times; Also includes: A second receiving unit is configured to receive a first head movement cursor track generated by the user turning his head clockwise or counterclockwise when the field of view cursor is located in a preset sliding area of ​​the application window; a second processing unit, configured to determine a sliding direction of the application window according to a direction in which the user turns his head when the first head-moving cursor track forms a closed figure; The third processing unit is used to slide the application window in the sliding direction if it is detected that the user's head continues to move in the sliding direction after the first head movement cursor trajectory forms a closed figure, until it is detected that the user's head moves in the opposite direction of the sliding direction, then stop sliding the application window and stop displaying the first head movement cursor trajectory.

6. The head-motion interaction device for a smart glasses terminal according to claim 5, characterized in that: Also includes: A fourth processing unit is configured to generate a head-driven writing board when the field of view cursor is located in a preset input area of ​​the input box and, within a preset time, the user drives the field of view cursor to move toward the target icon by moving the head horizontally for a preset number of times and when a preset event corresponding to the action information is a selection event; A third receiving unit is used to receive a second head-moving cursor track generated by the user moving the head when the field of view cursor is located in the area corresponding to the head-moving writing board; The fifth processing unit is used to perform text recognition according to the second head-movement cursor trajectory when the field of view cursor leaves the corresponding area of ​​the head-movement writing board, and input the text recognition result into the input box.

7. A head-motion interaction device for a smart glasses terminal, characterized in that: The device comprises a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is used to execute the head movement interaction method of the smart glasses terminal according to any one of claims 1-4 according to the instructions in the program code.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program code, and the program code is used to execute the head-motion interaction method of the smart glasses terminal according to any one of claims 1 to 4.

Images