Cursor calibration processing method and device, equipment and storage medium

By using a gyroscope sensor to detect acceleration data in the external remote control device of AR glasses and triggering the cursor calibration command, the problem of cursor drift in AR glasses is solved and the control convenience is improved.

CN119396310APending Publication Date: 2025-02-07BEIJING MULTISCREEN FUTURE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411293645.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-14
Publication Date
2025-02-07

AI Technical Summary

Technical Problem

The display terminal of AR glasses may not be able to fully display the virtual window within the display range, resulting in the cursor of the external remote control device being easily drifted, causing inconvenience to control when the user switches the virtual window by moving his head when wearing AR glasses.

Method used

The gyroscope sensor of the external remote control device of the smart glasses detects acceleration data in real time, and triggers a calibration command for the cursor when the preset threshold is reached, so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

Benefits of technology

It effectively solves the problem of cursor drift, improves the convenience of AR glasses, and ensures that the cursor is always in the alignment position of the user's line of sight and expected actions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119396310A_ABST
    Figure CN119396310A_ABST
Patent Text Reader

Abstract

The invention discloses a cursor calibration processing method, device and equipment and a storage medium, and the method comprises the steps: detecting acceleration data of external remote control equipment in real time based on a gyroscope sensor of the external remote control equipment of intelligent glasses; and when the acceleration data reaches a preset threshold value, triggering a cursor primary calibration instruction, so that a target cursor is displayed at a central point of a current picture of a display terminal of the intelligent glasses. By shaking the external remote control equipment, the acceleration data of the external remote control equipment is detected, the cursor is conveniently and quickly calibrated at one time, and the target cursor is displayed at the central point of the current picture of the display terminal of the intelligent glasses, so that the problem that the virtual window cannot be completely displayed in the displayable range of the display terminal of the AR glasses is solved. The technical problem that in the process of wearing AR glasses, a user can switch a virtual window by moving the head, and in the process, the phenomenon of cursor drift of external remote control equipment is likely to occur, and consequently control is inconvenient is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of smart glasses technology, and in particular to a cursor calibration processing method, device, equipment and storage medium. Background Art

[0002] Augmented Reality (AR) is a way of observing the world by adding virtualization technology to the user's sensory perception. In a direct sense, augmented reality can provide us with information that cannot be directly obtained in reality. In recent years, AR glasses have become a new product with an independent operating system like smartphones, and users can install software, games and other programs provided by software service providers.

[0003] AR glasses can be controlled through an external remote control device. However, since the virtual window may not be fully displayed within the display range of the display terminal of the AR glasses, the user will switch the virtual window by moving the head while wearing the AR glasses. During this process, the cursor of the external remote control device is prone to drift, resulting in technical problems of inconvenient control.

[0004] Therefore, it is urgent for those skilled in the art to provide a cursor calibration processing method to solve the above technical problems. Summary of the invention

[0005] The present application provides a cursor calibration processing method, device, equipment and storage medium, which solves the technical problem that since the virtual window may not be fully displayed within the display range of the display terminal of the AR glasses, the user switches the virtual window by moving the head while wearing the AR glasses. During this process, the cursor of the external remote control device is prone to drift, resulting in inconvenient operation.

[0006] In view of this, the first aspect of the present application provides a cursor calibration processing method, the method comprising:

[0007] Step S1, based on the gyroscope sensor of the external remote control device of the smart glasses, detecting the acceleration data of the external remote control device in real time;

[0008] Step S2: When the acceleration data reaches a preset threshold, a cursor calibration instruction is triggered so that a target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

[0009] Optionally, after step S2, the following steps are further included:

[0010] Step S3: When the acceleration data is not zero, the target cursor is synchronously and dynamically displayed according to the movement direction of the external remote control device and the acceleration data.

[0011] Optionally, after step S2, the following steps are further included:

[0012] Step S4: When the acceleration data is zero, trigger a cursor secondary calibration instruction so that the target direction of the external remote control device is consistent with the target cursor.

[0013] Optionally, it also includes:

[0014] Step S5, based on the gyroscope sensor of the external remote control device of the smart glasses, detecting the number of reciprocating movements and movement time of the external remote control device in real time;

[0015] Step S6: When the movement time reaches a preset time threshold and the number of reciprocating movements reaches a preset number threshold, a cursor calibration instruction is triggered so that a target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

[0016] Optionally, in step S4, making the target direction of the external remote control device consistent with the target cursor specifically comprises:

[0017] Determining a target orientation of the external remote control device according to a set of spatial dynamic coordinate data of the external remote control device collected between triggering the first cursor calibration instruction and the second cursor calibration instruction;

[0018] The target cursor is adjusted to a position corresponding to the target direction for display.

[0019] A second aspect of the present application provides a cursor calibration processing device, the device comprising:

[0020] A first detection unit, configured to detect acceleration data of an external remote control device of the smart glasses in real time based on a gyro sensor of the external remote control device;

[0021] The first calibration unit is used to trigger a cursor calibration instruction when the acceleration data reaches a preset threshold, so that the center point of the current screen of the display terminal of the smart glasses displays a target cursor.

[0022] Optionally, it also includes:

[0023] A second detection unit is used for detecting the number of reciprocating movements and movement time of the external remote control device in real time based on the gyro sensor of the external remote control device of the smart glasses;

[0024] The second calibration unit is used to trigger a cursor calibration instruction when the movement time reaches a preset time threshold and the number of reciprocating movements reaches a preset number threshold, so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

[0025] Optionally, it also includes:

[0026] The display unit is used to dynamically display the target cursor synchronously according to the movement direction of the external remote control device and the acceleration data when the acceleration data is not zero.

[0027] Optionally, it also includes:

[0028] The secondary calibration unit is used to trigger a cursor secondary calibration instruction when the acceleration data is zero, so that the target direction of the external remote control device is consistent with the target cursor.

[0029] Optionally, the secondary calibration unit is specifically used for:

[0030] Determining a target orientation of the external remote control device according to a set of spatial dynamic coordinate data of the external remote control device collected between triggering the first cursor calibration instruction and the second cursor calibration instruction;

[0031] The target cursor is adjusted to a position corresponding to the target direction for display.

[0032] A third aspect of the present application provides a cursor calibration processing device, the device comprising a processor and a memory:

[0033] The memory is used to store program code and transmit the program code to the processor;

[0034] The processor is used to execute the steps of the cursor calibration processing method as described in the first aspect according to the instructions in the program code.

[0035] A fourth aspect of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store program code, and the program code is used to execute the method described in the first aspect above.

[0036] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0037] In the present application, a cursor calibration processing method, device, equipment and storage medium are provided, including: based on the gyroscope sensor of the external remote control device of the smart glasses, the acceleration data of the external remote control device is detected in real time; when the acceleration data reaches a preset threshold, a cursor calibration instruction is triggered, so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses. By shaking the external remote control device, the acceleration data of the external remote control device is detected, and the cursor is calibrated once conveniently and quickly, and the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses, which solves the problem that the virtual window may not be fully displayed within the display range of the display terminal of the AR glasses. When the user is wearing the AR glasses, he will switch the virtual window by moving his head. In this process, the cursor of the external remote control device is prone to drift, resulting in inconvenient operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 A method flow chart of a cursor calibration processing method in an embodiment of the present application;

[0039] Figure 2 This is a schematic diagram of the structure of a cursor calibration processing device in an embodiment of the present application;

[0040] Figure 3 It is a structural schematic diagram of the cursor calibration processing device in an embodiment of the present application. DETAILED DESCRIPTION

[0041] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0042] The present application designs a cursor calibration processing method, device, equipment and storage medium, which solves the technical problem that the virtual window may not be fully displayed within the display range of the display terminal of the AR glasses, and the user switches the virtual window by moving the head while wearing the AR glasses. During this process, the cursor of the external remote control device is prone to drift, resulting in inconvenient operation.

[0043] For easier understanding, see Figure 1 , Figure 1 Flow chart of the cursor calibration processing method in the embodiment of the present application. Figure 1 As shown, specifically:

[0044] Step S1, based on the gyroscope sensor of the external remote control device of the smart glasses, detecting the acceleration data of the external remote control device in real time;

[0045] It should be noted that the smart glasses are connected to an external remote control device and use the built-in gyroscope sensor of the remote control device to continuously monitor and record the acceleration changes of the remote control device.

[0046] This process is continuous and is designed to capture any motion data generated by the user operating the remote control device.

[0047] For example:

[0048] Suppose a user wants to move the cursor through a remote control device while watching the content displayed by smart glasses. The user gently shakes the remote control device, and the gyroscope sensor detects this action and sends acceleration data to the smart glasses.

[0049] Step S2: When the acceleration data reaches a preset threshold, a cursor calibration instruction is triggered so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

[0050] It should be noted that when the detected acceleration data reaches or exceeds a preset threshold, the system will assume that the user wants to calibrate the cursor.

[0051] The system then triggers a calibration command and moves the cursor to the center point of the current screen on the smart glasses display terminal.

[0052] For example:

[0053] When the user wants to pause the video while watching it, he uses the remote control device to quickly shake up and down, and the acceleration data exceeds the preset threshold. The smart glasses receive this signal and position the cursor at the center of the video playback control button, preparing the user for the next operation.

[0054] Furthermore, after step S2, the following steps are further included:

[0055] Step S3: When the acceleration data is not zero, the target cursor is dynamically displayed synchronously according to the movement direction of the external remote control device and the acceleration data.

[0056] It should be noted that when the acceleration data is not zero, that is, when the user is still moving the remote control, the system adjusts the cursor position in real time according to the movement direction and acceleration data of the remote control.

[0057] Doing this ensures that the cursor's position aligns with the user's line of sight and intended action.

[0058] Furthermore, after step S2, the following steps are further included:

[0059] Step S4: When the acceleration data is zero, trigger the cursor secondary calibration instruction so that the target direction of the external remote control device is consistent with the target cursor.

[0060] It should be noted that when the acceleration data returns to zero, that is, when the user stops moving the remote controller, the system considers that the user may have completed the positioning of the cursor.

[0061] The system triggers a secondary calibration command to ensure that the target direction of the external remote control device is consistent with the target cursor.

[0062] For example:

[0063] When watching a video, the user selects the play button through the remote control. When the user stops moving the remote control, the system confirms that the cursor has been aligned with the play button, completing the secondary calibration.

[0064] Furthermore, in step S4, making the target direction of the external remote control device consistent with the target cursor is specifically as follows:

[0065] Determine the target orientation of the external remote control device according to the spatial dynamic coordinate data set of the external remote control device collected between triggering the cursor primary calibration instruction and the cursor secondary calibration instruction;

[0066] Adjust the target cursor to the position corresponding to the target direction for display.

[0067] It should be noted that between the first calibration and the second calibration, the system will collect the spatial dynamic coordinate data of the external remote control device.

[0068] By analyzing this data, the system determines the remote control's target direction.

[0069] The system adjusts the cursor to a position corresponding to the target direction of the remote control.

[0070] The purpose of secondary calibration is to more accurately align the cursor orientation with the external remote control device.

[0071] Furthermore, it also includes:

[0072] Step S5, based on the gyroscope sensor of the external remote control device of the smart glasses, real-time detection of the number of reciprocating movements and movement time of the external remote control device;

[0073] It should be noted that in an external remote control device, the gyroscope sensor can not only detect acceleration, but also monitor the overall movement pattern of the device, including reciprocating motion (i.e., the device moves back and forth between similar positions). The system records the number and duration of these reciprocating motions in real time through the gyroscope sensor.

[0074] For example:

[0075] Suppose a user uses a remote control device to browse the web on the virtual interface of smart glasses. The user may need to swipe up and down repeatedly to view different content. The gyroscope sensor records the number of swipes and the duration of each swipe. If the user swipes quickly and multiple times in a short period of time, this may indicate that the user is looking for specific information.

[0076] Step S6: When the movement time reaches a preset time threshold and the number of reciprocating movements reaches a preset number threshold, a cursor calibration instruction is triggered so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

[0077] It should be noted that when the number of reciprocating movements and the movement time of the user reach the system preset threshold, the system will think that the user needs more precise cursor control. At this time, the system will automatically trigger the cursor calibration command to position the cursor to the center point of the current display screen or the position where the user is most likely to focus.

[0078] For example:

[0079] Continuing with the web browsing example above, if the user quickly swipes up and down (back and forth) multiple times in a short period of time, and the total time exceeds a preset threshold, the system will automatically identify the exact location of the cursor where the user may have lost track. At this point, the system will automatically calibrate the cursor to the center of the screen, or where the user's line of sight is most likely to be focused, so that the user can easily continue their operation.

[0080] By analyzing the user's physical operation pattern, the system can predict the user's needs and automatically adjust the cursor position, thereby reducing the user's need for manual adjustment and improving overall interaction efficiency. This intelligent calibration mechanism is particularly suitable for fast and dynamic operation environments such as gaming, real-time video editing, or using smart glasses on the move.

[0081] See also Figure 2 , Figure 2 Schematic diagram of the structure of the cursor calibration processing device in the embodiment of the present application. Figure 2 As shown, specifically:

[0082] The detection unit 201 is used to detect the acceleration data of the external remote control device in real time based on the gyroscope sensor of the external remote control device of the smart glasses;

[0083] The primary calibration unit 202 is used to trigger a cursor primary calibration instruction when the acceleration data reaches a preset threshold, so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

[0084] Furthermore, it also includes:

[0085] The display unit is used to dynamically display the target cursor according to the movement direction of the external remote control device and the acceleration data when the acceleration data is not zero.

[0086] Furthermore, it also includes:

[0087] The secondary calibration unit is used to trigger the cursor secondary calibration instruction when the acceleration data is zero, so that the target direction of the external remote control device is consistent with the target cursor.

[0088] Furthermore, the secondary calibration unit is specifically used for:

[0089] Determine the target orientation of the external remote control device according to the spatial dynamic coordinate data set of the external remote control device collected between triggering the cursor primary calibration instruction and the cursor secondary calibration instruction;

[0090] Adjust the target cursor to the position corresponding to the target direction for display.

[0091] The present application also provides another cursor calibration processing device, such as Figure 3 For the sake of convenience, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiments of the present application. The terminal can be any terminal device including a mobile phone, a tablet computer, a personal digital assistant (English full name: Personal Digital Assistant, English abbreviation: PDA), a sales terminal (English full name: Point of Sales, English abbreviation: POS), a car computer, smart glasses, etc. Take the terminal as smart glasses as an example:

[0092] Figure 3 FIG. 1 is a block diagram showing a partial structure of smart glasses related to a terminal provided in an embodiment of the present application. Figure 3 The smart glasses include: a radio frequency (RF) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (WiFi) module 1070, a processor 1080, and a power supply 1090. Those skilled in the art will appreciate that Figure 3 The structure of the smart glasses shown in the figure does not constitute a limitation on the mobile phone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0093] Combine the following Figure 3 A detailed introduction to the various components of smart glasses:

[0094] The RF circuit 1010 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is sent to the processor 1080 for processing; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit 1010 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (full name: LowNoiseAmplifier, English abbreviation: LNA), a duplexer, etc. In addition, the RF circuit 1010 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to Global System of Mobile communications (Global System of Mobile communication, English abbreviation: GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, English abbreviation: CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (Long Term Evolution, English abbreviation: LTE), e-mail, Short Messaging Service (SMS), etc.

[0095] The memory 1020 can be used to store software programs and modules. The processor 1080 executes various functional applications and data processing of the smart glasses by running the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the smart glasses (such as audio data), etc. In addition, the memory 1020 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0096] The input unit 1030 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the smart glasses. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1031 or near the touch panel 1031 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 1031 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 1080, and can receive and execute the command sent by the processor 1080. In addition, the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1031, the input unit 1030 may further include other input devices 1032. Specifically, the other input devices 1032 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, a neck ring, etc.

[0097] The display unit 1040 can be used to display information input by the user or information provided to the user and various menus of the smart glasses. The display unit 1040 may include a display panel 1041. Optionally, the display panel 1041 may be configured in the form of a liquid crystal display (full name in English: Liquid Crystal Display, English abbreviation: LCD), an organic light-emitting diode (full name in English: Organic Light-Emitting Diode, English abbreviation: OLED), etc. Further, the touch panel 1031 may cover the display panel 1041. When the touch panel 1031 detects a touch operation on or near it, it is transmitted to the processor 1080 to determine the type of touch event. Subsequently, the processor 1080 provides a corresponding visual output on the display panel 1041 according to the type of touch event. Although in Figure 3 In the embodiment, the touch panel 1031 and the display panel 1041 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 1031 and the display panel 1041 can be integrated to realize the input and output functions of the smart glasses.

[0098] The smart glasses may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may automatically wake up the display panel 1041 when the smart glasses are worn. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used to identify the application of the posture of smart glasses (such as looking up, lowering, turning the head), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured in smart glasses, they will not be repeated here.

[0099] The audio circuit 1060, the speaker 1061, and the microphone 1062 can provide an audio interface between the user and the smart glasses. The audio circuit 1060 can transmit the received audio data to the speaker 1061 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1060 and converted into audio data, and then the audio data is output to the processor 1080 for processing, and then sent to, for example, another pair of smart glasses through the RF circuit 1010, or the audio data is output to the memory 1020 for further processing.

[0100] WiFi is a short-range wireless transmission technology. Smart glasses can help users send and receive emails, browse web pages, and access streaming media through WiFi module 1070. It provides users with wireless broadband Internet access. Figure 3 A WiFi module 1070 is shown, but it is understandable that it is not an essential component of the smart glasses and can be omitted as needed without changing the essence of the invention.

[0101] The processor 1080 is the control center of the smart glasses. It uses various interfaces and lines to connect the various parts of the entire smart glasses. By running or executing the software programs and / or modules stored in the memory 1020, and calling the data stored in the memory 1020, it performs various functions of the smart glasses and processes data, thereby monitoring the smart glasses as a whole. Optionally, the processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1080.

[0102] The smart glasses also include a power source 1090 (such as a battery) for supplying power to each component. Preferably, the power source can be logically connected to the processor 1080 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption management.

[0103] Although not shown, the smart glasses may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0104] In the embodiment of the present application, the processor 1080 included in the terminal also has the following functions:

[0105] Step S1, based on the gyroscope sensor of the external remote control device of the smart glasses, detecting the acceleration data of the external remote control device in real time;

[0106] Step S2: When the acceleration data reaches a preset threshold, a cursor calibration instruction is triggered so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

[0107] Furthermore, after step S2, the following steps are further included:

[0108] Step S3: When the acceleration data is not zero, the target cursor is dynamically displayed synchronously according to the movement direction of the external remote control device and the acceleration data.

[0109] Furthermore, after step S2, the following steps are further included:

[0110] Step S4: When the acceleration data is zero, trigger the cursor secondary calibration instruction so that the target direction of the external remote control device is consistent with the target cursor.

[0111] Furthermore, in step S4, making the target direction of the external remote control device consistent with the target cursor is specifically as follows:

[0112] Determine the target orientation of the external remote control device according to the spatial dynamic coordinate data set of the external remote control device collected between triggering the cursor primary calibration instruction and the cursor secondary calibration instruction;

[0113] Adjust the target cursor to the position corresponding to the target direction for display.

[0114] The embodiment of the present application further provides a computer-readable storage medium for storing program code, wherein the program code is used to execute any one of the implementation methods of a cursor calibration processing method described in the aforementioned embodiments.

[0115] In the embodiment of the present application, a cursor calibration processing method, device, equipment and storage medium are provided, including: based on the gyroscope sensor of the external remote control device of the smart glasses, the acceleration data of the external remote control device is detected in real time; when the acceleration data reaches a preset threshold, a cursor calibration instruction is triggered, so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses. By shaking the external remote control device, the acceleration data of the external remote control device is detected, and the cursor is calibrated once conveniently and quickly, and the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses, which solves the problem that the virtual window may not be fully displayed within the display range of the display terminal of the AR glasses. When the user is wearing the AR glasses, he will switch the virtual window by moving his head. In this process, the cursor of the external remote control device is prone to drift, resulting in inconvenient operation.

[0116] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0117] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0118] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0119] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0120] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0121] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0122] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (full name in English: Read-Only Memory, English abbreviation: ROM), random access memory (full name in English: Random Access Memory, English abbreviation: RAM), disk or optical disk and other media that can store program codes.

[0123] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A cursor calibration processing method, characterized in that: include: Step S1, based on the gyroscope sensor of the external remote control device of the smart glasses, detecting the acceleration data of the external remote control device in real time; Step S2: When the acceleration data reaches a preset threshold, a cursor calibration instruction is triggered so that a target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

2. The cursor calibration processing method according to claim 1, characterized in that: After step S2, the following steps are also included: Step S3: When the acceleration data is not zero, the target cursor is synchronously and dynamically displayed according to the movement direction of the external remote control device and the acceleration data.

3. The cursor calibration processing method according to claim 2, characterized in that: The step S2 further includes: Step S4: When the acceleration data is zero, trigger a cursor secondary calibration instruction so that the target direction of the external remote control device is consistent with the target cursor.

4. The cursor calibration processing method according to claim 3, characterized in that: The step S4 of making the target direction of the external remote control device consistent with the target cursor is specifically as follows: Determining a target orientation of the external remote control device according to a set of spatial dynamic coordinate data of the external remote control device collected between triggering the first cursor calibration instruction and the second cursor calibration instruction; The target cursor is adjusted to a position corresponding to the target direction for display.

5. The cursor calibration processing method according to claim 1, characterized in that: Also includes: Step S5, based on the gyroscope sensor of the external remote control device of the smart glasses, detecting the number of reciprocating movements and movement time of the external remote control device in real time; Step S6: When the movement time reaches a preset time threshold and the number of reciprocating movements reaches a preset number threshold, a cursor calibration instruction is triggered so that a target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

6. A cursor calibration processing device, characterized in that: include: A first detection unit, configured to detect acceleration data of an external remote control device of the smart glasses in real time based on a gyro sensor of the external remote control device; The first calibration unit is used to trigger a cursor calibration instruction when the acceleration data reaches a preset threshold, so that the center point of the current screen of the display terminal of the smart glasses displays a target cursor.

7. The cursor calibration processing device according to claim 6, characterized in that: Also includes: A second detection unit is used for detecting the number of reciprocating movements and movement time of the external remote control device in real time based on the gyro sensor of the external remote control device of the smart glasses; The second calibration unit is used to trigger a cursor calibration instruction when the movement time reaches a preset time threshold and the number of reciprocating movements reaches a preset number threshold, so that the target cursor is displayed at the center point of the current screen of the display terminal of the smart glasses.

8. The cursor calibration processing device according to claim 6, characterized in that: Also includes: The display unit is used to dynamically display the target cursor synchronously according to the movement direction of the external remote control device and the acceleration data when the acceleration data is not zero.

9. A cursor calibration processing device, characterized in that: The device comprises a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is used to execute the cursor calibration processing method according to any one of claims 1 to 6 according to the instructions in the program code.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program codes, and the program codes are used to execute the cursor calibration processing method according to any one of claims 1 to 6.