Method and system for automatically adjusting display picture of intelligent AR (Augmented Reality) glasses

Abstract

The invention provides a display picture automatic adjustment method, system and device for intelligent AR glasses and a storage medium, the method comprises the following steps: assembling a body movement sensor on each of a left glasses leg and a right glasses leg of the intelligent AR glasses, and when a user wears the intelligent AR glasses, automatically recording an initial pressure value of an initial wearing position by the body movement sensors; when a user adjusts the wearing position of the intelligent AR glasses, the body movement sensor collects the pressure variation of the current wearing position relative to the initial wearing position; and the collected pressure variation is transmitted to the CPU calculation unit, and the CPU calculation unit compares and calculates the pressure variation according to a preset algorithm to determine the direction needing to be adjusted and the adjustment amplitude of the display picture. The wearing position of the glasses is monitored in real time through the body motion sensor, the display picture is automatically adjusted according to the position change, it is ensured that the display picture is always kept in the sight line center of a user, and the wearing comfort and stability are improved.

Description

Technical Field

[0001] The present application relates to the technical field of AR glasses display adjustment, and in particular to a method and system for automatically adjusting the display screen of smart AR glasses. Background Art

[0002] With the rapid development of augmented reality (AR) technology, AR glasses, as an important bridge connecting the virtual and real worlds, have become one of the key factors in determining market acceptance, with regard to user experience. Traditional AR glasses are often designed to optimize technical parameters, such as resolution, field of view, brightness, etc., but there are still many challenges in terms of ergonomic adaptability. In particular, the stability of glasses not only affects the user's visual experience, but may also interrupt the sense of immersion due to frequent adjustments to the position of the glasses, reducing the overall convenience and comfort of use.

[0003] Each person's head shape, facial features, and even hairstyle will affect the fit and stability of AR glasses. Traditional AR glasses designs lack flexible adjustment mechanisms for individual differences, causing some users to feel uncomfortable or their glasses to slip after wearing them for a long time. In order to solve the problem of unstable wearing, users often need to constantly adjust the position of the glasses manually, which not only interrupts the use process, but may also cause damage to the glasses or further reduce wearing comfort due to improper operation. Moreover, a slight change in the position of the glasses can cause the display to deviate from the user's line of sight, affecting the viewing experience. This deviation is particularly obvious in dynamic environments, such as walking or exercising.

[0004] In view of this, the present invention proposes a method, system, device and storage medium for automatically adjusting the display image of smart AR glasses, which can monitor the wearing position of the glasses in real time and automatically adjust the display image according to the position change. Summary of the invention

[0005] In order to solve the problem that existing AR glasses require users to constantly manually adjust the position of glasses, etc., the present invention provides a method, system, device and storage medium for automatically adjusting the display screen of smart AR glasses to solve the above-mentioned technical defects.

[0006] According to the first aspect of the present application, a method for automatically adjusting a display image of smart AR glasses is proposed, the method comprising the following steps:

[0007] S1. A body motion sensor is installed on each of the left and right temples of the smart AR glasses. When the user wears the smart AR glasses, the body motion sensor automatically records the initial pressure value of the initial wearing position;

[0008] S2. When the user adjusts the wearing position of the smart AR glasses, the body motion sensor collects the pressure change of the current wearing position relative to the initial wearing position;

[0009] S3. The collected pressure variation is transmitted to the CPU calculation unit. The CPU calculation unit compares and calculates the pressure variation according to a preset algorithm to determine the direction and magnitude of adjustment required for the display screen.

[0010] Preferably, in step S3, the CPU calculation unit compares and calculates the pressure change according to a preset algorithm, specifically including:

[0011] If the pressure change is positive, the CPU calculation unit instructs the display screen to adjust upward / forward / leftward, where the adjustment amplitude is proportional to the pressure change;

[0012] If the pressure change is a negative value, the CPU calculation unit instructs the display screen to adjust downward / backward / rightward, wherein the magnitude of the adjustment is proportional to the pressure change.

[0013] Preferably, step S2 also includes: a body motion sensor recording the pressure value after the user adjusts the wearing position of the smart AR glasses, subtracting the initial pressure value from the adjusted pressure value to obtain the pressure change.

[0014] Preferably, the method for automatically adjusting the display image of smart AR glasses provided by the present invention further includes:

[0015] The body motion sensor collects the user's motion status information, which exists in the form of analog signals and includes acceleration, angular velocity and direction data;

[0016] After amplifying the collected analog signal, the noise and interference in the signal are removed through a filter, and then the processed analog signal is converted into a digital signal using an analog-to-digital converter;

[0017] Extracting characteristic information from the converted digital signal, including but not limited to the peak value, mean value and variance of the acceleration;

[0018] The Kalman filter algorithm is used to further process the characteristic information and output the final pressure value.

[0019] Preferably, in step S1, a weighted average calculation is performed on the pressure value collected by the body motion sensor installed at the left temple of the smart AR glasses and the pressure value collected by the body motion sensor installed at the right temple to obtain an initial pressure value.

[0020] Preferably, the method for automatically adjusting the display image of smart AR glasses provided by the present invention further includes:

[0021] The pressure change detected by the body motion sensor is mapped to a three-dimensional coordinate system, where the origin of the three-dimensional coordinate system is the initial state when the user wears the smart AR glasses, and the pressure change in the left and right directions detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the X-axis;

[0022] The pressure changes in the up and down directions detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the Y axis;

[0023] The pressure changes in the front-to-back direction detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the Z axis.

[0024] Preferably, the method for automatically adjusting the display screen of smart AR glasses provided by the present invention also includes: when it is detected that the user maintains the same wearing posture for a long time, reminding the user to adjust the posture through voice prompts or slight vibrations.

[0025] In a second aspect, the present invention provides a display screen automatic adjustment system for smart AR glasses, the system comprising:

[0026] The initial pressure value acquisition module is configured to equip the left and right temples of the smart AR glasses with a body motion sensor. When the user wears the smart AR glasses, the body motion sensor automatically records the initial pressure value of the initial wearing position;

[0027] The pressure variation collection module is configured so that when the user adjusts the wearing position of the smart AR glasses, the body motion sensor collects the pressure variation of the current wearing position relative to the initial wearing position;

[0028] The display screen adjustment module is configured to transmit the collected pressure change amount to the CPU calculation unit. The CPU calculation unit compares and calculates the pressure change amount according to a preset algorithm to determine the direction and amplitude of the display screen adjustment.

[0029] In a third aspect, the present invention provides a terminal device, comprising a processor, a memory, and a computer program stored in the memory, wherein the computer program is executed by the processor to implement a method for automatically adjusting a display screen for smart AR glasses as described in any one of the above.

[0030] In a fourth aspect, the present invention provides a computer-readable storage medium, wherein a computer program is stored in the medium. When the computer program is executed by a processor, a method for automatically adjusting a display screen for smart AR glasses as described in any one of the above is implemented.

[0031] Compared with the prior art, the beneficial results of the present invention are:

[0032] (1) Improve wearing comfort and stability: The body motion sensor monitors the wearing position of the glasses in real time and automatically adjusts the display screen according to the position change, ensuring that the display screen always remains in the center of the user's field of vision. This reduces the user's trouble of frequently adjusting the position of the glasses due to sliding or shifting of the glasses, and improves wearing comfort and stability.

[0033] (2) Intelligent and personalized experience: The present invention can intelligently adjust the display screen according to the user's wearing habits and movement status, providing a personalized user experience. For example, when the user slightly adjusts the position of the glasses, the display screen will immediately respond and adjust to the best viewing angle.

[0034] (3) Improve the accuracy of the display image: By further processing the feature information using the Kalman filter algorithm, a more accurate pressure value is output, thereby improving the accuracy and stability of the display image adjustment.

[0035] (4) Health reminder function: When the system detects that the user maintains the same wearing posture for a long time, it will remind the user to adjust the posture through voice prompts or slight vibrations, which helps prevent neck or eye fatigue caused by long-term wearing. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0037] Figure 1 is a flow chart of a method for automatically adjusting a display screen of smart AR glasses according to the present application;

[0038] Figure 2 is a structural diagram of a display screen automatic adjustment system for smart AR glasses according to the present application;

[0039] Figure 3 It is a structural diagram of a computer system suitable for implementing an electronic device of an embodiment of the present application. DETAILED DESCRIPTION

[0040] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It should also be noted that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0041] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0042] Figure 1 A flow chart of a method for automatically adjusting the display screen of smart AR glasses of the present application is shown, as shown in FIG. Figure 1 As shown, the method comprises the following steps:

[0043] S1. A body motion sensor is installed on each of the left and right temples of the smart AR glasses. When the user wears the smart AR glasses, the body motion sensor automatically records the initial pressure value of the initial wearing position.

[0044] In this embodiment, the initial pressure value can be obtained by performing weighted average calculation on the pressure value collected by the body motion sensor installed at the left temple of the smart AR glasses and the pressure value collected by the body motion sensor installed at the right temple.

[0045] The calculation formula of the sensor detection pressure is:

[0046] Body motion sensor output voltage V T =(maximum range of body motion sensor / number of subdivisions of body motion sensor)*excitation voltage V n -V 0 / Body motion sensor sensitivity, n = 1, 2, 3, ...

[0047] S2. When the user adjusts the wearing position of the smart AR glasses, the body motion sensor collects the pressure change of the current wearing position relative to the initial wearing position. The user adjusts the wearing position including: up and down, front and back, left and right.

[0048] In this embodiment, the pressure value after the user adjusts the wearing position of the smart AR glasses is recorded by a body motion sensor, and the initial pressure value is subtracted from the adjusted pressure value to obtain the pressure change.

[0049] S3. The collected pressure variation is transmitted to the CPU calculation unit. The CPU calculation unit compares and calculates the pressure variation according to a preset algorithm to determine the direction and magnitude of adjustment required for the display screen.

[0050] In this embodiment, the CPU calculation unit compares and calculates the pressure change according to a preset algorithm, specifically:

[0051] If the pressure change is positive, the CPU calculation unit instructs the display screen to adjust upward / forward / leftward, where the adjustment amplitude is proportional to the pressure change;

[0052] If the pressure change is a negative value, the CPU calculation unit instructs the display screen to adjust downward / backward / rightward, wherein the magnitude of the adjustment is proportional to the pressure change.

[0053] Set the initial wearing pressure value as V T1, the pressure value after adjusting the position is set to V T2 , subtracting the two values ​​gives the pressure change. For example, the pressure value V after adjusting in the up and down directions T2 Than the initial pressure value V before adjustment T1 When the pressure is greater than 200mV, the display screen is adjusted upward by 20mm. The pressure value V after adjustment in the up and down direction T2 Than the initial pressure value V before adjustment T1 When the pressure is greater than 2000mV, the display screen is adjusted upward by 200mm. The pressure value V after adjustment in the up and down direction T2 Than the pressure value before adjustment V T1 When the pressure is greater than 100mV, the display screen is adjusted upward by 10mm. The maximum range of the body motion sensor is 2000mV, which means it can be adjusted up to 200mm. The pressure value V after adjustment in the up and down direction T2 Than the initial pressure value V before adjustment T1 When the voltage is less than 200mV, the display screen is adjusted downward by 20mm. Similarly, the principle of adjusting the display screen downward / leftward / rightward / forward / backward is similar.

[0054] Preferably, the method for automatically adjusting the display image of smart AR glasses provided by the present invention further includes:

[0055] The body motion sensor collects the user's motion status information, which exists in the form of analog signals and includes acceleration, angular velocity and direction data;

[0056] After amplifying the collected analog signal, the noise and interference in the signal are removed through a filter, and then the processed analog signal is converted into a digital signal using an analog-to-digital converter;

[0057] Extracting characteristic information from the converted digital signal, including but not limited to the peak value, mean value and variance of the acceleration;

[0058] The Kalman filter algorithm is used to further process the characteristic information and output the final pressure value.

[0059] In a specific embodiment, the pressure change detected by the body motion sensor can be mapped to a three-dimensional coordinate system, where the origin of the three-dimensional coordinate system is the initial state when the user wears the smart AR glasses, wherein the pressure change in the left and right directions detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the X-axis;

[0060] The pressure changes in the up and down directions detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the Y axis;

[0061] The pressure changes in the front-to-back direction detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the Z axis.

[0062] In a specific embodiment, when it is detected that the user maintains the same wearing posture for a long time, the user is reminded to adjust the posture through voice prompts or slight vibrations.

[0063] Further references Figure 2 As an implementation of the above method, in the second aspect, the present application provides an embodiment of a structural diagram of a display screen automatic adjustment system 200 for smart AR glasses, which can be specifically applied to various electronic devices. The system 200 includes the following modules:

[0064] The initial pressure value acquisition module 210 is configured to equip the left and right temples of the smart AR glasses with a body motion sensor, and when the user wears the smart AR glasses, the body motion sensor automatically records the initial pressure value of the initial wearing position;

[0065] The pressure variation collection module 220 is configured to collect the pressure variation of the current wearing position relative to the initial wearing position by the body motion sensor when the user adjusts the wearing position of the smart AR glasses;

[0066] The display image adjustment module 230 is configured to transmit the collected pressure variation to the CPU computing unit. The CPU computing unit compares and calculates the pressure variation according to a preset algorithm to determine the direction and magnitude of adjustment of the display image.

[0067] In a third aspect, the present invention provides a terminal device, comprising a processor, a memory, and a computer program stored in the memory, wherein the computer program is executed by the processor to implement a method for automatically adjusting a display screen for smart AR glasses as described in any one of the above.

[0068] In a fourth aspect, the present invention provides a computer-readable storage medium, wherein a computer program is stored in the medium. When the computer program is executed by a processor, a method for automatically adjusting a display screen for smart AR glasses as described in any one of the above is implemented.

[0069] Reference below Figure 3 , which shows a schematic diagram of the structure of a computer system 300 of a terminal device or server suitable for implementing an embodiment of the present application. Figure 3 The terminal device or server shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0070] like Figure 3As shown, the computer system 300 includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage part 308 into a random access memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the computer system 300 are also stored. The CPU 301, the ROM 302, and the RAM 303 are connected to each other through a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.

[0071] The following components are connected to the I / O interface 305: an input section 306 including a keyboard, a mouse, etc.; an output section 307 including a liquid crystal display (LCD), etc. and a speaker, etc.; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed, so that a computer program read therefrom is installed into the storage section 308 as needed.

[0072] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 309, and / or installed from the removable medium 311. When the computer program is executed by the central processing unit (CPU) 301, the above functions defined in the method of the present application are executed. It should be noted that the computer-readable medium described in the present application can be a computer-readable signal medium or a computer-readable medium or any combination of the above two. The computer-readable medium can be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable media may include, but are not limited to, an electrical connection with one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, an apparatus or a device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, an apparatus or a device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0073] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as C or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0074] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0075] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.

Claims

1. A method for automatically adjusting the display image of smart AR glasses, characterized in that: The method comprises the following steps: S1. A body motion sensor is installed on each of the left and right temples of the smart AR glasses. When the user wears the smart AR glasses, the body motion sensor automatically records the initial pressure value of the initial wearing position; S2. When the user adjusts the wearing position of the smart AR glasses, the body motion sensor collects the pressure change of the current wearing position relative to the initial wearing position; S3. The collected pressure variation is transmitted to a CPU calculation unit. The CPU calculation unit compares and calculates the pressure variation according to a preset algorithm to determine the direction and magnitude of adjustment required for the display screen.

2. The method for automatically adjusting the display image of smart AR glasses according to claim 1, characterized in that: In step S3, the CPU calculation unit compares and calculates the pressure change according to a preset algorithm, specifically including: If the pressure change is a positive value, the CPU calculation unit instructs the display screen to adjust upward / forward / leftward, wherein the adjustment amplitude is proportional to the pressure change; If the pressure change is a negative value, the CPU calculation unit instructs the display screen to adjust downward / backward / rightward, wherein the magnitude of the adjustment is proportional to the pressure change.

3. The method for automatically adjusting the display image of smart AR glasses according to claim 1, characterized in that: In step S2, it also includes: the body motion sensor records the pressure value after the user adjusts the wearing position of the smart AR glasses, subtracts the initial pressure value from the adjusted pressure value, and obtains the pressure change.

4. The method for automatically adjusting the display image of smart AR glasses according to claim 1, characterized in that: Also includes: The body motion sensor collects user motion state information, which exists in the form of analog signals and includes acceleration, angular velocity and direction data; After amplifying the collected analog signal, removing noise and interference in the signal through a filter, and then converting the processed analog signal into a digital signal using an analog-to-digital converter; Extracting characteristic information from the converted digital signal, including but not limited to the peak value, mean value and variance of the acceleration; The characteristic information is further processed using a Kalman filter algorithm to output a final pressure value.

5. The method for automatically adjusting the display image of smart AR glasses according to claim 1, characterized in that: In step S1, a weighted average calculation is performed on the pressure value collected by the body motion sensor installed at the left temple of the smart AR glasses and the pressure value collected by the body motion sensor installed at the right temple to obtain an initial pressure value.

6. The method for automatically adjusting the display image of smart AR glasses according to claim 1, characterized in that: Also includes: The pressure change detected by the body motion sensor is mapped to a three-dimensional coordinate system, wherein the three-dimensional coordinate system takes the initial state when the user wears the smart AR glasses as the origin, wherein the pressure change in the left and right directions detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the X-axis; The pressure changes in the up and down directions detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the Y axis; The pressure changes in the front-to-back direction detected by the body motion sensor at the left temple and the body motion sensor at the right temple are weighted averaged and mapped to the Z axis.

7. The method for automatically adjusting the display image of smart AR glasses according to claim 1, characterized in that: Also includes: When it is detected that the user maintains the same wearing posture for a long time, the user will be reminded to adjust the posture through voice prompts or slight vibrations.

8. A display screen automatic adjustment system for smart AR glasses, characterized in that: The system comprises: The initial pressure value acquisition module is configured to equip the left and right temples of the smart AR glasses with a body motion sensor, and when the user wears the smart AR glasses, the body motion sensor automatically records the initial pressure value of the initial wearing position; A pressure variation acquisition module, configured so that when the user adjusts the wearing position of the smart AR glasses, the body motion sensor acquires the pressure variation of the current wearing position relative to the initial wearing position; The display picture adjustment module is configured to transmit the collected pressure change amount to the CPU calculation unit, and the CPU calculation unit compares and calculates the pressure change amount according to a preset algorithm to determine the direction and amplitude of the display picture adjustment.

9. A terminal device, characterized in that: It includes a processor, a memory, and a computer program stored in the memory, wherein the computer program is executed by the processor to implement the method for automatically adjusting the display screen for smart AR glasses as described in any one of claims 1 to 7.

10. A computer-readable storage medium, wherein a computer program is stored in the medium, and when the computer program is executed by a processor, the method for automatically adjusting the display screen for smart AR glasses as described in any one of claims 1 to 7 is implemented.

Images