Eyeball tracking method for naked-eye 3D display

By detecting and analyzing the vibrations of the user's eyeballs and the device, and combining the budget processing and adjustment management of naked-eye 3D display technology, the problem of naked-eye 3D display being unable to adjust quickly in bumpy environments has been solved, improving the accuracy and stability of the display and enhancing the user experience.

CN115981456BActive Publication Date: 2026-01-09RENMIN BAIYE TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202211380882.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-05
Publication Date
2026-01-09
Estimated Expiration
2042-11-05

AI Technical Summary

Technical Problem

Existing glasses-free 3D display technology cannot quickly adjust the visual 3D image when users are riding in a car on a bumpy road, resulting in a reduced user experience.

Method used

By tracking the user's eyeballs and detecting the amplitude of computer device vibrations, the display screen area is divided, naked-eye 3D technology budget analysis is performed, and the budget analysis results are adjusted and managed. This includes the use of the detection and tracking module, budget analysis module, and execution management module.

Benefits of technology

It improves the accuracy and stability of naked-eye 3D display analysis and processing, maintains user satisfaction, avoids display errors caused by changes in road conditions, and ensures the continuity of naked-eye 3D display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115981456B_ABST
    Figure CN115981456B_ABST
Patent Text Reader

Abstract

The application discloses a naked eye 3D display eyeball tracking method, which comprises tracking the user's eyeball, detecting the computer device oscillation amplitude, performing naked eye 3D technology budget analysis and processing, and performing adjustment management on the budget analysis result. The tracking of the user's eyeball and the detection of the computer device oscillation amplitude comprise real-time tracking and positioning of the user's eyeball through a front camera of a display screen, and detecting and recording the real-time distance between the user's eyeball and the screen. The oscillation amplitude of the computer device is detected, and the average oscillation amplitude of the computer device is periodically calculated and analyzed according to a specified time period. The naked eye 3D technology budget analysis and processing comprise dividing the display screen of the computer device into three vertical strip display areas with equal areas, and pre-setting the arrangement result of the number of view points in each area when the computer device is in the original direction opposite direction information. The application has the characteristics of intelligent analysis and adjustment.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of naked eye 3D display, in particular to a naked eye 3D display eyeball tracking method. BACKGROUND

[0002] Vision is the main way for humans to obtain information about the external environment, and 3D images can display more three-dimensional scene detail information, which can meet people's growing demand for immersive viewing. Naked eye 3D technology has excellent stereo viewing experience, and is one of the important development directions in the display technology field.

[0003] Although the existing naked eye 3D technology can adjust the visual 3D image according to the movement of the user's eye position, so that the user does not have to be limited to the front of the screen. But in some special cases, such as when the user is in a car driving on a bumpy road, the angle of the user facing the screen will change rapidly due to the bumpy road, causing the visual 3D image adjustment to be unable to follow the user for rapid adjustment, resulting in a great impact on the user's experience of naked eye 3D technology, reducing the user's satisfaction. Therefore, it is necessary to design an intelligent analysis and adjustment naked eye 3D display eyeball tracking method. SUMMARY

[0004] The purpose of the present application is to provide a naked eye 3D display eyeball tracking method to solve the problems raised in the background art.

[0005] In order to solve the above technical problems, the present application provides the following technical scheme: a naked eye 3D display eyeball tracking method, comprising:

[0006] Tracking and detecting the oscillation amplitude of the computer device;

[0007] Performing naked eye 3D technology budget analysis and processing;

[0008] Adjusting and managing the budget analysis results.

[0009] According to the above technical scheme, the tracking and detection of the user's eyeball and the detection of the oscillation amplitude of the computer device include:

[0010] The front camera of the display screen is used to track and locate the user's eyeball in real time, and the real-time distance between the user's eyeball and the screen is detected and recorded;

[0011] The oscillation amplitude of the computer device is detected, and the average oscillation amplitude of the computer device is periodically calculated and analyzed according to the specified time.

[0012] According to the above technical scheme, the naked eye 3D technology budget analysis and processing includes:

[0013] The display screen of the computer device is divided into three vertical display areas with equal area;

[0014] The number of viewpoints in each area is arranged according to the direction information of the computer device in the opposite direction of the original direction;

[0015] Further, the pixel values in each area of the screen and the screen parameters of the computer device are preprocessed according to the screen parameters of the computer device and the distance data between the user's eyeballs and the screen of the computer device, and the preprocessing results are stored;

[0016] In a specified time period, the above-mentioned estimation of the arrangement of the number of viewpoints, the preprocessing of the pixel values and the screen parameters of the computer device, the budget processing of the naked eye 3D display in each direction relative to the original direction of the computer device, and the storage of the budget results are repeated.

[0017] According to the above technical solution, the execution adjustment management of the budget analysis results includes;

[0018] When the computer device is in the corresponding direction, the analysis and adjustment results of the direction are called, and the pixel values in each area of the screen of the computer device and the screen parameters of the computer device are adjusted according to the results;

[0019] During the analysis and adjustment process of the naked eye 3D display, the module that completes the analysis processing is in an awakened state.

[0020] According to the above technical solution, the eye tracking method for naked eye 3D display is applied to an eye tracking system for naked eye 3D display, which includes:

[0021] The detection tracking module is used to track the user's eyeballs and detect the oscillation frequency of the computer device;

[0022] The budget analysis module is used to perform budget analysis and processing of the naked eye 3D technology;

[0023] The execution management module is used to perform adjustment management of the budget analysis results.

[0024] According to the above technical solution, the detection tracking module includes:

[0025] The positioning tracking unit is used to track and position the user's eyeballs;

[0026] The oscillation detection module is used to detect the oscillation amplitude of the computer device;

[0027] The distance management module is used to manage, detect and analyze the distance between the user's eyeballs and the screen of the computer.

[0028] According to the above technical solution, the budget analysis module includes:

[0029] The view point arrangement estimation module is configured to estimate the view point arrangement result.

[0030] The region division module is configured to perform region division processing.

[0031] The pixel point budget adjustment module is configured to perform budget adjustment on the pixel points.

[0032] The direction sensing module is configured to perform direction sensing analysis.

[0033] According to the above technical solution, the execution management module comprises:

[0034] The adjustment execution module is configured to perform adjustment execution on the analysis adjustment result.

[0035] The storage recording module is configured to perform storage recording on the analysis data information.

[0036] The state management module is configured to manage the state of the function modules.

[0037] Compared with the prior art, the present application has the following beneficial effects: the present application, by being provided with the detection tracking module, the budget analysis module and the execution management module, can calculate and update the average oscillation amplitude data of the computer device, avoid the delay in updating the average oscillation amplitude data due to the continuous change of the road conditions, and thus avoid errors in the naked-eye 3D display analysis processing, effectively improve the accuracy of the naked-eye 3D display analysis processing, and greatly improve the user's satisfaction; and can immediately perform rapid analysis and adjustment after the generated jolt changes, and maintain the display continuity and stability of the naked-eye 3D. BRIEF DESCRIPTION OF DRAWINGS

[0038] The accompanying drawings are included to provide a further understanding of the present application, and constitute a part of the specification, illustrate the present application, and are used to explain the present application, and do not constitute a limitation on the present application. In the drawings:

[0039] Figure 1 is a flowchart of the naked-eye 3D display eye tracking method provided by the first embodiment of the present application;

[0040] Figure 2 is a module composition schematic diagram of the naked-eye 3D display eye tracking system provided by the second embodiment of the present application. DETAILED DESCRIPTION

[0041] With reference to the accompanying drawings, the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments of the present application, all the other embodiments obtained by a person of ordinary skill in the art without creative effort belong to the scope of the present application.

[0042] Embodiment one:

[0043] Figure 1 A flow chart of an eyeball tracking method for naked-eye 3D display provided in the embodiment one of the present application, which can be executed by an eyeball tracking system for naked-eye 3D display provided in the embodiment of the present application. The system is composed of a plurality of software and hardware modules, and is usually used in a computer, as shown in the figure. The method specifically comprises the following steps: Figure 1

[0044] S101, tracking the eyeball of a user and detecting the amplitude of shaking of a computer device

[0045] In some embodiments of the present application, a front camera capable of eyeball positioning and tracking can be installed on a display screen, and the naked-eye 3D display requirement is met through the positioning and tracking of the eyeball.

[0046] For example, in the embodiment of the present application, after the user starts the eyeball tracking system for naked-eye 3D display of the computer device in hand due to road bumps, the front camera of the display screen tracks and positions the eyeball of the user in real time, and the real-time distance between the eyeball of the user and the screen is detected and recorded. When the user uses the computer device, the naked-eye 3D display of the computer device is affected due to road bumps. The user manually starts the eyeball tracking system for naked-eye 3D display, and the naked-eye 3D display requirement of the user using the computer device is ensured through the analysis and processing of the system. At the same time, the system is started more in line with the user's requirement through the manual starting of the user, and the additional consumption of the power of the computer device and the computer analysis and operation resources caused by the automatic starting of the system due to the small bumps and shaking is avoided, the user's satisfaction is effectively improved, and the distance between the eyeball of the user and the screen of the computer device is detected in real time, so that the subsequent 3D analysis and processing are more in line with the naked-eye 3D display requirement of the user.

[0047] ​The amplitude of the shock of the computer device is detected, and the average amplitude of the shock of the computer device is calculated according to a specified time period; since the amplitude of the shock of the computer device caused by road bumps is irregular, the average amplitude of the shock of the computer device is calculated, so that the subsequent adjustment and analysis of the 3D naked eye device are more in line with the user's needs, and the average amplitude of the shock of the computer device is updated periodically, so that the naked eye 3D display analysis and processing are not prone to errors due to the continuous change of the road conditions and the delay of the average amplitude of the shock data, and the accuracy of the naked eye 3D display analysis and processing is effectively improved, and the user's satisfaction is greatly improved.

[0048] S102, naked eye 3D technology budget analysis and processing

[0049] For example, in the embodiment of the application, after obtaining the distance detection result between the user's eyeball and the screen of the computer device and the average amplitude of the shock of the computer device, the original direction information of the computer device before starting the naked eye 3D display eyeball tracking system is sensed, and the display screen of the computer device is divided into three vertical strip display areas with equal area;

[0050] After the division of the display area, the number of view points in each area is estimated when the computer device is in the opposite direction information of the original direction; when the computer device is in a shock state, the direction of the computer device at the next moment will be opposite to the current direction due to inertia, so the number of view points in each area is estimated when the computer device is in the opposite direction information of the current direction, and the subsequent view point arrangement result is obtained, so that the subsequent naked eye 3D effect analysis and processing of the computer is more efficient;

[0051] After receiving the estimated result of the view point arrangement, the pixel value in each area of the screen and the screen parameter of the computer device are further budgeted by combining the distance data between the user's eyeball and the screen of the computer device, and the budgeted result is stored; wherein the screen parameter of the computer includes the number of lines and the inclination angle of the cylindrical lens, so that the computer device can immediately adjust when processing the opposite direction information of the current direction, maintain the naked eye 3D display effect, and improve the user's viewing experience;

[0052] The above-mentioned preprocessing of the view point number arrangement result estimation, pixel value and computer device screen parameter is repeated within a specified time period, the naked eye 3D display in each direction relative to the original direction of the computer device is preprocessed, and the preprocessed result is stored; through the preprocessing, the analysis and adjustment to be performed to maintain the naked eye 3D display effect in each direction can be calculated in advance under the condition that the computer device shock amplitude does not exceed the set threshold within the period of time, the analysis and adjustment result can be quickly called when the computer device is in the corresponding direction information due to the subsequent jolt, and the real-time analysis and adjustment result leading to the naked eye 3D display effect cannot be maintained is avoided, and through the preprocessing, the use experience of the naked eye 3D display for the user can be effectively improved.

[0053] S103, performing adjustment management on the budget analysis result

[0054] For example, in the embodiment of the application, when the computer device is in the corresponding direction, the analysis and adjustment result of the direction is called, and the pixel value in each region of the computer device screen and the computer device screen parameter are adjusted according to the result;

[0055] In the analysis and adjustment process of the naked eye 3D display, the module completing the analysis process is in a wake-up state; since the road jolt is irregular, or the user's viewing posture changes and adjustment is not required, therefore, through the processing, quick analysis and adjustment can be performed immediately after the change occurs, and the display continuity and stability of the naked eye 3D are maintained.

[0056] Embodiment two:

[0057] The eye tracking system for naked eye 3D display provided in the embodiment two of the application, Figure 2 The module structure schematic diagram of the eye tracking system for naked eye 3D display provided in the embodiment two is shown in Figure 2 The system comprises:

[0058] The detection tracking module is used for tracking the user's eyeball and detecting the computer device shock frequency;

[0059] The budget analysis module is used for performing naked eye 3D technology budget analysis processing;

[0060] The execution management module performs adjustment management on the budget analysis result.

[0061] In some embodiments of the application, the detection tracking module comprises:

[0062] The positioning tracking unit is used for tracking and positioning the user's eyeball;

[0063] The shock detection module is used for detecting the shock amplitude of the computer device;

[0064] A distance management module is configured to manage, detect and analyze the distance between the eyeball of a user and a computer screen.

[0065] In some embodiments of the present application, the budget analysis module comprises:

[0066] A viewpoint arrangement estimation module is configured to estimate the arrangement result of the viewpoints.

[0067] A region division module is configured to perform region division processing.

[0068] A pixel point budget adjustment module is configured to adjust the budget of the pixel points.

[0069] A direction sensing module is configured to perform direction sensing analysis.

[0070] In some embodiments of the present application, the execution management module comprises:

[0071] An adjustment execution module is configured to adjust the execution of the analysis result.

[0072] A storage recording module is configured to store and record the analysis data information.

[0073] A state management module is configured to manage the state of the functional modules.

[0074] It should be noted that, in this document, the terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such a process, method, article or device.

[0075] Finally, it should be noted that the above description is only for the preferred embodiments of the present application, and is not intended to limit the present application. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments, or make equivalent replacements to some technical features. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. An eyeball tracking method for naked-eye 3D display, characterized in that: tracking the eyeballs of a user and detecting the oscillation amplitude of a computer device; performing budget analysis and processing of naked-eye 3D technology; performing execution adjustment management on the budget analysis result; the tracking of the eyeballs of the user and the detection of the oscillation amplitude of the computer device comprise: tracking and positioning the eyeballs of the user in real time through a front camera of a display screen, and detecting and recording the real-time distance between the eyeballs of the user and the screen; detecting the oscillation amplitude of the computer device, and periodically calculating and analyzing the average oscillation amplitude of the computer device according to a specified time period; the performing of budget analysis and processing of naked-eye 3D technology comprises: after obtaining the distance detection result between the eyeballs of the user and the screen of the computer device and the average oscillation amplitude data of the computer device, and after sensing the original direction information of the computer device compared with that before the naked-eye 3D display eyeball tracking system is started, dividing the display screen of the computer device into three vertical display areas of equal area; estimating the arrangement result of the number of view points in each area when the computer device is in the direction information opposite to the original direction; further combining the screen parameters of the computer device, the distance data between the eyeballs of the user and the screen of the computer device, performing budget processing on the pixel values in each area of the screen and the screen parameters of the computer device, and storing the budget processing result; repeatedly estimating the arrangement result of the number of view points, the preprocessing of the pixel values and the screen parameters of the computer device, performing budget processing on the naked-eye 3D display in each of the up, down, left and right directions relative to the original direction of the computer device, and storing the budget result within a specified time period. the performing of execution adjustment management on the budget analysis result comprises: when the computer device is in the corresponding direction, calling the analysis and adjustment result of the direction, and adjusting the pixel values in each area of the screen of the computer device and the screen parameters of the computer device according to the result; in the analysis and adjustment process of naked-eye 3D display, the module that completes the analysis processing is in an awakened state.

3. An eyeball tracking system for naked-eye 3D display, used for implementing the eyeball tracking method for naked-eye 3D display in any one of claims 1-2, comprising: a detection and tracking module for tracking the eyeballs of a user and detecting the oscillation amplitude of a computer device; a budget analysis module for performing budget analysis and processing of naked-eye 3D technology; an execution management module for performing execution adjustment management on the budget analysis result. the detection and tracking module comprises: a positioning and tracking unit for tracking and positioning the eyeballs of a user; an oscillation detection module for detecting the oscillation amplitude of a computer device; a distance management module for managing, detecting and analyzing the distance between the eyeballs of a user and a computer screen. the budget analysis module comprises: a view point arrangement estimation module for estimating the arrangement result of the number of view points; an area division module for performing area division processing; a pixel point budget adjustment module for performing budget adjustment on pixel points; a direction sensing module for performing direction sensing analysis. the execution management module comprises: an adjustment execution module for performing execution adjustment on the analysis and adjustment result. ​ ​ ​ ​ ​ ​ 2. The eye tracking method for naked-eye 3D display according to claim 1, characterized in that: ​ ​ ​ ​ ​ ​ ​ 4. The eye-gaze tracking system for naked-eye 3D display according to claim 3, characterized in that: ​ ​ ​ ​ 5. The eye-globe tracking system for naked-eye 3D display according to claim 3, characterized by: ​ ​ ​ ​ ​ 6. The eye-globe tracking system for naked-eye 3D display according to claim 3, characterized by: ​ ​ A storage record module is configured to store and record the analysis data information. A state management module is configured to manage the state of the function modules.

Citation Information

Patent Citations

  • Naked eye 3D display method based on eye tracking

    CN108600733A