Naked eye visual 3D display control system and method

Abstract

The invention discloses a naked eye visual 3D display control system and method, and particularly relates to the technical field of naked eye 3D display control. According to the method, the objective conflict level of the image and the physiological state of the viewer are fused, a scientific fatigue judgment system is constructed, the eye pressure coefficient is output through depth map quantitative adjustment and convergence conflicts in combination with a personalized baseline, and the fatigue index is generated through fusion evaluation, so that the defect that individual differences are ignored by only depending on image parameters is avoided; and the problem that single physiological data cannot be associated with content risks is also solved, and the accuracy and reliability of fatigue early warning are greatly improved.

Description

Technical Field

[0001] This invention relates to the field of naked-eye 3D display control technology, and more specifically, to a naked-eye visual 3D display control system and method. Background Technology

[0002] With the rapid development of display technology, naked-eye 3D displays have been widely used because they do not require the use of professional auxiliary equipment and can bring viewers an immersive stereoscopic visual experience.

[0003] However, current naked-eye 3D display technology still faces the following shortcomings in practical applications: On the one hand, the stereoscopic image parameters of traditional naked-eye 3D display systems are mostly fixed preset values, which cannot be dynamically adjusted according to the individual differences and real-time status of viewers. There are significant differences in interpupillary distance, visual tolerance, and 3D experience adaptation ability among different viewers. Uniform stereoscopic parameters can easily lead to accommodation-convergence conflict in some people. That is, the matching relationship between the human eye's need to adjust focus and the convergence angle of the two eyes is broken, which can lead to visual fatigue symptoms such as eye strain, dizziness, and blurred vision. It may even have a potential impact on the eye health of some sensitive people. Meanwhile, existing systems can only assess visual stress based on the image content itself, ignoring the real-time physiological feedback of viewers, making it difficult to accurately perceive the degree of individual fatigue and unable to form an effective fatigue warning and intervention mechanism. On the other hand, existing naked-eye 3D display control solutions lack a personalized experience optimization system. Most systems do not establish historical experience files for viewers and cannot build a personalized visual tolerance baseline based on past 3D viewing records. As a result, parameter adjustments always remain at the "general" level, which can neither avoid fatigue risks for users with low tolerance in advance nor retain a better stereoscopic immersive experience for users with high tolerance.

[0004] Therefore, a naked-eye visual 3D display control system and method are proposed. Summary of the Invention

[0005] To overcome the above-mentioned deficiencies of the prior art, embodiments of the present invention provide a naked-eye visual 3D display control system and method.

[0006] To achieve the above objectives, the present invention provides the following technical solution: A naked-eye visual 3D display control system includes the following modules: Naked-eye 3D display module: presents stereoscopic images; Physiological sensing module: Collects real-time eye movement physiological data of the viewer, including convergence angle, pupil diameter, blink frequency, average duration of eye closure, and viewing distance; Visual evaluation module: conflict calculation unit, physiological feature extraction unit, and fusion evaluation unit; Conflict Calculation Unit: Based on the distance between the viewer and the screen, as well as scene depth information, it calculates the conflict coefficient generated by the screen convergence angle and the virtual adjustment distance in real time, and extracts the average conflict level of the current stereoscopic image based on the conflict coefficient; Physiological feature extraction unit: Extracts fatigue-related temporal features from eye movement physiological data, processes them, and outputs the viewer's eye pressure coefficient; Fusion evaluation unit: Using weighted fusion, the output of the conflict calculation unit is fused with the output of the physiological feature extraction unit to generate a visual fatigue index; Content adjustment module: Adjusts the stereoscopic visual parameters of the output stereoscopic image in real time based on the visual fatigue index; Correction trigger module: When the cumulative number of time zones for viewers reaches a set number, extract the comfort improvement scores of viewers after adjusting in each time zone, and use the comfort improvement scores of each group to dynamically correct the visual fatigue index in the next time zone.

[0007] Specifically, the analysis logic for the screen convergence angle; For a point on the screen and its corresponding virtual object point, if the interpupillary distance is set to I, then the lines of sight of the left and right eyes converge at the virtual object point. The vectors from the left and right eyes of the viewer to the virtual object point are calculated respectively, and the angle between the two vectors is obtained as the convergence angle. The convergence angle and the convergence conflict reference are connected using the formula Calculations were performed to obtain the change in the convergence angle; where This represents the convergence angle calculated when the viewer's eyes are focused on a virtual object point; This indicates the convergence angle required when the viewer's eyes are focused on the center of the screen.

[0008] Specifically, the analysis logic for virtual adjustment distance; Scene depth information is the scene depth map D(x,y), which stores the relative distances between virtual objects in the stereoscopic image and the viewer's eye plane; The formula for calculating the distance to virtual objects, using the viewer's viewing distance and the scene depth map as input, is as follows: ;in This is the preset correction value; L is the viewing distance. The relative distance between the virtual object in the stereoscopic image and the viewer's eye plane; Distance of virtual objects The reciprocal of the factor is used as the adjustment demand; the adjustment demand and the benchmark for adjustment conflict are connected using the formula. Calculations are performed to obtain the absolute adjustment conflict value.

[0009] Specifically, the logic for generating the average conflict level; After normalizing the absolute adjustment conflict value and the convergence angle change value, a comprehensive processing is performed to output the conflict coefficient; the conflict coefficient of all pixels in the stereo image is obtained, and the average value is calculated as the average conflict level.

[0010] Specifically, the calculation logic of the intraocular pressure coefficient; The convergence angle, pupil diameter, blink frequency, and average eye closure duration are extracted from eye movement physiological data. Temporal features are calculated to obtain the viewer's convergence angle change rate, significance level, and eye condition. After comprehensive processing combined with the viewer's personalized reference baseline, the eye pressure coefficient is output.

[0011] Specifically, the calculation logic for the rate of change of the convergence angle and the degree of significance; Let the collected convergence angle time series data be... The difference between the convergence angles of adjacent moments in the time series data is calculated, and the absolute value is divided by the duration of the adjacent moment to obtain the rate of change of the convergence angle between adjacent moments. The standard deviation of the rate of change of convergence angle for each group calculated in the time series data is used to obtain the degree of fluctuation in the viewer's change. Let the pupil diameter time series data be as follows: The difference between the pupil diameters at adjacent moments in the time series data is calculated and the absolute value is taken as the diameter change. Each group of diameter changes is compared with the preset change reference value. The diameter changes that are higher than the change reference value are selected and their number is counted as the number of significant changes. The proportion of the number of significant changes in the total number of diameter changes is calculated and recorded as the degree of significance.

[0012] Specifically, the calculation logic for the degree of eye condition; Let the timing of blink time be denoted as , =1 indicates that the viewer's eyes are closed at time t. =0 means eyes are open; Identify all independent blink cycles, from the start of closing the eyes to the end of opening the eyes; The number of blinks a viewer makes in the current time zone is counted and divided by the current time zone to obtain the viewer's blink frequency. The cumulative duration of eye closure for each group of viewers within the current time zone is summed to obtain the cumulative duration of eye closure. The ratio of the cumulative duration of eye closure to the duration of the current time zone is then calculated to obtain the percentage of viewers with their eyes closed. After standardizing the blinking frequency and the percentage of time the viewer's eyes are closed, a comprehensive analysis is performed to output the viewer's eye condition.

[0013] Specifically, the logic for building a personalized reference baseline; This is used to retrieve the current viewer's personal information from a pre-built database. After matching the personal information, it retrieves relevant historical 3D experience records. The historical 3D experience records store the viewer's convergence angle change rate, degree of significance, eye condition, and viewer's experience status during the current experience. The experience status includes excellent, good, and average. The personalized reference baseline is calculated by averaging the rate of change of the convergence angle, the degree of significance, and the degree of eye condition of the viewer in each good state, and then using this average as the viewer's personalized reference baseline.

[0014] Specifically, the generation and correction logic of the visual fatigue index; After comprehensively processing the average conflict level of the current stereoscopic image and the viewer's eye pressure coefficient, the viewer's visual fatigue index in the current time zone is obtained; in the next adjusted time zone, the viewer's comfort improvement rating is collected. The average of the comfort improvement scores of viewers in each time zone is calculated and used as the correction basis value; each group of scores corresponding to the correction basis value is set, and each group of scores corresponds to a correction coefficient; after converting the correction basis value into the correction coefficient, the visual fatigue index calculated in the next time zone is multiplied by the correction coefficient to obtain the final value matching the fatigue impact level.

[0015] A method for controlling naked-eye 3D display includes: S1: Real-time acquisition of the viewer's eye movement physiological data; S2: Combine real-time scene depth information with physiological data to calculate the visual fatigue index; S3: Select and implement the corresponding visual parameter adjustment strategy based on the visual fatigue index; S4: Output the adjusted stereoscopic image data to the naked-eye 3D display module for display; S5: Repeat steps S1-S4 to form a real-time closed-loop control aimed at reducing visual fatigue.

[0016] The technical effects and advantages of this invention are as follows: (1) By integrating the objective conflict level of the image with the physiological state of the viewer, a scientific fatigue assessment system was constructed. Through the quantitative adjustment of depth map and convergence conflict, combined with the output of eye pressure coefficient by personalized baseline, and then the fatigue index was generated by fusion assessment. This not only avoids the drawback of relying solely on image parameters and ignoring individual differences, but also solves the problem that single physiological data cannot be associated with content risk, thus greatly improving the accuracy and reliability of fatigue warning. (2) Based on the historical 3D experience records of viewers, a personalized reference baseline is constructed. Different stereoscopic parameter control strategies can be matched according to the visual tolerance of different groups. For different fatigue levels, parameters such as parallax amplitude, depth range, and rendering intensity can be adjusted in a targeted manner. When there is no fatigue, the immersion is guaranteed. When there is mild fatigue, the parameters are finely adjusted. When there is severe fatigue, the dimension is reduced urgently. This avoids the health risks of general parameters to sensitive groups and preserves a high-quality stereoscopic experience for users with high tolerance. (3) When users are not satisfied with the effect of parameter adjustment, the fatigue index is amplified by matching correction coefficients, prompting the system to adopt a stricter control strategy, so that parameter control can be continuously optimized according to user feedback, realizing the upgrade from passive response to active adaptation, and improving the stability and comfort of naked-eye 3D experience in the long term. Attached Figure Description

[0017] Figure 1 This is a schematic diagram of a naked-eye visible 3D display control system according to the present invention; Figure 2 This is a flowchart of a naked-eye visible 3D display control method according to the present invention. Detailed Implementation

[0018] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0019] like Figure 1 As shown, a naked-eye visual 3D display control system includes: The naked-eye 3D display module is used to present stereoscopic images; The physiological sensing module is used to non-invasively collect real-time eye movement physiological data of the viewer, including convergence angle, pupil diameter, blink frequency, average eye closure duration, and viewing distance. The physiological sensing module uses a high frame rate eye tracker and infrared imaging to track the rate of change of the convergence angle of the viewer's eyes and the pupil diameter; Monitor viewers' blink frequency and average duration of eye closure; It also includes a depth sensor for determining the distance between the viewer and the screen.

[0020] The visual evaluation module includes a conflict calculation unit, a physiological feature extraction unit, and a fusion evaluation unit; The conflict calculation unit is used to calculate the conflict coefficient generated by the screen convergence angle and the virtual adjustment distance in real time based on the distance between the viewer and the screen and the scene depth information, and to extract the average conflict level of the current stereoscopic image based on the conflict coefficient. Specifically: With the center of the screen as the origin O; The Z-axis is perpendicular to the screen plane, points towards the viewer, and its positive direction is towards the viewer; The X-axis points horizontally to the right, and the Y-axis points vertically upward (following the right-hand coordinate system). At this moment, the screen plane is located at Z=0, and the center of the viewer's eyes is located at (0,0,+L); To clarify, this is a standardized processing coordinate system, which needs to be aligned with the original sensor data through a coordinate transformation.

[0021] Scene depth information is the scene depth map D(x,y), which stores the relative distances between virtual objects in the stereoscopic image and the viewer's eye plane; Preprocessing: Except for pixels in the depth map where D(x,y)=0 (no depth information), D(x,y)>D_max (outside the effective perception range), or D(x,y)<L (virtual objects in front of the screen, which need to be specially marked), retain the effective pixel set.

[0022] The formula for calculating the distance to virtual objects, using the viewer's viewing distance and the scene depth map as input, is as follows: ;in The preset correction value, The value is 0.001 meters; L is the viewing distance. The relative distance between the virtual object in the stereoscopic image and the viewer's eye plane; Explanation: The forward or backward offset of an object relative to the screen plane, when... < L, the object is behind the screen (in-screen); > L, the object is in front of the screen (out of screen).

[0023] Distance of virtual objects The reciprocal of the value is used as the accommodation requirement; the accommodation requirement is expressed in diopters. The formula is used to connect the benchmarks for regulating demand and regulating conflict. Calculations are performed to obtain the absolute accommodation conflict value; the benchmark for accommodation conflict is the accommodation requirement when the viewer's eyes are focused on the screen plane, which is the reciprocal of the viewing distance. For a point on the screen and its corresponding virtual object point, if the interpupillary distance is set to I, then the lines of sight of the left and right eyes converge at the virtual object point. The vectors from the left and right eyes of the viewer to the virtual object point are calculated respectively, and the angle between the two vectors is obtained as the convergence angle. The convergence angle and the convergence conflict reference are connected using the formula Calculations were performed to obtain the change in the convergence angle; where This represents the convergence angle calculated when the viewer's eyes are focused on a virtual object point; This represents the convergence angle required when the viewer's eyes are focused on the center of the screen (0,0,0), serving as a reference for convergence conflict; Normalization is applied to the absolute adjustment conflict value and convergence angle variation value, i.e., through the formula... Quantified as a difference ratio; and These represent the absolute adjustment conflict value and the convergence angle change value after normalization, respectively. and These are the preset upper and lower limits for adjustment conflict, respectively. and These are the preset upper limit and lower limit values ​​for the convergence angle variation, respectively.

[0024] in , , , The settings are determined based on the physiological limits of the human eye and display parameters.

[0025] After normalizing the absolute adjustment conflict value and the convergence angle change value, a comprehensive processing is performed to output the conflict coefficient; That is, by setting the weight coefficients corresponding to the absolute adjustment conflict value and the convergence angle change value respectively, the absolute adjustment conflict value and the convergence angle change value are multiplied by the corresponding weight coefficients, and then the conflict coefficient is obtained by summing them.

[0026] The conflict coefficient is used to quantify the degree of mismatch between the "adjustment distance" and the "convergence angle". Ideally (when viewing a real object), the two should be perfectly coupled. When viewing a stereoscopic display, this coupling is broken.

[0027] Obtain the collision coefficients of all pixels in the stereo image and calculate the average collision level by averaging them.

[0028] The average conflict level is used as an objective indicator of how much visual stress current stereoscopic image content causes to the "standard eye".

[0029] The physiological feature extraction unit is used to extract fatigue-related temporal features from eye movement physiological data, process them, and output the viewer's eye pressure coefficient. Specifically: Convergence angle, pupil diameter, blink frequency, and average eye closure duration are extracted from eye movement physiological data, and temporal features are calculated. Collect data on the change in convergence angle of viewers within the current time zone; Let the collected convergence angle time series data be... The difference between the convergence angles of adjacent moments in the time series data is calculated, and the absolute value is divided by the duration of the adjacent moment to obtain the rate of change of the convergence angle between adjacent moments. The standard deviation of the rate of change of convergence angle for each group calculated in the time series data is used to obtain the degree of fluctuation in the viewer's change.

[0030] The degree of fluctuation in the rate of change of the convergence angle is measured; the greater the fluctuation, the less stable the eye muscle accommodation.

[0031] Let the pupil diameter time series data be as follows: For the pupil diameter at adjacent moments in the time series data, the difference is calculated and the absolute value is taken as the diameter change. Each group of diameter changes is compared with the preset change reference value. The diameter changes that are higher than the change reference value are selected and their number is counted as the significant change. The proportion of the significant change in the total diameter change is calculated and recorded as the degree of significance. Let the timing of blink time be denoted as , =1 indicates that the viewer's eyes are closed at time t. =0 means eyes are open; Identify all independent blink cycles, from the start of closing the eyes to the end of opening the eyes; The number of blinks a viewer makes in the current time zone is counted and divided by the current time zone to obtain the viewer's blink frequency. The cumulative duration of eye closure for each group of viewers within the current time zone is summed to obtain the cumulative duration of eye closure. The ratio of the cumulative duration of eye closure to the duration of the current time zone is then calculated to obtain the percentage of viewers with their eyes closed. After standardizing the blinking frequency and the percentage of time the viewer closes their eyes, a comprehensive analysis is performed to output the viewer's eye condition level. The standardization process uses the min-max method, which involves multiplying the normalized result by the set blink frequency weight and the closed eye ratio weight, and then summing them to obtain the degree of eye condition.

[0032] The eye pressure coefficient is output after comprehensively processing the viewer's convergence angle change rate, significance level, and eye condition level, combined with the viewer's personalized reference baseline. The viewer's personalized reference baseline is used to retrieve the viewer's personal information from a pre-built database. After matching the personal information, relevant historical 3D experience records are retrieved. These historical 3D experience records store the viewer's convergence angle change rate, degree of significance, eye condition, and viewer's experience status during the current experience. The experience status includes excellent, good, and average. The experience status is marked by the viewer based on their own feelings when experiencing 3D stereoscopic images. A rating of "excellent" indicates that the viewer is relatively satisfied with their experience and has not experienced any discomfort. A positive rating indicates that the viewer is relatively satisfied with their experience and that any discomfort is within an acceptable range. The marking usually indicates that the viewer is dissatisfied with their own feelings during the current experience, and there is obvious discomfort.

[0033] The personalized reference baseline is the average of the rate of change of the convergence angle, the degree of significance, and the degree of eye condition of the viewer in each good state, which is then used as the viewer's personalized reference baseline. The calculation process for the intraocular pressure coefficient is as follows: The rate of change of the viewer's convergence angle, the degree of significance, and the degree of eye condition were respectively labeled as... , , The rate of change of convergence angle, the degree of significance, and the degree of eye condition in the viewer's personalized reference baseline were respectively marked as... , , ; According to the formula The intraocular pressure coefficient was calculated. ;in , , The weighting coefficients are set.

[0034] The fusion evaluation unit is used to combine the output of the conflict calculation unit with the output of the physiological feature extraction unit using weighted fusion to generate a visual fatigue index; That is, after normalizing the average conflict level of the current stereoscopic image and the viewer's eye pressure coefficient, multiply them by the set conflict weight and eye weight respectively, and then sum them to obtain the viewer's visual fatigue index in the current time zone.

[0035] The fusion assessment unit weighted and fused the "objective conflict level of image content" with the "viewer's subjective physiological feedback" to generate a dynamic visual fatigue index. This avoids the assessment bias caused by relying solely on image parameters (ignoring individual tolerance) or solely on physiological data (ignoring the risk of the image itself). It achieves accurate judgment from two dimensions: "content characteristics + physiological state", which greatly improves the reliability of fatigue warning.

[0036] The content adjustment module is connected to the visual fatigue assessment module and the naked-eye 3D display module respectively. Based on the visual fatigue index, it adjusts the stereoscopic visual parameters of the output stereoscopic image in real time to reduce the visual load on the viewer. In the next time zone after adjustment, it collects the viewer's comfort improvement rating after adjustment. That is, by using a pre-built user feedback interface, the system receives subjective ratings from users on the comfort level of the current adjustments and feeds these ratings back to the content adjustment module. The comfort improvement rating is limited to a range of 1-10, and the higher the comfort improvement rating, the more satisfied the viewer is with the experience of the 3D graphics after the adjustment.

[0037] Specifically: Using a pre-built mapping rule between visual fatigue index and fatigue impact level, the viewer's visual fatigue index is converted into a fatigue impact level; the fatigue impact level includes no fatigue level, mild fatigue level, moderate fatigue level, and severe fatigue level. This involves setting the range of each group of indices corresponding to the visual fatigue index, with each range corresponding to a fatigue level. The higher the visual fatigue index, the higher the likelihood of matching a severe fatigue level.

[0038] Input the viewer’s current fatigue level into the pre-built strategy database. The strategy database stores the stereoscopic image control strategies corresponding to different fatigue levels. After determining the stereo image control strategy, the stereo vision parameters of the current stereo image are adjusted. For example, the stereoscopic image control strategies corresponding to different fatigue impact levels: Fatigue-free level: Maintains all parameters to ensure an immersive experience; no adjustment of stereo parameters is required at this level. Parallax parameters: Maintain the original maximum parallax amplitude and parallax gradient, preserving the complete "out-of-screen / in-screen" effect; Depth of field parameters: Maintain the original virtual depth of field range, and the focus plane is set to the center of the screen or the scene focus by default;

[0039] Rendering parameters: The 3D rendering intensity is kept at 100% without any attenuation.

[0040] Mild fatigue level: Fine-tune local parameters to reduce the adjustment burden, aiming to "slightly reduce conflict without compromising immersion," and specifically optimize parameters in high-conflict areas: Parallax parameter: Reduce the maximum parallax amplitude by 10%~15%, focusing on compressing the parallax in the "out-of-screen" area (D(x,y)>L) to avoid the emphasis requirements caused by extreme out-of-screen conditions; Smooth interpolation is performed in regions where the parallax gradient exceeds the human eye's comfort threshold to reduce frequent convergence adjustments caused by abrupt depth changes; Depth of field parameter: Offset the near edge of the virtual scene toward the screen plane (e.g., if the original near distance is L+0.1m, adjust it to L+0.05m), reducing the depth range of objects that go off-screen. Switch the focal plane from the screen plane to the virtual plane of the core object in the scene (such as the human face, the core interaction object) to make the adjustment reference and the convergence reference coincide as much as possible; Rendering parameters: Reduce the stereoscopic rendering intensity of the background area by 20%, and give priority to ensuring the stereoscopic effect of the foreground focus area.

[0041] Moderate fatigue level: Significantly reduce the stereoscopic intensity and eliminate the core conflict With the goal of "giving priority to ensuring visual safety and taking into account the basic stereoscopic perception", comprehensively optimize the conflict parameters: Parallax parameter: Reduce the maximum parallax amplitude by 30% - 50%, forcibly limit the parallax of the out-of-screen area (only retain the parallax of the in-screen or screen plane depth), and completely eliminate the high adjustment conflict caused by the out-of-screen; Depth of field parameter: Compress the virtual depth of field range to 50% - 60% of the original range (for example, if the original depth of field is [L - 2m, L + 0.1m], adjust it to [L - 1m, L]), and only retain the depth levels of the core scene; Lock the focal plane to the screen plane to avoid frequent switching of the adjustment reference; Rendering parameters: Reduce the stereoscopic rendering intensity to 60% - 70%, and directly use 2D rendering for non-focus areas (such as the edge background); Enable the "low conflict rendering mode" to automatically remove invalid / high conflict pixels where D(x, y) > D_max or D(x, y) < L in the depth map.

[0042] Severe fatigue level: Urgently reduce the dimension to prevent visual damage Parallax parameter: Force the global parallax amplitude to zero, set the parallax gradient of all areas to 0, and temporarily turn off the stereoscopic parallax effect; Depth of field parameter: Compress the virtual depth of field range to "screen plane ± 0.1m", only retain very shallow depth levels, or directly lock it to the plane depth of field; Rendering parameters: Reduce the stereoscopic rendering intensity to 0 - 30%, or directly switch to the pure 2D mode; Pop up a "visual rest reminder", and at the same time reduce the screen brightness by 10% - 20% to reduce eye light stimulation; Recovery mechanism: After the fatigue index drops below the moderate level and stabilizes for 30 seconds, the stereoscopic parameters can be gradually restored (increase the rendering intensity by 10% each time, with an interval of 5 seconds) to avoid secondary discomfort caused by parameter mutations.

[0043] The correction trigger module is used to extract the adjusted comfort improvement scores of the viewer in each time zone when the cumulative time zone of the viewer reaches the set number, and use the comfort improvement scores of each group to dynamically correct the visual fatigue index in the next time zone; Specifically: The average of the comfort improvement scores of viewers in each time zone was used as the basis for correction. Set the scoring intervals corresponding to the correction basis values, and each scoring interval corresponds to a correction coefficient; the correction coefficient is limited to the range of 1-1.1, and the lower the correction basis value, the higher the corresponding correction coefficient.

[0044] The lower the correction value, the less satisfied the viewer is with the stereoscopic visual parameter adjustment results of the stereoscopic images in the first few time zones, and the viewer still experiences fatigue. In this case, the visual fatigue index of the corresponding subsequent time zones should be amplified.

[0045] After converting the correction base value into a correction factor, the visual fatigue index calculated in the next time zone is multiplied by the correction factor to obtain the final value for matching the fatigue impact level. Example 2

[0046] Please see Figure 2 As shown, based on Embodiment 1 of this application, a naked-eye 3D display control system is provided. Embodiment 2 of this application proposes a naked-eye 3D display control method. Embodiment 2 is merely a preferred embodiment of Embodiment 1, and its implementation will not affect the individual implementation of Embodiment 1.

[0047] Specifically, Embodiment 2 of this application provides a naked-eye 3D display control method, including: S1: Real-time acquisition of the viewer's eye movement physiological data; S2: Combine real-time scene depth information with physiological data to calculate the visual fatigue index; S3: Select and implement the corresponding visual parameter adjustment strategy based on the visual fatigue index; S4: Output the adjusted stereoscopic image data to the naked-eye 3D display module for display; S5: Repeat steps S1-S4 to form a real-time closed-loop control aimed at reducing visual fatigue.

[0048] The above formulas are all dimensionless calculations. Dimensionless calculations can be performed using various methods such as standardization, which will not be elaborated here. The formulas are derived from software simulations based on a large amount of collected data, and the preset parameters in the formulas can be set by those skilled in the art according to the actual situation.

[0049] The above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more sets of available media. The available medium can be a magnetic medium (e.g., floppy disk, ATA hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium can be a solid-state ATA hard disk.

[0050] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0051] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0052] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0053] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0054] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0055] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable ATA hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0056] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A naked-eye viewable 3D display control system, characterized by, The system comprises the following modules: A naked eye 3D display module: to present a stereoscopic image; A physiological sensing module: to collect real-time eye movement physiological data of a viewer; including a vergence angle, a pupil diameter, a blink frequency, an average closed-eye duration, and a viewing distance; A visual assessment module: a conflict calculation unit, a physiological feature extraction unit, and a fusion assessment unit; The conflict calculation unit: to calculate a conflict coefficient generated by a screen vergence angle and a virtual accommodation distance in real time according to a distance between the viewer and the screen and scene depth information, and to extract an average conflict level of the current stereoscopic image based on the conflict coefficient; The physiological feature extraction unit: to extract fatigue-related time-domain features from the eye movement physiological data, process the features, and output an eye stress coefficient of the viewer; The fusion assessment unit: to generate a visual fatigue index by using weighted fusion to fuse the output of the conflict calculation unit and the output of the physiological feature extraction unit; A content adjustment module: to adjust stereoscopic vision parameters of the output stereoscopic image in real time according to the visual fatigue index; A correction triggering module: to extract a comfort improvement score of the viewer after adjustment in each time zone when a cumulative time zone of the viewer reaches a set number, and to dynamically correct the visual fatigue index in the next time zone by using the comfort improvement scores of each group.

2. The naked eye 3D display control system according to claim 1, wherein: Analysis logic of the screen vergence angle; For a point on the screen and its corresponding virtual object point, a interpupillary distance is set as I, the left and right eye lines intersect at the virtual object point, vectors from the left and right eyes of the viewer to the virtual object point are calculated respectively, and an included angle between the two vectors is obtained as the vergence angle; The formula is used to calculate the change of the convergence angle between the convergence angle and the reference of the convergence conflict to obtain the change of the convergence angle. wherein represents the calculated vergence angle when the viewer's two eyes gaze at the virtual object point; represents the required vergence angle when the viewer's two eyes gaze at the screen center.

3. The naked eye 3D display control system according to claim 2, wherein: Analysis logic of the virtual accommodation distance; Scene depth information is a scene depth map D(x, y) that stores a relative distance from a virtual object in a stereoscopic image to an eye plane of the viewer; The formula for calculating the distance of the virtual object is represented as ; wherein is a preset correction value; L is the viewing distance, is the relative distance from the virtual object to the eye plane of the viewer in the stereoscopic image. The reciprocal of the virtual object distance is used as the adjustment demand; the adjustment demand is calculated with the formula between the adjustment demand and the benchmark of adjustment conflict to obtain the absolute adjustment conflict value.

4. The naked eye 3D display control system according to claim 3, wherein: Generation logic of the average conflict level; After normalization processing of the absolute accommodation conflict value and the vergence angle change value is completed, comprehensive processing is performed to output a conflict coefficient; Conflict coefficients of all pixels of the stereoscopic image are obtained, and an average value is calculated as the average conflict level.

5. The naked eye 3D display control system according to claim 1, wherein: Calculation logic of the eye stress coefficient; Vergence angle change speeds, significant proportion degrees, and eye state degrees of the viewer are obtained by extracting a vergence angle, a pupil diameter, a blink frequency, and an average closed-eye duration from the eye movement physiological data and calculating time-domain features, and the eye stress coefficient is output after comprehensive processing in combination with a personalized reference baseline of the viewer.

6. The naked eye 3D display control system according to claim 5, wherein: Calculation logic of the vergence angle change speed and the significant proportion degree; Suppose the collected vergence angle time series data is For the adjacent time of the time series data, the difference value is calculated, and the absolute value is divided by the length of the adjacent time to obtain the change speed of the adjacent time of the vergence angle. Standard deviation calculation is performed on each group of vergence angle change speeds calculated in time series data to obtain a change fluctuation degree of the viewer; The pupil diameter time sequence data is For the pupil diameters of adjacent time points in the time sequence data, difference calculation is performed and the absolute values are taken as diameter change amounts. The diameter change amounts of each group are compared with preset change reference amounts, diameter change amounts higher than the change reference amounts are screened out, and the number thereof is counted as a significant change number. The proportion of the significant change number in the total number of diameter change amounts is calculated and recorded as a significant proportion degree.

7. The naked eye 3D display control system according to claim 5, wherein: Calculation logic of the eye state degree; Let the timing mark of the blink time be , =1 represents that the viewer is in the closed-eye state at time t, =0 is open-eye; Identify all independent blink cycles, that is, the start of the closed eye to the end of the open eye; Statistical viewer in the current time zone in the blink of an eye, divided by the current time zone to get the viewer's blink frequency; For each group of closed eye length of the viewer in the current time zone is summed up, get the closed eye cumulative length, calculate the ratio of closed eye cumulative length and current time zone length, get the viewer's closed eye proportion; After the standardization processing of the viewer's blink frequency and closed eye proportion, the comprehensive processing is carried out to output the viewer's eye state degree.

8. The naked eye 3D display control system of claim 5, characterized in that: Personalized reference baseline construction logic; For retrieving the personal information of the current viewer in the pre-constructed information base, and for calling the relevant historical 3D experience records after matching the personal information, wherein the historical 3D experience records store the convergence angle change speed, significant proportion degree and eye state degree of the viewer in the current experience process, and the experience state of the viewer; the experience state includes excellent, good and general; Wherein the personalized reference baseline, that is, by averaging the convergence angle change speed, significant proportion degree and eye state degree of the viewer in each good state, as the personalized reference baseline of the viewer.

9. The naked eye 3D display control system of claim 5, characterized in that: Visual fatigue index generation logic and correction logic; After the comprehensive processing of the average conflict level of the current stereoscopic image and the eye pressure coefficient of the viewer, the visual fatigue index of the viewer in the current time zone is obtained; Collect the viewer's comfort improvement score in the adjusted next time zone; After the average calculation of the comfort improvement score of the viewer in each time zone, the correction basis value is obtained; set the score interval corresponding to each group of correction basis values, and each group of score interval corresponds to a correction coefficient; after converting the correction basis value into the correction coefficient, multiply the visual fatigue index calculated in the next time zone by the correction coefficient, as the final value of matching fatigue influence level.

10. A naked eye 3D display control method applied to the naked eye 3D display control system of any one of claims 1-9, characterized in that: S1: real-time collection of viewer's eye movement physiological data; S2: combining real-time scene depth information and physiological data, calculating visual fatigue index; S3: according to the visual fatigue index, selecting and executing the corresponding visual parameter adjustment strategy; S4: output the adjusted stereoscopic image data to the naked eye 3D display module for display; S5: loop execution of steps S1-S4, forming a real-time closed-loop control with the goal of reducing visual fatigue.

Images