A three-dimensional optical display system and method for realizing LED screen based on photon film

Abstract

The present invention relates to the field of optics, and discloses a three-dimensional optical display system and method for realizing an LED screen based on a photon film. The system includes: a multi-viewpoint layout module for analyzing the stereoscopic effect requirements of the LED screen and constructing a multi-viewpoint layout of the photon film; an optical system construction module for determining the optical elements of the LED screen, configuring a collaborative operation network of the optical elements, the photon film and the LED screen, and constructing an optical system of the optical elements, the photon film and the LED screen; an optical system model construction module for constructing an optical system model of the optical system; a stereo image construction module for identifying the original screen image corresponding to the LED screen, dividing the original screen image into image viewpoints, and constructing a stereo image of the original screen image; and a display image stereo optimization module for tracking the user viewpoint of the target user, adjusting the element parameters of the optical elements corresponding to the optical system, and obtaining a target stereo display image of the LED screen. The present invention aims to improve the three-dimensional optical display effect of the LED screen.

Description

Technical Field

[0001] The present invention relates to the field of optics, and in particular to a three-dimensional optical display system and method for realizing an LED screen based on a photonic film. Background Art

[0002] The three-dimensional optical display of LED screen refers to the display method that can produce three-dimensional visual effects through LED screen technology. This display method uses the principle of binocular parallax of human beings. At a certain viewing distance and angle, the audience can see the image on the screen with a sense of depth and three-dimensionality, thus presenting a three-dimensional effect.

[0003] At present, the three-dimensional optical display of LED screens is mainly achieved through active 3D glasses technology, which blocks the different images seen by the left and right eyes respectively, thereby creating a three-dimensional effect. This method will sacrifice a certain amount of resolution or brightness while generating the three-dimensional effect, and the viewing experience is easily affected by the environment and angle, resulting in poor three-dimensional display of the LED screen. Summary of the invention

[0004] The present invention provides a three-dimensional optical display system and method for an LED screen based on a photonic film, the main purpose of which is to improve the three-dimensional optical display effect of the LED screen.

[0005] To achieve the above-mentioned purpose, the present invention provides a three-dimensional optical display system for realizing an LED screen based on a photon film, characterized in that the three-dimensional optical display system for realizing an LED screen based on a photon film comprises:

[0006] A multi-viewpoint layout module is used to obtain application scenarios and target users of the LED screen, analyze the stereoscopic effect requirements of the LED screen based on the application scenarios and the target users, identify the microstructure of the preset photon film, and construct a multi-viewpoint layout of the photon film based on the microstructure and the stereoscopic effect requirements;

[0007] An optical system construction module, used to determine the optical elements of the LED screen based on the multi-viewpoint layout, configure the collaborative operation network of the optical elements, the photonic film and the LED screen, and construct the optical system of the optical elements, the photonic film and the LED screen based on the collaborative operation network;

[0008] An optical system model building module, used to build an optical system model of the optical system;

[0009] A stereoscopic image construction module, used for identifying an original screen image corresponding to the LED screen, dividing the original screen image into image viewpoints based on the optical system model, and constructing a stereoscopic image of the original screen image based on the image viewpoints;

[0010] The display image stereoscopic optimization module is used to track the user viewpoint of the target user, and based on the user viewpoint and the stereoscopic image, adjust the element parameters of the optical elements corresponding to the optical system to obtain the target stereoscopic display image of the LED screen.

[0011] Optionally, analyzing the stereoscopic effect requirements of the LED screen based on the application scenario and the target user includes:

[0012] collecting user expectations of the target users;

[0013] Identify application scenario characteristics of the application scenario;

[0014] Determining the stereoscopic effect type of the LED screen based on the user expectations and the application scenario characteristics;

[0015] Analyzing the number and distribution of viewpoints of the stereoscopic effect type;

[0016] Based on the stereoscopic effect type, the number of viewpoints, and the viewpoint distribution, the stereoscopic effect requirement of the LED screen is determined.

[0017] Optionally, constructing a multi-viewpoint layout of the photonic film based on the microstructure and the three-dimensional effect requirement includes:

[0018] analyzing microstructural characteristics of the microstructure;

[0019] Based on the characteristics of the microstructure, determining the light control capability of the microstructure, wherein the light control capability includes the light propagation direction and the light focusing effect;

[0020] Determining an initial multi-viewpoint layout of the photonic film based on the microstructure characteristics and the light control capability;

[0021] Calculating the layout validity of the initial multi-viewpoint layout;

[0022] When the layout validity meets the preset validity threshold, a multi-viewpoint layout of the photonic film is constructed.

[0023] Optionally, the calculating the layout validity of the initial multi-viewpoint layout includes:

[0024] Analyzing layout effectiveness factors of the initial multi-viewpoint layout, wherein the layout effectiveness factors include parallax consistency, viewing angle coverage, stereoscopic depth perception, and viewing comfort;

[0025] Determine the effective factor weight of the layout effective factor;

[0026] Based on the layout validity factor and the validity factor weight, the layout validity of the initial multi-viewpoint layout is calculated using the following formula:

[0027] ρ=(DD σ *EE σ *GG σ *HH σ ) / (D+E+G+H)

[0028] Where ρ represents the layout effectiveness of the initial multi-view layout, D represents the parallax consistency of the initial multi-view layout, E represents the viewing angle coverage of the initial multi-view layout, G represents the stereoscopic depth of the initial multi-view layout, H represents the viewing comfort of the initial multi-view layout, and D σ represents the weight of disparity consistency, E σ represents the weight of the viewing angle coverage, G σ Represents the weight of stereo depth perception, H σ Indicates the weight of viewing comfort.

[0029] Optionally, the configuration of the collaborative operation network of the optical element, the photonic film and the LED screen includes:

[0030] Analyze the collaborative working mode of the optical element, the photonic film and the LED screen;

[0031] Based on the collaborative working mode, determining the connection mode and control logic of the optical element, the photonic film and the LED screen;

[0032] Determine the signal transmission scheme of the optical element, the photonic film and the LED screen through the connection mode and the control logic;

[0033] Based on the connection method, the control logic and the signal transmission scheme, a collaborative operation network of the optical element, the photonic film and the LED screen is configured.

[0034] Optionally, constructing an optical system model of the optical system includes:

[0035] determining optical system requirements for the optical system;

[0036] Based on the optical system requirements, select simulation software for the optical system;

[0037] By means of the simulation software, a simulation geometric model of the optical system is established;

[0038] Defining a simulation scene of the simulation geometric model, and configuring simulation parameters of the simulation scene;

[0039] Based on the simulation scene and the simulation parameters, simulating light propagation of the optical system;

[0040] Analyzing optical performance of the optical system based on the light propagation;

[0041] The optical performance is used to optimize the parameters of the simulation geometric model to obtain the optical system model.

[0042] Optionally, segmenting the original screen image into image viewpoints based on the optical system model includes:

[0043] Integrating the optical system model into a preset image processing software to obtain an integrated optical system model;

[0044] Based on the integrated optical system model, determining the viewpoint direction and viewpoint position of the original image on the screen;

[0045] Calculating the viewpoint disparity of the original image on the screen based on the viewpoint direction and the viewpoint position;

[0046] Based on the viewpoint parallax, the screen original image is segmented into image viewpoints.

[0047] Optionally, the calculating the viewpoint disparity of the screen original image based on the viewpoint direction and the viewpoint position includes:

[0048] Based on the viewpoint direction and the viewpoint position, determining the viewpoint image distance and the viewpoint light incident angle between the original screen image and the target user;

[0049] Based on the viewpoint image distance and the viewpoint light incident angle, the viewpoint parallax of the screen original image is calculated using the following formula:

[0050]

[0051] Among them, σ represents the viewpoint parallax of the original image on the screen, F r Indicates the viewpoint image distance between the original screen image and the left eye viewpoint of the target user, F e represents the viewpoint image distance between the original screen image and the target user's right eye viewpoint, θ r represents the incident angle of the viewpoint ray corresponding to the left eye viewpoint of the target user of the original screen image, θ e It represents the incident angle of the viewpoint light corresponding to the right eye viewpoint of the target user of the original image on the screen, and cos represents the cosine function.

[0052] Optionally, tracking the user viewpoint of the target user includes:

[0053] Using a preset camera system to capture the head movement image of the target user;

[0054] Identifying image feature points of the head motion image;

[0055] Identify the feature point displacement and rotation angle of the image feature point;

[0056] Based on the feature point displacement and the rotation angle, the head motion vector of the target user is calculated using the following formula:

[0057]

[0058] in, represents the target user's head motion vector, x ω -x ω-1 Indicates the displacement of the image feature point on the x-axis, y ω Indicates the position of the image feature point in the ωth frame on the x-axis, x ω-1 Indicates the position of the image feature point in the ω-1 frame on the x-axis, y ω -y ω-1 Represents the displacement of the image feature point on the y-axis, y ω Indicates the position of the image feature point on the y-axis in the ωth frame, y ω-1 Indicates the position of the image feature point in the ω-1 frame on the y-axis, Represents the rotation angle of the image feature point on the x-axis, Indicates the rotation angle of the image feature point on the y-axis, Indicates the rotation angle of the image feature point on the z-axis;

[0059] Determining a head movement trajectory of the target user based on the head movement vector;

[0060] Analyzing the head posture of the target user based on the head movement trajectory;

[0061] The user viewpoint of the target user is determined through the head posture.

[0062] In order to solve the above problems, the present invention also provides a three-dimensional optical display method of an LED screen based on a photonic film, the method comprising:

[0063] Acquire application scenarios and target users of LED screens, analyze the stereoscopic effect requirements of the LED screen based on the application scenarios and the target users, identify the microstructure of a preset photon film, and construct a multi-viewpoint layout of the photon film based on the microstructure and the stereoscopic effect requirements;

[0064] Based on the multi-viewpoint layout, determine the optical elements of the LED screen, configure the collaborative operation network of the optical elements, the photonic film and the LED screen, and construct the optical system of the optical elements, the photonic film and the LED screen based on the collaborative operation network;

[0065] constructing an optical system model of the optical system;

[0066] Identify the original screen image corresponding to the LED screen, segment the original screen image into image viewpoints based on the optical system model, and construct a stereoscopic image of the original screen image based on the image viewpoints;

[0067] The user viewpoint of the target user is tracked, and based on the user viewpoint and the stereoscopic image, the element parameters of the optical element corresponding to the optical system are adjusted to obtain the target stereoscopic display image of the LED screen.

[0068] Based on the application scenario and the target user, the present invention analyzes the stereoscopic effect requirements of the LED screen to ensure that the system can meet the application scenario and the requirements of the target user; based on the microstructure and the stereoscopic effect requirements, the present invention constructs a multi-viewpoint layout of the photon film to adapt to the viewing habits and comfort of the target user; the present invention configures the optical element, the photon film and the collaborative operation network of the LED screen to provide a basis for the later modification of the stereoscopic effect; further, based on the optical system model, the present invention divides the original image of the screen into image viewpoints as the basis for the later construction of the stereoscopic image. Finally, based on the user viewpoint and the stereoscopic image, the present invention adjusts the element parameters of the optical element corresponding to the optical system to obtain the target stereoscopic display image of the LED screen, which can improve the stereoscopic effect of the user viewing the image. Therefore, the present invention can improve the three-dimensional stereoscopic optical display effect of the LED screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] Figure 1 A functional module diagram of a three-dimensional optical display system for realizing an LED screen based on a photonic film provided in one embodiment of the present invention;

[0070] Figure 2 A schematic flow chart of a method for realizing a three-dimensional optical display of an LED screen based on a photonic film according to an embodiment of the present invention.

[0071] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0072] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0073] In addition, the step sequence in the following method embodiments is only an example and not a strict limitation.

[0074] In fact, the server-side device deployed by the three-dimensional stereoscopic optical display system for realizing LED screen based on photon film may be composed of one or more devices. The above-mentioned three-dimensional stereoscopic optical display system for realizing LED screen based on photon film can be implemented as: business instance, virtual machine, hardware device. For example, the three-dimensional stereoscopic optical display system for realizing LED screen based on photon film can be implemented as a business instance deployed on one or more devices in the cloud node. In simple terms, the optical display system can be understood as a software deployed on the cloud node, which is used to provide each user end with a service for realizing three-dimensional stereoscopic optical display of LED screen based on photon film. Alternatively, the three-dimensional stereoscopic optical display system for realizing LED screen based on photon film can also be implemented as a virtual machine deployed on one or more devices in the cloud node. The virtual machine is installed with application software for managing each user end. Alternatively, the three-dimensional stereoscopic optical display system for realizing LED screen based on photon film can also be implemented as a server end composed of many hardware devices of the same or different types, and one or more hardware devices are set to provide three-dimensional stereoscopic optical display services for realizing LED screen based on photon film to each user end.

[0075] In terms of implementation, the three-dimensional optical display system for LED screens based on photon film and the user end are adapted to each other. That is, the three-dimensional optical display system for LED screens based on photon film is an application installed on the cloud service platform, and the user end is a client that establishes a communication connection with the application; or the three-dimensional optical display system for LED screens based on photon film is implemented as a website, and the user end is implemented as a web page; or the three-dimensional optical display system for LED screens based on photon film is implemented as a cloud service platform, and the user end is implemented as a small program in an instant messaging application.

[0076] Reference Figure 1 , which is a functional module diagram of a three-dimensional optical display system for realizing an LED screen based on a photonic film provided by an embodiment of the present invention.

[0077] The three-dimensional stereoscopic optical display system 200 for realizing LED screen based on photon film of the present invention can be set in a cloud server. In terms of implementation, it can be used as one or more service devices, or it can be installed as an application on the cloud (such as the server of the optical display operator, server cluster, etc.), or it can be developed as a website. According to the functions implemented, the three-dimensional stereoscopic optical display system 200 for realizing LED screen based on photon film includes a multi-viewpoint layout module 101, an optical system construction module 102, an optical system model construction module 103, a stereoscopic image construction module 104 and a display image stereoscopic optimization module 105. In the embodiment of the present invention, in the tracking of the three-dimensional stereoscopic optical display of LED screen based on photon film, each of the above modules can be implemented independently and called with other modules. The call here can be understood as that a certain module can connect to multiple modules of another type and provide corresponding services to the multiple modules connected to it. In the three-dimensional optical display system for realizing LED screens based on photon membranes provided by the embodiments of the present invention, the scope of application of the three-dimensional optical display architecture for realizing LED screens based on photon membranes can be adjusted by adding modules and directly calling them without modifying the program code, so as to achieve cluster-type horizontal expansion, so as to achieve the purpose of quickly and flexibly expanding the three-dimensional optical display system for realizing LED screens based on photon membranes. In practical applications, the above modules can be set in the same device or different devices, or in virtual devices, such as service instances in cloud servers.

[0078] In the following, in combination with specific embodiments, each component and specific workflow of the three-dimensional optical display system for LED screen based on photonic film are described respectively:

[0079] The multi-viewpoint layout module 101 is used to obtain the application scenario and target users of the LED screen, analyze the stereoscopic effect requirements of the LED screen based on the application scenario and the target users, identify the microstructure of the preset photonic film, and construct a multi-viewpoint layout of the photonic film based on the microstructure and the stereoscopic effect requirements.

[0080] It should be explained that the LED screen refers to an electronic display screen that uses light-emitting diodes (LEDs) as display units, and the application scenario refers to the specific environment and occasion in which the LED screen will be used. For example, it may be used for outdoor billboards, shopping mall displays, cinemas, home entertainment centers, educational institutions, exhibition halls, etc. The target user refers to the intended user or audience of the system. For example, the target user may be an ordinary consumer, a professional audience, a student, an educator, a corporate customer, etc.

[0081] The present invention analyzes the stereoscopic effect requirements of the LED screen based on the application scenario and the target user to ensure that the system can meet the application scenario and the target user's requirements. The stereoscopic effect requirements refer to the specific parameters and requirements of the stereoscopic effect that the LED screen needs to achieve, including the number of viewpoints, viewpoint distribution, depth, layering and sense of motion of the stereoscopic effect, etc.

[0082] In detail, the analyzing the stereoscopic effect requirements of the LED screen based on the application scenario and the target user includes:

[0083] collecting user expectations of the target users;

[0084] Identify application scenario characteristics of the application scenario;

[0085] Determining the stereoscopic effect type of the LED screen based on the user expectations and the application scenario characteristics;

[0086] Analyzing the number and distribution of viewpoints of the stereoscopic effect type;

[0087] Based on the stereoscopic effect type, the number of viewpoints, and the viewpoint distribution, the stereoscopic effect requirement of the LED screen is determined.

[0088] Among them, the user expectations refer to the expectations and preferences of the target users for the stereoscopic effects of the LED screen, including requirements in terms of stereoscopic depth, image quality, viewing comfort, interactivity, etc. The application scenario characteristics refer to the characteristics of the specific environment in which the LED screen will be used, such as viewing distance, ambient light, number of viewers, frequency of use, etc. These characteristics will affect the design and implementation of the stereoscopic effect. The stereoscopic effect type refers to the specific stereoscopic effect that the LED screen needs to achieve based on user expectations and application scenario characteristics, such as sense of depth, sense of layering, sense of motion, etc. The number of viewpoints refers to the number of viewpoints required for the stereoscopic effect, that is, how many independent viewing angles the LED screen needs to provide when the audience watches at different angles and positions. The viewpoint distribution refers to the layout and distribution of viewpoints in the stereoscopic effect, which determines at which angles and positions the audience can see different images, thereby producing a stereoscopic effect.

[0089] Furthermore, the application scenario characteristics for identifying the application scenario may be analyzed by considering environmental factors of the application scenario, such as light, temperature, humidity, viewing distance, etc.

[0090] It should be explained that the photonic film refers to a special thin film material that controls light through its microstructure to achieve a three-dimensional display effect. The microstructure refers to the microstructure designed on the photonic film, including lens arrays, gratings, waveguides, liquid crystal microstructures and other structures.

[0091] Based on the microstructure and the three-dimensional effect requirements, the present invention constructs a multi-viewpoint layout of the photonic film to adapt to the viewing habits and comfort of the target users. The multi-viewpoint layout refers to a viewpoint layout that allows viewers to see different images from multiple different angles and positions.

[0092] In detail, the multi-viewpoint layout of the photonic film is constructed based on the microstructure and the three-dimensional effect requirements, including:

[0093] analyzing microstructural characteristics of the microstructure;

[0094] Based on the characteristics of the microstructure, determining the light control capability of the microstructure, wherein the light control capability includes the light propagation direction and the light focusing effect;

[0095] Determining an initial multi-viewpoint layout of the photonic film based on the microstructure characteristics and the light control capability;

[0096] Calculating the layout validity of the initial multi-viewpoint layout;

[0097] When the layout validity meets the preset validity threshold, a multi-viewpoint layout of the photonic film is constructed.

[0098] Among them, the microstructure characteristics refer to the unique properties of the microstructure on the photonic film, such as the shape of the lens, the periodicity of the grating, the phase change characteristics of the liquid crystal, etc. The light propagation direction refers to the propagation path and direction of the light in the photonic film, including the refraction and reflection of the light when passing through the microstructure. The light focusing effect refers to the degree of focusing of the light after passing through the microstructure, that is, the convergence effect of the light in a specific direction. The initial multi-viewpoint layout refers to the multi-viewpoint layout scheme preliminarily determined based on the microstructure characteristics and light control capabilities, which determines the number and distribution of viewpoints. The layout validity refers to the effect of the multi-viewpoint layout in achieving a stereoscopic effect, including the size of the parallax, the stereoscopic effect, etc. The validity threshold refers to a pre-set standard used to determine whether the multi-viewpoint layout meets the requirements of the stereoscopic effect.

[0099] Further, the calculating the layout validity of the initial multi-viewpoint layout includes:

[0100] Analyzing layout effectiveness factors of the initial multi-viewpoint layout, wherein the layout effectiveness factors include parallax consistency, viewing angle coverage, stereoscopic depth perception, and viewing comfort;

[0101] Determine the effective factor weight of the layout effective factor;

[0102] Based on the layout validity factor and the validity factor weight, the layout validity of the initial multi-viewpoint layout is calculated using the following formula:

[0103] ρ=(DD σ *EE σ *GG σ *HH σ ) / (D+E+G+H)

[0104] Where ρ represents the layout effectiveness of the initial multi-view layout, D represents the parallax consistency of the initial multi-view layout, E represents the viewing angle coverage of the initial multi-view layout, G represents the stereoscopic depth of the initial multi-view layout, H represents the viewing comfort of the initial multi-view layout, and D σ represents the weight of disparity consistency, E σ represents the weight of the viewing angle coverage, G σ Represents the weight of stereo depth perception, H σ Indicates the weight of viewing comfort.

[0105] Among them, the parallax consistency refers to whether the parallax between the images seen by the left and right eyes at different viewpoints is consistent in the multi-viewpoint layout. The higher the parallax consistency, the more stable the stereoscopic effect and the better the audience experience. The viewing angle coverage refers to the proportion of the audience viewing angle range that the multi-viewpoint layout can cover. The higher the viewing angle coverage, the more the multi-viewpoint layout can meet the viewing needs of more viewers. The stereoscopic depth sense refers to the depth sense of the stereoscopic effect produced by the multi-viewpoint layout. The higher the stereoscopic depth sense, the more obvious the stereoscopic effect and the more immersive the audience experience. The viewing comfort refers to the comfort level of the audience when watching stereoscopic images. The higher the viewing comfort, the more pleasant the audience experience. The effective factor weight refers to the weight assigned to the four factors of parallax consistency, viewing angle coverage, stereoscopic depth sense and viewing comfort according to the importance when calculating the layout effectiveness.

[0106] The optical system construction module 102 is used to determine the optical elements of the LED screen based on the multi-viewpoint layout, configure the collaborative operation network of the optical elements, the photonic film and the LED screen, and construct the optical system of the optical elements, the photonic film and the LED screen based on the collaborative operation network.

[0107] It should be explained that the optical elements include lenses, reflectors, gratings and other elements.

[0108] The collaborative operation network of the optical element, the photon film and the LED screen configured in the present invention can provide a basis for later modification of the three-dimensional effect. The collaborative operation network refers to a network that coordinates the optical element, the photon film and the LED screen to work together to achieve the goal.

[0109] In detail, the collaborative operation network of the optical element, the photonic film and the LED screen includes:

[0110] Analyze the collaborative working mode of the optical element, the photonic film and the LED screen;

[0111] Based on the collaborative working mode, determining the connection mode and control logic of the optical element, the photonic film and the LED screen;

[0112] Determine the signal transmission scheme of the optical element, the photonic film and the LED screen through the connection mode and the control logic;

[0113] Based on the connection method, the control logic and the signal transmission scheme, a collaborative operation network of the optical element, the photonic film and the LED screen is configured.

[0114] Among them, the collaborative working mode refers to how optical elements, photonic films and LED screens work together in a stereoscopic display system, including their functions, performances and the way they interact with each other; the connection mode refers to the physical connection mode between optical elements, photonic films and LED screens, including interfaces, cables, connectors, etc.; the control logic refers to how the components within the system are controlled and coordinated through electronic signals and software programs to ensure that they work in a predetermined manner; the signal transmission scheme refers to the transmission mode of signals within the system, including signal type, transmission path, transmission speed and reliability.

[0115] Furthermore, the signal transmission scheme for determining the optical element, the photonic film and the LED screen through the connection method and the control logic can be achieved through digital signal processing technology, high-speed communication interface and other technologies.

[0116] The optical system model building module 103 is used to build an optical system model of the optical system.

[0117] The present invention constructs an optical system model of the optical system to better understand the performance of the optical system and provide a basis for subsequent imaging.

[0118] In detail, the step of constructing an optical system model of the optical system includes:

[0119] determining optical system requirements for the optical system;

[0120] Based on the optical system requirements, select simulation software for the optical system;

[0121] By means of the simulation software, a simulation geometric model of the optical system is established;

[0122] Defining a simulation scene of the simulation geometric model, and configuring simulation parameters of the simulation scene;

[0123] Based on the simulation scene and the simulation parameters, simulating light propagation of the optical system;

[0124] Analyzing optical performance of the optical system based on the light propagation;

[0125] The optical performance is used to optimize the parameters of the simulation geometric model to obtain the optical system model.

[0126] Among them, the optical system requirements refer to the design goals and performance indicators that the optical system needs to meet, such as focal length, field of view, resolution, distortion, etc. The simulation software refers to a software tool used to simulate and analyze the performance of an optical system, such as Zemax, Opti System, Light Tools, etc. The simulation geometric model refers to a geometric layout model established in the simulation software that includes all optical elements (such as lenses, reflectors, gratings, etc.); the simulation scene refers to the environment and conditions for light propagation set in the simulation software, including the position of the light source, the position of the observer, the position of the imaging surface, etc. The simulation parameters refer to the parameters of the optical elements defined in the simulation scene, such as focal length, radius, refractive index, etc. The light propagation refers to the process simulated in the simulation software that the light starts from the light source, passes through the optical elements, and finally reaches the imaging surface; the optical system model refers to the optical system performance model obtained through simulation analysis, including simulations of light propagation path, focusing effect, imaging quality, etc.

[0127] Furthermore, the establishment of the simulation geometric model of the optical system by the simulation software can be achieved through geometric optics, wave optics or holographic optics.

[0128] The stereo image construction module 104 is used to identify the original screen image corresponding to the LED screen, divide the original screen image into image viewpoints based on the optical system model, and construct a stereo image of the original screen image based on the image viewpoints.

[0129] It should be explained that the original screen image refers to the initial image displayed on the LED screen, that is, the image that has not been processed for any three-dimensional effect.

[0130] Based on the optical system model, the present invention divides the original screen image into image viewpoints as the basis for later stereoscopic image construction. The image viewpoint refers to an image at a specific position on the screen, which represents the image content seen from a specific viewing angle in a stereoscopic display system.

[0131] In detail, the dividing the original screen image into image viewpoints based on the optical system model includes:

[0132] Integrating the optical system model into a preset image processing software to obtain an integrated optical system model;

[0133] Based on the integrated optical system model, determining the viewpoint direction and viewpoint position of the original image on the screen;

[0134] Calculating the viewpoint disparity of the original image on the screen based on the viewpoint direction and the viewpoint position;

[0135] Based on the viewpoint parallax, the screen original image is segmented into image viewpoints.

[0136] Among them, the integrated optical system model refers to combining the optical system model with the image processing software to form a software tool capable of processing optical-related data. The image processing software refers to a software tool for processing and analyzing image data, such as GI MP, Adobe Photoshop, ImageJ and other tools. The viewpoint direction refers to the direction of light propagation corresponding to each viewpoint in the optical system. These directions determine the difference in images seen by the left and right eyes and are the key to producing a stereoscopic effect. The viewpoint position refers to the position of each viewpoint relative to other viewpoints in the optical system. The determination of the viewpoint position helps to calculate the viewpoint parallax and segment the original image. The viewpoint parallax refers to the difference between the images seen by the left and right eyes at different viewpoints in the optical system. The viewpoint parallax is the basis for realizing stereoscopic display. By calculating the viewpoint parallax, the difference in the image of each viewpoint can be determined.

[0137] Further, the calculating the viewpoint disparity of the original image on the screen based on the viewpoint direction and the viewpoint position includes:

[0138] Based on the viewpoint direction and the viewpoint position, determining the viewpoint image distance and the viewpoint light incident angle between the original screen image and the target user;

[0139] Based on the viewpoint image distance and the viewpoint light incident angle, the viewpoint parallax of the screen original image is calculated using the following formula:

[0140]

[0141] Among them, σ represents the viewpoint parallax of the original image on the screen, F r Indicates the viewpoint image distance between the original screen image and the left eye viewpoint of the target user, F e represents the viewpoint image distance between the original screen image and the target user's right eye viewpoint, θ r represents the incident angle of the viewpoint ray corresponding to the left eye viewpoint of the target user of the original screen image, θ e It represents the incident angle of the viewpoint light corresponding to the right eye viewpoint of the target user of the original image on the screen, and cos represents the cosine function.

[0142] Among them, the viewpoint image distance refers to the distance between the image seen by the left eye viewpoint and the right eye viewpoint and the eyes respectively in the stereoscopic display system, the viewpoint light incident angle refers to the angle when the light enters the left eye or the right eye from a specific point on the screen, the right eye viewpoint refers to the position of the right eye in the stereoscopic display system, and the left eye viewpoint refers to the position of the left eye in the stereoscopic display system.

[0143] It should be explained that the stereoscopic image refers to an image with a sense of depth created by simulating the parallax of the left and right eyes of the human eye. In detail, the stereoscopic image can be formed into a stereoscopic image by combining image viewpoints using software such as 3D Studio Max and Blender.

[0144] The display image stereoscopic optimization module 105 is used to track the user viewpoint of the target user, and based on the user viewpoint and the stereoscopic image, adjust the element parameters of the optical elements corresponding to the optical system to obtain the target stereoscopic display image of the LED screen.

[0145] The present invention tracks the user viewpoint of the target user as a basis for subsequent stereo optimization, wherein the user viewpoint refers to the position and orientation of the user's eyes in three-dimensional space.

[0146] In detail, tracking the user viewpoint of the target user includes:

[0147] Using a preset camera system to capture the head movement image of the target user;

[0148] Identifying image feature points of the head motion image;

[0149] Identify the feature point displacement and rotation angle of the image feature point;

[0150] Based on the feature point displacement and the rotation angle, the head motion vector of the target user is calculated using the following formula:

[0151]

[0152] in, represents the target user's head motion vector, x ω -x ω-1 Indicates the displacement of the image feature point on the x-axis, y ω Indicates the position of the image feature point in the ωth frame on the x-axis, x ω-1 Indicates the position of the image feature point in the ω-1 frame on the x-axis, y ω -y ω-1 Represents the displacement of the image feature point on the y-axis, y ωIndicates the position of the image feature point on the y-axis in the ωth frame, y ω-1 Indicates the position of the image feature point in the ω-1 frame on the y-axis, Represents the rotation angle of the image feature point on the x-axis, Indicates the rotation angle of the image feature point on the y-axis, Indicates the rotation angle of the image feature point on the z-axis;

[0153] Determining a head movement trajectory of the target user based on the head movement vector;

[0154] Analyzing the head posture of the target user based on the head movement trajectory;

[0155] The user viewpoint of the target user is determined through the head posture.

[0156] The head motion image refers to a sequence of images captured by the camera system that contains the target user's head motion information. The image feature points refer to key points identified in the head motion image, which are used to track the movement of the head. Feature points are usually located in important parts of the head, such as the eyes, nose, mouth, etc. The head movement trajectory refers to the path of the feature points changing over time in continuous head motion images. By analyzing these trajectories, the translation and rotation of the head can be determined. The head posture refers to the direction and angle of the head, including the tilt angle of the head relative to the horizontal plane, the rotation angle of the head in three-dimensional space, etc. The feature point displacement refers to the change in the position of the feature point between continuous image frames. The rotation angle refers to the degree of rotation of the head in three-dimensional space. The head motion vector refers to the overall description of the head movement between continuous image frames.

[0157] Furthermore, the identifying of the image feature points of the head motion image may be performed by a feature point detection algorithm, such as Harris corner point detection, SI FT, SURF, and the like.

[0158] Furthermore, the determination of the target user's head movement trajectory based on the image feature points is mainly achieved by calculating the distance and angle change between the feature points.

[0159] The present invention adjusts the element parameters of the optical elements corresponding to the optical system based on the user's viewpoint and the stereoscopic image to obtain the target stereoscopic display image of the LED screen, which can improve the stereoscopic effect of the user viewing the image. The target stereoscopic display image refers to the final image with a sense of depth and a stereoscopic effect provided to the audience through the optical system and image processing technology in the stereoscopic display system.

[0160] In detail, based on the user viewpoint and the stereoscopic image, the component parameters of the optical elements corresponding to the optical system are adjusted to obtain the target stereoscopic display image of the LED screen by mapping the user viewpoint from the coordinate system of the camera system to the coordinate system of the optical system, analyzing the influence of the user viewpoint on the viewing angle and depth perception of the stereoscopic image, and adjusting the parameters of the optical elements, such as the focal length of the lens, the period of the grating and other parameters according to the viewpoint analysis results.

[0161] Based on the application scenario and the target user, the present invention analyzes the stereoscopic effect requirements of the LED screen to ensure that the system can meet the application scenario and the requirements of the target user; based on the microstructure and the stereoscopic effect requirements, the present invention constructs a multi-viewpoint layout of the photon film to adapt to the viewing habits and comfort of the target user; the present invention configures the optical element, the photon film and the collaborative operation network of the LED screen to provide a basis for the later modification of the stereoscopic effect; further, based on the optical system model, the present invention divides the original image of the screen into image viewpoints as the basis for the later construction of the stereoscopic image. Finally, based on the user viewpoint and the stereoscopic image, the present invention adjusts the element parameters of the optical element corresponding to the optical system to obtain the target stereoscopic display image of the LED screen, which can improve the stereoscopic effect of the user viewing the image. Therefore, the present invention can improve the three-dimensional stereoscopic optical display effect of the LED screen.

[0162] Reference Figure 2 FIG. 1 is a flow chart of a method for realizing a three-dimensional optical display of an LED screen based on a photon film according to an embodiment of the present invention. In this embodiment, the method for realizing a three-dimensional optical display of an LED screen based on a photon film includes:

[0163] Acquire application scenarios and target users of LED screens, analyze the stereoscopic effect requirements of the LED screen based on the application scenarios and the target users, identify the microstructure of a preset photon film, and construct a multi-viewpoint layout of the photon film based on the microstructure and the stereoscopic effect requirements;

[0164] Based on the multi-viewpoint layout, determine the optical elements of the LED screen, configure the collaborative operation network of the optical elements, the photonic film and the LED screen, and construct the optical system of the optical elements, the photonic film and the LED screen based on the collaborative operation network;

[0165] constructing an optical system model of the optical system;

[0166] Identify the original screen image corresponding to the LED screen, segment the original screen image into image viewpoints based on the optical system model, and construct a stereoscopic image of the original screen image based on the image viewpoints;

[0167] The user viewpoint of the target user is tracked, and based on the user viewpoint and the stereoscopic image, the element parameters of the optical element corresponding to the optical system are adjusted to obtain the target stereoscopic display image of the LED screen.

[0168] In the several embodiments provided by the present invention, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are only illustrative, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation.

[0169] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0170] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0171] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0172] Therefore, no matter from which point of view, the embodiments should be regarded as illustrative and non-restrictive, and the scope of the present invention is limited by the appended claims rather than the above description, so it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention. Any attached figure mark in the claims should not be regarded as limiting the claims involved.

[0173] In addition, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or systems stated in a system claim can also be implemented by one unit or system through software or hardware. The words first, second, etc. are used to indicate names, and do not indicate any particular order.

[0174] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. A three-dimensional optical display system based on photonic film to realize LED screen, characterized in that: The three-dimensional optical display system for realizing LED screen based on photon film includes: A multi-viewpoint layout module is used to obtain the application scenario and target user of the LED screen, analyze the stereoscopic effect requirements of the LED screen based on the application scenario and the target user, identify the microstructure of the preset photon film, and construct the multi-viewpoint layout of the photon film based on the microstructure and the stereoscopic effect requirements, wherein the multi-viewpoint layout of the photon film based on the microstructure and the stereoscopic effect requirements includes: analyzing the microstructure characteristics of the microstructure, and determining the light control capability of the microstructure based on the microstructure characteristics, wherein the light control capability includes the light propagation direction and the light focusing effect, and based on the microstructure characteristics and the light The method comprises the following steps: determining an initial multi-viewpoint layout of the photon film, calculating the layout validity of the initial multi-viewpoint layout, and constructing a multi-viewpoint layout of the photon film when the layout validity meets the preset validity threshold. The method comprises: analyzing the layout validity factor of the initial multi-viewpoint layout, wherein the layout validity factor includes parallax consistency, viewing angle coverage, stereoscopic depth perception, and viewing comfort, determining the effective factor weight of the layout effective factor, and calculating the layout validity of the initial multi-viewpoint layout based on the layout effective factor and the effective factor weight using the following formula: ρ=(DD σ *YES σ *YG σ *HH σ ) / (D+E+G+H) Where ρ represents the layout effectiveness of the initial multi-view layout, D represents the parallax consistency of the initial multi-view layout, E represents the viewing angle coverage of the initial multi-view layout, G represents the stereoscopic depth of the initial multi-view layout, H represents the viewing comfort of the initial multi-view layout, and D σ represents the weight of disparity consistency, E σ represents the weight of the viewing angle coverage, G σ Represents the weight of stereoscopic depth perception, H σ Indicates the weight of viewing comfort; An optical system construction module, used to determine the optical elements of the LED screen based on the multi-viewpoint layout, configure the collaborative operation network of the optical elements, the photonic film and the LED screen, and construct the optical system of the optical elements, the photonic film and the LED screen based on the collaborative operation network; An optical system model building module, used to build an optical system model of the optical system; A stereoscopic image construction module, used for identifying an original screen image corresponding to the LED screen, dividing the original screen image into image viewpoints based on the optical system model, and constructing a stereoscopic image of the original screen image based on the image viewpoints; The display image stereoscopic optimization module is used to track the user viewpoint of the target user, and based on the user viewpoint and the stereoscopic image, adjust the element parameters of the optical elements corresponding to the optical system to obtain the target stereoscopic display image of the LED screen.

2. The three-dimensional optical display system for realizing LED screen based on photonic film according to claim 1, characterized in that: The analyzing the stereoscopic effect requirements of the LED screen based on the application scenario and the target user includes: Collecting user expectations of the target users; Identify application scenario characteristics of the application scenario; Determining the stereoscopic effect type of the LED screen based on the user expectations and the application scenario characteristics; Analyzing the number and distribution of viewpoints of the stereoscopic effect type; Based on the stereoscopic effect type, the number of viewpoints, and the viewpoint distribution, the stereoscopic effect requirement of the LED screen is determined.

3. The three-dimensional optical display system for realizing LED screen based on photonic film according to claim 1, characterized in that: The collaborative operation network configured with the optical element, the photonic film and the LED screen includes: Analyze the collaborative working mode of the optical element, the photonic film and the LED screen; Based on the collaborative working mode, determining the connection mode and control logic of the optical element, the photonic film and the LED screen; Determine the signal transmission scheme of the optical element, the photonic film and the LED screen through the connection mode and the control logic; Based on the connection method, the control logic and the signal transmission scheme, a collaborative operation network of the optical element, the photonic film and the LED screen is configured.

4. The three-dimensional optical display system for realizing LED screen based on photonic film according to claim 1, characterized in that: The step of constructing an optical system model of the optical system comprises: determining optical system requirements for the optical system; Based on the optical system requirements, select simulation software for the optical system; By means of the simulation software, a simulation geometric model of the optical system is established; Defining a simulation scene of the simulation geometric model, and configuring simulation parameters of the simulation scene; Based on the simulation scene and the simulation parameters, simulating light propagation of the optical system; Analyzing optical performance of the optical system based on the light propagation; The optical performance is used to optimize the parameters of the simulation geometric model to obtain the optical system model.

5. The three-dimensional optical display system for realizing LED screen based on photonic film as claimed in claim 1, characterized in that: The step of segmenting the original screen image into image viewpoints based on the optical system model includes: Integrating the optical system model into a preset image processing software to obtain an integrated optical system model; Based on the integrated optical system model, determining the viewpoint direction and viewpoint position of the original image on the screen; Calculating the viewpoint disparity of the original image on the screen based on the viewpoint direction and the viewpoint position; Based on the viewpoint parallax, the screen original image is segmented into image viewpoints.

6. The three-dimensional optical display system for realizing LED screen based on photonic film as claimed in claim 5, characterized in that: The calculating the viewpoint disparity of the original image on the screen based on the viewpoint direction and the viewpoint position comprises: Based on the viewpoint direction and the viewpoint position, determining the viewpoint image distance and the viewpoint light incident angle between the original screen image and the target user; Based on the viewpoint image distance and the viewpoint light incident angle, the viewpoint parallax of the screen original image is calculated using the following formula: Among them, σ represents the viewpoint parallax of the original image on the screen, F r Indicates the viewpoint image distance between the original screen image and the left eye viewpoint of the target user, F e represents the viewpoint image distance between the original screen image and the target user's right eye viewpoint, θ r represents the incident angle of the viewpoint ray corresponding to the left eye viewpoint of the target user of the original screen image, θ e It represents the incident angle of the viewpoint light corresponding to the right eye viewpoint of the target user of the original image on the screen, and cos represents the cosine function.

7. The three-dimensional optical display system for realizing LED screen based on photonic film as claimed in claim 1, characterized in that: The tracking of the user viewpoint of the target user includes: Using a preset camera system to capture the head movement image of the target user; Identifying image feature points of the head motion image; Identify the feature point displacement and rotation angle of the image feature point; Based on the feature point displacement and the rotation angle, the head motion vector of the target user is calculated using the following formula: in, represents the target user's head motion vector, x ω -x ω-1 Represents the displacement of the image feature point on the x-axis, x ω Indicates the position of the image feature point in the ωth frame on the x-axis, x ω-1 Indicates the position of the image feature point in the ω-1 frame on the x-axis, y ω -y ω-1 Represents the displacement of the image feature point on the y-axis, y ω Indicates the position of the image feature point on the y-axis in the ωth frame, y ω-1 Indicates the position of the image feature point in the ω-1 frame on the y-axis, Represents the rotation angle of the image feature point on the x-axis, Indicates the rotation angle of the image feature point on the y-axis, Indicates the rotation angle of the image feature point on the z-axis; Determining a head movement trajectory of the target user based on the head movement vector; Analyzing the head posture of the target user based on the head movement trajectory; The user viewpoint of the target user is determined through the head posture.

8. A three-dimensional optical display method for LED screen based on photonic film, characterized in that: The method comprises: Acquire the application scenario and target user of the LED screen, analyze the stereoscopic effect requirement of the LED screen based on the application scenario and the target user, identify the microstructure of the preset photon film, and construct the multi-viewpoint layout of the photon film based on the microstructure and the stereoscopic effect requirement, wherein the multi-viewpoint layout of the photon film based on the microstructure and the stereoscopic effect requirement comprises: analyzing the microstructure characteristics of the microstructure, and determining the light control capability of the microstructure based on the microstructure characteristics, wherein the light control capability includes the light propagation direction and the light focusing effect, and based on the microstructure characteristics and the light control capability , determining the initial multi-viewpoint layout of the photon film, calculating the layout validity of the initial multi-viewpoint layout, and constructing the multi-viewpoint layout of the photon film when the layout validity meets the preset validity threshold, wherein the calculation of the layout validity of the initial multi-viewpoint layout includes: analyzing the layout validity factor of the initial multi-viewpoint layout, wherein the layout validity factor includes parallax consistency, viewing angle coverage, stereoscopic depth perception, and viewing comfort, determining the effective factor weight of the layout validity factor, and based on the layout validity factor and the effective factor weight, calculating the layout validity of the initial multi-viewpoint layout using the following formula: ρ=(DD σ *YES σ *YG σ *HH σ ) / (D+E+G+H) Where ρ represents the layout effectiveness of the initial multi-view layout, D represents the parallax consistency of the initial multi-view layout, E represents the viewing angle coverage of the initial multi-view layout, G represents the stereoscopic depth of the initial multi-view layout, H represents the viewing comfort of the initial multi-view layout, and D σ represents the weight of disparity consistency, E σ represents the weight of the viewing angle coverage, G σ Represents the weight of stereoscopic depth perception, H σ Indicates the weight of viewing comfort; Based on the multi-viewpoint layout, determine the optical elements of the LED screen, configure the collaborative operation network of the optical elements, the photonic film and the LED screen, and construct the optical system of the optical elements, the photonic film and the LED screen based on the collaborative operation network; constructing an optical system model of the optical system; Identify the original screen image corresponding to the LED screen, segment the original screen image into image viewpoints based on the optical system model, and construct a stereoscopic image of the original screen image based on the image viewpoints; The user viewpoint of the target user is tracked, and based on the user viewpoint and the stereoscopic image, the element parameters of the optical element corresponding to the optical system are adjusted to obtain the target stereoscopic display image of the LED screen.

Images