Image display method and device

Abstract

The invention discloses an image display method and device, and the method comprises the steps: obtaining a frame of image data; according to light field coding information of a light field screen and the image data, color data of pixel points corresponding to all viewpoints are generated, the light field coding information is used for indicating the corresponding relation between all the viewpoints of the light field screen and all the pixel points in the image with the target resolution, and the target resolution is the resolution of the light field screen; and displaying a three-dimensional image formed by the color data of the pixel points corresponding to the plurality of viewpoints on the light field screen.

Description

Technical Field

[0001] The present application relates to the field of image display technology, and in particular to an image display method and device. Background Art

[0002] The light field screen is a new type of display based on light field display technology. Through the light field screen, the device can display images with three-dimensional visual effects to users, providing users with a more realistic visual experience.

[0003] A light field screen generally corresponds to multiple viewpoints, for example, 50 viewpoints. In related technologies, when an electronic device uses a light field screen to display an image, it needs to generate an image corresponding to each viewpoint, and then obtain a three-dimensional image that can be displayed on the light field screen based on the image encoding of multiple viewpoints.

[0004] Light field screens generally have a higher resolution (e.g. 8K resolution). Some solutions generate low-resolution images for each viewpoint, and then encode the low-resolution images to obtain high-resolution images for display on the light field screen. This solution has the problem of low clarity of the encoded images. Summary of the invention

[0005] To this end, this application discloses the following technical solutions:

[0006] The first aspect of the present application provides an image display method, comprising:

[0007] Obtain a frame of image data;

[0008] Generate color data of a pixel corresponding to each viewpoint according to light field coding information of the light field screen and the image data, wherein the light field coding information is used to indicate a correspondence between each viewpoint of the light field screen and each pixel in an image of a target resolution, and the target resolution is a resolution of the light field screen;

[0009] A three-dimensional image composed of color data of pixel points corresponding to the plurality of viewpoints is displayed on the light field screen.

[0010] Optionally, generating color data of a pixel corresponding to each viewpoint according to the light field coding information of the light field screen and the image data includes:

[0011] Perform three-dimensional reconstruction according to the image data to obtain three-dimensional representation information corresponding to the image data;

[0012] Color data of a pixel point corresponding to each viewpoint is generated according to the light field coding information of the light field screen and the three-dimensional representation information.

[0013] Optionally, the three-dimensional representation information includes Gaussian three-dimensional representation information obtained by performing Gaussian three-dimensional reconstruction processing on the image data.

[0014] Optionally, generating color data of a pixel corresponding to each viewpoint according to the light field coding information of the light field screen and the three-dimensional representation information includes:

[0015] For each viewpoint of the light field screen, Gaussian splashing processing is performed on the pixel points corresponding to the viewpoint according to the light field coding information of the light field screen and the three-dimensional representation information to obtain color data of the pixel points corresponding to the viewpoint.

[0016] Optionally, generating color data of a pixel corresponding to each viewpoint according to the light field coding information of the light field screen and the three-dimensional representation information includes:

[0017] creating a blank image having the target resolution;

[0018] Dividing the blank image into a plurality of blocks;

[0019] Color data of a pixel point corresponding to each viewpoint in each of the blocks is generated in parallel according to the light field coding information of the light field screen and the three-dimensional representation information.

[0020] Optionally, also include:

[0021] Obtaining optical parameters, inclination angle, number of lines and number of viewpoints of the light field screen;

[0022] The light field coding information of the light field screen is determined according to the optical parameters, inclination angle, number of lines and number of viewpoints of the light field screen.

[0023] Optionally, each of the pixel points includes multiple color channels, and the light field encoding information is used to indicate the corresponding relationship between each viewpoint of the light field screen and the color channel of the pixel point.

[0024] Optionally, obtaining a frame of image data includes:

[0025] A target object for displaying on the light field screen is scanned to obtain a frame of image data.

[0026] Optionally, scanning the target object for display on the light field screen to obtain a frame of image data includes:

[0027] The target object to be displayed on the light field screen is scanned from multiple viewing angles to obtain a frame of image data.

[0028] A second aspect of the present application provides an electronic device, including a processor and a light field screen;

[0029] The processor is used to:

[0030] Obtain a frame of image data;

[0031] generating color data of a pixel corresponding to each viewpoint according to light field coding information of the light field screen and the image data, wherein the light field coding information is used to indicate a correspondence between each viewpoint of the light field screen and each pixel in an image of a target resolution, and the target resolution is a resolution of the light field screen;

[0032] A three-dimensional image composed of color data of pixel points corresponding to the plurality of viewpoints is displayed on the light field screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0034] Figure 1 is a flow chart of an image display method provided by an embodiment of the present application;

[0035] Figure 2 is a flow chart of another image display method provided by an embodiment of the present application;

[0036] Figure 3 This is a flow chart of generating color data for each pixel provided by an embodiment of the present application;

[0037] Figure 4 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0039] The present application embodiment provides an image display method, see Figure 1 , is a flow chart of the method, and the method may include the following steps.

[0040] S101, obtaining a frame of image data.

[0041] In step S101, a frame of image data may be obtained in a variety of ways.

[0042] For example, a frame of image data may be obtained by photographing with a photographing device, or a frame of image data may be generated by an image generation technology.

[0043] Alternatively, the target object to be displayed on the light field screen may be scanned to obtain a frame of image data.

[0044] The scanned target object can be a physical person or object, or a virtual three-dimensional model.

[0045] There may be one or more target objects to be scanned. If multiple target objects need to be displayed on the light field screen, multiple target objects may be scanned simultaneously, and the obtained scanning results are used as a frame of image data.

[0046] Optionally, the target object can be scanned in the following ways:

[0047] The target object for display on the light field screen is scanned from multiple viewing angles to obtain a frame of image data.

[0048] In the above scanning method, the scanning device (such as a camera) corresponding to each viewing angle can be determined first, and then multiple scanning devices are used to scan the target object simultaneously. The set of data scanned by the multiple scanning devices is used as a frame of image data in step S101.

[0049] A frame of image data obtained through multi-view scanning can more comprehensively reflect the appearance of the target object, so a three-dimensional image that is closer to the appearance of the target object can be obtained based on the one frame of image data.

[0050] The method of this embodiment can be continuously executed at certain time intervals during display using a light field screen, that is, after each certain time interval, a frame of image data can be obtained through S101, and a frame of three-dimensional image can be obtained based on the frame of image data through subsequent steps of this embodiment and the frame of three-dimensional image can be displayed on the light field screen.

[0051] Optionally, before executing S101 for the first time, light field coding information corresponding to the light field screen may be obtained by the following steps:

[0052] Obtain the optical parameters, inclination angle, number of lines and number of viewpoints of the light field screen;

[0053] The light field coding information of the light field screen is determined according to the optical parameters, inclination angle, number of lines and number of viewpoints of the light field screen.

[0054] Among them, optical parameters, inclination angle, number of lines and number of viewpoints are inherent properties of the light field screen and can be directly obtained from the configuration information corresponding to the light field screen.

[0055] The method of determining the light field coding information may refer to the relevant technology in the field of light field screens, which will not be described in detail in this embodiment.

[0056] The optical parameters, inclination angle, number of lines and number of viewpoints of a light field screen are generally fixed. Therefore, for a light field screen, the above step of obtaining light field coding information can be performed only once, and the obtained light field coding information can be stored in various memories. Each time a frame of three-dimensional image for display on the light field screen is obtained by the method of this embodiment, the method of this embodiment can be directly performed according to the obtained light field coding information of the light field screen.

[0057] S102, generating color data of a pixel corresponding to each viewpoint according to light field coding information and image data of the light field screen, wherein the light field coding information is used to indicate a correspondence between each viewpoint of the light field screen and each pixel in an image of a target resolution, and the target resolution is a resolution of the light field screen.

[0058] See also Figure 2 In step S102, three-dimensional reconstruction can be performed based on the image data to obtain three-dimensional representation information corresponding to the image data; then color data of the pixel points corresponding to each viewpoint can be generated based on the light field coding information and the three-dimensional representation information of the light field screen. Figure 2 The shaded square corresponding to each viewpoint in represents the pixel corresponding to the viewpoint in the image of the target resolution.

[0059] The process of three-dimensional reconstruction of image data can be performed by any data processing model with three-dimensional reconstruction capability (i.e. Figure 2 The reconstruction model can be a neural network model, a deep learning model, or other models that can be used for three-dimensional reconstruction based on relevant technologies.

[0060] In some optional embodiments, such as Figure 2 As shown, the three-dimensional representation information may include Gaussian three-dimensional representation information obtained by performing Gaussian three-dimensional reconstruction processing on image data.

[0061] Gaussian three-dimensional representation information may include multiple Gaussian feature points (also referred to as Gaussian points), each of which may be represented by a set of parameters (X, c, r, s, α), wherein X represents the position of the Gaussian point, c represents the color of the Gaussian point, r represents the rotation parameter of the Gaussian point, s represents the scaling parameter of the Gaussian point, and α represents the opacity of the Gaussian point.

[0062] The manner of performing Gaussian 3D reconstruction processing on the image data may refer to relevant technologies in the field of Gaussian 3D reconstruction, which will not be described in detail in this embodiment.

[0063] When the 3D representation information is Gaussian 3D representation information, for any viewpoint, Gaussian splatting can be performed on the Gaussian 3D representation information based on the viewpoint to obtain color data of the pixel corresponding to the viewpoint. The implementation of Gaussian splatting can refer to the relevant technology and will not be described in detail.

[0064] In this embodiment, the correspondence between the viewpoint and the pixel indicated by the light field coding information can represent whether the pixel in the image of the target resolution corresponding to the viewpoint will be used for coding to obtain a three-dimensional image of the light field screen.

[0065] Taking the light field screen with a resolution of 7680*4320 as an example, if the light field coding information of the light field screen indicates that 5 rows and 6 columns of pixels in an image with a resolution of 7680*4320 correspond to viewpoint 8, it means that the color data (e.g., RGB data) of 5 rows and 6 columns of pixels in the image with a resolution of 7680*4320 corresponding to viewpoint 8 of the light field screen will be used to encode to obtain a three-dimensional image of the light field screen.

[0066] In the related technical field, in order to obtain a high-definition image for display on a light field screen, one solution is to generate, for each viewpoint of the light field screen, an image corresponding to the viewpoint and having a resolution consistent with the resolution of the light field screen, and then obtain a three-dimensional image of the light field screen based on image encoding of multiple viewpoints.

[0067] For example, assuming that the resolution of the light field screen is 8K (i.e., 7680*4320) and the number of viewpoints is 50, an 8K resolution image corresponding to each viewpoint is generated, thereby obtaining 50 frames of 8K resolution images, and then a frame of three-dimensional image of the light field screen is obtained based on the color data encoding of each pixel in these 50 frames of 8K resolution images.

[0068] It can be seen that for each frame of 3D image obtained by the above scheme, it is necessary to generate multiple frames of high-resolution image data corresponding to multiple viewpoints. At 8K resolution, 7680*4320 pixels of color data need to be generated for each viewpoint, which consumes a lot of computing resources.

[0069] In this embodiment, after research, it is found that when encoding a frame of a light field screen 3D image, only the color data of a part of the pixels in the image corresponding to each viewpoint is used to encode to form the 3D image, and the color data of other pixels will be directly ignored.

[0070] Based on the above situation, when the color data of the pixel points corresponding to each viewpoint is generated in step S102, it can be determined according to the light field coding information which pixels in the image with the target resolution corresponding to the viewpoint will be used to encode to obtain a three-dimensional image and which pixels will not be used to encode to obtain a three-dimensional image. Thus, only the color data of the pixel points corresponding to each viewpoint that will be used to encode to obtain a three-dimensional image can be generated, and the color data of the remaining pixel points will not be generated.

[0071] For example, assuming that in the image of the target resolution corresponding to viewpoint 4, only the color data of 4% of the pixels will be used to encode the three-dimensional image, then in S102, only the color data of the 4% of the pixels corresponding to viewpoint 4 may be generated, and the color data of the remaining 96% of the pixels that are not used to encode the three-dimensional image will not be generated.

[0072] Optionally, in the image with the target resolution corresponding to the viewpoint, each pixel may include multiple color channels, for example, may include three color channels of red (R), green (G) and blue (B). Correspondingly, the light field encoding information can be specifically used to indicate the correspondence between the color channels of each viewpoint and pixel of the light field screen.

[0073] Among them, if a viewpoint corresponds to one or more color channels of a pixel in an image of a target resolution, it means that in the image of the target resolution corresponding to the viewpoint, the data of the pixel on these color channels will be used to encode a three-dimensional image of the light field screen.

[0074] Taking the light field screen with a resolution of 7680*4320 as an example, if the light field coding information of the light field screen indicates that the R channel and G channel of the pixels in 5 rows and 6 columns in the image with a resolution of 7680*4320 both correspond to viewpoint 8, it means that in the image with a resolution of 7680*4320 corresponding to viewpoint 8 of the light field screen, the color data of the pixels in 5 rows and 6 columns on the R channel (that is, the R value in the RGB value of the pixel) and the color data of the pixel on the G channel (that is, the G value in the RGB value of the pixel) will be used to encode the three-dimensional image of the light field screen.

[0075] For any viewpoint, one way to generate color data of pixels corresponding to the viewpoint is to generate all color data of the pixel corresponding to the viewpoint for each pixel as long as the pixel has one or more color channels corresponding to the viewpoint.

[0076] Combination Figure 2For example, assuming that the R channel of the pixel point P corresponds to the viewpoint 1, and the G channel and the B channel of the pixel point P correspond to the viewpoint 2, then in S102, the RGB value of the pixel point P corresponding to the viewpoint 1 can be generated based on the viewpoint 1 and the three-dimensional representation information, and the RGB value of the pixel point P corresponding to the viewpoint 2 can be generated based on the viewpoint 2 and the three-dimensional representation information. When obtaining the three-dimensional image, the R value of the RGB value of the pixel point P corresponding to the viewpoint 1 and the G value and the B value of the RGB value of the pixel point P corresponding to the viewpoint 2 can be used to encode the three-dimensional image of the light field screen.

[0077] Another way to generate the color data of the pixel points corresponding to the viewpoint is to generate, for each pixel point, only the color data of the pixel point on the color channel corresponding to the viewpoint, and the color data on other color channels not corresponding to the viewpoint may not be generated.

[0078] In combination with the above example, assuming that the R channel of the pixel points in 5 rows and 6 columns corresponds to viewpoint 8, only the R value of the pixel points in 5 rows and 6 columns corresponding to viewpoint 8 is generated, and the G value and B value of the pixel points corresponding to viewpoint 8 may not be generated.

[0079] The advantage of generating color data in the latter manner is that the amount of calculation in the process of obtaining a frame of three-dimensional image can be further reduced, thereby reducing the consumed computing resources.

[0080] The light field encoding information can be represented in various forms. As an example, the light field encoding information can be a matrix corresponding to a size and a target resolution, each element in the matrix corresponds one-to-one to each pixel in the image of the target resolution, each element of the matrix can be an N-dimensional array, N can be the number of color channels contained in the pixel, each parameter of the N-dimensional array corresponds to a color channel of the pixel, and the value of each parameter of the N-dimensional array can represent the number of the viewpoint corresponding to the color channel of the pixel.

[0081] As an example, the resolution of the light field screen may be 8K, each pixel may contain three color channels of R, G, and B, and the number of viewpoints of the light field screen may be 50, numbered from viewpoint 1 to viewpoint 50. In this example, the light field encoding information may be a 7680*4320 matrix, each element in the matrix may be a three-dimensional array, and the three parameters in the array correspond to the three color channels of R, G, and B, assuming that the elements of 5 rows and 6 columns in the matrix are (8, 8, 15), indicating that in the image of the target resolution corresponding to viewpoint 8, the R values ​​and G values ​​of the pixels of 5 rows and 6 columns will be used to encode the three-dimensional image of the light field screen, and in the image of the target resolution corresponding to viewpoint 15, the B values ​​of the pixels of 5 rows and 6 columns will be used to encode the three-dimensional image of the light field screen.

[0082] S103, displaying a three-dimensional image composed of color data of pixel points corresponding to multiple viewpoints on a light field screen.

[0083] In this embodiment, a frame of a 3D image for display on a light field screen may have a resolution consistent with that of the light field screen. Taking a light field screen with an 8K resolution as an example, a frame of a 3D image including 7680*4320 pixels may be displayed in step S103.

[0084] Each pixel in a three-dimensional image may include multiple color channels, for example, may include three color channels of red (R), green (G) and blue (B).

[0085] The method of displaying a three-dimensional image based on the color data of the pixel points corresponding to multiple viewpoints may be:

[0086] For each pixel corresponding to each viewpoint, the target color channel corresponding to the pixel is determined according to the light field coding information, and then the color data of the pixel on the target color channel is assigned to the corresponding color channel of the pixel at the corresponding position in the three-dimensional image. After traversing each viewpoint of the light field screen and each pixel corresponding to the viewpoint in this way, a frame of image data corresponding to the three-dimensional image can be obtained, and the frame of image data is provided to the light field screen, so that the corresponding frame of three-dimensional image can be displayed on the light field screen.

[0087] The target color channel corresponding to the pixel refers to the color channels used to encode the three-dimensional image among the multiple color channels of the pixel. In combination with the above example, the light field encoding information indicates that the R channel and the G channel of the pixel points of 5 rows and 6 columns corresponding to the viewpoint 8 will be used to encode the three-dimensional image of the light field screen, then the target color channels of the pixel points of 5 rows and 6 columns corresponding to the viewpoint 8 include the R channel and the G channel.

[0088] In this embodiment, a blank image for accommodating image data corresponding to a three-dimensional image may be created in advance, and the blank image may include a number of pixels corresponding to the resolution of the light field screen, for example, for an 8K light field screen, it may include 7680*4320 pixels. The color data of each pixel in the blank image on each color channel may be an initial value, for example, the RGB value of each pixel is (255, 255, 255).

[0089] Then, the color data of the pixel points corresponding to each viewpoint on the target color channel can be assigned to the pixel points of the blank image in the above manner.

[0090] In combination with the foregoing example, assuming that the light field coding information indicates that the target color channels of the pixels in the 5 rows and 6 columns corresponding to viewpoint 8 include the R channel and the G channel, and the target color channels of the pixels in the 5 rows and 6 columns corresponding to viewpoint 15 include the B channel, and the RGB values ​​of the pixels in the 5 rows and 6 columns corresponding to viewpoint 8 generated by executing step S102 are (10, 100, 150), and the RGB values ​​of the pixels in the 5 rows and 6 columns corresponding to viewpoint 15 are (200, 84, 39), then in S103, the color data 10 on the R channel and the color data 100 on the G channel of the pixels in the 5 rows and 6 columns corresponding to viewpoint 8 can be assigned to the R channel and G channel of the pixels in the 5 rows and 6 columns in the blank image, and the color data 39 on the B channel of the pixels in the 5 rows and 6 columns corresponding to viewpoint 15 are assigned to the B channel of the pixels in the 5 rows and 6 columns in the blank image. After the assignment, the RGB values ​​of the pixels in the 5 rows and 6 columns in the blank image are (10, 100, 39).

[0091] Each pixel corresponding to each viewpoint is assigned a value in the above manner, that is, each pixel in the blank image is assigned a value on each color channel. After all the assignments are completed, the color data of 7680*4320 pixels contained in the blank image is a frame of image data corresponding to the three-dimensional image to be displayed.

[0092] The beneficial effects of this embodiment are:

[0093] When generating images of target resolutions corresponding to each viewpoint based on a frame of input image data, a complete image is no longer generated. Instead, based on the light field coding information, only the color data of a portion of pixel points in the image of the target resolution corresponding to the viewpoint that will be used to encode the three-dimensional image is generated, and the color data of pixel points that are not used for encoding is not generated. In this way, it is possible to obtain a high-definition three-dimensional image by encoding images of target resolutions corresponding to multiple viewpoints, and to significantly reduce the amount of calculation required to generate images of target resolutions corresponding to multiple viewpoints, thereby reducing the consumption of computing resources.

[0094] In some optional embodiments, in order to improve the efficiency of generating color data, parallel processing can be performed as follows.

[0095] Create a blank image with the target resolution;

[0096] Divide the blank image into multiple blocks;

[0097] According to the light field coding information and the three-dimensional representation information of the light field screen, the color data of the pixel points corresponding to each viewpoint in each block are generated in parallel.

[0098] In the above embodiment, the electronic device for generating color data may create a corresponding thread for each block, and process the corresponding multiple blocks in parallel through multiple threads, thereby shortening the time required to generate all color data for encoding a three-dimensional image.

[0099] See also Figure 3 , for any block (referred to as the current block), the thread can generate the color data corresponding to the pixels in the block as follows.

[0100] S1, determine the current viewpoint.

[0101] The thread can arbitrarily select an unselected viewpoint as the current viewpoint. After traversing all pixels in the block in accordance with steps S2 to S4 each time, the thread can execute step S1 again and select a new viewpoint as the current viewpoint, and so on, until each viewpoint has been selected once.

[0102] S2, select an unselected pixel in the current block.

[0103] In step S2, the thread may start from any vertex of the current block and select each pixel point in the block one by one according to the rule of increasing or decreasing coordinates. Each time a pixel point is selected, step S3 is executed for the selected pixel point.

[0104] S3, determining whether the selected pixel point is a pixel point corresponding to the current viewpoint.

[0105] If the selected pixel point is the pixel point corresponding to the current viewpoint, execute step S4; if the selected pixel point is not the pixel point corresponding to the current viewpoint, return to execute step S2 to select a new pixel point.

[0106] The thread may execute S3 based on the light field encoding information.

[0107] For each selected pixel, if at least one color channel of the pixel corresponds to the current viewpoint based on the light field coding information, then it can be determined that the pixel is the pixel corresponding to the current viewpoint; if each color channel of the pixel does not correspond to the current viewpoint, then it can be determined that the pixel is not the pixel corresponding to the current viewpoint.

[0108] In combination with the above example, assuming that the element of 5 rows and 6 columns in the light field coding information is (8, 8, 15), the current viewpoint is viewpoint 7 of the light field screen, and the pixel point selected by the thread is the pixel point of 5 rows and 6 columns in the image with the target resolution. Based on the light field coding information, it can be seen that each color channel of the pixel point does not correspond to viewpoint 7, so it can be determined that the pixel point is not the pixel point corresponding to viewpoint 7, so the color data of the pixel point can be generated not based on viewpoint 7;

[0109] If the current viewpoint is viewpoint 8, based on the light field encoding information, it can be seen that the R channel and the G channel of the pixel point correspond to viewpoint 8, so it is determined that the pixel point is the pixel point corresponding to the current viewpoint. At this time, step S4 can be executed on the pixel point, and Gaussian splash processing is performed on the pixel point based on the three-dimensional representation information and the viewpoint 8 of the light field screen to generate color data of 5 rows and 6 columns of pixels corresponding to viewpoint 8.

[0110] S4, performing Gaussian splash processing on the selected pixel points according to the three-dimensional representation information and the current viewpoint to generate color data corresponding to the selected pixel points.

[0111] After step S4 is executed, the thread can return to execute step S2 until every pixel in the block is traversed.

[0112] It can be seen that after processing each pixel in the block in the above manner, the thread can execute S1 again, determine a new current viewpoint, and then continue to process the pixels in the block in the above manner, and so on, until the thread traverses each viewpoint corresponding to the light field screen.

[0113] Taking the light field screen corresponding to 50 viewpoints as an example, the thread can first determine viewpoint 1 as the current viewpoint, and execute steps S2 to S4 based on viewpoint 1. After traversing each pixel in the block based on viewpoint 1, viewpoint 2 is determined as the current viewpoint, and steps S2 to S4 are executed based on viewpoint 2. Then viewpoint 3 is determined as the current viewpoint, and steps S2 to S4 are executed based on viewpoint 3, and so on, until viewpoint 50 is determined as the current viewpoint. After traversing each pixel in the block based on viewpoint 50, the processing process of the thread ends.

[0114] Optionally, in order to further improve efficiency, each time the thread generates color data corresponding to a pixel, the color data of the pixel on the target color channel can be immediately assigned to the corresponding color channel of the pixel at the corresponding position in the blank image in the manner of step S103. In this way, after all threads are processed, a frame of image data corresponding to the three-dimensional image can be obtained.

[0115] Further optionally, if computing resources permit, a thread can be created for each block and each viewpoint, that is, one thread corresponds to a specific block and to a specific viewpoint, and the thread can be used to generate color data of pixel points corresponding to a specific viewpoint in the specific block in the manner of steps S2 to S4 described above, and multiple threads are used to generate color data of pixel points corresponding to each viewpoint in each block in parallel.

[0116] The present application embodiment provides an electronic device, see Figure 4 , the electronic device may include a processor 401 and a light field screen 402;

[0117] The processor 401 is used for:

[0118] Obtain a frame of image data;

[0119] Generate color data of a pixel corresponding to each viewpoint according to the light field coding information and the image data of the light field screen 402, wherein the light field coding information is used to indicate the correspondence between each viewpoint of the light field screen and each pixel in the image of the target resolution, and the target resolution is the resolution of the light field screen;

[0120] A three-dimensional image composed of color data of pixel points corresponding to multiple viewpoints is displayed on the light field screen.

[0121] Optionally, when the processor 401 generates color data of a pixel point corresponding to each viewpoint according to the light field coding information and image data of the light field screen, it can be used to:

[0122] Perform three-dimensional reconstruction based on the image data to obtain three-dimensional representation information corresponding to the image data;

[0123] The color data of the pixel points corresponding to each viewpoint is generated according to the light field coding information and the three-dimensional representation information of the light field screen.

[0124] Optionally, the three-dimensional representation information includes Gaussian three-dimensional representation information obtained by performing Gaussian three-dimensional reconstruction processing on the image data.

[0125] Optionally, when the processor 401 generates color data of a pixel point corresponding to each viewpoint according to the light field coding information and the three-dimensional representation information of the light field screen, it can be used to:

[0126] For each viewpoint of the light field screen, Gaussian splash processing is performed on the pixel points corresponding to the viewpoint according to the light field coding information and three-dimensional representation information of the light field screen to obtain color data of the pixel points corresponding to the viewpoint.

[0127] Optionally, when the processor 401 generates color data of a pixel point corresponding to each viewpoint according to the light field coding information and the three-dimensional representation information of the light field screen, it can be used to:

[0128] Create a blank image with the target resolution;

[0129] Divide the blank image into multiple blocks;

[0130] According to the light field coding information and the three-dimensional representation information of the light field screen, the color data of the pixel points corresponding to each viewpoint in each block are generated in parallel.

[0131] Optionally, the processor 401 may also be configured to:

[0132] Obtain the optical parameters, inclination angle, number of lines and number of viewpoints of the light field screen;

[0133] The light field coding information of the light field screen is determined according to the optical parameters, inclination angle, number of lines and number of viewpoints of the light field screen.

[0134] Optionally, each pixel includes multiple color channels, and the light field coding information is used to indicate the correspondence between each viewpoint of the light field screen and the color channel of the pixel.

[0135] Optionally, when the processor 401 obtains a frame of image data, it can be used to:

[0136] A target object for displaying on a light field screen is scanned to obtain a frame of image data.

[0137] Optionally, when the processor 401 scans the target object for display on the light field screen to obtain a frame of image data, it can be used to:

[0138] The target object for display on the light field screen is scanned from multiple viewing angles to obtain a frame of image data.

[0139] The working principle of the image display device of this embodiment can refer to the relevant steps of the image display method provided in any embodiment of the present application, and will not be repeated here.

[0140] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0141] For the convenience of description, the above system or device is described by dividing it into various modules or units according to its functions. Of course, when implementing this application, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0142] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0143] Finally, it should be noted that, in this article, relational terms such as first, second, third and fourth are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0144] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. An image display method, comprising: Obtain a frame of image data; Generate color data of a pixel corresponding to each viewpoint according to light field coding information of the light field screen and the image data, wherein the light field coding information is used to indicate a correspondence between each viewpoint of the light field screen and each pixel in an image of a target resolution, and the target resolution is a resolution of the light field screen; A three-dimensional image composed of color data of pixel points corresponding to the plurality of viewpoints is displayed on the light field screen.

2. The method according to claim 1, wherein generating color data of a pixel corresponding to each viewpoint according to light field coding information of the light field screen and the image data comprises: Perform three-dimensional reconstruction according to the image data to obtain three-dimensional representation information corresponding to the image data; Color data of a pixel point corresponding to each viewpoint is generated according to the light field coding information of the light field screen and the three-dimensional representation information.

3. According to the method of claim 2, the three-dimensional characterization information includes Gaussian three-dimensional characterization information obtained by performing Gaussian three-dimensional reconstruction processing on the image data.

4. The method according to claim 3, wherein generating color data of a pixel corresponding to each viewpoint according to the light field coding information of the light field screen and the three-dimensional representation information comprises: For each viewpoint of the light field screen, Gaussian splashing processing is performed on the pixel points corresponding to the viewpoint according to the light field coding information of the light field screen and the three-dimensional representation information to obtain color data of the pixel points corresponding to the viewpoint.

5. The method according to claim 2, wherein generating color data of a pixel corresponding to each viewpoint according to the light field coding information of the light field screen and the three-dimensional representation information comprises: creating a blank image having the target resolution; Dividing the blank image into a plurality of blocks; Color data of a pixel point corresponding to each viewpoint in each of the blocks is generated in parallel according to the light field coding information of the light field screen and the three-dimensional representation information.

6. The method according to claim 1, further comprising: Obtaining optical parameters, inclination angle, number of lines and number of viewpoints of the light field screen; The light field coding information of the light field screen is determined according to the optical parameters, inclination angle, number of lines and number of viewpoints of the light field screen.

7. The method according to claim 1, wherein each of the pixel points comprises a plurality of color channels, and the light field encoding information is used to indicate a correspondence between each viewpoint of the light field screen and the color channel of the pixel point.

8. The method according to claim 1, wherein obtaining a frame of image data comprises: A target object for displaying on the light field screen is scanned to obtain a frame of image data.

9. The method according to claim 8, wherein scanning the target object for display on the light field screen to obtain a frame of image data comprises: The target object to be displayed on the light field screen is scanned from multiple viewing angles to obtain a frame of image data.

10. An electronic device comprising a processor and a light field screen; The processor is used to: Obtain a frame of image data; generating color data of a pixel corresponding to each viewpoint according to light field coding information of the light field screen and the image data, wherein the light field coding information is used to indicate a correspondence between each viewpoint of the light field screen and each pixel in an image of a target resolution, and the target resolution is a resolution of the light field screen; A three-dimensional image composed of color data of pixel points corresponding to the plurality of viewpoints is displayed on the light field screen.

Images