Processing method and system for display image of curved display screen

Abstract

The present invention provides a method and system for processing a display image of a curved display screen, the method comprising: dividing an image to be processed into N sub-images; obtaining an index relationship between the point coordinates in a target image to be generated and the pixel points on the sub-images; optimizing the RGBA values ​​of the sub-images according to the index relationship, and generating the RGBA values ​​of the corresponding point coordinates of the target image according to the optimized RGBA values; generating a target image according to the RGBA values ​​of the point coordinates of the target image; splicing the target images to generate a frame of image to be displayed. The present invention searches for the position (floating point number) of the original pixel point through the position of the target image, so that the RGBA values ​​of the point coordinates of the new target image can be generated according to the floating point number, without causing the target image to be jagged or torn, that is, the 2D image to be processed can be quickly sphericalized to generate a clear new image that can be played and displayed on a curved display screen.

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and in particular to a method for processing a display image of a curved display screen and a system for processing a display image of a curved display screen. Background Art

[0002] With the advancement of science and technology, projection technology has developed rapidly, and more and more people are beginning to pursue 3D (three-dimensional) and 4D (four-dimensional) works and enjoy the benefits brought by virtual reality technology. Recently, curved display technology has developed rapidly, from curved projection to curved display, which undoubtedly shows the development of science and technology.

[0003] At present, the algorithms used for displaying on curved displays are mostly to directly attach a two-dimensional image to the surface of an object model, and then obtain a new three-dimensional image through model transformation and engine rendering. This method not only requires a complex rendering engine, but also directly transfers pixels from a two-dimensional image to a three-dimensional image. The pixel of an image is a floating point number. If this point is directly transferred, the relationship between the pixels will be erased, and there will be no correlation between each pixel in the generated image, resulting in a high degree of jaggedness and tearing in the generated image, and the generated image will also be very sharp. Summary of the invention

[0004] In order to solve the above technical problems, the first aspect of the present invention provides a method for processing a display image of a curved display screen.

[0005] A second embodiment of the present invention provides a system for processing displayed images on a curved display screen.

[0006] The technical solution adopted by the present invention is as follows:

[0007] The first aspect of the present invention provides a method for processing a display image of a curved display screen, comprising: dividing an image to be processed into N sub-images, where N is a positive integer, and when N=1, it indicates that the image is not divided and is processed as a whole image; obtaining an index relationship between a point coordinate in a target image to be generated and a pixel point on the sub-image; optimizing an RGBA (Red-Green-Blue-Alpha) value of the sub-image according to the index relationship between the point coordinate in the target image to be generated and the pixel point on the sub-image, and generating an RGBA value of a corresponding point coordinate of the target image to be generated according to the optimized RGBA value; generating a target image according to the RGBA value of the point coordinate of the target image to be generated; and splicing the target images to generate a frame of image to be displayed for display on the curved display screen.

[0008] The method for processing the displayed image of the curved display screen of the present invention also has the following additional technical features:

[0009] Obtaining the index relationship between the point coordinates in the target image to be generated and the pixel points on the sub-image, specifically includes: normalizing each pixel point P(x, y) of the sub-image; uniformly mapping the pixel points on the normalized sub-image to the surface of the unit spherical shell to obtain the mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell; mapping the point coordinates P"(i, j) in the target image to be generated to the surface of the unit spherical shell to obtain the mapping relationship between the point coordinates P"(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell; according to the mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell, and the mapping relationship between the point coordinates P"(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell, obtaining the index relationship between the point coordinates P"(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image.

[0010] According to one embodiment of the present invention, the RGBA value of the sub-image is optimized according to the index relationship between the point coordinates P" (i, j) in the target image to be generated and the pixel point P (x, y) on the sub-image, and the RGBA value of the corresponding point coordinate of the target image to be generated is generated according to the optimized RGBA value, which specifically includes: reading the RGBA value of each pixel point of the sub-image; calculating the weight vector w of the dynamic Gaussian convolution kernel using a two-dimensional Gaussian distribution according to the index relationship between the point coordinates P" (i, j) in the target image to be generated and the pixel point P (x, y) on the sub-image, and normalizing it; performing a convolution operation on the RGBA value of the corresponding pixel point of the sub-image according to the weight vector w of the Gaussian convolution kernel to generate the RGBA value of the corresponding point coordinate of the target image to be generated.

[0011] According to one embodiment of the present invention, the above-mentioned method for processing a display image of a curved display screen further includes: using TOPSIS to normalize the RGBA values ​​of the corresponding point coordinates of the target image to be generated, and using a sigmoid activation function to perform image enhancement on the sub-image.

[0012] According to one embodiment of the present invention, the weight vector w of the dynamic Gaussian convolution kernel is calculated and normalized using the following formula:

[0013]

[0014]

[0015] Among them, s is the number of rows in the convolution kernel corresponding to the weight of the sub-image, t is the number of columns in the convolution kernel corresponding to the weight of the sub-image, σ is the standard deviation of the normal distribution, x is the floating point number corresponding to the number of rows where the pixel point is located on the sub-image, y is the floating point number corresponding to the number of columns where the pixel point is located on the sub-image, C is the convolution kernel, w [s,t] is the weight vector corresponding to the s-th row and t-th column of the sub-image, and pi is the pi.

[0016] According to one embodiment of the present invention, the mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell is obtained by the following formula: (α1, β1) = (j / m*K, i / n*K); P' (x, y, z) = P' (sinα1cosβ1, cosα1, sinα1sinβ1); wherein, i represents the row corresponding to the point coordinates P" (i, j) in the target image to be generated, j represents the column corresponding to the point coordinates P" (i, j) in the target image to be generated, P' (x, y, z) represents the three-dimensional coordinates on the unit spherical shell, m represents the width of the target image to be generated, n represents the height of the target image to be generated, and K represents the circumference of the curved display screen.

[0017] According to one embodiment of the present invention, the mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell is obtained by the following formula:

[0018] P'(x,y,

[0019] Among them, α2 is the latitude angle of the curved display screen corresponding to the point coordinate P" (i, j) in the target image to be generated, β2 is the longitude angle of the curved display screen corresponding to the point coordinate P" (i, j) in the target image to be generated, and P' (x, y, z) represents the three-dimensional coordinates on the unit spherical shell.

[0020] According to an embodiment of the present invention, the curved display screen includes an internal display screen and an external display screen. A second aspect of the present invention provides a processing system for displaying images on a curved display screen, comprising: a host, at least one slave and a receiver, wherein the host is used to divide the image to be processed into N sub-images, and send each of the sub-images to different slaves respectively, wherein N is a positive integer, and when N=1, it indicates that the image is not divided, and is processed as a whole image; the slave is used to receive the sub-image sent by the host, obtain the index relationship between the point coordinates in the target image to be generated and the pixel point P on the sub-image, optimize the RGBA value of the sub-image according to the index relationship between the point coordinates in the target image to be generated and the pixel point on the sub-image, and generate the RGBA value of the corresponding point coordinate of the target image to be generated according to the optimized RGBA value, generate the target image according to the RGBA value of the point coordinate of the target image to be generated, and send the target image to the receiver; the receiver is used to receive the target image sent by the slave, and splice the target image to generate a frame of image to be displayed for display by the curved display screen.

[0021] The above-mentioned display image processing system of the curved display screen of the present invention also has the following additional technical features:

[0022] According to one embodiment of the present invention, the slave machine is specifically used to: normalize each pixel point P(x, y) of the sub-image; uniformly map the pixel points on the normalized sub-image to the surface of a unit spherical shell to obtain a mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell; map the point coordinates P"(i, j) in the target image to be generated to the surface of a unit spherical shell to obtain a mapping relationship between the point coordinates P"(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell; obtain an index relationship between the point coordinates P"(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image according to the mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell, and the mapping relationship between the point coordinates P"(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell.

[0023] According to one embodiment of the present invention, the slave is specifically used to: read the RGBA value of each pixel of the sub-image; calculate the weight vector w of the dynamic Gaussian convolution kernel using a two-dimensional Gaussian distribution according to the index relationship between the point coordinates P" (i, j) in the target image to be generated and the pixel point P (x, y) on the sub-image, and normalize it; perform a convolution operation on the RGBA values ​​of the corresponding pixel points of the sub-image according to the weight vector w of the Gaussian convolution kernel to generate the RGBA values ​​of the corresponding point coordinates of the target image to be generated.

[0024] According to one embodiment of the present invention, the slave machine is further used to: normalize the RGBA values ​​of the corresponding point coordinates of the target image to be generated using TOPSIS, and perform image enhancement on the sub-image using a sigmoid activation function.

[0025] According to one embodiment of the present invention, the slave machine specifically uses the following formula to calculate the weight vector w of the dynamic Gaussian convolution kernel and normalizes it:

[0026]

[0027]

[0028] Among them, s is the number of rows in the convolution kernel corresponding to the weight of the sub-image, t is the number of columns in the convolution kernel corresponding to the weight of the sub-image, σ is the standard deviation of the normal distribution, x is the floating point number corresponding to the number of rows where the pixel point is located on the sub-image, y is the floating point number corresponding to the number of columns where the pixel point is located on the sub-image, C is the convolution kernel, w [s,t] is the weight vector corresponding to the s-th row and t-th column of the sub-image, and pi is the pi.

[0029] According to an embodiment of the present invention, the slave device specifically obtains the mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell through the following formula:

[0030] (α1, β1)=(j / m*K, i / n*K);

[0031] P'(x, y, z)=P'(sinα1cosβ1, cosα1, sinα1sinβ1);

[0032] Among them, i represents the row corresponding to the point coordinates P" (i, j) in the target image to be generated, j represents the column corresponding to the point coordinates P" (i, j) in the target image to be generated, P' (x, y, z) represents the three-dimensional coordinates on the unit spherical shell, m represents the width of the target image to be generated, n represents the height of the target image to be generated, and K represents the circumference of the curved display screen.

[0033] According to an embodiment of the present invention, the slave device specifically obtains the mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell through the following formula:

[0034]

[0035] Among them, α2 is the latitude angle of the curved display screen corresponding to the point coordinate P" (i, j) in the target image to be generated, β2 is the longitude angle of the curved display screen corresponding to the point coordinate P" (i, j) in the target image to be generated, and P' (x, y, z) represents the three-dimensional coordinates on the unit spherical shell.

[0036] According to an embodiment of the present invention, the curved display screen includes an internal display screen and an external display screen. Advantageous effects of the invention:

[0037] The present invention first divides the image to be processed, and then processes the divided sub-images separately, which can significantly improve the processing efficiency and does not require a complex rendering engine. The position of the original pixel point (floating point number) is found through the position of the target image, so that the RGBA value of the point coordinate of the new target image can be generated according to the floating point number, without losing the clarity of the original image and causing the target image to appear jagged and torn. That is, the 2D image to be processed can be quickly sphericalized to generate a clear new image that can be played and displayed on a curved display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 is a flow chart of a method for processing a display image of a curved display screen according to an embodiment of the present invention;

[0039] Figure 2 is a block diagram of a system for processing displayed images on a curved display screen according to an embodiment of the present invention;

[0040] Figure 3 is a flow chart of a method for processing a display image of a curved display screen according to a second embodiment of the present invention.

[0041] Figure 4 is a coordinate diagram of a unit spherical shell according to an embodiment of the present invention;

[0042] Figure 5 is a schematic diagram of the principle of the mapping relationship between the point coordinates P" (i, j) in the target image and the three-dimensional coordinates on the unit spherical shell according to one embodiment of the present invention;

[0043] Figure 6 is a flow chart of a method for processing a display image of a curved display screen according to a third embodiment of the present invention. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] Figure 1 FIG. 1 is a flow chart of a method for processing a display image of a curved display screen according to an embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0046] S1, dividing the image to be processed into N sub-images, where N is a positive integer. When N=1, it means that the image is not divided and is processed as a whole image.

[0047] Specifically, Figure 2 As shown, the host can divide the complete image to be processed into N sub-images, which are sent to different slaves for processing, and one slave processes one sub-image (the processing process is the following steps S2-S4). The segmentation scheme can be specifically selected according to the existing machines to meet the shortest synchronization trigger time. For example, the chessboard segmentation scheme divides the image to be processed into n small squares with a length and width of n, with a total of n^2 small squares of equal size. The segmentation scheme can also be obtained by pre-training the optimization model according to the actual situation.

[0048] S2, obtaining the index relationship between the point coordinates in the target image to be generated and the pixel points on the sub-image.

[0049] The target image is the image that needs to be displayed on the curved display screen in the end, and the size of the target image can be set in advance according to the requirements, such as 1920*1920.

[0050] Furthermore, if Figure 3 As shown, obtaining the index relationship between the point coordinates in the target image to be generated and the pixel points on the sub-image specifically includes:

[0051] S21, normalize each pixel point P(x, y) of the sub-image.

[0052] Specifically, Figure 4 As shown, each point on the sub-image (original image) is normalized to obtain a plane graph with the horizontal and vertical axis values ​​ranging from [-1, 1]. Suppose the sub-image resolution is w*h, w represents the width, h represents the height, and the pixel point P(x, y) on it should be ((w-2x) / w, (h-2y) / h) after normalization.

[0053] S22, uniformly mapping the pixel points on the normalized sub-image to the surface of the unit spherical shell to obtain a mapping relationship between the pixel point P (x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell.

[0054] Specifically, the normalized sub-image pixel points are pressed into the unit spherical shell so that the sub-image is evenly stretched to the surface of the spherical shell, and the arc of the corresponding surface is K. Assume that the pixel point P (x, y) on the sub-image corresponds to Figure 4 Point P on the unit spherical shell, draw the following auxiliary lines on the surface of the unit spherical shell:

[0055] Connect OP and extend it to intersect the circle O at point Q. Draw a perpendicular line through point O that is perpendicular to the image plane and intersects the hemisphere at point R. Connect arc RP' and arc P'Q. From the corresponding relationship of the transformation, it is easy to know that OP / OQ = arc RP' / arc RQ.

[0056] Because ρ=OP=sqrt(x 2 +y 2 ), OQ = 1, and the circular angle corresponding to arc RQ is K / 2, K = pi, and the circular angle corresponding to arc RP' can be set as θ, and the following expression can be obtained:

[0057] sqrt(x 2 +y 2 ) / 1=θ / (K / 2), that is, θ=(K / 2)*ρ.

[0058] Since the above changes do not change the angle on the orthogonal projection plane, φ=arctan(y / x).

[0059] Therefore, the three-dimensional coordinates of the pixel point P(x, y) on the sub-image after stretching to the surface of the spherical shell should be P'(sinθcosφ, sinθsinφ, cosθ), that is, the mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell is: P'(sinθcosφ, sinθsinφ, cosθ), φ = arctan(y / x), θ = (K / 2)*ρ, ρ = sqrt(x 2 +y 2 ). That is to say, the pixel point P(x, y) on the sub-image can be deduced to the corresponding three-dimensional coordinate P' on the surface of the unit spherical shell, and the derivation process is reversible, so it is also possible to deduce P from P' according to the diagram.

[0060] S23, mapping the point coordinates P" (i, j) in the target image to be generated to the surface of the unit spherical shell to obtain a mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell.

[0061] Specifically, the point coordinates P" (i, j) in the target image to be generated are mapped to the surface of the unit spherical shell, i represents the row, j represents the column. For example, if the size of the target image is 1920*1920, then P" is (0, 0), (0, 1), ... (0, 1919), ... (1919, 1919) in sequence. Since the pixels of the curved display screen are equally spaced at each center angle, the curved display screen is divided into several equal parts at each angle using angle as the unit of measurement, and is divided into a rectangular chessboard (pixels not displayed on the spherical screen, such as (0, 0), (0, 1), etc., still appear on the target image, and the image actually displayed on the spherical surface is quasi-circular).

[0062] In one embodiment of the present invention, the mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell can be obtained by the following formula:

[0063] (α1, β1)=(j / m*K, i / n*K);

[0064] P'(x, y, z)=P'(sinα1cosβ1, cosα1, sinα1sinβ1);

[0065] Among them, i represents the row corresponding to the point coordinates P" (i, j) in the target image to be generated, j represents the column corresponding to the point coordinates P" (i, j) in the target image to be generated, P' (x, y, z) represents the three-dimensional coordinates on the unit spherical shell, m represents the width of the target image to be generated, n represents the height of the target image to be generated, and K represents the circumference of the curved display screen.

[0066] Specifically, Figure 5 As shown, assuming that the width and height of the target image are m and n respectively, the corresponding circumference arc of the curved display screen is K (hemisphere K=pi), and the (α1, β1) value corresponding to any point P"(i, j) in the target image should be (j / m*K, i / n*K), α1 represents the angle between OP' and the positive semi-axis of the Y axis, and β1 represents the angle between the projection of OP' on the XOZ plane and the positive semi-axis of the X axis. Therefore, the target image P"(i, j), the corresponding spherical coordinates should be P'(x, y, z)=(sinα1cosβ1, cosα1, sinα1sinβ1), and the derivation process is reversible.

[0067] For the longitude and latitude curved display screen, the longitude and latitude method can be used to obtain the mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell, as follows:

[0068] When P' is indexed by P" (x, y), another set of index relationships should be obtained from the longitude and latitude display screen features. The specific features are: from a point P" (x, y) on the target image, the corresponding P' on the unit spherical shell can be derived, specifically:

[0069] Among them, α2 is the latitude angle of the curved display screen corresponding to the point coordinate P" (i, j) in the target image to be generated, β2 is the longitude angle of the curved display screen corresponding to the point coordinate P" (i, j) in the target image to be generated, and P' (x, y, z) represents the three-dimensional coordinate on the unit spherical shell. The specific proof is:

[0070] according to Figure 5 , it is easy to know the following relationship: tanα2=z / y, tanβ2=z / x, x 2 +y 2 +z 2 =1, it is not difficult to obtain the above result by solving the equation.

[0071] S24, based on the mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell, and the mapping relationship between the point coordinate P"(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell, obtain the index relationship between the point coordinate P"(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image.

[0072] In other words, the above calling relationship is that P can be deduced to P', and the deduction is reversible, so it is also possible to deduce P from P'. On the other hand, P" can also be calculated to get P' through α and β, so P' can be regarded as a bridge between P" and P, and the calculation and deduction of P"->P'->P is completed in sequence. Therefore, the pixel corresponding to the i-th row and j-th column of the new image (that is, the pixel of P") should correspond to the position of the sub-image P (that is, the pixel at the position of point P), so an index relationship between P" and P can be formed. The position of the pixel on the original sub-image can be found through the position of the final target image.

[0073] S3, optimizing the RGBA value of the sub-image according to the index relationship between the point coordinates in the target image to be generated and the pixel points on the sub-image, and generating the RGBA value of the corresponding point coordinates of the target image to be generated according to the optimized RGBA value.

[0074] Further, according to one embodiment of the present invention, Figure 6As shown, the RGBA value of the sub-image is optimized according to the index relationship between the point coordinates P" (i, j) in the target image to be generated and the pixel point P (x, y) on the sub-image, and the RGBA value of the corresponding point coordinate of the target image to be generated is generated according to the optimized RGBA value, specifically including:

[0075] S31, reading the RGBA value of each pixel point P (x, y) of the sub-image.

[0076] S32, according to the index relationship between the point coordinates P" (i, j) in the target image to be generated and the pixel point P (x, y) on the sub-image, a weight vector w of the dynamic Gaussian convolution kernel is calculated using a two-dimensional Gaussian distribution and normalized.

[0077] Further, according to one embodiment of the present invention, the n-order convolution kernel is defined as 4n 2 The corresponding P(x, y) coordinates should be located in the center of the convolution kernel. For each weight in the convolution kernel, the coordinates of the corresponding sub-image are the sth row and tth column. The weight vector w of the dynamic Gaussian convolution kernel is calculated and normalized using the following formula:

[0078]

[0079]

[0080] Among them, s is the number of rows in the convolution kernel corresponding to the weight of the sub-image, t is the number of columns in the convolution kernel corresponding to the weight of the sub-image, σ is the standard deviation of the normal distribution, x is the floating point number corresponding to the number of rows where the pixel point is located on the sub-image, y is the floating point number corresponding to the number of columns where the pixel point is located on the sub-image, C is the convolution kernel, w [s,t ] is the weight vector corresponding to the s-th row and t-th column of the sub-image, and pi is the pi.

[0081] S33, performing a convolution operation on the RGBA values ​​of the corresponding pixel points of the sub-image according to the weight vector w of the Gaussian convolution kernel to generate the RGBA values ​​of the coordinates of the corresponding points of the target image to be generated.

[0082] Specifically, the following formula is used to generate the RGBA value of the corresponding point coordinates of the target image to be generated: 新 =∑X×w [s,t] ;

[0083] Among them, X is the RGBA value of the sub-image pixel (RGBA: four colors are calculated separately), w [s,t] is the weight vector corresponding to the sth row and tth column of the sub-image, X 新 It is the RGBA value of the corresponding point coordinates of the target image to be generated.

[0084] S34, using TOPSIS to normalize the RGBA values ​​of the corresponding point coordinates of the target image to be generated, and using a sigmoid activation function to perform image enhancement on the sub-image.

[0085] Specifically, the RGBA value X of the corresponding point coordinates of the generated target image to be generated 新 Use TOPSIS (Topology of Superiority and Superiority) method to normalize them respectively, and use sigmoid activation function to enhance the sub-images to get the pixel value RGBA of the generated target image.

[0086] Assuming the image grayscale number is c, then:

[0087]

[0088] Among them, α is a parameter to be determined for adjusting the contrast, its value is related to σ, and f(x) is a sigmoid function.

[0089] S4, generating a target image according to the RGBA values ​​of the point coordinates of the target image to be generated.

[0090] From the above, we can find the position of the original sub-image pixel points (all floating point numbers) through the location of the final target image to be generated, and then we can use this floating point number to perform Gaussian convolution and image enhancement to generate new pixel RGBA values, and generate the target image, thereby completing the sphericalization of the sub-image. The new RGBA value is the color of the point to be moved, so the generated target image has no jagged edges.

[0091] S5, stitching the target images to generate a frame of image to be displayed, so as to be displayed on the curved display screen.

[0092] Specifically, the slave sends the generated target image to the receiver, and the receiver splices the received target images to generate a frame of image to be displayed for display on the curved display screen.

[0093] In actual use, we can add a signal synchronization generator to achieve complete frame-by-frame playback of the curved display.

[0094] It should be noted that, in the embodiment of the present invention, the curved display screen includes an internal display screen and an external display screen.

[0095] From the above, it can be seen that the method for processing the displayed image of the curved display screen has the following technical effects:

[0096] 1. Accuracy is not constrained by image size:

[0097] Since the entire processing process is continuous, it is not limited to the pixel ratio of the original image and can convert images at any ratio. That is, for images of any size, the conversion can be completed by normalizing them into coordinates in the standard coordinate system. After the conversion is completed, the corresponding image is generated according to the image sizes of the previous and next images. This method will not lose the clarity of the original image.

[0098] 2. Distributed processing is not segmented and misplaced:

[0099] The whole method is for each pixel. If it is true for each pixel, it will be true for any part of the image. Since the algorithm for an image is fixed, the same result will be obtained in distributed image processing as in independent processing, and the image will not be misplaced, torn, or jumped when it is stitched together. Therefore, this method can be used in a distributed system for image processing, where the host transmits the image to the slave, which converts and processes a certain part of the image, and then aggregates it to the receiver for merging and displaying it on the surface.

[0100] 3. Support partial or full spherical surface activation of any spherical surface:

[0101] This method is not limited to K=pi, and the calculation process is performed via a normalized coordinate system, so it is also completely applicable to a non-holosphere screen.

[0102] In summary, according to the method for processing the displayed image of the curved display screen according to the embodiment of the present invention, the image to be processed is first segmented, and then the segmented sub-images are processed separately, which can significantly improve the processing efficiency, and does not require a complex rendering engine. The position of the original pixel point (floating point number) is found through the position of the target image, so that the RGBA value of the point coordinate of the new target image can be generated according to the floating point number, without losing the clarity of the original image and causing the target image to appear jagged and torn. That is, the 2D image to be processed can be quickly sphericalized to generate a clear new image that can be played and displayed on the curved display screen.

[0103] Corresponding to the above-mentioned method for processing the display image of the curved display screen, the present invention also provides a system for processing the display image of the curved display screen. Since the system embodiment of the present invention is based on the above-mentioned method embodiment, the details not disclosed in the system embodiment can be referred to the above-mentioned method embodiment, and will not be described in detail in the present invention.

[0104] Figure 2 is a block diagram of a system for processing displayed images on a curved display screen according to an embodiment of the present invention. Figure 2 As shown, the system includes: a host, at least one slave and a receiver, wherein:

[0105] The host is used to divide the image to be processed into N sub-images, and send each sub-image to different slaves respectively, where N is a positive integer. When N=1, it means that the image is not divided and is processed as a whole image; the slave is used to receive the sub-image sent by the host, obtain the index relationship between the point coordinates in the target image to be generated and the pixel point P on the sub-image, optimize the RGBA value of the sub-image according to the index relationship between the point coordinates in the target image to be generated and the pixel point on the sub-image, and generate the RGBA value of the corresponding point coordinate of the target image to be generated according to the optimized RGBA value, generate the target image according to the RGBA value of the point coordinate of the target image to be generated, and send the target image to the receiver; the receiver is used to receive the target image sent by the slave, and splice the target image to generate a frame of image to be displayed for display on the curved display screen.

[0106] Specifically, the host can divide the complete image to be processed into N sub-images and send them to different slaves for processing. One slave processes one sub-image and generates a target image. After the processing is completed, each slave sends the generated target image to the receiver. The receiver splices the received target images to generate a frame of image to be displayed for display on the curved display screen. Therefore, the use of a distributed structure can significantly improve the processing performance.

[0107] The host, slave and receiver of the processing system are pronouns. They can be computers, or other hardware facilities, synchronization signals and other devices that can realize the functions as substitutes. They all belong to the category of host, slave and receiver.

[0108] According to one embodiment of the present invention, the slave is specifically used to: normalize each pixel point P(x, y) of the sub-image; uniformly map the pixel points on the normalized sub-image to the surface of the unit spherical shell to obtain the mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell; map the point coordinates P"(i, j) in the target image to be generated to the surface of the unit spherical shell to obtain the mapping relationship between the point coordinates P"(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell; obtain the index relationship between the point coordinates P"(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image according to the mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell, and the mapping relationship between the point coordinates P"(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell.

[0109] According to one embodiment of the present invention, the slave is specifically used to: read the RGBA value of each pixel of the sub-image; calculate the weight vector w of the dynamic Gaussian convolution kernel using a two-dimensional Gaussian distribution according to the index relationship between the point coordinates P" (i, j) in the target image to be generated and the pixel point P (x, y) on the sub-image, and normalize it; perform a convolution operation on the RGBA value of the corresponding pixel point of the sub-image according to the weight vector w of the Gaussian convolution kernel to generate the RGBA value of the corresponding point coordinate of the target image to be generated.

[0110] According to one embodiment of the present invention, the slave machine is further used to: normalize the RGBA values ​​of the corresponding point coordinates of the target image to be generated using TOPSIS, and perform image enhancement on the sub-image using a sigmoid activation function.

[0111] According to one embodiment of the present invention, the slave machine specifically uses the following formula to calculate the weight vector w of the dynamic Gaussian convolution kernel and normalizes it:

[0112]

[0113]

[0114] Among them, s is the number of rows of the sub-image corresponding to the weight in the convolution kernel, t is the number of columns of the sub-image corresponding to the weight in the convolution kernel, σ is the standard deviation of the normal distribution, x is the floating point number corresponding to the number of rows where the pixel point is on the sub-image, y is the floating point number corresponding to the number of columns where the pixel point is on the sub-image, C is the convolution kernel, w [s,t] is the weight vector corresponding to the s-th row and t-th column of the sub-image, and pi is the pi.

[0115] According to an embodiment of the present invention, the slave device may specifically obtain the mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell through the following formula:

[0116] (α1, β1)=(j / m*K, i / n*K);

[0117] P'(x, y, z)=P'(sinα1cosβ1, cosα1, sinα1sinβ1);

[0118] Among them, i represents the row corresponding to the point coordinates P" (i, j) in the target image to be generated, j represents the column corresponding to the point coordinates P" (i, j) in the target image to be generated, P' (x, y, z) represents the three-dimensional coordinates on the unit spherical shell, m represents the width of the target image to be generated, n represents the height of the target image to be generated, and K represents the circumference of the curved display screen.

[0119] According to an embodiment of the present invention, the slave device may specifically obtain the mapping relationship between the point coordinates P" (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell through the following formula:

[0120]

[0121] Among them, α2 is the latitude angle of the curved display screen corresponding to the point coordinate P" (i, j) in the target image to be generated, β2 is the longitude angle of the curved display screen corresponding to the point coordinate P" (i, j) in the target image to be generated, and P' (x, y, z) represents the three-dimensional coordinates on the unit spherical shell.

[0122] According to an embodiment of the present invention, the curved display screen includes an internal display screen and an external display screen.

[0123] In summary, according to the display image processing system of the curved display screen according to the embodiment of the present invention, the image to be processed is first segmented, and then the segmented sub-images are processed respectively, which can significantly improve the processing efficiency, and no complex rendering engine is required. The position of the original pixel point (floating point number) is found through the position of the target image, so that the RGBA value of the point coordinate of the new target image can be generated according to the floating point number, and the clarity of the original image will not be lost, and the target image will not appear jagged and torn. That is, the 2D image to be processed can be quickly sphericalized to generate a clear new image that can be played and displayed on the curved display screen. The distributed structure can significantly improve the processing performance.

[0124] In the description of this specification, the use of "distributed system" is only an optional option to improve processing efficiency, and is not a necessary process for the spherification process. Both the spherification longitude and latitude algorithm and the angle-by-angle algorithm have been strictly proven and are within the scope of protection. In the description of this specification, the description of reference terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples without contradiction.

[0125] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0126] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present invention belong.

[0127] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0128] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0129] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0130] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0131] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present invention. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present invention.

Claims

1. A method for processing a display image of a curved display screen, characterized in that: include: The image to be processed is divided into N sub-images, where N is a positive integer; the index relationship between the coordinates of a point in the target image to be generated and the pixel points on the sub-image is obtained; the index relationship between the coordinates of a point in the target image to be generated and the pixel points on the sub-image is obtained, specifically including: normalizing each pixel point P (x, y) of the sub-image; uniformly mapping the pixel points on the normalized sub-image to the surface of a unit spherical shell to obtain the mapping relationship between the pixel point P (x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell; mapping the point coordinate P'' (i, j) in the target image to be generated to the surface of a unit spherical shell to obtain the mapping relationship between the point coordinate P'' (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell; according to the mapping relationship between the pixel point P (x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell, and the mapping relationship between the point coordinate P'' (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell, obtain the point coordinate P'' (i, j) in the target image to be generated. j) and the pixel point P(x, y) on the sub-image; Optimizing the RGBA value of the sub-image according to the index relationship between the point coordinates P''(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image, and generating the RGBA value of the corresponding point coordinate of the target image to be generated according to the optimized RGBA value, specifically including: Reading the RGBA value of each pixel point of the sub-image; Calculating the weight vector of the dynamic Gaussian convolution kernel using a two-dimensional Gaussian distribution according to the index relationship between the point coordinates P''(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image w, and normalize it; perform a convolution operation on the RGBA values ​​of the corresponding pixels of the sub-image according to the weight vector w of the Gaussian convolution kernel to generate the RGBA values ​​of the corresponding point coordinates of the target image to be generated; optimize the RGBA values ​​of the sub-image according to the index relationship between the point coordinates in the target image to be generated and the pixel points on the sub-image, and generate the RGBA values ​​of the corresponding point coordinates of the target image to be generated according to the optimized RGBA values; generate a target image according to the RGBA values ​​of the point coordinates of the target image to be generated; splice the target images to generate a frame of image to be displayed, so as to be displayed on the curved display screen.

2. The method for processing a display image of a curved display screen according to claim 1, characterized in that: The method further includes: using TOPSIS to normalize the RGBA values ​​of the corresponding point coordinates of the target image to be generated, and using a sigmoid activation function to perform image enhancement on the sub-image.

3. The method for processing a display image of a curved display screen according to claim 1, characterized in that: The weight vector w of the dynamic Gaussian convolution kernel is calculated and normalized using the following formula: ; ; Where s is the number of rows in the convolution kernel corresponding to the weight in the sub-image, t is the number of columns in the convolution kernel corresponding to the weight in the sub-image, σ is the standard deviation of the normal distribution, x is the floating point number corresponding to the row number of the pixel on the sub-image, y is the floating point number corresponding to the column number of the pixel on the sub-image, C is the convolution kernel, w[s,t] is the weight vector corresponding to the s-th row and t-th column of the sub-image, and pi is the pi.

4. The method for processing a display image of a curved display screen according to claim 1, characterized in that: Specifically, the mapping relationship between the point coordinates P''(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell is obtained by the following formula: ; ; Among them, i represents the row corresponding to the point coordinate P''(i, j) in the target image to be generated, j represents the column corresponding to the point coordinate P''(i, j) in the target image to be generated, P' (x, y, z) represents the three-dimensional coordinates on the unit spherical shell, m represents the width of the target image to be generated, n represents the height of the target image to be generated, and K represents the circumference of the curved display screen.

5. The method for processing a display image of a curved display screen according to claim 1, characterized in that: Specifically, the mapping relationship between the point coordinates P''(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell is obtained by the following formula: ; Among them, α2 is the latitude angle of the curved display screen corresponding to the point coordinate P''(i, j) in the target image to be generated, β2 is the longitude angle of the curved display screen corresponding to the point coordinate P''(i, j) in the target image to be generated, and P'(x, y, z) represents the three-dimensional coordinates on the unit spherical shell.

6. The method for processing a display image of a curved display screen according to any one of claims 1 to 5, characterized in that: The curved display screen includes an internal display screen and an external display screen.

7. A system for processing images displayed on a curved display screen, characterized in that: include: A host, at least one slave and a receiver, wherein the host is used to divide the image to be processed into N sub-images, and send each of the sub-images to different slaves, wherein N is a positive integer; the slave is used to receive the sub-images sent by the host, obtain the index relationship between the point coordinates in the target image to be generated and the pixel point P on the sub-image, and perform pixel index processing on the sub-image according to the index relationship between the point coordinates in the target image to be generated and the pixel point on the sub-image. Optimize the RGBA values, generate the RGBA values ​​of the corresponding point coordinates of the target image to be generated according to the optimized RGBA values, generate the target image according to the RGBA values ​​of the point coordinates of the target image to be generated, and send the target image to the receiver; obtain the index relationship between the point coordinates in the target image to be generated and the pixel points on the sub-image, specifically including: normalize each pixel point P (x, y) of the sub-image; uniformly map the pixel points on the normalized sub-image to the surface of the unit spherical shell to obtain the mapping relationship between the pixel point P (x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell; map the point coordinates P'' (i, j) in the target image to be generated to the surface of the unit spherical shell to obtain the mapping relationship between the point coordinates P'' (i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell; according to the mapping relationship between the pixel point P (x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell, the point coordinates P'' (i, j) in the target image to be generated j) and the three-dimensional coordinates on the unit spherical shell, obtaining the index relationship between the point coordinates P''(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image; optimizing the RGBA value of the sub-image according to the index relationship between the point coordinates P''(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image, and generating the RGBA value of the corresponding point coordinate of the target image to be generated according to the optimized RGBA value, specifically including: reading the RGBA value of each pixel point of the sub-image; calculating the weight vector of the dynamic Gaussian convolution kernel using a two-dimensional Gaussian distribution according to the index relationship between the point coordinates P''(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image w, and normalize it; perform a convolution operation on the RGBA values ​​of the pixels corresponding to the sub-image according to the weight vector w of the Gaussian convolution kernel to generate the RGBA values ​​of the coordinates of the corresponding points of the target image to be generated; the receiver is used to receive the target image sent by the slave, and splice the target image to generate a frame of image to be displayed, so as to be displayed on the curved display screen.

8. The display image processing system of the curved display screen according to claim 7, characterized in that: The slave device is specifically used to: normalize each pixel point P (x, y) of the sub-image; uniformly map the pixel points on the normalized sub-image to the surface of the unit spherical shell to obtain a mapping relationship between the pixel point P (x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell; The point coordinates P''(i, j) in the target image to be generated are mapped to the surface of the unit spherical shell to obtain the mapping relationship between the point coordinates P''(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell; according to the mapping relationship between the pixel point P(x, y) on the sub-image and the three-dimensional coordinates on the unit spherical shell, and the mapping relationship between the point coordinates P''(i, j) in the target image to be generated and the three-dimensional coordinates on the unit spherical shell, the index relationship between the point coordinates P''(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image is obtained.

9. The display image processing system of the curved display screen according to claim 8, characterized in that: The slave is specifically used to: read the RGBA value of each pixel of the sub-image; calculate the weight vector of the dynamic Gaussian convolution kernel using a two-dimensional Gaussian distribution according to the index relationship between the point coordinates P''(i, j) in the target image to be generated and the pixel point P(x, y) on the sub-image w, and normalize; performing a convolution operation on the RGBA values ​​of the corresponding pixel points of the sub-image according to the weight vector w of the Gaussian convolution kernel to generate the RGBA values ​​of the coordinates of the corresponding points of the target image to be generated.

10. The display image processing system of the curved display screen according to claim 9, characterized in that: The slave machine is further used for: normalizing the RGBA values ​​of the corresponding point coordinates of the target image to be generated by using TOPSIS, and performing image enhancement on the sub-image by using a sigmoid activation function.

11. The display image processing system of the curved display screen according to claim 9, characterized in that: The slave machine specifically uses the following formula to calculate the weight vector w of the dynamic Gaussian convolution kernel.

Images