A display method of a special-shaped screen picture and a related device

Abstract

The application relates to a display method of a special-shaped screen picture and related devices, wherein the method comprises the following steps: determining shape information of the special-shaped screen, dividing a display area of the special-shaped screen into a central display area according to the shape information, dividing an edge display area according to the central display area, determining pixel unit cells of the central display area and the edge display area; acquiring play source data, performing data processing on the play source data; extracting background data of a play picture according to infrared images and grayscale images of the play source data; and finally filling the play source data into the pixel unit cells of the central display area and filling the background data into the pixel unit cells of the edge display area. The method guarantees the integrity of picture display by dividing the central display area, fills the background data into the edge display area to increase the extensibility of the picture, and helps to provide better visual experience.

Description

Technical Field

[0001] This invention relates to the technical field of display screens, and in particular to a method and related apparatus for displaying images on irregularly shaped screens. Background Technology

[0002] Currently, most common irregular-shaped screens are curved screens. With the rise of COB technology, by encapsulating key components such as LEDs in PCBs, screens can be more easily manufactured into various irregular shapes, such as regular or irregular polygons, or even irregular curved edges, to meet the display needs of different scenarios.

[0003] The irregularly shaped screens mentioned above place higher technical demands on the display of images. When the screen ratio does not match the display ratio, the displayed image cannot fill the screen, resulting in blank areas around the screen and a poor visual experience. Summary of the Invention

[0004] The purpose of this invention is to provide a method and related apparatus for displaying images on irregularly shaped screens, which can solve the problem in the above-mentioned technologies where the image cannot fill the screen when the screen ratio does not match the display ratio, resulting in blank areas around the screen and an inability to obtain a good visual experience.

[0005] The above-mentioned objective of this invention is achieved through the following technical solution:

[0006] A method for displaying an image on an irregularly shaped screen includes the following steps:

[0007] The shape information of the irregular screen is determined, and the display area of ​​the irregular screen is divided into a central display area and an edge display area according to the shape information. The pixel cells of the central display area and the edge display area are determined.

[0008] Acquire playback source data and perform data processing on the playback source data;

[0009] The background data of the playback screen is extracted based on the infrared and grayscale images of the playback source data.

[0010] The playback source data is filled into the pixel cells of the center display area, and the background data is filled into the pixel cells of the edge display area.

[0011] By adopting the above technical solution, the shape of the irregular screen is determined by determining the pixel cell information of the irregular screen, which makes it easier to divide a central display area in the irregular screen. The playback image is then adjusted according to the size of the central display area. Then, the edge display area is determined by the central display area. The edge display area is used as an extension of the central display area. The background data is extracted and filled into the edge display area, so that the entire screen is filled with the image. This preserves the integrity of the image while improving the visual openness, which helps to obtain a better visual experience.

[0012] In a preferred embodiment, the present invention can be further configured as follows: dividing the display area of ​​the irregularly shaped screen into a central display area according to the shape information includes:

[0013] Determine a preset pixel starting point and obtain the coordinates A(x1,y1) of the preset pixel starting point, wherein the preset pixel starting point is located at the edge of the irregular screen;

[0014] The longest side length is constructed by traversing the edge pixel cells of the irregularly shaped screen and x1 in A(x1,y1); the longest side width is constructed by traversing the edge pixel cells of the irregularly shaped screen and y1 in A(x1,y1);

[0015] The area is determined by the side length and the side width, and the maximum area is determined by the MAX function. The area corresponding to the maximum area is the center display area, and the remaining areas are the edge display areas.

[0016] By adopting the above technical solution, the largest rectangle in the irregular screen can be determined. The pixel cells falling into the largest rectangle together form the central display area. This technical solution can determine the central display area with a simpler algorithm, and the determined rectangular area is also convenient for subsequent adjustment of the screen size.

[0017] In a preferred embodiment, the present invention can be further configured as follows: the step of constructing the longest side length based on traversing the edge pixel cells of the irregularly shaped screen and x1 in A(x1,y1); and constructing the longest side width based on traversing the edge pixel cells of the irregularly shaped screen and y1 in A(x1,y1), includes:

[0018] Traverse the edge pixel cells of the irregular screen until the endpoint coordinate B(x2,y1) that is the same as y1 in A(x1,y1) is obtained;

[0019] The distance between A(x1,y1) and the endpoint coordinate B(x2,y1) is calculated as the side length;

[0020] Traverse the edge pixel cells of the irregular screen until the endpoint coordinate D(x1,y2) that is the same as x1 in A(x1,y1) is obtained, and C(x2,y2) is determined according to B(x2,y1) and D(x1,y2);

[0021] The distance between A(x1,y1) and the endpoint coordinates D(x1,y2) is calculated as the side width.

[0022] By adopting the above technical solution, the edge display area of ​​the irregularly shaped screen is usually curved. This method identifies the first vertex located on the same X-axis or Y-axis as point A, ensuring that the central display area is always within the irregularly shaped screen, thus guaranteeing the integrity of the image display. After identifying the four vertices of the constructed rectangle, the side length and width can be calculated to obtain the area of ​​the rectangle.

[0023] In a preferred embodiment, the present invention can be further configured such that: dividing the edge display area according to the central display area includes:

[0024] Establish coordinate systems A, B, C, and D based on coordinates A(x1,y1), B(x2,y1), C(x2,y2), and D(x1,y2), respectively.

[0025] Obtain the quadrants of the A, B, C, and D coordinate systems;

[0026] The first edge sub-region is determined using the fourth quadrant of the A coordinate system and the third quadrant of the B coordinate system, and the second edge sub-region is determined using the fourth quadrant of the B coordinate system; the third edge sub-region is determined using the first quadrant of the B coordinate system and the fourth quadrant of the C coordinate system.

[0027] The fourth edge sub-region is determined according to the first quadrant of the C coordinate system, the fifth edge sub-region is determined according to the second quadrant of the C coordinate system and the first quadrant of the D coordinate system, the sixth edge sub-region is determined according to the second quadrant of the D coordinate system, the seventh edge sub-region is determined according to the third quadrant of the D coordinate system and the second quadrant of the A coordinate system, and the eighth edge sub-region is determined according to the third quadrant of the A coordinate system; the first edge sub-regions to the eighth edge sub-regions constitute the edge display area.

[0028] By adopting the above technical solution, in order to ensure a better visual effect after the background image is filled, the edge display area can be divided into multiple sub-areas, and different background data can be filled into each sub-area. This solution can accurately divide the edge sub-areas, which is convenient for subsequent filling processing.

[0029] In a preferred embodiment, the present invention can be further configured such that: extracting background data of the playback screen based on the infrared image and grayscale image of the playback source data includes:

[0030] The infrared image and grayscale image of the playback source data are acquired, and the infrared image and grayscale image are registered to obtain the target image;

[0031] The feature data of the target image is extracted, and the background data is extracted using the feature data, which includes texture, contour, and corner points.

[0032] By adopting the above technical solution, the background and foreground in the image can be separated, making the extracted background data more accurate.

[0033] In a preferred embodiment, the present invention can be further configured such that filling the pixel cells of the central display area with playback source data includes:

[0034] The size information of the playback source data is adjusted according to the side length and side width of the central display area;

[0035] The adjusted playback source data is then filled into the pixel cells of the central display area.

[0036] By adopting the above technical solution, the size information of the playback source data is adjusted to be consistent with the central display area, making the picture in the central display area fuller.

[0037] In a preferred embodiment, the present invention may be further configured such that filling the background data into the pixel cells of the edge display area includes:

[0038] The filling data is extracted from the background data;

[0039] The filling data is then filled into the first edge sub-region to the eighth edge sub-region, respectively.

[0040] By adopting the above technical solution, the background data is filled into each edge sub-region, so that the entire irregular screen fills the picture.

[0041] In a preferred embodiment, the present invention can be further configured as follows: taking the coordinate system A(x1,y1) as the starting point, the background data adjacent to the first edge sub-region is determined by a preset sorting algorithm, and the background data adjacent to the first edge sub-region is the filling data.

[0042] By adopting the above technical solution and selecting the background data closest to the first edge sub-region for filling, the connection effect of the filled image can be better.

[0043] In a preferred embodiment, the present invention may be further configured such that filling the background data into the pixel cells of the edge display area further includes:

[0044] The extracted texture data is then overlaid onto the filled first edge sub-region.

[0045] By adopting the above technical solution, the overall consistency of the image is further improved after the texture data is covered, resulting in a better visual effect after filling.

[0046] The second objective of this invention is to provide a display device for irregularly shaped screens, which can solve the problem in the above-mentioned technologies where the image cannot fill the screen when the screen ratio does not match the display ratio, resulting in blank areas around the screen and a poor visual experience.

[0047] The second objective of this invention is achieved through the following technical solution:

[0048] A display device for an irregularly shaped screen, comprising:

[0049] The division / determination module is used to determine the shape information of the irregular screen, divide the display area of ​​the irregular screen into a central display area based on the shape information, divide the display area into an edge display area based on the central display area, and determine the pixel cells of the central display area and the edge display area;

[0050] The acquisition / processing module is used to acquire playback source data and process the playback source data.

[0051] The extraction module is used to extract the background data of the playback screen based on the infrared and grayscale images of the playback source data.

[0052] The fill module is used to fill the pixel cells in the center display area with playback source data and fill the pixel cells in the edge display areas with background data.

[0053] By adopting the above technical solution, the division / determination module determines the shape information of the irregularly shaped screen, divides the display area of ​​the irregularly shaped screen into a central display area based on the shape information, and divides the display area into an edge display area based on the central display area, determines the pixel cells of the central display area and the edge display area, and sends the pixel cell information of the central display area and the edge display area to the filling module; the acquisition / processing module acquires the playback source data, processes the playback source data, and sends the processed data to the extraction module; the extraction module acquires the infrared image and grayscale image based on the received processed playback source data, and extracts the background data of the playback screen and sends it to the filling module; the filling module fills the pixel cells of the central display area with the playback source data and fills the pixel cells of the edge display area with the background data.

[0054] In a preferred embodiment, the present invention can be further configured such that the partitioning / determination module includes a preset unit, a construction unit, and a calculation unit, wherein:

[0055] The preset unit is used to determine the preset pixel starting point and obtain the coordinates A(x1,y1) of the preset pixel starting point. The preset pixel starting point is located at the edge of the irregular screen.

[0056] The construction unit is used to construct the longest side length based on the edge pixel cells of the irregular screen and x1 in A(x1,y1); and to construct the longest side width based on the edge pixel cells of the irregular screen and y1 in A(x1,y1).

[0057] The calculation unit is used to determine the area by the side length and side width, and uses the MAX function to determine the maximum area. The area corresponding to the maximum area is the center display area, and the remaining areas are the edge display areas.

[0058] In a preferred embodiment, the present invention can be further configured such that: the construction unit includes a first traversal subunit, a first calculation subunit, a second traversal subunit, and a second calculation subunit, wherein:

[0059] The first traversal of the sub-cells is used to traverse the edge pixel cells of the irregular screen until the endpoint coordinate B(x2,y1) that is the same as y1 in A(x1,y1) is obtained;

[0060] The first calculation subunit is used to calculate the distance between A(x1,y1) and the endpoint coordinate B(x2,y1) as the side length;

[0061] The second traversal sub-unit is used to traverse the edge pixel cells of the irregular screen until the endpoint coordinate D(x1,y2) that is the same as x1 in A(x1,y1) is obtained, and C(x2,y2) is determined according to B(x2,y1) and D(x1,y2);

[0062] The second calculation subunit is used to calculate the distance between A(x1,y1) and the endpoint coordinates D(x1,y2) as the side width.

[0063] In a preferred embodiment, the present invention may be further configured such that the partitioning / determination module further includes an establishment unit, an acquisition unit, a first determination unit, and a second determination unit, wherein:

[0064] Establish a unit to establish coordinate systems A, B, C, and D based on coordinates A(x1,y1), B(x2,y1), C(x2,y2), and D(x1,y2), respectively.

[0065] The acquisition unit is used to acquire the quadrants of coordinate systems A, B, C, and D.

[0066] The first determining unit is used to determine the first edge sub-region using the fourth quadrant in the A coordinate system and the third quadrant in the B coordinate system, and to determine the second edge sub-region based on the fourth quadrant in the B coordinate system; and to determine the third edge sub-region based on the first quadrant in the B coordinate system and the fourth quadrant in the C coordinate system.

[0067] The second determining unit is used to determine the fourth edge sub-region based on the first quadrant in the C coordinate system, the fifth edge sub-region based on the second quadrant in the C coordinate system and the first quadrant in the D coordinate system, the sixth edge sub-region based on the second quadrant in the D coordinate system, the seventh edge sub-region based on the third quadrant in the D coordinate system and the second quadrant in the A coordinate system, and the eighth edge sub-region based on the third quadrant in the A coordinate system; the first edge sub-region to the eighth edge sub-region constitute the edge display area.

[0068] In a preferred embodiment, the present invention can be further configured such that the extraction module includes a registration unit and a segmentation unit, wherein:

[0069] The registration unit is used to acquire the infrared image and grayscale image of the playback source data, and register the infrared image and grayscale image to obtain the target image;

[0070] The first extraction unit is used to extract feature data of the target image and extract background data through the feature data. The feature data includes texture, contour and corner points.

[0071] In a preferred embodiment, the present invention can be further configured such that the filling module includes an adjustment unit and a first filling unit, wherein:

[0072] The adjustment unit is used to adjust the size information of the playback source data according to the side length and side width of the central display area;

[0073] The center fill unit is used to fill the pixel cells in the center display area with the adjusted playback source data.

[0074] In a preferred embodiment, the present invention may be further configured such that the filling module includes a second extraction unit and an edge filling unit.

[0075] The second extraction unit is used to extract the fill data from the background data;

[0076] Edge filling units are used to fill the first edge sub-region to the eighth edge sub-region with filling data respectively.

[0077] In a preferred embodiment, the present invention can be further configured such that the second extraction unit includes:

[0078] The sorting sub-unit is used to determine the background data of the adjacent first edge sub-region by using a preset sorting algorithm with coordinate system A(x1,y1) as the starting point. The background data of the adjacent first edge sub-region is the filling data.

[0079] In a preferred embodiment, the invention may be further configured such that the filling module also includes:

[0080] A covering unit is used to extract the texture data and cover it over the filled first edge sub-region.

[0081] In summary, the present invention has at least one of the following beneficial technical effects:

[0082] 1. The shape of the irregularly shaped screen is determined by identifying the pixel cell information, which facilitates the division of a central display area within the screen. The playback image is then adjusted to fit the size of the central display area. Next, the edge display area is determined using the central display area. The edge display area serves as an extension of the central display area. Background data is extracted and filled into the edge display area, filling the entire screen with the image. This preserves the integrity of the image while improving visual openness, contributing to a better visual experience.

[0083] 2. It can be applied to various scenarios to create atmosphere, such as outdoor advertising projection and performance projection. Attached Figure Description

[0084] Figure 1 This is a flowchart illustrating a method for displaying an irregularly shaped screen according to one embodiment of the present invention.

[0085] Figure 2 This is another flowchart illustrating a method for displaying an irregularly shaped screen according to one embodiment of the present invention.

[0086] Figure 3 This is another flowchart illustrating a method for displaying an irregularly shaped screen according to one embodiment of the present invention.

[0087] Figure 4 This is a schematic diagram of a method for dividing the edge display area using four coordinate systems according to one embodiment of the present invention.

[0088] Figure 5 This is another schematic flowchart of a method for displaying an irregularly shaped screen according to one embodiment of the present invention.

[0089] Figure 6 This is another flowchart illustrating a method for displaying an irregularly shaped screen according to one embodiment of the present invention. Detailed Implementation

[0090] The following is in conjunction with the appendix Figure 1-6The present invention will be described in further detail below.

[0091] Currently, most common irregular-shaped screens are curved screens. With the rise of COB technology, by encapsulating key components such as LEDs in PCBs, screens can be more easily manufactured into various irregular shapes, such as regular or irregular polygons, or even irregular curved edges, to meet the display needs of different scenarios.

[0092] The irregularly shaped screens mentioned above place higher technical demands on the display of images. When the screen ratio does not match the display ratio, the displayed image cannot fill the screen, resulting in blank areas around the screen and a poor visual experience.

[0093] To address the aforementioned issues, embodiments of this application provide a method and related apparatus for displaying images on irregularly shaped screens.

[0094] Embodiment 1 of the present invention provides a method for displaying images on irregularly shaped screens, as shown in the attached figure. Figure 1 This includes steps S1-S4:

[0095] S1. Determine the shape information of the irregular screen, divide the display area of ​​the irregular screen into a central display area based on the shape information, and divide the display area into an edge display area based on the central display area, and determine the pixel cells of the central display area and the edge display area;

[0096] The shape of an irregularly shaped screen can be determined by checking the screen's factory settings, specifically by identifying the pixel cell information of the screen. The integrity of the displayed image is ensured by first defining the central playback area within the irregularly shaped screen, and then the image is further extended using edge display areas to improve the visual effect.

[0097] See attached document Figure 2 The steps of dividing the display area of ​​the irregularly shaped screen into a central display area based on the shape information, and dividing the edge display area based on the central display area, include S101-S107:

[0098] S101. Determine the preset pixel starting point and obtain the coordinates A(x1,y1) of the preset pixel starting point. The preset pixel starting point is located at the edge of the irregular screen.

[0099] To maximize the area of ​​the central display region, it is necessary to identify the largest rectangle within the irregularly shaped screen as the central display area. Therefore, the more the apex of this rectangle is located at the edge of the irregularly shaped screen, the larger the resulting central display area will be. A preset pixel starting point A(x1,y1) at the edge of the irregularly shaped screen is a vertex of the rectangle to be constructed. The largest rectangle within the irregularly shaped screen is constructed starting from this point.

[0100] S102. Construct the longest side length by traversing the edge pixel cells of the irregular screen and x1 in A(x1,y1); construct the longest side width by traversing the edge pixel cells of the irregular screen and y1 in A(x1,y1);

[0101] Search along the edge pixel cells of the irregularly shaped screen one by one until you find two target points that can form a right angle with A(x1,y1). Calculate the distances from the two target points to A(x1,y1) and then you can calculate the area of ​​the constructed rectangle.

[0102] A rectangle constructed with a preset pixel starting point may not be the largest rectangle of the central display area. Only by constructing rectangles sequentially with the pixel units at the edge of the irregular screen as starting points can the final central display area be determined.

[0103] See attached document Figure 3 Furthermore, the specific method for constructing the longest side length and the longest side width includes steps S1021-S1024:

[0104] S1021. Traverse the edge pixel cells of the irregular screen until the endpoint coordinate B(x2,y1) that is the same as y1 in A(x1,y1) is obtained; for example, the edge pixel cells traversed are B1(x2,y0), B2(x3,y2) and B3(x3,y1). By comparing the size on the y-axis, it can be seen that B3(x3,y1) and A(x1,y1) are located on the same x-axis, that is, B3(x3,y1) is the longest side length constructed with A(x1,y1) as the starting point.

[0105] When the edges of an irregularly shaped screen are uneven, there may be multiple endpoints on the same axis x as A(x1,y1). This means that after B3(x3,y1), it is still possible to find target points that meet the conditions for constructing the side length, and the constructed side lengths are all greater than the side length constructed by B3(x3,y1). However, constructing the rectangle using target points after B3(x3,y1) will cause the edges of the constructed rectangle to extend beyond the edges of the irregularly shaped screen, meaning the central display area extends beyond the irregularly shaped screen, thus affecting the integrity of the displayed image.

[0106] S1022. Calculate the distance between A(x1,y1) and the endpoint coordinate B(x2,y1) as the side length;

[0107] The side length constructed using A(x1,y1) can be determined by calculating the absolute value of the difference between x2 and x1.

[0108] S1023. Traverse the edge pixel cells of the irregular screen until the endpoint coordinate D(x1,y2) that is the same as x1 in A(x1,y1) is obtained, and determine C(x2,y2) based on B(x2,y1) and D(x1,y2);

[0109] Similar to the method for determining the longest side length, when determining the longest side width, it is only necessary to find the first target point that is the same as x1 in A(x1,y1).

[0110] Once points B(x2,y1) and D(x1,y2) are determined, the coordinates of the last endpoint C(x2,y2) can be determined based on the symmetry of the rectangle.

[0111] S1024. Calculate the distance between A(x1,y1) and the endpoint coordinates D(x1,y2) as the side width.

[0112] Similarly, by calculating the absolute value of the difference between y2 and y1, the maximum side width constructed with A(x1,y1) can be determined.

[0113] S103. Determine the area by using the side length and side width, and use the MAX function to determine the maximum area. The area corresponding to the maximum area is the central display area.

[0114] For example, the maximum side length of the rectangle constructed using A(x1,y1) is 5, the maximum side width is 3, and the corresponding central display area is 15. Changing the starting point to A2(x2,y2) and constructing the rectangle again results in a rectangle with an area of ​​20. Once all pixel cells at the edge of the irregularly shaped screen are used as starting points and constructed one by one, an area array S = [15, 20…16] is obtained. The MAX function determines the maximum area to be 20, thus determining the maximum rectangle area that can be constructed within the irregularly shaped screen to be 20. The coordinates of the four vertices of the rectangle can then be determined.

[0115] S104. Establish coordinate systems A, B, C, and D based on coordinates A(x1,y1), B(x2,y1), C(x2,y2), and D(x1,y2), respectively.

[0116] See attached document Figure 4 Based on the four vertices of the constructed central display area, coordinate systems A, B, C, and D are established, so that the central display area falls in the middle of the four coordinate systems, which facilitates the separation of the central display area from other areas within the irregularly shaped screen.

[0117] S105. Obtain the quadrants of coordinate systems A, B, C, and D;

[0118] Obtaining quadrant information for the four coordinate systems facilitates further division of the edge display area.

[0119] S106. Determine the first edge sub-region using the fourth quadrant in coordinate system A and the third quadrant in coordinate system B, and determine the second edge sub-region using the fourth quadrant in coordinate system B; determine the third edge sub-region using the first quadrant in coordinate system B and the fourth quadrant in coordinate system C.

[0120] See attached document Figure 4 Regions falling into the fourth quadrant of coordinate system A and the third quadrant of coordinate system B are the first edge sub-regions; regions falling into the fourth quadrant of coordinate system B are the second edge sub-regions; regions falling into the first quadrant of coordinate system B and the fourth quadrant of coordinate system C are the third edge sub-regions.

[0121] In this embodiment, the range of the fourth quadrant in the B coordinate system exceeds the edge of the irregular screen, so the corresponding second edge sub-region also does not fall within the irregular screen, and is defaulted to 0.

[0122] S107. The second determining unit is used to determine the fourth edge sub-region based on the first quadrant in the C coordinate system, the fifth edge sub-region based on the second quadrant in the C coordinate system and the first quadrant in the D coordinate system, the sixth edge sub-region based on the second quadrant in the D coordinate system, the seventh edge sub-region based on the third quadrant in the D coordinate system and the second quadrant in the A coordinate system, and the eighth edge sub-region based on the third quadrant in the A coordinate system; the first edge sub-region to the eighth edge sub-region constitute the edge display area.

[0123] See attached document Figure 4 The region falling into the first quadrant of the C coordinate system is the fourth edge sub-region; the region falling into the second quadrant of the C coordinate system and the first quadrant of the D coordinate system is the fifth edge sub-region; and the region falling into the second quadrant of the D coordinate system is the sixth edge sub-region. The sixth edge sub-region is set to 0 by default. The fourth edge sub-region, being located within an irregularly shaped screen, requires background data filling.

[0124] The region falling into the third quadrant of the D coordinate system and the second quadrant of the A coordinate system is the seventh edge sub-region, and the region falling into the third quadrant of the A coordinate system is the eighth edge sub-region. The eighth edge sub-region is set to 0 by default.

[0125] S2. Obtain playback source data and perform data processing on the playback source data;

[0126] Playback source data typically includes video files, image files, text information, and audio files. In this embodiment, the irregularly shaped screen is used to rotate promotional images. Therefore, after obtaining the playback source data, data processing is performed first to remove noise and enhance image contrast, so as to fill the image to the first edge sub-region to the eighth edge sub-region later.

[0127] S3. Extract the background data of the playback screen based on the infrared and grayscale images of the playback source data;

[0128] See attached document Figure 5 Furthermore, the steps for extracting background data based on the infrared image and the grayscale image include S301-S302:

[0129] S301. Obtain the infrared image and grayscale image of the playback source data, and register the infrared image and grayscale image to obtain the target image;

[0130] By registering infrared and grayscale images, which contain different information, the two images are spatially aligned. This allows the hotspots or temperature distribution in the infrared image to correspond to the shape, texture, and other features in the grayscale image, thus obtaining richer image information.

[0131] S302. The first extraction unit is used to extract feature data of the target image and extract background data through the feature data. The feature data includes texture, contour and corner points.

[0132] For example, if the target image to be displayed on an irregularly shaped screen is a sunrise over the sea, by extracting feature data, it was confirmed that the foreground is the sun and flying seagulls, the background is the sky and the sea, and data such as the shimmering light on the sea surface and the curvature of the waves were obtained.

[0133] S4. Fill the pixel cells in the center display area with the playback source data, and fill the pixel cells in the edge display area with the background data.

[0134] The playback source data is filled into the pixel cells of the center display area to ensure the integrity of the screen content, while the background data is simultaneously filled into the pixel cells of the edge display area to increase the openness of the screen and ensure that the screen fills the entire irregular screen.

[0135] See attached document Figure 6 The specific implementation methods of the above steps include S401-S405:

[0136] S401. Adjust the size information of the playback source data according to the side length and side width of the central display area;

[0137] For example, if the length of the maximum rectangle constructed within the irregularly shaped screen is 5m and the width is 4m, after receiving this aspect ratio, the system will modify the size information of the playback source data to match the rectangle ratio, so that the playback source data can better fill the pixel cells of the central display area.

[0138] S402. Fill the adjusted playback source data into the pixel cells of the center display area;

[0139] The adjusted playback source data is filled into the pixel cells of the center display area so that the center display area shows the adjusted image.

[0140] S403. Extract fill data from background data;

[0141] For example, in step S302, the background data extracted from the sunrise image at sea consists of the sky and the sea surface. Further, fill data is extracted from this background data to fill the edge display areas. To ensure the filled background blends more seamlessly with the overall image, different fill data is needed for each of the first to eighth edge sub-regions.

[0142] When filling the first edge sub-region, the background data of the nearest first edge sub-region is selected as the fill data. For example, if the background of the nearest first edge sub-region is the sea, then the background data of the sea is used to fill the first edge sub-region. The background of the third edge sub-region is both the sea and the sky, so the extracted fill data includes both the sea and the sky.

[0143] Furthermore, methods for extracting filler data include:

[0144] Starting from coordinate system A(x1,y1), the background data of the adjacent first edge sub-region is determined by a preset sorting algorithm. The background data of the adjacent first edge sub-region is the filling data.

[0145] In this embodiment, when extracting filling data to fill the third edge sub-region, the background data can be sorted using a preset sorting algorithm, starting from C(x2,y2), and the background data closest to the third edge sub-region can be identified. This filling data is distributed in multiple pixel cells.

[0146] S404. Fill the fill data into the first edge sub-region to the eighth edge sub-region respectively;

[0147] For example, to fill the third edge sub-region, first determine the coordinates of the first pixel cell where the fill data is located, E1(x). 11 ,y 22 ), corresponding to E1(x 11 ,y 22 The data is filled into the third edge sub-region at coordinates F1(x). 12 ,y 22 The pixel cell containing the data; the coordinates of another pixel cell containing the data are E2(x). 21 ,y 22 ), corresponding to E2(x 21 ,y 22 The data is filled into the third edge sub-region at coordinates F2(x). 13 ,y 22 The pixel cells are filled row by row / column by column, that is, along the direction perpendicular to the side length of the center display area.

[0148] When filling the fourth edge sub-region, the pixel cell closest to the fourth edge sub-region is C(x2,y2). If C(x2,y2) is filled with background data, then the background data is filled into every pixel cell of the fourth edge sub-region.

[0149] S405. Extract texture data and overlay it onto the first edge sub-region after filling.

[0150] After the first edge sub-region is filled, texture data is extracted and overlaid on the pixel cells of the first edge sub-region to further increase the consistency of the image and provide a better visual effect.

[0151] Similarly, after each edge sub-region is filled with background data, texture data can be overlaid to enhance the visual effect.

[0152] The implementation principle of this invention is as follows: the shape of the irregularly shaped screen is determined by determining the pixel cell information of the irregularly shaped screen, thereby facilitating the division of a central display area in the irregularly shaped screen, so that the played image is adjusted according to the size of the central display area; then, the edge display area is determined by the central display area, and the edge display area is used as an extension display area of ​​the central display area. The background data is extracted and filled into the edge display area, so that the entire screen is filled with the image, which preserves the integrity of the image while improving the visual openness and helps to obtain a better visual experience.

[0153] Embodiment 2 of the present invention provides a display device for irregularly shaped screen images, including a division / determination module, an acquisition / processing module, an extraction module, and a filling module, wherein:

[0154] The division / determination module is used to determine the shape information of the irregular screen, divide the display area of ​​the irregular screen into a central display area based on the shape information, divide the display area into an edge display area based on the central display area, and determine the pixel cells of the central display area and the edge display area;

[0155] The acquisition / processing module is used to acquire playback source data and process the playback source data.

[0156] The extraction module is used to extract the background data of the playback screen based on the infrared and grayscale images of the playback source data.

[0157] The fill module is used to fill the pixel cells in the center display area with playback source data and fill the pixel cells in the edge display areas with background data.

[0158] In this embodiment, the division / determination module determines the shape information of the irregularly shaped screen, divides the display area of ​​the irregularly shaped screen into a central display area and an edge display area based on the shape information, determines the pixel cells of the central and edge display areas, and sends the pixel cell information of the central and edge display areas to the filling module; the acquisition / processing module acquires the playback source data, processes the playback source data, and sends the processed data to the extraction module; the extraction module acquires the infrared image and grayscale image based on the received processed playback source data, extracts the background data of the playback screen, and sends it to the filling module; the filling module fills the pixel cells of the central display area with the playback source data and fills the pixel cells of the edge display areas with the background data.

[0159] In a preferred embodiment, the present invention can be further configured such that the partitioning / determination module includes a preset unit, a construction unit, and a calculation unit, wherein:

[0160] The preset unit is used to determine the preset pixel starting point and obtain the coordinates A(x1,y1) of the preset pixel starting point. The preset pixel starting point is located at the edge of the irregular screen.

[0161] The construction unit is used to construct the longest side length based on the edge pixel cells of the irregular screen and x1 in A(x1,y1); and to construct the longest side width based on the edge pixel cells of the irregular screen and y1 in A(x1,y1).

[0162] The calculation unit is used to determine the area by the side length and side width, and uses the MAX function to determine the maximum area. The area corresponding to the maximum area is the center display area, and the remaining areas are the edge display areas.

[0163] In this embodiment, a preset unit may determine a preset pixel starting point and obtain the coordinates A(x1,y1) of the preset pixel starting point, and send the coordinates A(x1,y1) of the preset pixel starting point to the construction unit; the construction unit constructs the longest side length by traversing the edge pixel cells of the irregular screen and x1 in A(x1,y1); it constructs the longest side width by traversing the edge pixel cells of the irregular screen and y1 in A(x1,y1), and sends the constructed side length and side width to the calculation unit; the calculation unit determines the area by the side length and side width, and uses the MAX function to determine the maximum area. The area corresponding to the maximum area is the center display area, and the remaining areas are the edge display areas.

[0164] In a preferred embodiment, the present invention can be further configured such that: the construction unit includes a first traversal subunit, a first calculation subunit, a second traversal subunit, and a second calculation subunit, wherein:

[0165] The first traversal sub-unit is used to traverse the edge pixel cells of the irregular screen until the endpoint coordinate B(x2,y1) that is the same as y1 in A(x1,y1) is obtained;

[0166] The first calculation subunit is used to calculate the distance between A(x1,y1) and the coordinates of the point B(x2,y1) as the side length;

[0167] The second traversal sub-unit is used to traverse the edge pixel cells of the irregular screen until the endpoint coordinate D(x1,y2) that is the same as x1 in A(x1,y1) is obtained, and C(x2,y2) is determined according to B(x2,y1) and D(x1,y2);

[0168] The second calculation subunit is used to calculate the distance between A(x1,y1) and the endpoint coordinates D(x1,y2) as the side width.

[0169] In this embodiment, the first traversal subunit may traverse the edge pixel cells of the irregularly shaped screen until it obtains the endpoint coordinate B(x2,y1) that is the same as y1 in A(x1,y1), and send B(x2,y1) to the first calculation subunit; the first calculation subunit calculates the distance between A(x1,y1) and the endpoint coordinate B(x2,y1) as the side length; the second traversal subunit may traverse the edge pixel cells of the irregularly shaped screen until it obtains the endpoint coordinate D(x1,y2) that is the same as x1 in A(x1,y1), and determine C(x2,y2) based on B(x2,y1) and D(x1,y2), and send C(x2,y2) and D(x1,y2) to the second calculation subunit; the second calculation subunit calculates the distance between A(x1,y1) and the endpoint coordinate D(x1,y2) as the side width.

[0170] In a preferred embodiment, the present invention may be further configured such that the partitioning / determination module further includes an establishment unit, an acquisition unit, a first determination unit, and a second determination unit, wherein:

[0171] Establish a unit to establish coordinate systems A, B, C, and D based on coordinates A(x1,y1), B(x2,y1), C(x2,y2), and D(x1,y2), respectively.

[0172] The acquisition unit is used to acquire the quadrants of coordinate systems A, B, C, and D.

[0173] The first determining unit is used to determine the first edge sub-region using the fourth quadrant in the A coordinate system and the third quadrant in the B coordinate system, and to determine the second edge sub-region based on the fourth quadrant in the B coordinate system; and to determine the third edge sub-region based on the first quadrant in the B coordinate system and the fourth quadrant in the C coordinate system.

[0174] The second determining unit is used to determine the fourth edge sub-region based on the first quadrant in the C coordinate system, the fifth edge sub-region based on the second quadrant in the C coordinate system and the first quadrant in the D coordinate system, the sixth edge sub-region based on the second quadrant in the D coordinate system, the seventh edge sub-region based on the third quadrant in the D coordinate system and the second quadrant in the A coordinate system, and the eighth edge sub-region based on the third quadrant in the A coordinate system; the first edge sub-region to the eighth edge sub-region constitute the edge display area.

[0175] In this embodiment, it may be an establishment unit, used to establish coordinate system A, coordinate system B, coordinate system C and coordinate system D according to coordinates A(x1,y1), B(x2,y1), C(x2,y2) and D(x1,y2), respectively, and send the information of coordinate systems A, B, C and D to the first determination unit and the second determination unit;

[0176] The first determining unit uses the fourth quadrant in coordinate system A and the third quadrant in coordinate system B to determine the first edge sub-region, and uses the fourth quadrant in coordinate system B to determine the second edge sub-region; and uses the first quadrant in coordinate system B and the fourth quadrant in coordinate system C to determine the third edge sub-region.

[0177] The second determining unit determines the fourth edge sub-region based on the first quadrant in the C coordinate system, the fifth edge sub-region based on the second quadrant in the C coordinate system and the first quadrant in the D coordinate system, the sixth edge sub-region based on the second quadrant in the D coordinate system, the seventh edge sub-region based on the third quadrant in the D coordinate system and the second quadrant in the A coordinate system, and the eighth edge sub-region based on the third quadrant in the A coordinate system; the first edge sub-region to the eighth edge sub-region constitute the edge display area.

[0178] In a preferred embodiment, the present invention can be further configured such that the extraction module includes a registration unit and a segmentation unit, wherein:

[0179] The registration unit is used to acquire the infrared image and grayscale image of the playback source data, and register the infrared image and grayscale image to obtain the target image;

[0180] The first extraction unit is used to extract feature data of the target image and extract background data through the feature data. The feature data includes texture, contour and corner points.

[0181] In this embodiment, the registration unit may acquire the infrared image and grayscale image of the playback source data, register the infrared image and grayscale image to obtain the target image, and send the target image to the first extraction unit; the first extraction unit extracts the feature data of the target image, and extracts the background data through the feature data, the feature data including texture, contour and corner points.

[0182] In a preferred embodiment, the present invention can be further configured such that the filling module includes an adjustment unit and a first filling unit, wherein:

[0183] The adjustment unit is used to adjust the size information of the playback source data according to the side length and side width of the central display area;

[0184] The center fill unit is used to fill the pixel cells in the center display area with the adjusted playback source data.

[0185] In this embodiment, the adjustment unit may adjust the size information of the playback source data according to the side length and side width of the central display area, and send the adjusted playback source data to the central filling unit; the central filling unit fills the adjusted playback source data into the pixel cells of the central display area.

[0186] In a preferred embodiment, the present invention may be further configured such that the filling module includes a second extraction unit and an edge filling unit.

[0187] The second extraction unit is used to extract the fill data from the background data;

[0188] Edge filling units are used to fill the first edge sub-region to the eighth edge sub-region with filling data respectively.

[0189] In this embodiment, the second extraction unit may extract the filling data from the background data and send the filling data to the edge filling unit; the edge filling unit fills the filling data into the first edge sub-region to the eighth edge sub-region respectively.

[0190] In a preferred embodiment, the present invention can be further configured such that the second extraction unit includes:

[0191] The sorting sub-unit is used to determine the background data of the adjacent first edge sub-region by using a preset sorting algorithm with coordinate system A(x1,y1) as the starting point. The background data of the adjacent first edge sub-region is the filling data.

[0192] In this embodiment, the sorting sub-unit may take coordinate system A(x1,y1) as the starting point, determine the background data of the adjacent first edge sub-region through a preset sorting algorithm, and the background data of the adjacent first edge sub-region is the filling data, and send the filling data to the edge filling unit.

[0193] In a preferred embodiment, the invention may be further configured such that the filling module also includes:

[0194] Overlay unit, used to extract texture data and overlay it onto the first edge sub-region after filling.

[0195] In this embodiment, the overlay unit may extract texture data and overlay it onto the filled first edge sub-region after receiving the background data sent by the extraction module.

[0196] It should be noted that the above embodiments of the apparatus are only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0197] This application also provides a display device for irregularly shaped screens. The display device for irregularly shaped screens may include: at least one processor, at least one network interface, a user interface, a memory, and at least one communication bus.

[0198] The processor is used to call the display method of the irregular screen image stored in the memory. When executed by one or more processors, the display device of the irregular screen image performs one or more of the methods described in the above embodiments.

[0199] This application also provides a computer-readable storage medium storing a computer program thereon. When the computer program is executed by a processor, it implements the display method of the irregular screen image described in the above embodiments. To avoid repetition, it will not be described again here.

[0200] This specific embodiment is merely an explanation of the present invention and is not intended to limit the invention. After reading this specification, those skilled in the art can make modifications to this embodiment without contributing any inventive step, but such modifications are protected by patent law as long as they are within the scope of the claims of the present invention.

Claims

1. A method for displaying an image on an irregularly shaped screen, characterized in that, Includes the following steps: The shape information of the irregular screen is determined, and the display area of ​​the irregular screen is divided into a central display area and an edge display area according to the shape information. The pixel cells of the central display area and the edge display area are determined. Acquire playback source data and perform data processing on the playback source data; The background data of the playback screen is extracted based on the infrared and grayscale images of the playback source data. The playback source data is filled into the pixel cells of the center display area, and the background data is filled into the pixel cells of the edge display area; The step of dividing the display area of ​​the irregularly shaped screen into a central display area based on the shape information includes: Determine a preset pixel starting point and obtain the coordinates of the preset pixel starting point. The preset pixel starting point is located at the edge of the irregularly shaped screen; Based on traversing the edge pixel cells of the irregularly shaped screen and the In Construct the longest side length; based on the edge pixel cells of the irregularly shaped screen and the... In Construct the longest side width; The area is determined by the side length and the side width, and the maximum area is determined by the MAX function. The area corresponding to the maximum area is the central display area. The step of extracting background data of the playback screen based on the infrared image and grayscale image of the playback source data includes: The infrared image and grayscale image of the playback source data are acquired, and the infrared image and grayscale image are registered to obtain the target image; The feature data of the target image is extracted, and the background data is extracted using the feature data, which includes texture, contour, and corner points.

2. The method for displaying an irregularly shaped screen according to claim 1, characterized in that, The method is based on traversing the edge pixel cells of the irregular screen and the In Construct the longest side length; based on the edge pixel cells of the irregularly shaped screen and the... In Constructing the longest side width includes: Traverse the edge pixel cells of the irregularly shaped screen until the value is obtained. In Same endpoint coordinates ; Calculate the With the endpoint coordinates The distance between them is taken as the side length; Traverse the edge pixel cells of the irregularly shaped screen until the value is obtained. In Same endpoint coordinates and stated Determine C ; Calculate the With the endpoint coordinates The distance between them is used as the side width.

3. The method for displaying an irregularly shaped screen according to claim 2, characterized in that, The step of dividing the edge display area according to the central display area includes: According to coordinates , C and Establish coordinate systems A, B, C, and D respectively; Obtain the quadrants of the A, B, C, and D coordinate systems; The first edge sub-region is determined using the fourth quadrant of the A coordinate system and the third quadrant of the B coordinate system, and the second edge sub-region is determined using the fourth quadrant of the B coordinate system; the third edge sub-region is determined using the first quadrant of the B coordinate system and the fourth quadrant of the C coordinate system. The fourth edge sub-region is determined according to the first quadrant of the C coordinate system, the fifth edge sub-region is determined according to the second quadrant of the C coordinate system and the first quadrant of the D coordinate system, the sixth edge sub-region is determined according to the second quadrant of the D coordinate system, the seventh edge sub-region is determined according to the third quadrant of the D coordinate system and the second quadrant of the A coordinate system, and the eighth edge sub-region is determined according to the third quadrant of the A coordinate system; the first edge sub-regions to the eighth edge sub-regions constitute the edge display area.

4. The method for displaying an irregularly shaped screen according to claim 2, characterized in that, The step of filling the pixel cells of the central display area with the playback source data includes: The size information of the playback source data is adjusted according to the side length and side width of the central display area; The adjusted playback source data is then filled into the pixel cells of the central display area.

5. The method for displaying an irregularly shaped screen according to claim 3, characterized in that, The step of filling the background data into the pixel cells of the edge display area includes: The filling data is extracted from the background data; The filling data is then filled into the first edge sub-region to the eighth edge sub-region, respectively.

6. The method for displaying an irregularly shaped screen according to claim 5, characterized in that, The step of extracting fill data from the background data includes: With the coordinates Starting from a pre-defined sorting algorithm, background data adjacent to the first edge sub-region is determined, and the background data adjacent to the first edge sub-region is the filling data.

7. The method for displaying an irregularly shaped screen according to claim 5, characterized in that, The step of filling the background data into the pixel cells of the edge display area further includes: Extract texture data and overlay it onto the first edge sub-region after filling.

8. A display device for an irregularly shaped screen, characterized in that, include: The division / determination module is used to determine the shape information of the irregular screen, divide the display area of ​​the irregular screen into a central display area based on the shape information, divide the display area into an edge display area based on the central display area, and determine the pixel cells of the central display area and the edge display area; The acquisition / processing module is used to acquire playback source data and process the playback source data. The extraction module is used to extract the background data of the playback screen based on the infrared image and grayscale image of the playback source data; A filling module is used to fill the pixel cells of the center display area with the playback source data and to fill the pixel cells of the edge display area with the background data; The step of dividing the display area of ​​the irregularly shaped screen into a central display area based on the shape information includes: Determine a preset pixel starting point and obtain the coordinates of the preset pixel starting point. The preset pixel starting point is located at the edge of the irregularly shaped screen; Based on traversing the edge pixel cells of the irregularly shaped screen and the In Construct the longest side length; based on the edge pixel cells of the irregularly shaped screen and the... In Construct the longest side width; The area is determined by the side length and the side width, and the maximum area is determined by the MAX function. The area corresponding to the maximum area is the central display area. The step of extracting background data of the playback screen based on the infrared image and grayscale image of the playback source data includes: The infrared image and grayscale image of the playback source data are acquired, and the infrared image and grayscale image are registered to obtain the target image; The feature data of the target image is extracted, and the background data is extracted using the feature data, which includes texture, contour, and corner points.

Images